-- Logs begin at Tue 2022-09-13 19:05:11 UTC, end at Tue 2022-09-13 20:05:57 UTC. -- Sep 13 19:34:21.735397 dv-cinder-828805-6-smb systemd[1]: Starting Devstack devstack@keystone.service... Sep 13 19:34:21.744525 dv-cinder-828805-6-smb devstack@keystone.service[87920]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Sep 13 19:34:21.746687 dv-cinder-828805-6-smb devstack@keystone.service[87920]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue Sep 13 19:34:21 2022] *** Sep 13 19:34:21.746687 dv-cinder-828805-6-smb devstack@keystone.service[87920]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Sep 13 19:34:21.746687 dv-cinder-828805-6-smb devstack@keystone.service[87920]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Sep 13 19:34:21.746687 dv-cinder-828805-6-smb devstack@keystone.service[87920]: nodename: dv-cinder-828805-6-smb Sep 13 19:34:21.746687 dv-cinder-828805-6-smb devstack@keystone.service[87920]: machine: x86_64 Sep 13 19:34:21.746687 dv-cinder-828805-6-smb devstack@keystone.service[87920]: clock source: unix Sep 13 19:34:21.746687 dv-cinder-828805-6-smb devstack@keystone.service[87920]: pcre jit disabled Sep 13 19:34:21.746687 dv-cinder-828805-6-smb devstack@keystone.service[87920]: detected number of CPU cores: 4 Sep 13 19:34:21.746687 dv-cinder-828805-6-smb devstack@keystone.service[87920]: current working directory: / Sep 13 19:34:21.746687 dv-cinder-828805-6-smb devstack@keystone.service[87920]: detected binary path: /usr/bin/uwsgi-core Sep 13 19:34:21.746687 dv-cinder-828805-6-smb devstack@keystone.service[87920]: your processes number limit is 47680 Sep 13 19:34:21.746687 dv-cinder-828805-6-smb devstack@keystone.service[87920]: your memory page size is 4096 bytes Sep 13 19:34:21.746687 dv-cinder-828805-6-smb devstack@keystone.service[87920]: detected max file descriptor number: 2048 Sep 13 19:34:21.747541 dv-cinder-828805-6-smb devstack@keystone.service[87920]: lock engine: pthread robust mutexes Sep 13 19:34:21.747541 dv-cinder-828805-6-smb devstack@keystone.service[87920]: thunder lock: enabled Sep 13 19:34:21.747541 dv-cinder-828805-6-smb devstack@keystone.service[87920]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Sep 13 19:34:21.747541 dv-cinder-828805-6-smb devstack@keystone.service[87920]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Sep 13 19:34:21.788590 dv-cinder-828805-6-smb devstack@keystone.service[87920]: Python main interpreter initialized at 0x563e73e959c0 Sep 13 19:34:21.788590 dv-cinder-828805-6-smb devstack@keystone.service[87920]: python threads support enabled Sep 13 19:34:21.788590 dv-cinder-828805-6-smb devstack@keystone.service[87920]: your server socket listen backlog is limited to 100 connections Sep 13 19:34:21.788590 dv-cinder-828805-6-smb devstack@keystone.service[87920]: your mercy for graceful operations on workers is 90 seconds Sep 13 19:34:21.789010 dv-cinder-828805-6-smb devstack@keystone.service[87920]: mapped 403077 bytes (393 KB) for 2 cores Sep 13 19:34:21.789081 dv-cinder-828805-6-smb devstack@keystone.service[87920]: *** Operational MODE: preforking *** Sep 13 19:34:21.789334 dv-cinder-828805-6-smb devstack@keystone.service[87920]: *** uWSGI is running in multiple interpreter mode *** Sep 13 19:34:21.789334 dv-cinder-828805-6-smb devstack@keystone.service[87920]: spawned uWSGI master process (pid: 87920) Sep 13 19:34:21.789576 dv-cinder-828805-6-smb systemd[1]: Started Devstack devstack@keystone.service. Sep 13 19:34:21.796246 dv-cinder-828805-6-smb devstack@keystone.service[87920]: spawned uWSGI worker 1 (pid: 87934, cores: 1) Sep 13 19:34:21.796246 dv-cinder-828805-6-smb devstack@keystone.service[87920]: spawned uWSGI worker 2 (pid: 87935, cores: 1) Sep 13 19:34:21.796246 dv-cinder-828805-6-smb devstack@keystone.service[87920]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Sep 13 19:34:26.183364 dv-cinder-828805-6-smb devstack@keystone.service[87934]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 13 19:34:26.183364 dv-cinder-828805-6-smb devstack@keystone.service[87934]: from cryptography.utils import int_from_bytes Sep 13 19:34:26.184161 dv-cinder-828805-6-smb devstack@keystone.service[87934]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 13 19:34:26.184161 dv-cinder-828805-6-smb devstack@keystone.service[87934]: from cryptography.utils import int_from_bytes Sep 13 19:34:26.199304 dv-cinder-828805-6-smb devstack@keystone.service[87935]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 13 19:34:26.199304 dv-cinder-828805-6-smb devstack@keystone.service[87935]: from cryptography.utils import int_from_bytes Sep 13 19:34:26.199929 dv-cinder-828805-6-smb devstack@keystone.service[87935]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 13 19:34:26.199929 dv-cinder-828805-6-smb devstack@keystone.service[87935]: from cryptography.utils import int_from_bytes Sep 13 19:34:26.235332 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=87934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 13 19:34:26.235544 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=87934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 13 19:34:26.235697 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG uwsgi [-] command line args: [] {{(pid=87934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 13 19:34:26.235964 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=87934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 13 19:34:26.236143 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG uwsgi [-] ================================================================================ {{(pid=87934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 13 19:34:26.236423 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG uwsgi [-] admin_token = **** {{(pid=87934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:34:26.236671 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG uwsgi [-] config_dir = [] {{(pid=87934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:34:26.236860 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=87934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:34:26.237042 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG uwsgi [-] config_source = [] {{(pid=87934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:34:26.237220 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG uwsgi [-] debug = True {{(pid=87934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:34:26.237420 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=87934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:34:26.237792 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=87934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:34:26.237970 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG uwsgi [-] insecure_debug = False {{(pid=87934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:34:26.238223 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=87934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:34:26.238473 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=87934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:34:26.238705 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG uwsgi [-] list_limit = None {{(pid=87934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:34:26.238884 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG uwsgi [-] log_config_append = None {{(pid=87934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:34:26.239062 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=87934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:34:26.239288 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG uwsgi [-] log_dir = None {{(pid=87934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:34:26.239405 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG uwsgi [-] log_file = None {{(pid=87934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:34:26.239654 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=87934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:34:26.239885 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=87934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:34:26.240127 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=87934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:34:26.240415 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=87934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:34:26.240576 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=87934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:34:26.240744 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=87934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:34:26.240967 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=87934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:34:26.241211 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=87934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:34:26.241443 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=87934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:34:26.241674 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=87934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:34:26.241907 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=87934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:34:26.242142 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=87934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:34:26.242389 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=87934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:34:26.242630 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG uwsgi [-] notification_format = cadf {{(pid=87934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:34:26.243100 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=87934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:34:26.243679 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.25/identity {{(pid=87934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:34:26.243930 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG uwsgi [-] publish_errors = False {{(pid=87934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:34:26.244185 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=87934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:34:26.244471 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=87934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:34:26.244639 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=87934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:34:26.244892 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=87934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:34:26.245126 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=87934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:34:26.245369 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG uwsgi [-] standard_threads = False {{(pid=87934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:34:26.245598 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG uwsgi [-] strict_password_check = False {{(pid=87934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:34:26.245840 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=87934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:34:26.246014 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG uwsgi [-] use_eventlog = False {{(pid=87934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:34:26.246190 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG uwsgi [-] use_journal = False {{(pid=87934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:34:26.246365 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG uwsgi [-] use_json = False {{(pid=87934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:34:26.246537 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG uwsgi [-] use_stderr = False {{(pid=87934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:34:26.246713 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG uwsgi [-] use_syslog = False {{(pid=87934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:34:26.246943 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG uwsgi [-] watch_log_file = False {{(pid=87934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:34:26.247199 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=87934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:34:26.247437 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=87934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:34:26.250082 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=87934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:34:26.250082 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=87934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:34:26.250082 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=87934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:34:26.250082 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=87934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:34:26.250082 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=87934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:34:26.250082 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=87934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:34:26.250082 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=87934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:34:26.250082 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=87934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:34:26.250082 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=87934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:34:26.250753 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=87934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:34:26.250753 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=87934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:34:26.250884 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=87935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 13 19:34:26.250884 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=87935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 13 19:34:26.251009 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=87934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:34:26.251073 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG uwsgi [-] command line args: [] {{(pid=87935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 13 19:34:26.251143 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=87934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:34:26.251214 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=87935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 13 19:34:26.251292 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=87934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:34:26.251365 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG uwsgi [-] ================================================================================ {{(pid=87935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 13 19:34:26.251429 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=87934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:34:26.251499 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG uwsgi [-] admin_token = **** {{(pid=87935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:34:26.251570 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=87934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:34:26.251635 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG uwsgi [-] config_dir = [] {{(pid=87935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:34:26.251703 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=87934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:34:26.251773 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=87935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:34:26.251843 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=87934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:34:26.251919 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG uwsgi [-] config_source = [] {{(pid=87935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:34:26.251919 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG uwsgi [-] debug = True {{(pid=87935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:34:26.252068 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=87934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:34:26.252141 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=87935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:34:26.252312 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=87934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:34:26.252395 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=87935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:34:26.252468 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=87934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:34:26.252544 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG uwsgi [-] insecure_debug = False {{(pid=87935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:34:26.252618 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=87934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:34:26.252682 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=87935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:34:26.252795 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=87934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:34:26.252907 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=87935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:34:26.253027 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=87934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:34:26.253150 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG uwsgi [-] list_limit = None {{(pid=87935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:34:26.253258 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=87934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:34:26.253342 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG uwsgi [-] log_config_append = None {{(pid=87935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:34:26.253491 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=87934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:34:26.253566 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=87935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:34:26.253665 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG uwsgi [-] log_dir = None {{(pid=87935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:34:26.253747 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=87934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:34:26.253847 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG uwsgi [-] log_file = None {{(pid=87935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:34:26.253961 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=87934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:34:26.254096 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=87935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:34:26.254224 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=87934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:34:26.254339 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=87935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:34:26.254453 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=87934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:34:26.254574 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=87935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:34:26.254742 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=87934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:34:26.254877 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=87935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:34:26.254995 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=87934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:34:26.255131 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=87935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:34:26.255131 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=87935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:34:26.255343 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=87934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:34:26.255343 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=87934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:34:26.255566 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=87935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:34:26.255678 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=87934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:34:26.255791 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=87935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:34:26.255919 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=87934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:34:26.256047 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=87935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:34:26.256180 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=87934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:34:26.256328 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=87935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:34:26.256455 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=87934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:34:26.256601 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=87935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:34:26.256729 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=87934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:34:26.256864 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=87935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:34:26.257010 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=87934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:34:26.257147 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=87935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:34:26.257277 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=87934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:34:26.257403 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG uwsgi [-] notification_format = cadf {{(pid=87935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:34:26.257533 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=87934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:34:26.257661 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=87935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:34:26.257810 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=87934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:34:26.257810 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=87934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:34:26.258046 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.25/identity {{(pid=87935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:34:26.258175 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=87934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:34:26.258317 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG uwsgi [-] publish_errors = False {{(pid=87935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:34:26.258950 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=87934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:34:26.259083 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=87935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:34:26.259209 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=87934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:34:26.259346 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=87935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:34:26.259484 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=87934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:34:26.259725 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=87935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:34:26.259859 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=87934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:34:26.259980 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=87935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:34:26.260121 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=87934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:34:26.260410 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=87935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:34:26.260563 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=87934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:34:26.260563 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=87934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:34:26.260815 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG uwsgi [-] standard_threads = False {{(pid=87935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:34:26.260908 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=87934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:34:26.260984 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG uwsgi [-] strict_password_check = False {{(pid=87935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:34:26.261050 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=87934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:34:26.261133 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=87935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:34:26.261207 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=87934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:34:26.261277 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG uwsgi [-] use_eventlog = False {{(pid=87935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:34:26.261277 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG uwsgi [-] use_journal = False {{(pid=87935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:34:26.261408 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=87934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:34:26.261472 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG uwsgi [-] use_json = False {{(pid=87935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:34:26.261544 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=87934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:34:26.261615 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG uwsgi [-] use_stderr = False {{(pid=87935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:34:26.261679 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=87934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:34:26.261754 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG uwsgi [-] use_syslog = False {{(pid=87935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:34:26.261828 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=87934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:34:26.261892 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG uwsgi [-] watch_log_file = False {{(pid=87935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:34:26.261976 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=87934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:34:26.262049 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=87935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:34:26.262178 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=87934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:34:26.262278 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=87935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:34:26.262437 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=87934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:34:26.262521 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=87935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:34:26.262672 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=87934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:34:26.262758 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=87935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:34:26.262901 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=87934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:34:26.262978 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=87935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:34:26.263136 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=87934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:34:26.263218 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=87935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:34:26.263372 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=87934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:34:26.263450 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=87935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:34:26.263638 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=87935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:34:26.263713 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=87934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:34:26.263873 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=87934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:34:26.263948 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=87935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:34:26.264131 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=87935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:34:26.264257 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=87934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:34:26.264397 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=87935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:34:26.264515 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=87934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:34:26.264628 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=87935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:34:26.264740 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=87934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:34:26.264902 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=87935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:34:26.265018 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=87934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:34:26.265131 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=87935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:34:26.265250 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=87934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:34:26.265332 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=87935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:34:26.265404 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG uwsgi [-] cache.enabled = True {{(pid=87934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:34:26.265562 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=87935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:34:26.265644 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=87934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:34:26.265806 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=87935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:34:26.265893 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=87934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:34:26.266044 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=87934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:34:26.266124 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=87935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:34:26.266281 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=87934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:34:26.266363 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=87935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:34:26.266527 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=87934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:34:26.266608 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=87935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:34:26.266762 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=87935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:34:26.266841 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=87934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:34:26.266995 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=87934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:34:26.267076 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=87935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:34:26.267229 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=87934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:34:26.267316 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=87935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:34:26.267461 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=87934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:34:26.267539 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=87935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:34:26.267695 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=87934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:34:26.267800 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=87935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:34:26.268767 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=87934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:34:26.268930 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=87935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:34:26.268930 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=87935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:34:26.269124 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=87934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:34:26.269250 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=87935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:34:26.269328 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=87934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:34:26.269431 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=87935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:34:26.269509 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=87934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:34:26.269509 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=87934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:34:26.269682 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=87935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:34:26.269756 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=87934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:34:26.269865 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=87935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:34:26.269941 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=87934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:34:26.270040 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=87935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:34:26.270126 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=87934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:34:26.270253 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=87935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:34:26.270329 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=87934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:34:26.270449 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=87935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:34:26.270565 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=87934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:34:26.270640 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=87935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:34:26.270746 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=87934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:34:26.270824 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=87935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:34:26.270944 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=87934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:34:26.271028 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=87935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:34:26.271132 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=87934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:34:26.271209 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=87935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:34:26.271321 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=87934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:34:26.271391 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=87935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:34:26.271524 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=87934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:34:26.271668 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=87935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:34:26.271804 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=87934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:34:26.271918 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=87935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:34:26.272082 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=87934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:34:26.272195 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=87935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:34:26.272379 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=87934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:34:26.272511 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=87935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:34:26.272676 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=87934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:34:26.272792 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=87935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:34:26.272900 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=87934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:34:26.273050 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=87935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:34:26.273164 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=87934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:34:26.273325 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=87935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:34:26.273439 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG uwsgi [-] auth.external = None {{(pid=87934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:34:26.273589 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=87935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:34:26.273707 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG uwsgi [-] auth.mapped = None {{(pid=87934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:34:26.273877 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=87935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:34:26.273990 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=87934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:34:26.274727 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=87935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:34:26.274845 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=87934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:34:26.275028 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=87935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:34:26.275154 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG uwsgi [-] auth.password = None {{(pid=87934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:34:26.275269 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=87935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:34:26.275377 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG uwsgi [-] auth.token = None {{(pid=87934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:34:26.275550 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=87935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:34:26.275664 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=87934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:34:26.275773 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=87935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:34:26.275934 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG uwsgi [-] catalog.caching = True {{(pid=87934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:34:26.276045 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=87935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:34:26.276153 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=87934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:34:26.276153 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=87934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:34:26.276451 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=87935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:34:26.276613 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=87934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:34:26.276725 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=87935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:34:26.276834 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=87934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:34:26.276941 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=87935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:34:26.277060 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=87934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:34:26.277169 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=87935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:34:26.277277 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG uwsgi [-] credential.caching = True {{(pid=87934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:34:26.277391 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=87935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:34:26.277501 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG uwsgi [-] credential.driver = sql {{(pid=87934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:34:26.277609 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=87935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:34:26.277733 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=87934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:34:26.277844 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=87935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:34:26.278017 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=87934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:34:26.278137 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=87935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:34:26.278247 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=87934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:34:26.278465 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=87935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:34:26.278596 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=87934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:34:26.278716 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=87935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:34:26.278835 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=87934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:34:26.278956 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=87935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:34:26.279066 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=87934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:34:26.279182 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=87935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:34:26.279299 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=87934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:34:26.279428 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=87935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:34:26.279543 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=87934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:34:26.279656 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=87935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:34:26.279774 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=87934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:34:26.279887 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=87935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:34:26.279996 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=87934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:34:26.280117 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=87935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:34:26.280256 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=87934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:34:26.280375 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=87935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:34:26.280503 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=87934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:34:26.280673 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=87935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:34:26.280785 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=87934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:34:26.280907 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=87935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:34:26.281018 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=87934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:34:26.281136 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=87935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:34:26.281249 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG uwsgi [-] federation.caching = True {{(pid=87934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:34:26.281367 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=87935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:34:26.281484 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=87934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:34:26.281648 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG uwsgi [-] cache.enabled = True {{(pid=87935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:34:26.281773 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG uwsgi [-] federation.driver = sql {{(pid=87934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:34:26.281896 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=87935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:34:26.282010 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=87934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:34:26.282125 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=87935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:34:26.282240 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=87934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:34:26.282356 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=87935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:34:26.282474 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=87934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:34:26.282598 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=87935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:34:26.282712 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=87934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:34:26.282840 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=87935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:34:26.282959 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=87934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:34:26.283078 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=87935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:34:26.283198 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=87934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:34:26.283329 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=87935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:34:26.283448 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=87934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:34:26.283584 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=87935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:34:26.283718 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=87934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:34:26.283845 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=87935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:34:26.283966 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=87934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:34:26.284099 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=87935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:34:26.284431 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG uwsgi [-] identity.caching = True {{(pid=87934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:34:26.284431 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=87934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:34:26.284431 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=87934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:34:26.284789 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=87935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:34:26.284914 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=87934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:34:26.285049 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=87935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:34:26.285171 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=87934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:34:26.285292 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=87935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:34:26.285407 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG uwsgi [-] identity.driver = sql {{(pid=87934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:34:26.285519 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=87935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:34:26.285637 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=87934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:34:26.285762 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=87935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:34:26.285882 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=87934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:34:26.286003 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=87935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:34:26.286124 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=87934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:34:26.286236 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=87935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:34:26.286347 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=87934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:34:26.286475 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=87935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:34:26.286586 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=87934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:34:26.286697 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=87935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:34:26.286807 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=87934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:34:26.286916 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=87935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:34:26.287027 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=87934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:34:26.287146 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=87935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:34:26.287257 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=87934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:34:26.287373 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=87935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:34:26.287488 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=87934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:34:26.287604 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=87935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:34:26.287719 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=87934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:34:26.287847 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=87935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:34:26.287964 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=87934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:34:26.288078 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=87935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:34:26.288190 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=87934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:34:26.288338 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=87935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:34:26.288460 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=87934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:34:26.288599 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=87935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:34:26.288724 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=87934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:34:26.288847 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=87935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:34:26.288968 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=87934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:34:26.289100 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=87935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:34:26.289223 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=87934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:34:26.289356 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=87935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:34:26.289480 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=87934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:34:26.289626 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=87935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:34:26.289749 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=87934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:34:26.289872 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG uwsgi [-] auth.external = None {{(pid=87935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:34:26.290002 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=87934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:34:26.290137 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG uwsgi [-] auth.mapped = None {{(pid=87935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:34:26.290260 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=87934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:34:26.290260 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=87934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:34:26.290483 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=87935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:34:26.290611 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=87934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:34:26.290746 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=87935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:34:26.290877 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=87934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:34:26.290998 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG uwsgi [-] auth.password = None {{(pid=87935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:34:26.291122 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=87934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:34:26.291243 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG uwsgi [-] auth.token = None {{(pid=87935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:34:26.291362 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=87934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:34:26.291494 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=87935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:34:26.291618 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=87934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:34:26.291749 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG uwsgi [-] catalog.caching = True {{(pid=87935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:34:26.291869 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=87934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:34:26.291869 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=87934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:34:26.292100 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=87935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:34:26.292370 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=87934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:34:26.292499 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=87935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:34:26.292624 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=87934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:34:26.292751 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=87935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:34:26.292881 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG uwsgi [-] ldap.password = **** {{(pid=87934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:34:26.293008 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=87935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:34:26.293226 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=87934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:34:26.293359 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=87935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:34:26.293490 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=87934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:34:26.293620 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG uwsgi [-] credential.caching = True {{(pid=87935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:34:26.293748 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=87934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:34:26.293875 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG uwsgi [-] credential.driver = sql {{(pid=87935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:34:26.294043 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=87934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:34:26.294145 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=87935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:34:26.294222 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=87934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:34:26.294295 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=87935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:34:26.294368 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=87934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:34:26.294440 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=87935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:34:26.294542 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=87934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:34:26.294640 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=87935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:34:26.294724 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=87934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:34:26.294816 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=87935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:34:26.294893 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=87934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:34:26.294966 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=87935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:34:26.295048 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=87934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:34:26.295123 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=87935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:34:26.295191 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=87934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:34:26.295284 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=87935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:34:26.295377 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=87934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:34:26.295452 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=87935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:34:26.295548 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=87934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:34:26.295548 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=87934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:34:26.295658 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=87935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:34:26.295738 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG uwsgi [-] ldap.user = None {{(pid=87934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:34:26.295801 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=87935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:34:26.295859 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=87934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:34:26.295925 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=87935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:34:26.296004 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=87934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:34:26.296067 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=87935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:34:26.296126 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=87934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:34:26.296185 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=87935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:34:26.296266 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=87934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:34:26.296341 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG uwsgi [-] federation.caching = True {{(pid=87935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:34:26.296404 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=87934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:34:26.296516 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=87935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:34:26.296638 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=87934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:34:26.296749 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG uwsgi [-] federation.driver = sql {{(pid=87935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:34:26.296863 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=87934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:34:26.296994 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=87935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:34:26.297120 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=87934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:34:26.297246 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=87935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:34:26.297375 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=87934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:34:26.297506 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=87935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:34:26.297625 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=87934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:34:26.297754 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=87935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:34:26.297871 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=87934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:34:26.297992 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=87935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:34:26.298116 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=87934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:34:26.298235 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=87935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:34:26.298356 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=87934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:34:26.298490 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=87935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:34:26.298609 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=87934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:34:26.298725 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=87935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:34:26.298836 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=87934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:34:26.298956 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=87935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:34:26.299081 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=87934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:34:26.299212 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG uwsgi [-] identity.caching = True {{(pid=87935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:34:26.299339 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=87934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:34:26.299339 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=87934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:34:26.299563 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=87935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:34:26.299683 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=87934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:34:26.299806 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=87935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:34:26.299945 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=87934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:34:26.300072 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=87935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:34:26.300202 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=87934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:34:26.300468 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=87935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:34:26.300618 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=87934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:34:26.300793 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG uwsgi [-] identity.driver = sql {{(pid=87935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:34:26.300948 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=87934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:34:26.301107 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=87935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:34:26.301259 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=87934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:34:26.301393 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=87935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:34:26.301527 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=87934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:34:26.301695 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=87935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:34:26.301849 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=87934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:34:26.302007 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=87935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:34:26.302158 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG uwsgi [-] policy.driver = sql {{(pid=87934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:34:26.302305 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=87935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:34:26.302459 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=87934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:34:26.302623 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=87935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:34:26.302765 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=87934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:34:26.302903 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=87935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:34:26.303038 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=87934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:34:26.303183 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=87935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:34:26.303319 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG uwsgi [-] receipt.caching = True {{(pid=87934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:34:26.303468 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=87935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:34:26.303609 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=87934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:34:26.303762 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=87935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:34:26.303902 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=87934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:34:26.304038 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=87935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:34:26.304173 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=87934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:34:26.304351 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=87935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:34:26.304498 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=87934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:34:26.304635 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=87935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:34:26.304768 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=87934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:34:26.304904 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=87935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:34:26.305895 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG uwsgi [-] resource.caching = True {{(pid=87934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:34:26.306047 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=87935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:34:26.306159 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=87934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:34:26.306271 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=87935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:34:26.306413 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG uwsgi [-] resource.driver = sql {{(pid=87934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:34:26.306543 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=87935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:34:26.306667 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=87934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:34:26.306798 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=87935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:34:26.306919 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=87934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:34:26.307044 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=87935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:34:26.307175 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=87934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:34:26.307297 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=87935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:34:26.307414 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG uwsgi [-] revoke.caching = True {{(pid=87934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:34:26.307533 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=87935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:34:26.307651 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=87934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:34:26.307771 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=87935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:34:26.307905 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=87934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:34:26.308034 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=87935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:34:26.308160 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG uwsgi [-] role.cache_time = None {{(pid=87934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:34:26.308306 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=87935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:34:26.308433 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG uwsgi [-] role.caching = True {{(pid=87934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:34:26.308561 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=87935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:34:26.308712 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG uwsgi [-] role.driver = sql {{(pid=87934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:34:26.308712 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG uwsgi [-] role.list_limit = None {{(pid=87934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:34:26.308952 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=87935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:34:26.309082 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=87934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:34:26.309082 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=87934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:34:26.309323 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=87935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:34:26.309468 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=87934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:34:26.309602 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=87935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:34:26.309729 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=87934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:34:26.309851 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=87935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:34:26.309990 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=87934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:34:26.310117 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=87935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:34:26.310264 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=87934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:34:26.310385 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG uwsgi [-] ldap.password = **** {{(pid=87935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:34:26.310505 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=87934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:34:26.310623 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=87935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:34:26.310736 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=87934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:34:26.310857 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=87935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:34:26.310990 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=87934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:34:26.311120 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=87935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:34:26.311250 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=87934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:34:26.311382 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=87935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:34:26.311514 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=87934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:34:26.311643 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=87935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:34:26.311774 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=87934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:34:26.311893 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=87935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:34:26.312009 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=87934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:34:26.312125 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=87935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:34:26.312125 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=87935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:34:26.312454 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=87934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:34:26.312588 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=87935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:34:26.312714 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=87934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:34:26.312837 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=87935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:34:26.312961 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=87934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:34:26.313090 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=87935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:34:26.313211 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=87934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:34:26.313364 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=87935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:34:26.313541 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=87934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:34:26.313668 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=87935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:34:26.313796 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=87934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:34:26.313796 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=87934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:34:26.313939 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=87935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:34:26.314024 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=87934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:34:26.314099 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG uwsgi [-] ldap.user = None {{(pid=87935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:34:26.314172 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=87934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:34:26.314245 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=87935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:34:26.314318 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=87934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:34:26.314398 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=87935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:34:26.314473 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=87934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:34:26.314546 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=87935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:34:26.314618 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=87934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:34:26.314690 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=87935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:34:26.314762 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=87934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:34:26.314832 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=87935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:34:26.314894 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=87934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:34:26.314953 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=87935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:34:26.315012 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=87934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:34:26.315071 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=87935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:34:26.315130 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=87934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:34:26.315274 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=87935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:34:26.315338 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=87934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:34:26.315398 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=87935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:34:26.315470 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=87934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:34:26.315543 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=87935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:34:26.315615 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG uwsgi [-] token.cache_time = None {{(pid=87934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:34:26.315699 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=87935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:34:26.315774 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG uwsgi [-] token.caching = True {{(pid=87934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:34:26.315846 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=87935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:34:26.315918 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=87934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:34:26.315989 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=87935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:34:26.316067 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG uwsgi [-] token.provider = fernet {{(pid=87934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:34:26.316148 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=87935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:34:26.316239 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=87934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:34:26.316315 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=87935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:34:26.316387 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=87934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:34:26.316459 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=87935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:34:26.316531 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=87934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:34:26.316616 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=87935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:34:26.316697 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=87934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:34:26.316771 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=87935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:34:26.316843 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=87934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:34:26.316915 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=87935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:34:26.316987 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=87934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:34:26.317067 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=87935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:34:26.317141 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG uwsgi [-] trust.driver = sql {{(pid=87934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:34:26.317213 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=87935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:34:26.317285 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=87934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:34:26.317362 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=87935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:34:26.317436 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=87934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:34:26.317515 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=87935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:34:26.317588 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=87934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:34:26.317588 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=87934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:34:26.317719 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=87935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:34:26.317719 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=87935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:34:26.317850 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=87934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:34:26.317929 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=87935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:34:26.318004 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=87934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:34:26.318084 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG uwsgi [-] policy.driver = sql {{(pid=87935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:34:26.318165 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=87934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:34:26.318239 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=87935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:34:26.318311 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=87934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:34:26.318382 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=87935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:34:26.318462 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG uwsgi [-] database.connection = **** {{(pid=87934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:34:26.318536 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=87935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:34:26.318608 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=87934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:34:26.318696 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG uwsgi [-] receipt.caching = True {{(pid=87935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:34:26.318784 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=87934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:34:26.318858 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=87935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:34:26.318947 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=87934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:34:26.319022 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=87935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:34:26.319095 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=87934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:34:26.319168 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=87935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:34:26.319240 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=87934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:34:26.319312 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=87935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:34:26.319393 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=87934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:34:26.319467 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=87935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:34:26.319539 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=87934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:34:26.319611 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG uwsgi [-] resource.caching = True {{(pid=87935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:34:26.319684 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=87934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:34:26.319756 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=87935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:34:26.319839 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=87934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:34:26.319913 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG uwsgi [-] resource.driver = sql {{(pid=87935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:34:26.319986 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=87934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:34:26.320058 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=87935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:34:26.320131 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=87934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:34:26.320240 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=87935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:34:26.320331 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=87934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:34:26.320407 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=87935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:34:26.320480 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=87934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:34:26.320606 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG uwsgi [-] revoke.caching = True {{(pid=87935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:34:26.320687 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=87934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:34:26.321459 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=87935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:34:26.321620 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=87934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:34:26.321735 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=87934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:34:26.321814 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=87935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:34:26.321926 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=87934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:34:26.322160 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=87934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:34:26.322239 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG uwsgi [-] role.cache_time = None {{(pid=87935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:34:26.322322 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=87934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 13 19:34:26.322603 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG uwsgi [-] role.caching = True {{(pid=87935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:34:26.322862 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG uwsgi [-] role.driver = sql {{(pid=87935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:34:26.323104 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG uwsgi [-] role.list_limit = None {{(pid=87935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:34:26.323364 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=87935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:34:26.323620 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=87935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:34:26.323875 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=87935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:34:26.324134 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=87935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:34:26.324415 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=87935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:34:26.324668 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=87935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:34:26.324919 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=87935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:34:26.325172 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=87935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:34:26.325413 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=87935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:34:26.325666 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=87935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:34:26.325917 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=87935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:34:26.326171 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=87935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:34:26.326424 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=87935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:34:26.326857 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=87935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:34:26.327107 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=87935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:34:26.327567 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=87935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:34:26.328021 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=87935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:34:26.328587 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=87935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:34:26.329031 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=87935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:34:26.329205 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=87935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:34:26.329478 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=87935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:34:26.329745 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=87935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:34:26.330002 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=87935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:34:26.330242 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=87935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:34:26.330488 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=87935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:34:26.330725 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=87935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:34:26.330991 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=87935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:34:26.331252 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=87935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:34:26.331508 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=87935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:34:26.331753 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=87935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:34:26.331996 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=87935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:34:26.332262 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG uwsgi [-] token.cache_time = None {{(pid=87935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:34:26.332765 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG uwsgi [-] token.caching = True {{(pid=87935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:34:26.333011 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=87935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:34:26.333267 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG uwsgi [-] token.provider = fernet {{(pid=87935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:34:26.333512 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=87935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:34:26.333774 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=87935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:34:26.334026 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=87935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:34:26.334279 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=87935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:34:26.334532 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=87935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:34:26.334782 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=87935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:34:26.335035 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG uwsgi [-] trust.driver = sql {{(pid=87935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:34:26.335276 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=87935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:34:26.335520 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=87935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:34:26.335760 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=87935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:34:26.336011 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=87935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:34:26.336325 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=87935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:34:26.337136 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=87935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:34:26.337449 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=87935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:34:26.337942 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=87935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:34:26.338359 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG uwsgi [-] database.connection = **** {{(pid=87935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:34:26.338618 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=87935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:34:26.338879 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=87935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:34:26.339125 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=87935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:34:26.339373 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=87935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:34:26.339617 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=87935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:34:26.339861 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=87935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:34:26.340103 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=87935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:34:26.340382 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=87935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:34:26.340635 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=87935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:34:26.340879 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=87935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:34:26.341128 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=87935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:34:26.341368 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=87935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:34:26.341621 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=87935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:34:26.341863 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=87935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:34:26.342112 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=87935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:34:26.342347 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=87935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:34:26.342590 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=87935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:34:26.342830 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=87935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:34:26.343006 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=87935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 13 19:34:26.353447 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=87934) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 19:34:26.353682 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=87934) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 19:34:26.353910 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=87934) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 19:34:26.362757 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=87934) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 19:34:26.370101 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=87935) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 19:34:26.370338 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=87935) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 19:34:26.370570 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=87935) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 19:34:26.379024 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=87935) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 19:34:26.391540 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=87934) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 19:34:26.391776 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=87934) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 19:34:26.398469 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=87935) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 19:34:26.398703 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=87935) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 19:34:26.447638 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=87934) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 19:34:26.448197 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=87935) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 19:34:26.497580 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=87934) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 19:34:26.497789 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=87934) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 19:34:26.499971 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=87935) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 19:34:26.500231 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=87935) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 19:34:26.659434 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=87935) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 19:34:26.659632 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=87934) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 19:34:26.659731 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=87935) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 19:34:26.659807 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=87934) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 19:34:26.659882 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=87935) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 19:34:26.659995 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=87934) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 19:34:26.660078 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=87935) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 19:34:26.660229 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=87934) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 19:34:26.660314 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=87935) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 19:34:26.660451 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=87934) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 19:34:26.660531 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=87935) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 19:34:26.660665 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=87934) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 19:34:26.685244 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=87934) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 19:34:26.685470 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=87934) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 19:34:26.685689 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=87934) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 19:34:26.685774 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=87935) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 19:34:26.685916 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=87934) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 19:34:26.685999 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=87935) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 19:34:26.686134 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=87934) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 19:34:26.686218 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=87935) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 19:34:26.686349 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=87934) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 19:34:26.686432 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=87935) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 19:34:26.686560 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=87934) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 19:34:26.686651 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=87935) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 19:34:26.686810 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=87935) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 19:34:26.687028 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=87935) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 19:34:26.698885 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=87934) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 19:34:26.699620 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=87935) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 19:34:26.712398 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=87934) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 19:34:26.712740 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=87934) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 19:34:26.712974 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=87934) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 19:34:26.713096 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=87935) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 19:34:26.713209 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=87934) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 19:34:26.713416 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=87935) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 19:34:26.713515 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=87934) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 19:34:26.713579 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=87935) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 19:34:26.713641 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=87934) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 19:34:26.713757 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=87935) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 19:34:26.713842 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=87934) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 19:34:26.713975 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=87935) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 19:34:26.714192 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=87935) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 19:34:26.714409 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=87935) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 19:34:26.731057 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=87934) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 19:34:26.731317 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=87934) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Sep 13 19:34:26.731589 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=87934) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 19:34:26.731789 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=87935) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 19:34:26.731927 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=87934) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Sep 13 19:34:26.732055 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=87935) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Sep 13 19:34:26.732180 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=87934) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 19:34:26.732336 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=87934) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 19:34:26.732428 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=87935) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 19:34:26.732556 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=87935) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Sep 13 19:34:26.732638 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=87934) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 19:34:26.732823 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=87934) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 19:34:26.732903 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=87935) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 19:34:26.733091 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=87935) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 19:34:26.733356 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=87935) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 19:34:26.733621 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=87935) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 19:34:26.742451 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=87934) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 19:34:26.743255 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=87934) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 19:34:26.743537 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=87934) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 19:34:26.743819 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=87934) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 19:34:26.744281 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=87935) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 19:34:26.744577 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=87935) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 19:34:26.753702 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=87935) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 19:34:26.753702 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=87935) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 19:34:26.753960 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=87934) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 13 19:34:26.754046 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=87935) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 13 19:34:26.754122 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=87934) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 13 19:34:26.754265 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=87934) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 19:34:26.754554 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=87934) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 19:34:26.754841 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=87934) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 19:34:26.755129 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=87934) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 19:34:26.755213 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=87935) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 13 19:34:26.755393 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=87934) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 19:34:26.755477 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=87935) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 19:34:26.755667 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=87934) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 19:34:26.755767 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=87935) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 19:34:26.755944 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=87934) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 19:34:26.756027 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=87935) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 19:34:26.756235 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=87934) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 19:34:26.756335 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=87935) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 19:34:26.756524 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=87934) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 19:34:26.756664 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=87935) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 19:34:26.756805 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=87934) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 19:34:26.756939 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=87935) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 19:34:26.757073 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=87935) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 19:34:26.757365 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=87935) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 19:34:26.757597 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=87935) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 19:34:26.757850 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=87935) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 19:34:26.780564 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=87934) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 19:34:26.782092 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=87934) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 13 19:34:26.782341 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=87935) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 19:34:26.782490 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=87934) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 19:34:26.783847 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=87935) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 13 19:34:26.784140 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=87935) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 19:34:26.787101 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=87934) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 13 19:34:26.787387 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=87934) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 19:34:26.787667 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=87934) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 19:34:26.788889 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=87935) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 13 19:34:26.789191 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=87935) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 19:34:26.789480 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=87935) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 19:34:26.794330 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=87934) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 13 19:34:26.794625 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=87934) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 19:34:26.796315 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=87935) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 13 19:34:26.796616 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=87935) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 19:34:26.800621 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=87934) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 13 19:34:26.800925 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=87934) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 19:34:26.801210 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=87934) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 19:34:26.801491 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=87934) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 19:34:26.801768 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=87934) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 19:34:26.802044 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=87934) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 19:34:26.802311 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=87934) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 19:34:26.802580 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=87934) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 19:34:26.802717 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=87935) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 13 19:34:26.802940 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=87935) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 19:34:26.803239 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=87935) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 19:34:26.803535 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=87935) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 19:34:26.803820 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=87935) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 19:34:26.804108 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=87935) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 19:34:26.804413 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=87935) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 19:34:26.804690 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=87935) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 19:34:26.818799 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=87934) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 19:34:26.819114 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=87934) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 19:34:26.822132 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=87935) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 19:34:26.822425 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=87935) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 19:34:26.823658 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=87934) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 13 19:34:26.826306 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=87935) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 13 19:34:26.826882 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=87934) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 19:34:26.827181 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=87934) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 19:34:26.829690 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=87935) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 19:34:26.829994 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=87935) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 19:34:26.831368 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=87934) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 13 19:34:26.834480 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=87935) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 13 19:34:26.834782 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=87934) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 13 19:34:26.838029 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=87935) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 13 19:34:26.838225 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=87934) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 19:34:26.838535 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=87934) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 19:34:26.838824 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=87934) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 19:34:26.839112 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=87934) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 19:34:26.839395 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=87934) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 19:34:26.839680 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=87934) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 19:34:26.841338 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=87935) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 19:34:26.841651 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=87935) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 19:34:26.841942 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=87935) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 19:34:26.842252 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=87935) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 19:34:26.842539 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=87935) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 19:34:26.842834 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=87935) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 19:34:26.855879 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=87934) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 13 19:34:26.856183 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=87934) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 19:34:26.856485 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=87934) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 19:34:26.856754 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=87934) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 19:34:26.859528 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=87935) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 13 19:34:26.859836 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=87935) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 19:34:26.860114 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=87935) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 19:34:26.860412 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=87935) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 19:34:26.863618 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH2: ['/token' {}] {{(pid=87934) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 19:34:26.865185 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=87934) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 19:34:26.866722 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=87934) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 19:34:26.866999 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=87934) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 19:34:26.867398 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH2: ['/token' {}] {{(pid=87935) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 19:34:26.869873 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=87935) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 19:34:26.870616 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=87934) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 13 19:34:26.870911 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=87934) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 19:34:26.871205 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=87934) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 19:34:26.871459 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=87935) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 19:34:26.871554 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=87934) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 19:34:26.871739 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=87935) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 19:34:26.871869 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=87934) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 19:34:26.874714 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=87935) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 13 19:34:26.875027 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=87935) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 19:34:26.875326 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=87935) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 19:34:26.875614 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=87935) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 19:34:26.876021 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=87935) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 19:34:26.883128 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=87934) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 13 19:34:26.884097 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=87934) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 19:34:26.884458 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=87934) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 19:34:26.884746 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=87934) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 19:34:26.885132 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=87934) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 19:34:26.885418 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=87934) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 19:34:26.885698 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=87934) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 19:34:26.888358 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=87935) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 13 19:34:26.888658 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=87935) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 19:34:26.888948 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=87935) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 19:34:26.889238 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=87935) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 19:34:26.889628 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=87935) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 19:34:26.889919 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=87935) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 19:34:26.890207 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=87935) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 19:34:26.901542 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=87934) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 13 19:34:26.904519 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=87934) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 13 19:34:26.907034 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=87935) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 13 19:34:26.907402 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=87934) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 19:34:26.909005 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=87934) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 19:34:26.910204 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=87935) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 13 19:34:26.910541 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=87934) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 13 19:34:26.910829 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=87934) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 19:34:26.911231 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=87934) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 19:34:26.913337 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=87935) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 19:34:26.914887 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=87935) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 19:34:26.916751 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=87935) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 13 19:34:26.917046 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=87935) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 19:34:26.917455 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=87935) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 19:34:26.918237 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=87934) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 19:34:26.919725 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=87934) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 13 19:34:26.922669 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=87934) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 19:34:26.923064 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=87934) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 19:34:26.923351 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=87934) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 19:34:26.923632 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=87934) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 19:34:26.923963 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=87935) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 19:34:26.925489 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=87935) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 13 19:34:26.928428 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=87935) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 19:34:26.929169 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=87935) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 19:34:26.929472 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=87935) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 19:34:26.929759 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=87935) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 19:34:26.932179 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=87934) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 13 19:34:26.932499 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=87934) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 19:34:26.932790 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=87934) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 19:34:26.938765 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=87935) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 13 19:34:26.939072 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=87935) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 19:34:26.939359 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=87935) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 19:34:26.939682 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=87934) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 13 19:34:26.939971 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=87934) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 19:34:26.940285 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=87934) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 19:34:26.940566 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=87934) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 19:34:26.940851 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=87934) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 19:34:26.941125 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=87934) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 19:34:26.941400 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=87934) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 19:34:26.941686 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=87934) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 19:34:26.941958 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=87934) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 19:34:26.942231 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=87934) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 19:34:26.942630 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=87934) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 19:34:26.942899 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=87934) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 19:34:26.943169 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=87934) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 19:34:26.943434 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=87934) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 19:34:26.947237 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=87935) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 13 19:34:26.947630 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=87935) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 19:34:26.947924 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=87935) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 19:34:26.948239 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=87935) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 19:34:26.948514 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=87935) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 19:34:26.948792 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=87935) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 19:34:26.949117 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=87935) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 19:34:26.949372 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=87935) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 19:34:26.949662 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=87935) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 19:34:26.949931 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=87935) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 19:34:26.950218 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=87935) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 19:34:26.950490 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=87935) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 19:34:26.950760 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=87935) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 19:34:26.951035 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=87935) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 19:34:26.979693 dv-cinder-828805-6-smb devstack@keystone.service[87934]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x563e73e959c0 pid: 87934 (default app) Sep 13 19:34:26.983192 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffdce2e-70b7-430a-8e77-ed2b343d9949 None None] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:34:26.983479 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffdce2e-70b7-430a-8e77-ed2b343d9949 None None] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:34:26.983748 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffdce2e-70b7-430a-8e77-ed2b343d9949 None None] PATH_INFO: `/v3` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:34:26.987941 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 1/1] 10.222.0.25 () {50 vars in 791 bytes} [Tue Sep 13 19:34:26 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:34:26.989677 dv-cinder-828805-6-smb devstack@keystone.service[87935]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x563e73e959c0 pid: 87935 (default app) Sep 13 19:34:33.998365 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b852f38a-3628-4b88-8e01-4edaf4a01767 None None] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:34:33.998928 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b852f38a-3628-4b88-8e01-4edaf4a01767 None None] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:34:33.998928 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b852f38a-3628-4b88-8e01-4edaf4a01767 None None] PATH_INFO: `/` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:34:34.000238 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 2/2] 10.222.0.25 () {54 vars in 927 bytes} [Tue Sep 13 19:34:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:34:34.007985 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fc51ea-1d06-4880-8536-c6a8eb1b50b0 None None] REQUEST_METHOD: `POST` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:34:34.008664 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fc51ea-1d06-4880-8536-c6a8eb1b50b0 None None] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:34:34.008664 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fc51ea-1d06-4880-8536-c6a8eb1b50b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:34:34.082927 dv-cinder-828805-6-smb devstack@keystone.service[87935]: INFO dbcounter [None req-35fc51ea-1d06-4880-8536-c6a8eb1b50b0 None None] Registered counter for database keystone Sep 13 19:34:34.104441 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG oslo_db.sqlalchemy.engines [None req-35fc51ea-1d06-4880-8536-c6a8eb1b50b0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87935) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 13 19:34:34.120777 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG dbcounter [-] [87935] Writer thread running {{(pid=87935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 13 19:34:34.307318 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG passlib.handlers.bcrypt [None req-35fc51ea-1d06-4880-8536-c6a8eb1b50b0 None None] detected 'bcrypt' backend, version '4.0.0' {{(pid=87935) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Sep 13 19:34:34.307707 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG passlib.handlers.bcrypt [None req-35fc51ea-1d06-4880-8536-c6a8eb1b50b0 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=87935) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Sep 13 19:34:34.368061 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.auth.core [None req-35fc51ea-1d06-4880-8536-c6a8eb1b50b0 None None] MFA Rules not processed for user `7b0aed92d02344acb92a0e4aa67c3068`. Rule list: `[]` (Enabled: `True`). {{(pid=87935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:34:34.369761 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.fernet_utils [None req-35fc51ea-1d06-4880-8536-c6a8eb1b50b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:34:34.510712 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 1/3] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Sep 13 19:34:34 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 506 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Sep 13 19:34:34.810357 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b852f38a-3628-4b88-8e01-4edaf4a01767 None None] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:34:34.879941 dv-cinder-828805-6-smb devstack@keystone.service[87934]: INFO dbcounter [None req-b852f38a-3628-4b88-8e01-4edaf4a01767 None None] Registered counter for database keystone Sep 13 19:34:34.902196 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG oslo_db.sqlalchemy.engines [None req-b852f38a-3628-4b88-8e01-4edaf4a01767 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87934) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 13 19:34:34.909185 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG dbcounter [-] [87934] Writer thread running {{(pid=87934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 13 19:34:35.030595 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b852f38a-3628-4b88-8e01-4edaf4a01767 None None] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:34:35.035091 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606f13af-09b3-479e-94e7-2e2424b9823c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:34:35.035730 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606f13af-09b3-479e-94e7-2e2424b9823c admin admin] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:34:35.036010 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606f13af-09b3-479e-94e7-2e2424b9823c admin admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:34:35.036311 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606f13af-09b3-479e-94e7-2e2424b9823c admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:34:35.045989 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-606f13af-09b3-479e-94e7-2e2424b9823c admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:34:35.107199 dv-cinder-828805-6-smb devstack@keystone.service[87934]: WARNING keystone.common.rbac_enforcer.enforcer [None req-606f13af-09b3-479e-94e7-2e2424b9823c admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Sep 13 19:34:35.107536 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-606f13af-09b3-479e-94e7-2e2424b9823c admin admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:34:35.119261 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 3/4] 10.222.0.25 () {58 vars in 1324 bytes} [Tue Sep 13 19:34:34 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 13 19:34:35.126350 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35fc51ea-1d06-4880-8536-c6a8eb1b50b0 None None] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:34:35.146028 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35fc51ea-1d06-4880-8536-c6a8eb1b50b0 None None] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:34:35.151161 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adaab8c0-931f-41e9-969d-f555c79eeb23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:34:35.152324 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adaab8c0-931f-41e9-969d-f555c79eeb23 admin admin] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:34:35.152604 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adaab8c0-931f-41e9-969d-f555c79eeb23 admin admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:34:35.152870 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adaab8c0-931f-41e9-969d-f555c79eeb23 admin admin] PATH_INFO: `/v3/projects/455c35cf3f4241039d612c7710aac324` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:34:35.154308 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adaab8c0-931f-41e9-969d-f555c79eeb23 admin admin] RBAC: Authorizing `identity:get_project(project_id=455c35cf3f4241039d612c7710aac324)` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:34:35.210500 dv-cinder-828805-6-smb devstack@keystone.service[87935]: WARNING keystone.common.rbac_enforcer.enforcer [None req-adaab8c0-931f-41e9-969d-f555c79eeb23 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Sep 13 19:34:35.210825 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adaab8c0-931f-41e9-969d-f555c79eeb23 admin admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:34:35.216311 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 2/5] 10.222.0.25 () {56 vars in 1207 bytes} [Tue Sep 13 19:34:35 2022] GET /identity/v3/projects/455c35cf3f4241039d612c7710aac324 => generated 344 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:34:37.484345 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e16441-19df-4fd1-9af1-62cab70c2292 None None] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:34:37.484931 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e16441-19df-4fd1-9af1-62cab70c2292 None None] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:34:37.484931 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e16441-19df-4fd1-9af1-62cab70c2292 None None] PATH_INFO: `/` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:34:37.489102 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 4/6] 10.222.0.25 () {54 vars in 927 bytes} [Tue Sep 13 19:34:37 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 13 19:34:37.495736 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45c8ad0-c106-4e17-b3bc-db8982c0baf2 None None] REQUEST_METHOD: `POST` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:34:37.496316 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45c8ad0-c106-4e17-b3bc-db8982c0baf2 None None] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:34:37.496316 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45c8ad0-c106-4e17-b3bc-db8982c0baf2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:34:37.517430 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.auth.core [None req-d45c8ad0-c106-4e17-b3bc-db8982c0baf2 None None] MFA Rules not processed for user `7b0aed92d02344acb92a0e4aa67c3068`. Rule list: `[]` (Enabled: `True`). {{(pid=87935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:34:37.518996 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.fernet_utils [None req-d45c8ad0-c106-4e17-b3bc-db8982c0baf2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:34:37.530233 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 3/7] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Sep 13 19:34:37 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Sep 13 19:34:37.808098 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e16441-19df-4fd1-9af1-62cab70c2292 None None] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:34:37.821088 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e16441-19df-4fd1-9af1-62cab70c2292 None None] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:34:37.831702 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897cc403-ef1f-4043-8b4d-4244d9b51b98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:34:37.832637 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897cc403-ef1f-4043-8b4d-4244d9b51b98 admin admin] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:34:37.832922 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897cc403-ef1f-4043-8b4d-4244d9b51b98 admin admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:34:37.833195 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897cc403-ef1f-4043-8b4d-4244d9b51b98 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:34:37.845322 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-897cc403-ef1f-4043-8b4d-4244d9b51b98 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:34:37.847117 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-897cc403-ef1f-4043-8b4d-4244d9b51b98 admin admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:34:37.856531 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 5/8] 10.222.0.25 () {58 vars in 1324 bytes} [Tue Sep 13 19:34:37 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 13 19:34:37.862330 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45c8ad0-c106-4e17-b3bc-db8982c0baf2 None None] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:34:37.872143 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45c8ad0-c106-4e17-b3bc-db8982c0baf2 None None] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:34:37.876664 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3947cf10-0a15-478d-9c00-050aa1499086 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:34:37.877296 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3947cf10-0a15-478d-9c00-050aa1499086 admin admin] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:34:37.877570 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3947cf10-0a15-478d-9c00-050aa1499086 admin admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:34:37.877838 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3947cf10-0a15-478d-9c00-050aa1499086 admin admin] PATH_INFO: `/v3/users/7b0aed92d02344acb92a0e4aa67c3068` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:34:37.879150 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3947cf10-0a15-478d-9c00-050aa1499086 admin admin] RBAC: Authorizing `identity:get_user(user_id=7b0aed92d02344acb92a0e4aa67c3068)` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:34:37.881022 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3947cf10-0a15-478d-9c00-050aa1499086 admin admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:34:37.882575 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 4/9] 10.222.0.25 () {56 vars in 1198 bytes} [Tue Sep 13 19:34:37 2022] GET /identity/v3/users/7b0aed92d02344acb92a0e4aa67c3068 => generated 247 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:34:40.178878 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0784e2f3-0248-4ce2-897d-6d145a01bfe8 None None] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:34:40.179520 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0784e2f3-0248-4ce2-897d-6d145a01bfe8 None None] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:34:40.179520 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0784e2f3-0248-4ce2-897d-6d145a01bfe8 None None] PATH_INFO: `/` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:34:40.181520 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 6/10] 10.222.0.25 () {54 vars in 927 bytes} [Tue Sep 13 19:34:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:34:40.187532 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f8ec7b-16c5-4d77-8961-d8ad38291a99 None None] REQUEST_METHOD: `POST` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:34:40.188043 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f8ec7b-16c5-4d77-8961-d8ad38291a99 None None] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:34:40.188043 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f8ec7b-16c5-4d77-8961-d8ad38291a99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:34:40.215938 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.auth.core [None req-d1f8ec7b-16c5-4d77-8961-d8ad38291a99 None None] MFA Rules not processed for user `7b0aed92d02344acb92a0e4aa67c3068`. Rule list: `[]` (Enabled: `True`). {{(pid=87935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:34:40.217160 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.fernet_utils [None req-d1f8ec7b-16c5-4d77-8961-d8ad38291a99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:34:40.309775 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a375605-b688-44f8-8450-87d55f198c04 None None] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:34:40.310063 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a375605-b688-44f8-8450-87d55f198c04 None None] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:34:40.310342 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a375605-b688-44f8-8450-87d55f198c04 None None] PATH_INFO: `/` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:34:40.311663 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 7/11] 10.222.0.25 () {54 vars in 927 bytes} [Tue Sep 13 19:34:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 13 19:34:40.317445 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddceac24-c601-442f-a5de-597f896cb472 None None] REQUEST_METHOD: `POST` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:34:40.317732 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddceac24-c601-442f-a5de-597f896cb472 None None] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:34:40.318008 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddceac24-c601-442f-a5de-597f896cb472 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:34:40.319397 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 5/12] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Sep 13 19:34:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 19:34:40.376657 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG passlib.handlers.bcrypt [None req-ddceac24-c601-442f-a5de-597f896cb472 None None] detected 'bcrypt' backend, version '4.0.0' {{(pid=87934) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Sep 13 19:34:40.377052 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG passlib.handlers.bcrypt [None req-ddceac24-c601-442f-a5de-597f896cb472 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=87934) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Sep 13 19:34:40.426298 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.auth.core [None req-ddceac24-c601-442f-a5de-597f896cb472 None None] MFA Rules not processed for user `7b0aed92d02344acb92a0e4aa67c3068`. Rule list: `[]` (Enabled: `True`). {{(pid=87934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:34:40.427912 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.fernet_utils [None req-ddceac24-c601-442f-a5de-597f896cb472 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:34:40.532520 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 8/13] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Sep 13 19:34:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 13 19:34:40.589042 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f8ec7b-16c5-4d77-8961-d8ad38291a99 None None] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:34:40.616179 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG dbcounter [-] [87935] Writing DB stats keystone:SELECT=100 {{(pid=87935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:34:40.705440 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f8ec7b-16c5-4d77-8961-d8ad38291a99 None None] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:34:40.745988 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377f2b77-76db-4182-9bc0-a3e0b6333ed9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:34:40.746818 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377f2b77-76db-4182-9bc0-a3e0b6333ed9 None admin] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:34:40.747170 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377f2b77-76db-4182-9bc0-a3e0b6333ed9 None admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:34:40.747445 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377f2b77-76db-4182-9bc0-a3e0b6333ed9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:34:40.762226 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-377f2b77-76db-4182-9bc0-a3e0b6333ed9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 19:34:40.771267 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application [None req-377f2b77-76db-4182-9bc0-a3e0b6333ed9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 19:34:40.771267 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:34:40.771267 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:34:40.771267 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:34:40.771267 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:34:40.771267 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:34:40.771267 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:34:40.771267 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:34:40.771267 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:34:40.771267 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:34:40.771267 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:34:40.771267 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:34:40.771267 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 19:34:40.771267 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 19:34:40.771267 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 19:34:40.771267 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 19:34:40.772564 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 19:34:40.772564 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 19:34:40.772564 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 19:34:40.772564 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 19:34:40.772564 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:34:40.772564 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:34:40.772564 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:34:40.772564 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:34:40.772564 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:34:40.772564 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:34:40.772564 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:34:40.772564 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application with Lock( Sep 13 19:34:40.772564 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:34:40.772564 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:34:40.772564 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:34:40.772564 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:34:40.773369 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:34:40.773369 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:34:40.773369 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:34:40.773369 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:34:40.773369 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 19:34:40.773369 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 19:34:40.773369 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 19:34:40.773369 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 19:34:40.773369 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 19:34:40.773369 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 19:34:40.773369 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 19:34:40.773369 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application Sep 13 19:34:40.773369 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 6/14] 10.222.0.25 () {56 vars in 1096 bytes} [Tue Sep 13 19:34:40 2022] GET /identity/v3/roles/admin => generated 83 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:34:40.778687 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddceac24-c601-442f-a5de-597f896cb472 None None] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:34:40.819588 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377f2b77-76db-4182-9bc0-a3e0b6333ed9 None admin] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:34:40.890067 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddceac24-c601-442f-a5de-597f896cb472 None None] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:34:40.892835 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG dbcounter [-] [87934] Writing DB stats keystone:SELECT=100 {{(pid=87934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:34:40.908547 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG dbcounter [-] [87935] Writing DB stats keystone:SELECT=100 {{(pid=87935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:34:40.929715 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377f2b77-76db-4182-9bc0-a3e0b6333ed9 None admin] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:34:40.938201 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0a5f06-f0a6-40a6-9f7e-d4de5567dec1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:34:40.939062 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0a5f06-f0a6-40a6-9f7e-d4de5567dec1 None admin] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:34:40.939350 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0a5f06-f0a6-40a6-9f7e-d4de5567dec1 None admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:34:40.939618 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0a5f06-f0a6-40a6-9f7e-d4de5567dec1 None admin] PATH_INFO: `/v3/roles` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:34:40.940489 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb0a5f06-f0a6-40a6-9f7e-d4de5567dec1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87934) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:34:40.940785 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb0a5f06-f0a6-40a6-9f7e-d4de5567dec1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:34:40.942257 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb0a5f06-f0a6-40a6-9f7e-d4de5567dec1 None admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:34:40.954833 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 9/15] 10.222.0.25 () {56 vars in 1099 bytes} [Tue Sep 13 19:34:40 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:34:40.960820 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0a5f06-f0a6-40a6-9f7e-d4de5567dec1 None admin] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:34:40.965317 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f52a150-c9a3-4497-922a-a933038bf370 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:34:40.965941 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f52a150-c9a3-4497-922a-a933038bf370 None admin] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:34:40.966215 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f52a150-c9a3-4497-922a-a933038bf370 None admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:34:40.966485 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f52a150-c9a3-4497-922a-a933038bf370 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:34:41.040093 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f52a150-c9a3-4497-922a-a933038bf370 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:34:41.041711 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f52a150-c9a3-4497-922a-a933038bf370 None admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:34:41.073614 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0a5f06-f0a6-40a6-9f7e-d4de5567dec1 None admin] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:34:41.110728 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a412b4d-f4a0-4986-ac27-d2d716675bd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:34:41.111584 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a412b4d-f4a0-4986-ac27-d2d716675bd7 None admin] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:34:41.111866 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a412b4d-f4a0-4986-ac27-d2d716675bd7 None admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:34:41.112130 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a412b4d-f4a0-4986-ac27-d2d716675bd7 None admin] PATH_INFO: `/v3/users/7b0aed92d02344acb92a0e4aa67c3068` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:34:41.113679 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a412b4d-f4a0-4986-ac27-d2d716675bd7 None admin] RBAC: Authorizing `identity:get_user(user_id=7b0aed92d02344acb92a0e4aa67c3068)` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:34:41.115139 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a412b4d-f4a0-4986-ac27-d2d716675bd7 None admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:34:41.116745 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 10/16] 10.222.0.25 () {56 vars in 1177 bytes} [Tue Sep 13 19:34:40 2022] GET /identity/v3/users/7b0aed92d02344acb92a0e4aa67c3068 => generated 247 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 19:34:41.122674 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a412b4d-f4a0-4986-ac27-d2d716675bd7 None admin] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:34:41.127205 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG dbcounter [-] [87935] Writing DB stats keystone:SELECT=100 {{(pid=87935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:34:41.153234 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 7/17] 10.222.0.25 () {58 vars in 1282 bytes} [Tue Sep 13 19:34:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 13 19:34:41.158896 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f52a150-c9a3-4497-922a-a933038bf370 None admin] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:34:41.161496 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG dbcounter [-] [87934] Writing DB stats keystone:SELECT=100 {{(pid=87934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:34:41.237544 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a412b4d-f4a0-4986-ac27-d2d716675bd7 None admin] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:34:41.274521 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0c731c-b210-4544-b09b-6d85868b5e7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:34:41.275167 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0c731c-b210-4544-b09b-6d85868b5e7a None admin] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:34:41.275475 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0c731c-b210-4544-b09b-6d85868b5e7a None admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:34:41.275748 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0c731c-b210-4544-b09b-6d85868b5e7a None admin] PATH_INFO: `/v3/domains/default` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:34:41.277087 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e0c731c-b210-4544-b09b-6d85868b5e7a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:34:41.278047 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f52a150-c9a3-4497-922a-a933038bf370 None admin] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:34:41.278534 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e0c731c-b210-4544-b09b-6d85868b5e7a None admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:34:41.282120 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 11/18] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Sep 13 19:34:41 2022] GET /identity/v3/domains/default => generated 199 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 19:34:41.286262 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0c731c-b210-4544-b09b-6d85868b5e7a None admin] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:34:41.316050 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e846c58-fbac-4646-9003-7f31d85fc6c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:34:41.316729 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e846c58-fbac-4646-9003-7f31d85fc6c3 None admin] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:34:41.317016 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e846c58-fbac-4646-9003-7f31d85fc6c3 None admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:34:41.317287 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e846c58-fbac-4646-9003-7f31d85fc6c3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:34:41.328680 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e846c58-fbac-4646-9003-7f31d85fc6c3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:34:41.330126 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e846c58-fbac-4646-9003-7f31d85fc6c3 None admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:34:41.347116 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application [None req-7e846c58-fbac-4646-9003-7f31d85fc6c3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 19:34:41.347116 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:34:41.347116 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:34:41.347116 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:34:41.347116 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:34:41.347116 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:34:41.347116 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:34:41.347116 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:34:41.347116 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:34:41.347116 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:34:41.347116 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:34:41.347116 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:34:41.347116 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 19:34:41.347116 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 19:34:41.347116 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 19:34:41.347116 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 19:34:41.348066 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:34:41.348066 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:34:41.348066 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:34:41.348066 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:34:41.348066 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:34:41.348066 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:34:41.348066 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:34:41.348066 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application with Lock( Sep 13 19:34:41.348066 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:34:41.348066 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:34:41.348066 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:34:41.348066 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:34:41.348066 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:34:41.348066 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:34:41.348066 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:34:41.348066 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:34:41.348066 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 19:34:41.348899 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 19:34:41.348899 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 19:34:41.348899 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application Sep 13 19:34:41.348899 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 8/19] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Sep 13 19:34:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 13 19:34:41.354918 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e846c58-fbac-4646-9003-7f31d85fc6c3 None admin] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:34:41.397907 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0c731c-b210-4544-b09b-6d85868b5e7a None admin] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:34:41.399736 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG dbcounter [-] [87935] Writing DB stats keystone:SELECT=100 {{(pid=87935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:34:41.400408 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG dbcounter [-] [87934] Writing DB stats keystone:SELECT=100 {{(pid=87934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:34:41.450604 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe559f9-ca6a-4c10-b837-60248e2900a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:34:41.451217 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe559f9-ca6a-4c10-b837-60248e2900a9 None admin] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:34:41.451499 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe559f9-ca6a-4c10-b837-60248e2900a9 None admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:34:41.451772 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe559f9-ca6a-4c10-b837-60248e2900a9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:34:41.452558 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe559f9-ca6a-4c10-b837-60248e2900a9 None admin] RBAC: Adding query filter params (role.id=6ca1d4427ff64e0a9d25d96cfb1445f6, scope.domain.id=default, user.id=7b0aed92d02344acb92a0e4aa67c3068) {{(pid=87934) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:34:41.452868 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe559f9-ca6a-4c10-b837-60248e2900a9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:34:41.454450 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe559f9-ca6a-4c10-b837-60248e2900a9 None admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:34:41.464575 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 12/20] 10.222.0.25 () {56 vars in 1322 bytes} [Tue Sep 13 19:34:41 2022] GET /identity/v3/role_assignments?user.id=7b0aed92d02344acb92a0e4aa67c3068&scope.domain.id=default&role.id=6ca1d4427ff64e0a9d25d96cfb1445f6 => generated 233 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 19:34:41.471272 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e846c58-fbac-4646-9003-7f31d85fc6c3 None admin] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:34:41.509991 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53a0595-c551-4ea8-8cd9-ff00d0c59eeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:34:41.510673 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53a0595-c551-4ea8-8cd9-ff00d0c59eeb None admin] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:34:41.511061 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53a0595-c551-4ea8-8cd9-ff00d0c59eeb None admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:34:41.511332 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53a0595-c551-4ea8-8cd9-ff00d0c59eeb None admin] PATH_INFO: `/v3/domains` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:34:41.511989 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53a0595-c551-4ea8-8cd9-ff00d0c59eeb None admin] RBAC: Adding query filter params (name=Default) {{(pid=87935) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:34:41.512323 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53a0595-c551-4ea8-8cd9-ff00d0c59eeb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:34:41.513745 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53a0595-c551-4ea8-8cd9-ff00d0c59eeb None admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:34:41.534715 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 9/21] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Sep 13 19:34:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 19:34:44.464957 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95456de9-765e-4263-a847-123ed86bdbdc None None] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:34:44.465989 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95456de9-765e-4263-a847-123ed86bdbdc None None] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:34:44.466477 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95456de9-765e-4263-a847-123ed86bdbdc None None] PATH_INFO: `/` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:34:44.468078 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 13/22] 10.222.0.25 () {54 vars in 927 bytes} [Tue Sep 13 19:34:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:34:44.474064 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f196e279-fb26-4420-8d85-66f13cebfdea None None] REQUEST_METHOD: `POST` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:34:44.475032 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f196e279-fb26-4420-8d85-66f13cebfdea None None] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:34:44.475494 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f196e279-fb26-4420-8d85-66f13cebfdea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:34:44.501261 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.auth.core [None req-f196e279-fb26-4420-8d85-66f13cebfdea None None] MFA Rules not processed for user `7b0aed92d02344acb92a0e4aa67c3068`. Rule list: `[]` (Enabled: `True`). {{(pid=87935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:34:44.502874 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.fernet_utils [None req-f196e279-fb26-4420-8d85-66f13cebfdea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:34:44.552139 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553be040-aa50-4078-abfd-ee7100384514 None None] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:34:44.552757 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553be040-aa50-4078-abfd-ee7100384514 None None] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:34:44.553243 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553be040-aa50-4078-abfd-ee7100384514 None None] PATH_INFO: `/` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:34:44.555377 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 14/23] 10.222.0.25 () {54 vars in 927 bytes} [Tue Sep 13 19:34:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:34:44.561451 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653f3be8-9fff-4c19-b56e-734b0c34bc77 None None] REQUEST_METHOD: `POST` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:34:44.562031 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653f3be8-9fff-4c19-b56e-734b0c34bc77 None None] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:34:44.562584 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653f3be8-9fff-4c19-b56e-734b0c34bc77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:34:44.605809 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.auth.core [None req-653f3be8-9fff-4c19-b56e-734b0c34bc77 None None] MFA Rules not processed for user `7b0aed92d02344acb92a0e4aa67c3068`. Rule list: `[]` (Enabled: `True`). {{(pid=87934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:34:44.608269 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.fernet_utils [None req-653f3be8-9fff-4c19-b56e-734b0c34bc77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:34:44.649975 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 10/24] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Sep 13 19:34:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 19:34:44.734002 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 15/25] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Sep 13 19:34:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 19:34:45.110233 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5ca5fd-3b61-4b69-8a5f-216b0bfb436e None None] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:34:45.110904 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5ca5fd-3b61-4b69-8a5f-216b0bfb436e None None] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:34:45.111375 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5ca5fd-3b61-4b69-8a5f-216b0bfb436e None None] PATH_INFO: `/` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:34:45.112959 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 11/26] 10.222.0.25 () {54 vars in 927 bytes} [Tue Sep 13 19:34:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:34:45.118794 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586996bf-d427-4932-9a71-df79974f019e None None] REQUEST_METHOD: `POST` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:34:45.119365 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586996bf-d427-4932-9a71-df79974f019e None None] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:34:45.119841 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586996bf-d427-4932-9a71-df79974f019e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:34:45.131260 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2338459c-87eb-4b82-b981-0d07286d63f3 None None] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:34:45.131856 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2338459c-87eb-4b82-b981-0d07286d63f3 None None] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:34:45.132372 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2338459c-87eb-4b82-b981-0d07286d63f3 None None] PATH_INFO: `/` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:34:45.134738 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 12/27] 10.222.0.25 () {54 vars in 927 bytes} [Tue Sep 13 19:34:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 13 19:34:45.140254 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b61ed7-fb03-4447-bce1-67d2a6e44c79 None None] REQUEST_METHOD: `POST` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:34:45.141021 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b61ed7-fb03-4447-bce1-67d2a6e44c79 None None] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:34:45.143048 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b61ed7-fb03-4447-bce1-67d2a6e44c79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:34:45.171006 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.auth.core [None req-586996bf-d427-4932-9a71-df79974f019e None None] MFA Rules not processed for user `7b0aed92d02344acb92a0e4aa67c3068`. Rule list: `[]` (Enabled: `True`). {{(pid=87934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:34:45.173332 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.fernet_utils [None req-586996bf-d427-4932-9a71-df79974f019e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:34:45.180378 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.auth.core [None req-e8b61ed7-fb03-4447-bce1-67d2a6e44c79 None None] MFA Rules not processed for user `7b0aed92d02344acb92a0e4aa67c3068`. Rule list: `[]` (Enabled: `True`). {{(pid=87935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:34:45.182696 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.fernet_utils [None req-e8b61ed7-fb03-4447-bce1-67d2a6e44c79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:34:45.232601 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG dbcounter [-] [87935] Writing DB stats keystone:SELECT=100 {{(pid=87935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:34:45.294982 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 16/28] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Sep 13 19:34:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 13 19:34:45.296117 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586996bf-d427-4932-9a71-df79974f019e None None] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:34:45.316500 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 13/29] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Sep 13 19:34:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 13 19:34:45.318209 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b61ed7-fb03-4447-bce1-67d2a6e44c79 None None] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:34:45.361493 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG dbcounter [-] [87934] Writing DB stats keystone:SELECT=100 {{(pid=87934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:34:45.481357 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586996bf-d427-4932-9a71-df79974f019e None None] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:34:45.482295 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b61ed7-fb03-4447-bce1-67d2a6e44c79 None None] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:34:45.528847 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97196035-10c4-469c-bff1-ab609db508bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:34:45.529340 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96aee258-040e-4f4b-a382-b27d5684f0e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:34:45.529487 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97196035-10c4-469c-bff1-ab609db508bd None admin] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:34:45.529957 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97196035-10c4-469c-bff1-ab609db508bd None admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:34:45.530379 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96aee258-040e-4f4b-a382-b27d5684f0e0 None admin] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:34:45.530490 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97196035-10c4-469c-bff1-ab609db508bd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:34:45.530938 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96aee258-040e-4f4b-a382-b27d5684f0e0 None admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:34:45.531503 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96aee258-040e-4f4b-a382-b27d5684f0e0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:34:45.543501 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96aee258-040e-4f4b-a382-b27d5684f0e0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 19:34:45.548685 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application [None req-96aee258-040e-4f4b-a382-b27d5684f0e0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 19:34:45.548685 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:34:45.548685 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:34:45.548685 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:34:45.548685 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:34:45.548685 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:34:45.548685 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:34:45.548685 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:34:45.548685 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:34:45.548685 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:34:45.548685 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:34:45.548685 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:34:45.548685 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 19:34:45.548685 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 19:34:45.548685 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 19:34:45.548685 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 19:34:45.549752 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 19:34:45.549752 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 19:34:45.549752 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 19:34:45.549752 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 19:34:45.549752 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:34:45.549752 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:34:45.549752 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:34:45.549752 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:34:45.549752 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:34:45.549752 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:34:45.549752 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:34:45.549752 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application with Lock( Sep 13 19:34:45.549752 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:34:45.549752 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:34:45.549752 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:34:45.549752 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:34:45.550532 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:34:45.550532 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:34:45.550532 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:34:45.550532 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:34:45.550532 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 19:34:45.550532 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 19:34:45.550532 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 19:34:45.550532 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 19:34:45.550532 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 19:34:45.550532 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 19:34:45.550532 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 19:34:45.550532 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application Sep 13 19:34:45.553175 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 14/30] 10.222.0.25 () {56 vars in 1096 bytes} [Tue Sep 13 19:34:45 2022] GET /identity/v3/roles/admin => generated 83 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:34:45.557284 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97196035-10c4-469c-bff1-ab609db508bd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:34:45.557284 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97196035-10c4-469c-bff1-ab609db508bd None admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:34:45.562349 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96aee258-040e-4f4b-a382-b27d5684f0e0 None admin] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:34:45.584236 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application [None req-97196035-10c4-469c-bff1-ab609db508bd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 19:34:45.584236 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:34:45.584236 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:34:45.584236 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:34:45.584236 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:34:45.584236 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:34:45.584236 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:34:45.584236 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:34:45.584236 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:34:45.584236 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:34:45.584236 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:34:45.584236 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:34:45.584236 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 19:34:45.584236 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 19:34:45.584236 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 19:34:45.584236 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 19:34:45.585366 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:34:45.585366 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:34:45.585366 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:34:45.585366 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:34:45.585366 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:34:45.585366 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:34:45.585366 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:34:45.585366 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application with Lock( Sep 13 19:34:45.585366 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:34:45.585366 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:34:45.585366 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:34:45.585366 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:34:45.585366 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:34:45.585366 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:34:45.585366 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:34:45.585366 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:34:45.585366 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 19:34:45.586830 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 19:34:45.586830 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 19:34:45.586830 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application Sep 13 19:34:45.586830 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 17/31] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Sep 13 19:34:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 288 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:34:45.592405 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG dbcounter [-] [87935] Writing DB stats keystone:SELECT=100 {{(pid=87935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:34:45.593445 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97196035-10c4-469c-bff1-ab609db508bd None admin] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:34:45.724439 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96aee258-040e-4f4b-a382-b27d5684f0e0 None admin] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:34:45.764638 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG dbcounter [-] [87934] Writing DB stats keystone:SELECT=100 {{(pid=87934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:34:45.770285 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394e8c46-b5e1-4b61-bcde-2417f2e9c405 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:34:45.771137 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394e8c46-b5e1-4b61-bcde-2417f2e9c405 None admin] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:34:45.771668 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394e8c46-b5e1-4b61-bcde-2417f2e9c405 None admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:34:45.772129 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394e8c46-b5e1-4b61-bcde-2417f2e9c405 None admin] PATH_INFO: `/v3/roles` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:34:45.773068 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-394e8c46-b5e1-4b61-bcde-2417f2e9c405 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87935) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:34:45.774130 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-394e8c46-b5e1-4b61-bcde-2417f2e9c405 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:34:45.776401 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-394e8c46-b5e1-4b61-bcde-2417f2e9c405 None admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:34:45.792621 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 15/32] 10.222.0.25 () {56 vars in 1099 bytes} [Tue Sep 13 19:34:45 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 19:34:45.794120 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd76ef45-9c85-4477-b9a3-1fae0d94e76a None None] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:34:45.794419 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97196035-10c4-469c-bff1-ab609db508bd None admin] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:34:45.794749 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd76ef45-9c85-4477-b9a3-1fae0d94e76a None None] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:34:45.795172 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd76ef45-9c85-4477-b9a3-1fae0d94e76a None None] PATH_INFO: `/` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:34:45.801316 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 16/33] 10.222.0.25 () {54 vars in 927 bytes} [Tue Sep 13 19:34:45 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:34:45.802338 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd76ef45-9c85-4477-b9a3-1fae0d94e76a None None] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:34:45.848985 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe32f461-2fa7-4c8d-9eb5-315e95140e16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:34:45.849626 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe32f461-2fa7-4c8d-9eb5-315e95140e16 None admin] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:34:45.849908 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe32f461-2fa7-4c8d-9eb5-315e95140e16 None admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:34:45.850181 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe32f461-2fa7-4c8d-9eb5-315e95140e16 None admin] PATH_INFO: `/v3/domains` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:34:45.850835 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe32f461-2fa7-4c8d-9eb5-315e95140e16 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87934) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:34:45.851138 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe32f461-2fa7-4c8d-9eb5-315e95140e16 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:34:45.853191 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe32f461-2fa7-4c8d-9eb5-315e95140e16 None admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:34:45.876330 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 18/34] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Sep 13 19:34:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:34:45.881216 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dac9690-a9c2-4fce-859f-0b4719eae465 None None] REQUEST_METHOD: `POST` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:34:45.881216 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dac9690-a9c2-4fce-859f-0b4719eae465 None None] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:34:45.881216 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dac9690-a9c2-4fce-859f-0b4719eae465 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:34:45.904686 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.auth.core [None req-7dac9690-a9c2-4fce-859f-0b4719eae465 None None] MFA Rules not processed for user `7b0aed92d02344acb92a0e4aa67c3068`. Rule list: `[]` (Enabled: `True`). {{(pid=87934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:34:45.905900 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.fernet_utils [None req-7dac9690-a9c2-4fce-859f-0b4719eae465 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:34:45.911011 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG dbcounter [-] [87935] Writing DB stats keystone:SELECT=100 {{(pid=87935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:34:45.938766 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd76ef45-9c85-4477-b9a3-1fae0d94e76a None None] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:34:45.981819 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7e7247-d0f8-43ba-a838-6d6c62ecc634 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:34:45.982376 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7e7247-d0f8-43ba-a838-6d6c62ecc634 None admin] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:34:45.982646 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7e7247-d0f8-43ba-a838-6d6c62ecc634 None admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:34:45.983032 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7e7247-d0f8-43ba-a838-6d6c62ecc634 None admin] PATH_INFO: `/v3/users/7b0aed92d02344acb92a0e4aa67c3068` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:34:45.984234 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a7e7247-d0f8-43ba-a838-6d6c62ecc634 None admin] RBAC: Authorizing `identity:get_user(user_id=7b0aed92d02344acb92a0e4aa67c3068)` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:34:45.985688 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a7e7247-d0f8-43ba-a838-6d6c62ecc634 None admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:34:45.991851 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 17/35] 10.222.0.25 () {56 vars in 1177 bytes} [Tue Sep 13 19:34:45 2022] GET /identity/v3/users/7b0aed92d02344acb92a0e4aa67c3068 => generated 247 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:34:45.991851 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7e7247-d0f8-43ba-a838-6d6c62ecc634 None admin] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:34:46.012073 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 19/36] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Sep 13 19:34:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 19:34:46.020449 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dac9690-a9c2-4fce-859f-0b4719eae465 None None] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:34:46.115719 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG dbcounter [-] [87934] Writing DB stats keystone:SELECT=100 {{(pid=87934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:34:46.135454 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7e7247-d0f8-43ba-a838-6d6c62ecc634 None admin] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:34:46.166816 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dac9690-a9c2-4fce-859f-0b4719eae465 None None] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:34:46.186694 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edba9620-615f-4a24-a673-0418f07d60c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:34:46.187407 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edba9620-615f-4a24-a673-0418f07d60c9 None admin] REQUEST_METHOD: `POST` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:34:46.187580 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edba9620-615f-4a24-a673-0418f07d60c9 None admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:34:46.187833 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edba9620-615f-4a24-a673-0418f07d60c9 None admin] PATH_INFO: `/v3/roles` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:34:46.188533 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edba9620-615f-4a24-a673-0418f07d60c9 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:34:46.190036 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edba9620-615f-4a24-a673-0418f07d60c9 None admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:34:46.215860 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672d2218-7ab9-495a-b510-24fef4c8b63f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:34:46.216926 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672d2218-7ab9-495a-b510-24fef4c8b63f None admin] REQUEST_METHOD: `POST` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:34:46.217462 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672d2218-7ab9-495a-b510-24fef4c8b63f None admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:34:46.217972 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672d2218-7ab9-495a-b510-24fef4c8b63f None admin] PATH_INFO: `/v3/roles` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:34:46.218851 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-672d2218-7ab9-495a-b510-24fef4c8b63f None admin] RBAC: Authorizing `identity:create_role()` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:34:46.220666 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-672d2218-7ab9-495a-b510-24fef4c8b63f None admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:34:46.327309 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 18/37] 10.222.0.25 () {60 vars in 1131 bytes} [Tue Sep 13 19:34:45 2022] POST /identity/v3/roles => generated 219 bytes in 339 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 19:34:46.328312 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edba9620-615f-4a24-a673-0418f07d60c9 None admin] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:34:46.332756 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG dbcounter [-] [87935] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:34:46.365585 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 20/38] 10.222.0.25 () {60 vars in 1131 bytes} [Tue Sep 13 19:34:46 2022] POST /identity/v3/roles => generated 225 bytes in 351 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 19:34:46.365585 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672d2218-7ab9-495a-b510-24fef4c8b63f None admin] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:34:46.477912 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edba9620-615f-4a24-a673-0418f07d60c9 None admin] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:34:46.529400 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48f653d-84c8-4a01-8c3b-e1350e6341dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:34:46.530057 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672d2218-7ab9-495a-b510-24fef4c8b63f None admin] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:34:46.531455 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48f653d-84c8-4a01-8c3b-e1350e6341dd None admin] REQUEST_METHOD: `POST` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:34:46.531906 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48f653d-84c8-4a01-8c3b-e1350e6341dd None admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:34:46.532417 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48f653d-84c8-4a01-8c3b-e1350e6341dd None admin] PATH_INFO: `/v3/projects` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:34:46.533374 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d48f653d-84c8-4a01-8c3b-e1350e6341dd None admin] RBAC: Authorizing `identity:create_project()` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:34:46.535337 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d48f653d-84c8-4a01-8c3b-e1350e6341dd None admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:34:46.569911 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG dbcounter [-] [87934] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:34:46.582697 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27bd209-2544-4058-87d7-7c5ea8e28ff3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:34:46.582697 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27bd209-2544-4058-87d7-7c5ea8e28ff3 None admin] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:34:46.582697 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27bd209-2544-4058-87d7-7c5ea8e28ff3 None admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:34:46.582697 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27bd209-2544-4058-87d7-7c5ea8e28ff3 None admin] PATH_INFO: `/v3/domains/default` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:34:46.583894 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d27bd209-2544-4058-87d7-7c5ea8e28ff3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:34:46.588529 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d27bd209-2544-4058-87d7-7c5ea8e28ff3 None admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:34:46.589534 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 21/39] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Sep 13 19:34:46 2022] GET /identity/v3/domains/default => generated 199 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:34:46.590873 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d91483-d3f8-42e5-b566-5e4ba0c95272 None None] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:34:46.591165 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d91483-d3f8-42e5-b566-5e4ba0c95272 None None] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:34:46.591449 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d91483-d3f8-42e5-b566-5e4ba0c95272 None None] PATH_INFO: `/` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:34:46.597102 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 22/40] 10.222.0.25 () {54 vars in 927 bytes} [Tue Sep 13 19:34:46 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:34:46.598067 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d91483-d3f8-42e5-b566-5e4ba0c95272 None None] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:34:46.695702 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 19/41] 10.222.0.25 () {60 vars in 1141 bytes} [Tue Sep 13 19:34:46 2022] POST /identity/v3/projects => generated 301 bytes in 368 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 19:34:46.697103 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07080abc-4e3e-4f43-b59d-4909dbdc5c18 None None] REQUEST_METHOD: `POST` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:34:46.697386 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07080abc-4e3e-4f43-b59d-4909dbdc5c18 None None] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:34:46.697662 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07080abc-4e3e-4f43-b59d-4909dbdc5c18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:34:46.732708 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.auth.core [None req-07080abc-4e3e-4f43-b59d-4909dbdc5c18 None None] MFA Rules not processed for user `7b0aed92d02344acb92a0e4aa67c3068`. Rule list: `[]` (Enabled: `True`). {{(pid=87935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:34:46.733667 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d91483-d3f8-42e5-b566-5e4ba0c95272 None None] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:34:46.734647 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.fernet_utils [None req-07080abc-4e3e-4f43-b59d-4909dbdc5c18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:34:46.775808 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ff7efa-bff8-4d95-b9b4-66593985ab37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:34:46.776487 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ff7efa-bff8-4d95-b9b4-66593985ab37 None admin] REQUEST_METHOD: `POST` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:34:46.776770 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ff7efa-bff8-4d95-b9b4-66593985ab37 None admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:34:46.777046 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ff7efa-bff8-4d95-b9b4-66593985ab37 None admin] PATH_INFO: `/v3/roles` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:34:46.777754 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ff7efa-bff8-4d95-b9b4-66593985ab37 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:34:46.779207 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ff7efa-bff8-4d95-b9b4-66593985ab37 None admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:34:46.797493 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 23/42] 10.222.0.25 () {60 vars in 1131 bytes} [Tue Sep 13 19:34:46 2022] POST /identity/v3/roles => generated 223 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 19:34:46.798421 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ff7efa-bff8-4d95-b9b4-66593985ab37 None admin] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:34:46.821652 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG dbcounter [-] [87935] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:34:46.845392 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 20/43] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Sep 13 19:34:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 19:34:46.903425 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG dbcounter [-] [87934] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:34:46.968103 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ff7efa-bff8-4d95-b9b4-66593985ab37 None admin] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:34:47.027115 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415fadc6-4871-465b-a4cb-643d3e79520e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:34:47.028191 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415fadc6-4871-465b-a4cb-643d3e79520e None admin] REQUEST_METHOD: `PUT` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:34:47.028690 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415fadc6-4871-465b-a4cb-643d3e79520e None admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:34:47.029155 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415fadc6-4871-465b-a4cb-643d3e79520e None admin] PATH_INFO: `/v3/domains/default/users/7b0aed92d02344acb92a0e4aa67c3068/roles/6ca1d4427ff64e0a9d25d96cfb1445f6` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:34:47.032465 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-415fadc6-4871-465b-a4cb-643d3e79520e None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=7b0aed92d02344acb92a0e4aa67c3068, role_id=6ca1d4427ff64e0a9d25d96cfb1445f6)` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:34:47.035000 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-415fadc6-4871-465b-a4cb-643d3e79520e None admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:34:47.055596 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 24/44] 10.222.0.25 () {58 vars in 1361 bytes} [Tue Sep 13 19:34:46 2022] PUT /identity/v3/domains/default/users/7b0aed92d02344acb92a0e4aa67c3068/roles/6ca1d4427ff64e0a9d25d96cfb1445f6 => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 19:34:47.135008 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07080abc-4e3e-4f43-b59d-4909dbdc5c18 None None] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:34:47.251454 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07080abc-4e3e-4f43-b59d-4909dbdc5c18 None None] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:34:47.291284 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af140ef9-573d-46a4-9505-316d59e8b585 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:34:47.291924 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af140ef9-573d-46a4-9505-316d59e8b585 None admin] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:34:47.292202 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af140ef9-573d-46a4-9505-316d59e8b585 None admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:34:47.292496 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af140ef9-573d-46a4-9505-316d59e8b585 None admin] PATH_INFO: `/v3/domains/default` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:34:47.293627 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af140ef9-573d-46a4-9505-316d59e8b585 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:34:47.295078 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af140ef9-573d-46a4-9505-316d59e8b585 None admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:34:47.297799 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 21/45] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Sep 13 19:34:47 2022] GET /identity/v3/domains/default => generated 199 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:34:47.302302 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415fadc6-4871-465b-a4cb-643d3e79520e None admin] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:34:47.412906 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415fadc6-4871-465b-a4cb-643d3e79520e None admin] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:34:47.431014 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG dbcounter [-] [87934] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:34:47.451624 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f8126e-0708-4dde-b01e-40263ef49911 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:34:47.452273 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f8126e-0708-4dde-b01e-40263ef49911 None admin] REQUEST_METHOD: `POST` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:34:47.452560 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f8126e-0708-4dde-b01e-40263ef49911 None admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:34:47.452832 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f8126e-0708-4dde-b01e-40263ef49911 None admin] PATH_INFO: `/v3/projects` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:34:47.453492 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f8126e-0708-4dde-b01e-40263ef49911 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:34:47.454956 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f8126e-0708-4dde-b01e-40263ef49911 None admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:34:47.485416 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 25/46] 10.222.0.25 () {60 vars in 1141 bytes} [Tue Sep 13 19:34:47 2022] POST /identity/v3/projects => generated 312 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 19:34:49.270344 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd51a3c3-7f2d-4b30-8f7d-0fa5096d890e None None] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:34:49.270865 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd51a3c3-7f2d-4b30-8f7d-0fa5096d890e None None] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:34:49.271021 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd51a3c3-7f2d-4b30-8f7d-0fa5096d890e None None] PATH_INFO: `/` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:34:49.272578 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 22/47] 10.222.0.25 () {54 vars in 927 bytes} [Tue Sep 13 19:34:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:34:49.278151 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a190d96-5711-4366-8955-f3a7899d32b9 None None] REQUEST_METHOD: `POST` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:34:49.278640 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a190d96-5711-4366-8955-f3a7899d32b9 None None] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:34:49.278730 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a190d96-5711-4366-8955-f3a7899d32b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:34:49.297621 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.auth.core [None req-2a190d96-5711-4366-8955-f3a7899d32b9 None None] MFA Rules not processed for user `7b0aed92d02344acb92a0e4aa67c3068`. Rule list: `[]` (Enabled: `True`). {{(pid=87934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:34:49.299285 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.fernet_utils [None req-2a190d96-5711-4366-8955-f3a7899d32b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:34:49.373590 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 26/48] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Sep 13 19:34:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 19:34:49.644659 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd51a3c3-7f2d-4b30-8f7d-0fa5096d890e None None] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:34:49.705826 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG dbcounter [-] [87935] Writing DB stats keystone:SELECT=100 {{(pid=87935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:34:49.714933 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41318c75-7796-4449-9631-8b709b5b4c07 None None] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:34:49.715227 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41318c75-7796-4449-9631-8b709b5b4c07 None None] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:34:49.715510 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41318c75-7796-4449-9631-8b709b5b4c07 None None] PATH_INFO: `/` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:34:49.716902 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 27/49] 10.222.0.25 () {54 vars in 927 bytes} [Tue Sep 13 19:34:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:34:49.722217 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a559f8-e337-406b-8369-c13e5479d447 None None] REQUEST_METHOD: `POST` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:34:49.722515 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a559f8-e337-406b-8369-c13e5479d447 None None] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:34:49.722779 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a559f8-e337-406b-8369-c13e5479d447 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:34:49.742730 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.auth.core [None req-27a559f8-e337-406b-8369-c13e5479d447 None None] MFA Rules not processed for user `7b0aed92d02344acb92a0e4aa67c3068`. Rule list: `[]` (Enabled: `True`). {{(pid=87934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:34:49.743958 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.fernet_utils [None req-27a559f8-e337-406b-8369-c13e5479d447 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:34:49.758433 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd51a3c3-7f2d-4b30-8f7d-0fa5096d890e None None] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:34:49.795998 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247590c8-ab10-4074-ba65-c1fda6f91cf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:34:49.796658 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247590c8-ab10-4074-ba65-c1fda6f91cf2 None admin] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:34:49.796935 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247590c8-ab10-4074-ba65-c1fda6f91cf2 None admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:34:49.797213 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247590c8-ab10-4074-ba65-c1fda6f91cf2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:34:49.809007 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-247590c8-ab10-4074-ba65-c1fda6f91cf2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 19:34:49.813992 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application [None req-247590c8-ab10-4074-ba65-c1fda6f91cf2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 19:34:49.813992 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:34:49.813992 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:34:49.813992 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:34:49.813992 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:34:49.813992 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:34:49.813992 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:34:49.813992 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:34:49.813992 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:34:49.813992 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:34:49.813992 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:34:49.813992 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:34:49.813992 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 19:34:49.813992 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 19:34:49.813992 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 19:34:49.813992 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 19:34:49.815031 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 19:34:49.815031 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 19:34:49.815031 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 19:34:49.815031 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 19:34:49.815031 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:34:49.815031 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:34:49.815031 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:34:49.815031 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:34:49.815031 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:34:49.815031 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:34:49.815031 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:34:49.815031 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application with Lock( Sep 13 19:34:49.815031 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:34:49.815031 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:34:49.815031 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:34:49.815031 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:34:49.816063 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:34:49.816063 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:34:49.816063 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:34:49.816063 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:34:49.816063 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 19:34:49.816063 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 19:34:49.816063 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 19:34:49.816063 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 19:34:49.816063 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 19:34:49.816063 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 19:34:49.816063 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 19:34:49.816063 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application Sep 13 19:34:49.816063 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 23/50] 10.222.0.25 () {56 vars in 1096 bytes} [Tue Sep 13 19:34:49 2022] GET /identity/v3/roles/admin => generated 83 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:34:49.818048 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 28/51] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Sep 13 19:34:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 13 19:34:49.822101 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247590c8-ab10-4074-ba65-c1fda6f91cf2 None admin] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:34:49.933470 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247590c8-ab10-4074-ba65-c1fda6f91cf2 None admin] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:34:49.948393 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG dbcounter [-] [87935] Writing DB stats keystone:SELECT=100 {{(pid=87935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:34:49.975283 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f540b97d-5b42-4201-81d9-09b7716a9b05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:34:49.975900 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f540b97d-5b42-4201-81d9-09b7716a9b05 None admin] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:34:49.976182 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f540b97d-5b42-4201-81d9-09b7716a9b05 None admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:34:49.977036 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f540b97d-5b42-4201-81d9-09b7716a9b05 None admin] PATH_INFO: `/v3/roles` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:34:49.977740 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f540b97d-5b42-4201-81d9-09b7716a9b05 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87935) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:34:49.978161 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f540b97d-5b42-4201-81d9-09b7716a9b05 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:34:49.979565 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f540b97d-5b42-4201-81d9-09b7716a9b05 None admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:34:49.996706 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 24/52] 10.222.0.25 () {56 vars in 1099 bytes} [Tue Sep 13 19:34:49 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:34:50.002883 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a559f8-e337-406b-8369-c13e5479d447 None None] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:34:50.045461 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG dbcounter [-] [87934] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:34:50.097787 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f540b97d-5b42-4201-81d9-09b7716a9b05 None admin] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:34:50.130055 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a559f8-e337-406b-8369-c13e5479d447 None None] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:34:50.169299 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea22152-bbc0-4e28-ae90-a99ad93fd517 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:34:50.169943 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea22152-bbc0-4e28-ae90-a99ad93fd517 None admin] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:34:50.170831 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea22152-bbc0-4e28-ae90-a99ad93fd517 None admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:34:50.171125 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea22152-bbc0-4e28-ae90-a99ad93fd517 None admin] PATH_INFO: `/v3/users/7b0aed92d02344acb92a0e4aa67c3068` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:34:50.172370 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea22152-bbc0-4e28-ae90-a99ad93fd517 None admin] RBAC: Authorizing `identity:get_user(user_id=7b0aed92d02344acb92a0e4aa67c3068)` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:34:50.173840 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea22152-bbc0-4e28-ae90-a99ad93fd517 None admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:34:50.175450 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 29/53] 10.222.0.25 () {56 vars in 1177 bytes} [Tue Sep 13 19:34:50 2022] GET /identity/v3/users/7b0aed92d02344acb92a0e4aa67c3068 => generated 247 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:34:50.181200 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea22152-bbc0-4e28-ae90-a99ad93fd517 None admin] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:34:50.208452 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f540b97d-5b42-4201-81d9-09b7716a9b05 None admin] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:34:50.246575 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a23abc-f6f8-4898-9818-e80fab667d5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:34:50.247247 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a23abc-f6f8-4898-9818-e80fab667d5e None admin] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:34:50.247524 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a23abc-f6f8-4898-9818-e80fab667d5e None admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:34:50.247794 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a23abc-f6f8-4898-9818-e80fab667d5e None admin] PATH_INFO: `/v3/domains/default` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:34:50.250231 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a23abc-f6f8-4898-9818-e80fab667d5e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:34:50.251666 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a23abc-f6f8-4898-9818-e80fab667d5e None admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:34:50.253443 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 25/54] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Sep 13 19:34:50 2022] GET /identity/v3/domains/default => generated 199 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 19:34:50.260328 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a23abc-f6f8-4898-9818-e80fab667d5e None admin] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:34:50.313920 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG dbcounter [-] [87935] Writing DB stats keystone:SELECT=100 {{(pid=87935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:34:50.392989 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a23abc-f6f8-4898-9818-e80fab667d5e None admin] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:34:50.403516 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG dbcounter [-] [87934] Writing DB stats keystone:SELECT=100 {{(pid=87934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:34:50.410915 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea22152-bbc0-4e28-ae90-a99ad93fd517 None admin] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:34:50.429767 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b83b4a-89ab-4be4-8767-86429075cf9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:34:50.430385 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b83b4a-89ab-4be4-8767-86429075cf9f None admin] REQUEST_METHOD: `POST` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:34:50.430663 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b83b4a-89ab-4be4-8767-86429075cf9f None admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:34:50.430933 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b83b4a-89ab-4be4-8767-86429075cf9f None admin] PATH_INFO: `/v3/projects` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:34:50.431601 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b83b4a-89ab-4be4-8767-86429075cf9f None admin] RBAC: Authorizing `identity:create_project()` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:34:50.433099 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b83b4a-89ab-4be4-8767-86429075cf9f None admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:34:50.446546 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee5db39-ab9b-4846-b590-bd2efad7b739 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:34:50.447498 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee5db39-ab9b-4846-b590-bd2efad7b739 None admin] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:34:50.448038 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee5db39-ab9b-4846-b590-bd2efad7b739 None admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:34:50.448633 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee5db39-ab9b-4846-b590-bd2efad7b739 None admin] PATH_INFO: `/v3/domains/default` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:34:50.450504 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee5db39-ab9b-4846-b590-bd2efad7b739 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:34:50.452427 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee5db39-ab9b-4846-b590-bd2efad7b739 None admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:34:50.454186 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 30/55] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Sep 13 19:34:50 2022] GET /identity/v3/domains/default => generated 199 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 19:34:50.461779 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee5db39-ab9b-4846-b590-bd2efad7b739 None admin] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:34:50.468955 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 26/56] 10.222.0.25 () {60 vars in 1140 bytes} [Tue Sep 13 19:34:50 2022] POST /identity/v3/projects => generated 298 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 13 19:34:50.597853 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee5db39-ab9b-4846-b590-bd2efad7b739 None admin] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:34:50.638163 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3cba20-a3c3-413d-acda-e0238de04bc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:34:50.638791 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3cba20-a3c3-413d-acda-e0238de04bc5 None admin] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:34:50.639076 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3cba20-a3c3-413d-acda-e0238de04bc5 None admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:34:50.639353 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3cba20-a3c3-413d-acda-e0238de04bc5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:34:50.640094 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc3cba20-a3c3-413d-acda-e0238de04bc5 None admin] RBAC: Adding query filter params (role.id=6ca1d4427ff64e0a9d25d96cfb1445f6, scope.domain.id=default, user.id=7b0aed92d02344acb92a0e4aa67c3068) {{(pid=87934) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:34:50.640440 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc3cba20-a3c3-413d-acda-e0238de04bc5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:34:50.641910 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc3cba20-a3c3-413d-acda-e0238de04bc5 None admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:34:50.648704 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 31/57] 10.222.0.25 () {56 vars in 1322 bytes} [Tue Sep 13 19:34:50 2022] GET /identity/v3/role_assignments?user.id=7b0aed92d02344acb92a0e4aa67c3068&scope.domain.id=default&role.id=6ca1d4427ff64e0a9d25d96cfb1445f6 => generated 530 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 19:34:52.714686 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3383b5-21bc-4c96-ba27-9508833b4173 None None] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:34:52.715175 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3383b5-21bc-4c96-ba27-9508833b4173 None None] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:34:52.715263 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3383b5-21bc-4c96-ba27-9508833b4173 None None] PATH_INFO: `/` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:34:52.716886 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 27/58] 10.222.0.25 () {54 vars in 927 bytes} [Tue Sep 13 19:34:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:34:52.722581 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c2fb95-1d81-4e17-a884-d9e3aaba155d None None] REQUEST_METHOD: `POST` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:34:52.722997 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c2fb95-1d81-4e17-a884-d9e3aaba155d None None] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:34:52.723265 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c2fb95-1d81-4e17-a884-d9e3aaba155d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:34:52.742819 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.auth.core [None req-b1c2fb95-1d81-4e17-a884-d9e3aaba155d None None] MFA Rules not processed for user `7b0aed92d02344acb92a0e4aa67c3068`. Rule list: `[]` (Enabled: `True`). {{(pid=87934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:34:52.744087 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.fernet_utils [None req-b1c2fb95-1d81-4e17-a884-d9e3aaba155d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:34:52.768038 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG dbcounter [-] [87934] Writing DB stats keystone:SELECT=100 {{(pid=87934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:34:52.817389 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 32/59] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Sep 13 19:34:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 19:34:53.088260 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3383b5-21bc-4c96-ba27-9508833b4173 None None] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:34:53.213347 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG dbcounter [-] [87935] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:34:53.221508 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3383b5-21bc-4c96-ba27-9508833b4173 None None] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:34:53.256235 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfca83c4-d6cf-4412-b2ec-a12e54697611 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:34:53.256908 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfca83c4-d6cf-4412-b2ec-a12e54697611 None admin] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:34:53.257352 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfca83c4-d6cf-4412-b2ec-a12e54697611 None admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:34:53.258318 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfca83c4-d6cf-4412-b2ec-a12e54697611 None admin] PATH_INFO: `/v3/domains/default` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:34:53.259499 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfca83c4-d6cf-4412-b2ec-a12e54697611 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:34:53.260988 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfca83c4-d6cf-4412-b2ec-a12e54697611 None admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:34:53.262581 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 28/60] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Sep 13 19:34:53 2022] GET /identity/v3/domains/default => generated 199 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:34:53.268431 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c2fb95-1d81-4e17-a884-d9e3aaba155d None None] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:34:53.373728 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c2fb95-1d81-4e17-a884-d9e3aaba155d None None] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:34:53.416951 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9e87f1-51ba-415d-900d-76eeee091ae4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:34:53.417579 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9e87f1-51ba-415d-900d-76eeee091ae4 None admin] REQUEST_METHOD: `POST` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:34:53.417859 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9e87f1-51ba-415d-900d-76eeee091ae4 None admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:34:53.418132 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9e87f1-51ba-415d-900d-76eeee091ae4 None admin] PATH_INFO: `/v3/users` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:34:53.418796 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af9e87f1-51ba-415d-900d-76eeee091ae4 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:34:53.420261 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af9e87f1-51ba-415d-900d-76eeee091ae4 None admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:34:53.448485 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 33/61] 10.222.0.25 () {60 vars in 1132 bytes} [Tue Sep 13 19:34:53 2022] POST /identity/v3/users => generated 275 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 19:34:57.094865 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66c5cfc-e6ff-4e4f-b3d9-01ef19c00cfc None None] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:34:57.095427 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66c5cfc-e6ff-4e4f-b3d9-01ef19c00cfc None None] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:34:57.095427 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66c5cfc-e6ff-4e4f-b3d9-01ef19c00cfc None None] PATH_INFO: `/` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:34:57.096794 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 29/62] 10.222.0.25 () {54 vars in 927 bytes} [Tue Sep 13 19:34:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:34:57.102961 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73f2c2d-eeea-41cb-a577-7679293239cf None None] REQUEST_METHOD: `POST` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:34:57.103416 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73f2c2d-eeea-41cb-a577-7679293239cf None None] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:34:57.103621 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73f2c2d-eeea-41cb-a577-7679293239cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:34:57.133494 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.auth.core [None req-e73f2c2d-eeea-41cb-a577-7679293239cf None None] MFA Rules not processed for user `7b0aed92d02344acb92a0e4aa67c3068`. Rule list: `[]` (Enabled: `True`). {{(pid=87934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:34:57.134734 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.fernet_utils [None req-e73f2c2d-eeea-41cb-a577-7679293239cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:34:57.145524 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG dbcounter [-] [87934] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:34:57.234824 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 34/63] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Sep 13 19:34:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 19:34:57.437770 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097d5c9f-e1c8-4431-b47e-e1e63d5014af None None] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:34:57.438071 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097d5c9f-e1c8-4431-b47e-e1e63d5014af None None] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:34:57.438250 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097d5c9f-e1c8-4431-b47e-e1e63d5014af None None] PATH_INFO: `/` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:34:57.439906 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 30/64] 10.222.0.25 () {54 vars in 927 bytes} [Tue Sep 13 19:34:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:34:57.454232 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8043679b-c7c6-4e9c-9ac4-1b65de5f4d59 None None] REQUEST_METHOD: `POST` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:34:57.454583 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8043679b-c7c6-4e9c-9ac4-1b65de5f4d59 None None] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:34:57.454793 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8043679b-c7c6-4e9c-9ac4-1b65de5f4d59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:34:57.461675 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be4d323-fbab-45a4-8267-7c92ae59bf9d None None] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:34:57.462280 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be4d323-fbab-45a4-8267-7c92ae59bf9d None None] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:34:57.462701 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be4d323-fbab-45a4-8267-7c92ae59bf9d None None] PATH_INFO: `/` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:34:57.464607 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 31/65] 10.222.0.25 () {54 vars in 927 bytes} [Tue Sep 13 19:34:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:34:57.471589 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6dd31d-5332-4075-b103-41609d8f8a0e None None] REQUEST_METHOD: `POST` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:34:57.472066 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6dd31d-5332-4075-b103-41609d8f8a0e None None] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:34:57.472511 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6dd31d-5332-4075-b103-41609d8f8a0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:34:57.502243 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.auth.core [None req-8043679b-c7c6-4e9c-9ac4-1b65de5f4d59 None None] MFA Rules not processed for user `7b0aed92d02344acb92a0e4aa67c3068`. Rule list: `[]` (Enabled: `True`). {{(pid=87934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:34:57.503704 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.fernet_utils [None req-8043679b-c7c6-4e9c-9ac4-1b65de5f4d59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:34:57.504750 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.auth.core [None req-4b6dd31d-5332-4075-b103-41609d8f8a0e None None] MFA Rules not processed for user `7b0aed92d02344acb92a0e4aa67c3068`. Rule list: `[]` (Enabled: `True`). {{(pid=87935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:34:57.508148 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.fernet_utils [None req-4b6dd31d-5332-4075-b103-41609d8f8a0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:34:57.604290 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 32/66] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Sep 13 19:34:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (3 switches on core 0) Sep 13 19:34:57.605520 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6dd31d-5332-4075-b103-41609d8f8a0e None None] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:34:57.612354 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 35/67] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Sep 13 19:34:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 13 19:34:57.613962 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd96efc3-da7b-48de-8866-2405882753ad None None] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:34:57.614454 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd96efc3-da7b-48de-8866-2405882753ad None None] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:34:57.614925 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd96efc3-da7b-48de-8866-2405882753ad None None] PATH_INFO: `/` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:34:57.616483 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 36/68] 10.222.0.25 () {54 vars in 927 bytes} [Tue Sep 13 19:34:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:34:57.625271 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2b13ac-6a0e-48b9-a5cb-c61ddef806f2 None None] REQUEST_METHOD: `POST` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:34:57.625916 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2b13ac-6a0e-48b9-a5cb-c61ddef806f2 None None] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:34:57.626387 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2b13ac-6a0e-48b9-a5cb-c61ddef806f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:34:57.665244 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.auth.core [None req-0d2b13ac-6a0e-48b9-a5cb-c61ddef806f2 None None] MFA Rules not processed for user `7b0aed92d02344acb92a0e4aa67c3068`. Rule list: `[]` (Enabled: `True`). {{(pid=87934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:34:57.666781 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.fernet_utils [None req-0d2b13ac-6a0e-48b9-a5cb-c61ddef806f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:34:57.733648 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG dbcounter [-] [87935] Writing DB stats keystone:SELECT=100 {{(pid=87935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:34:57.747813 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6dd31d-5332-4075-b103-41609d8f8a0e None None] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:34:57.801922 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 37/69] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Sep 13 19:34:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 19:34:57.809919 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4bb36d-53f8-48ef-aee0-740f313ae463 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:34:57.810576 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4bb36d-53f8-48ef-aee0-740f313ae463 None admin] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:34:57.810859 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4bb36d-53f8-48ef-aee0-740f313ae463 None admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:34:57.811132 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4bb36d-53f8-48ef-aee0-740f313ae463 None admin] PATH_INFO: `/v3/roles/member` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:34:57.823280 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce4bb36d-53f8-48ef-aee0-740f313ae463 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 19:34:57.828598 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application [None req-ce4bb36d-53f8-48ef-aee0-740f313ae463 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 13 19:34:57.828598 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:34:57.828598 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:34:57.828598 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:34:57.828598 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:34:57.828598 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:34:57.828598 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:34:57.828598 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:34:57.828598 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:34:57.828598 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:34:57.828598 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:34:57.828598 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:34:57.828598 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 19:34:57.828598 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 19:34:57.828598 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 19:34:57.828598 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 19:34:57.829511 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 19:34:57.829511 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 19:34:57.829511 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 19:34:57.829511 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 19:34:57.829511 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:34:57.829511 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:34:57.829511 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:34:57.829511 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:34:57.829511 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:34:57.829511 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:34:57.829511 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:34:57.829511 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application with Lock( Sep 13 19:34:57.829511 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:34:57.829511 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:34:57.829511 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:34:57.829511 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:34:57.830276 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:34:57.830276 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:34:57.830276 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:34:57.830276 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:34:57.830276 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 19:34:57.830276 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 19:34:57.830276 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 19:34:57.830276 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 19:34:57.830276 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 19:34:57.830276 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 19:34:57.830276 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 13 19:34:57.830276 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application Sep 13 19:34:57.830276 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 33/70] 10.222.0.25 () {56 vars in 1099 bytes} [Tue Sep 13 19:34:57 2022] GET /identity/v3/roles/member => generated 84 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:34:57.838147 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2b13ac-6a0e-48b9-a5cb-c61ddef806f2 None None] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:34:57.845336 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG dbcounter [-] [87934] Writing DB stats keystone:SELECT=100 {{(pid=87934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:34:57.935952 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4bb36d-53f8-48ef-aee0-740f313ae463 None admin] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:34:57.981666 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2b13ac-6a0e-48b9-a5cb-c61ddef806f2 None None] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:34:58.020483 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b45fdbe-95e4-4e8c-90c5-07fbf2036820 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:34:58.021545 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b45fdbe-95e4-4e8c-90c5-07fbf2036820 None admin] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:34:58.021545 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b45fdbe-95e4-4e8c-90c5-07fbf2036820 None admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:34:58.021732 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b45fdbe-95e4-4e8c-90c5-07fbf2036820 None admin] PATH_INFO: `/v3/roles` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:34:58.022261 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b45fdbe-95e4-4e8c-90c5-07fbf2036820 None admin] RBAC: Adding query filter params (name=member) {{(pid=87934) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:34:58.022566 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b45fdbe-95e4-4e8c-90c5-07fbf2036820 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:34:58.024192 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b45fdbe-95e4-4e8c-90c5-07fbf2036820 None admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:34:58.033225 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 38/71] 10.222.0.25 () {56 vars in 1101 bytes} [Tue Sep 13 19:34:57 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 19:34:58.034617 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12095abe-952c-43ff-a564-5d245ece3511 None None] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:34:58.034904 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12095abe-952c-43ff-a564-5d245ece3511 None None] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:34:58.035179 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12095abe-952c-43ff-a564-5d245ece3511 None None] PATH_INFO: `/` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:34:58.036663 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 39/72] 10.222.0.25 () {54 vars in 927 bytes} [Tue Sep 13 19:34:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:34:58.037523 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12095abe-952c-43ff-a564-5d245ece3511 None None] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:34:58.058377 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4bb36d-53f8-48ef-aee0-740f313ae463 None admin] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:34:58.095294 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45de6e40-a10e-4bc9-9fa0-136aca240271 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:34:58.097431 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45de6e40-a10e-4bc9-9fa0-136aca240271 None admin] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:34:58.098272 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45de6e40-a10e-4bc9-9fa0-136aca240271 None admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:34:58.098747 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45de6e40-a10e-4bc9-9fa0-136aca240271 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:34:58.110597 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG dbcounter [-] [87934] Writing DB stats keystone:SELECT=100 {{(pid=87934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:34:58.112592 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45de6e40-a10e-4bc9-9fa0-136aca240271 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 19:34:58.119900 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application [None req-45de6e40-a10e-4bc9-9fa0-136aca240271 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 13 19:34:58.119900 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:34:58.119900 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:34:58.119900 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:34:58.119900 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:34:58.119900 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:34:58.119900 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:34:58.119900 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:34:58.119900 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:34:58.119900 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:34:58.119900 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:34:58.119900 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:34:58.119900 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 19:34:58.119900 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 19:34:58.119900 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 19:34:58.119900 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 19:34:58.120890 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 19:34:58.120890 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 19:34:58.120890 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 19:34:58.120890 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 19:34:58.120890 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:34:58.120890 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:34:58.120890 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:34:58.120890 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:34:58.120890 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:34:58.120890 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:34:58.120890 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:34:58.120890 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application with Lock( Sep 13 19:34:58.120890 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:34:58.120890 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:34:58.120890 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:34:58.120890 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:34:58.121643 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:34:58.121643 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:34:58.121643 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:34:58.121643 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:34:58.121643 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 19:34:58.121643 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 19:34:58.121643 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 19:34:58.121643 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 19:34:58.121643 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 19:34:58.121643 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 19:34:58.121643 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 13 19:34:58.121643 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application Sep 13 19:34:58.122247 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 34/73] 10.222.0.25 () {56 vars in 1114 bytes} [Tue Sep 13 19:34:57 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:34:58.122829 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45de6e40-a10e-4bc9-9fa0-136aca240271 None admin] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:34:58.143543 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG dbcounter [-] [87935] Writing DB stats keystone:SELECT=100 {{(pid=87935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:34:58.151637 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12095abe-952c-43ff-a564-5d245ece3511 None None] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:34:58.199084 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2c0802-19e7-4e1f-91eb-16b39a6ed4ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:34:58.199722 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2c0802-19e7-4e1f-91eb-16b39a6ed4ee None admin] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:34:58.200004 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2c0802-19e7-4e1f-91eb-16b39a6ed4ee None admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:34:58.200316 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2c0802-19e7-4e1f-91eb-16b39a6ed4ee None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:34:58.212458 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd2c0802-19e7-4e1f-91eb-16b39a6ed4ee None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 19:34:58.218467 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application [None req-dd2c0802-19e7-4e1f-91eb-16b39a6ed4ee None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 19:34:58.218467 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:34:58.218467 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:34:58.218467 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:34:58.218467 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:34:58.218467 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:34:58.218467 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:34:58.218467 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:34:58.218467 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:34:58.218467 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:34:58.218467 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:34:58.218467 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:34:58.218467 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 19:34:58.218467 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 19:34:58.218467 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 19:34:58.218467 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 19:34:58.219356 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 19:34:58.219356 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 19:34:58.219356 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 19:34:58.219356 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 19:34:58.219356 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:34:58.219356 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:34:58.219356 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:34:58.219356 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:34:58.219356 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:34:58.219356 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:34:58.219356 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:34:58.219356 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application with Lock( Sep 13 19:34:58.219356 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:34:58.219356 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:34:58.219356 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:34:58.219356 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:34:58.220107 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:34:58.220107 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:34:58.220107 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:34:58.220107 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:34:58.220107 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 19:34:58.220107 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 19:34:58.220107 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 19:34:58.220107 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 19:34:58.220107 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 19:34:58.220107 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 19:34:58.220107 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 19:34:58.220107 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application Sep 13 19:34:58.220107 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 40/74] 10.222.0.25 () {56 vars in 1096 bytes} [Tue Sep 13 19:34:58 2022] GET /identity/v3/roles/admin => generated 83 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:34:58.220793 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5928897d-f068-4f98-adef-fe3e27d8e95f None None] REQUEST_METHOD: `POST` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:34:58.221044 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5928897d-f068-4f98-adef-fe3e27d8e95f None None] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:34:58.221287 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5928897d-f068-4f98-adef-fe3e27d8e95f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:34:58.239819 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.auth.core [None req-5928897d-f068-4f98-adef-fe3e27d8e95f None None] MFA Rules not processed for user `7b0aed92d02344acb92a0e4aa67c3068`. Rule list: `[]` (Enabled: `True`). {{(pid=87934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:34:58.241052 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.fernet_utils [None req-5928897d-f068-4f98-adef-fe3e27d8e95f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:34:58.249073 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45de6e40-a10e-4bc9-9fa0-136aca240271 None admin] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:34:58.286590 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe34ba8-a3d0-4b7f-9a3b-250966b9aeed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:34:58.287130 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe34ba8-a3d0-4b7f-9a3b-250966b9aeed None admin] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:34:58.287406 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe34ba8-a3d0-4b7f-9a3b-250966b9aeed None admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:34:58.287675 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe34ba8-a3d0-4b7f-9a3b-250966b9aeed None admin] PATH_INFO: `/v3/users/d2e76fe7aad644f59888b9590b97c20c` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:34:58.301515 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe34ba8-a3d0-4b7f-9a3b-250966b9aeed None admin] RBAC: Authorizing `identity:get_user(user_id=d2e76fe7aad644f59888b9590b97c20c)` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:34:58.302989 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe34ba8-a3d0-4b7f-9a3b-250966b9aeed None admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:34:58.305160 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 35/75] 10.222.0.25 () {56 vars in 1177 bytes} [Tue Sep 13 19:34:58 2022] GET /identity/v3/users/d2e76fe7aad644f59888b9590b97c20c => generated 275 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:34:58.305936 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe34ba8-a3d0-4b7f-9a3b-250966b9aeed None admin] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:34:58.313494 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 41/76] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Sep 13 19:34:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 19:34:58.313494 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5928897d-f068-4f98-adef-fe3e27d8e95f None None] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:34:58.375181 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG dbcounter [-] [87934] Writing DB stats keystone:SELECT=100 {{(pid=87934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:34:58.380280 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG dbcounter [-] [87935] Writing DB stats keystone:SELECT=100 {{(pid=87935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:34:58.413018 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe34ba8-a3d0-4b7f-9a3b-250966b9aeed None admin] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:34:58.427392 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5928897d-f068-4f98-adef-fe3e27d8e95f None None] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:34:58.450908 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153f6d3d-364a-4275-bafa-6331b2842fb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:34:58.451520 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153f6d3d-364a-4275-bafa-6331b2842fb5 None admin] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:34:58.451805 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153f6d3d-364a-4275-bafa-6331b2842fb5 None admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:34:58.452090 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153f6d3d-364a-4275-bafa-6331b2842fb5 None admin] PATH_INFO: `/v3/roles` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:34:58.452803 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-153f6d3d-364a-4275-bafa-6331b2842fb5 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=87935) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:34:58.453110 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-153f6d3d-364a-4275-bafa-6331b2842fb5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:34:58.454516 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-153f6d3d-364a-4275-bafa-6331b2842fb5 None admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:34:58.467506 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 36/77] 10.222.0.25 () {56 vars in 1111 bytes} [Tue Sep 13 19:34:58 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:34:58.467506 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153f6d3d-364a-4275-bafa-6331b2842fb5 None admin] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:34:58.469333 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17793a21-7935-44c6-bc2a-78b5a5d00674 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:34:58.470155 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17793a21-7935-44c6-bc2a-78b5a5d00674 None admin] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:34:58.470571 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17793a21-7935-44c6-bc2a-78b5a5d00674 None admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:34:58.470970 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17793a21-7935-44c6-bc2a-78b5a5d00674 None admin] PATH_INFO: `/v3/roles/member` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:34:58.482613 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17793a21-7935-44c6-bc2a-78b5a5d00674 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 19:34:58.487736 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application [None req-17793a21-7935-44c6-bc2a-78b5a5d00674 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 13 19:34:58.487736 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:34:58.487736 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:34:58.487736 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:34:58.487736 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:34:58.487736 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:34:58.487736 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:34:58.487736 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:34:58.487736 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:34:58.487736 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:34:58.487736 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:34:58.487736 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:34:58.487736 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 19:34:58.487736 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 19:34:58.487736 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 19:34:58.487736 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 19:34:58.488755 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 19:34:58.488755 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 19:34:58.488755 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 19:34:58.488755 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 19:34:58.488755 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:34:58.488755 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:34:58.488755 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:34:58.488755 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:34:58.488755 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:34:58.488755 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:34:58.488755 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:34:58.488755 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application with Lock( Sep 13 19:34:58.488755 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:34:58.488755 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:34:58.488755 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:34:58.488755 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:34:58.489798 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:34:58.489798 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:34:58.489798 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:34:58.489798 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:34:58.489798 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 19:34:58.489798 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 19:34:58.489798 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 19:34:58.489798 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 19:34:58.489798 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 19:34:58.489798 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 19:34:58.489798 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 13 19:34:58.489798 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application Sep 13 19:34:58.491779 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 42/78] 10.222.0.25 () {56 vars in 1099 bytes} [Tue Sep 13 19:34:58 2022] GET /identity/v3/roles/member => generated 84 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:34:58.492964 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17793a21-7935-44c6-bc2a-78b5a5d00674 None admin] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:34:58.574023 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153f6d3d-364a-4275-bafa-6331b2842fb5 None admin] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:34:58.601324 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17793a21-7935-44c6-bc2a-78b5a5d00674 None admin] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:34:58.609900 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c07338c-7f23-4a23-bbda-3a403a4de8e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:34:58.610509 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c07338c-7f23-4a23-bbda-3a403a4de8e4 None admin] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:34:58.610792 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c07338c-7f23-4a23-bbda-3a403a4de8e4 None admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:34:58.611070 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c07338c-7f23-4a23-bbda-3a403a4de8e4 None admin] PATH_INFO: `/v3/roles` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:34:58.611735 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c07338c-7f23-4a23-bbda-3a403a4de8e4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87935) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:34:58.612043 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c07338c-7f23-4a23-bbda-3a403a4de8e4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:34:58.613512 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c07338c-7f23-4a23-bbda-3a403a4de8e4 None admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:34:58.614864 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG dbcounter [-] [87935] Writing DB stats keystone:SELECT=100 {{(pid=87935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:34:58.617804 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG dbcounter [-] [87934] Writing DB stats keystone:SELECT=100 {{(pid=87934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:34:58.623074 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 37/79] 10.222.0.25 () {56 vars in 1099 bytes} [Tue Sep 13 19:34:58 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:34:58.623893 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c07338c-7f23-4a23-bbda-3a403a4de8e4 None admin] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:34:58.641392 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272bce1a-663f-4bcf-a1d9-61a3e86da5eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:34:58.642005 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272bce1a-663f-4bcf-a1d9-61a3e86da5eb None admin] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:34:58.642283 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272bce1a-663f-4bcf-a1d9-61a3e86da5eb None admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:34:58.642551 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272bce1a-663f-4bcf-a1d9-61a3e86da5eb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:34:58.711662 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-272bce1a-663f-4bcf-a1d9-61a3e86da5eb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:34:58.713165 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-272bce1a-663f-4bcf-a1d9-61a3e86da5eb None admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:34:58.730469 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c07338c-7f23-4a23-bbda-3a403a4de8e4 None admin] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:34:58.763849 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd17b1b7-9178-4c31-8bab-7d311e7402cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:34:58.764496 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd17b1b7-9178-4c31-8bab-7d311e7402cc None admin] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:34:58.764773 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd17b1b7-9178-4c31-8bab-7d311e7402cc None admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:34:58.765041 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd17b1b7-9178-4c31-8bab-7d311e7402cc None admin] PATH_INFO: `/v3/users/d2e76fe7aad644f59888b9590b97c20c` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:34:58.766196 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd17b1b7-9178-4c31-8bab-7d311e7402cc None admin] RBAC: Authorizing `identity:get_user(user_id=d2e76fe7aad644f59888b9590b97c20c)` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:34:58.767632 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd17b1b7-9178-4c31-8bab-7d311e7402cc None admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:34:58.769245 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 38/80] 10.222.0.25 () {56 vars in 1177 bytes} [Tue Sep 13 19:34:58 2022] GET /identity/v3/users/d2e76fe7aad644f59888b9590b97c20c => generated 275 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:34:58.771426 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd17b1b7-9178-4c31-8bab-7d311e7402cc None admin] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:34:58.811833 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 43/81] 10.222.0.25 () {58 vars in 1282 bytes} [Tue Sep 13 19:34:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 13 19:34:58.812708 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272bce1a-663f-4bcf-a1d9-61a3e86da5eb None admin] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:34:58.830321 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG dbcounter [-] [87934] Writing DB stats keystone:SELECT=100 {{(pid=87934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:34:58.833647 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG dbcounter [-] [87935] Writing DB stats keystone:SELECT=100 {{(pid=87935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:34:58.873434 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd17b1b7-9178-4c31-8bab-7d311e7402cc None admin] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:34:58.908094 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755c0f67-c922-4c6b-815a-11547ba61263 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:34:58.908722 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755c0f67-c922-4c6b-815a-11547ba61263 None admin] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:34:58.909001 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755c0f67-c922-4c6b-815a-11547ba61263 None admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:34:58.909269 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755c0f67-c922-4c6b-815a-11547ba61263 None admin] PATH_INFO: `/v3/roles` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:34:58.909925 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-755c0f67-c922-4c6b-815a-11547ba61263 None admin] RBAC: Adding query filter params (name=member) {{(pid=87935) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:34:58.910221 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-755c0f67-c922-4c6b-815a-11547ba61263 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:34:58.911591 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-755c0f67-c922-4c6b-815a-11547ba61263 None admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:34:58.914896 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272bce1a-663f-4bcf-a1d9-61a3e86da5eb None admin] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:34:58.919832 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 39/82] 10.222.0.25 () {56 vars in 1101 bytes} [Tue Sep 13 19:34:58 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:34:58.920669 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755c0f67-c922-4c6b-815a-11547ba61263 None admin] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:34:58.950751 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7577bb51-0cec-4348-9bc2-8fe19679e391 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:34:58.951391 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7577bb51-0cec-4348-9bc2-8fe19679e391 None admin] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:34:58.951673 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7577bb51-0cec-4348-9bc2-8fe19679e391 None admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:34:58.951952 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7577bb51-0cec-4348-9bc2-8fe19679e391 None admin] PATH_INFO: `/v3/domains/default` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:34:58.953093 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7577bb51-0cec-4348-9bc2-8fe19679e391 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:34:58.954556 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7577bb51-0cec-4348-9bc2-8fe19679e391 None admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:34:58.956123 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 44/83] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Sep 13 19:34:58 2022] GET /identity/v3/domains/default => generated 199 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:34:58.956912 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7577bb51-0cec-4348-9bc2-8fe19679e391 None admin] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:34:59.028898 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755c0f67-c922-4c6b-815a-11547ba61263 None admin] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:34:59.039889 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG dbcounter [-] [87934] Writing DB stats keystone:SELECT=100 {{(pid=87934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:34:59.055168 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG dbcounter [-] [87935] Writing DB stats keystone:SELECT=100 {{(pid=87935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:34:59.056065 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7577bb51-0cec-4348-9bc2-8fe19679e391 None admin] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:34:59.064300 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66cebd6e-8630-4f0e-a561-9a86eadce09e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:34:59.064929 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cebd6e-8630-4f0e-a561-9a86eadce09e None admin] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:34:59.065222 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cebd6e-8630-4f0e-a561-9a86eadce09e None admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:34:59.065506 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cebd6e-8630-4f0e-a561-9a86eadce09e None admin] PATH_INFO: `/v3/users/7b0aed92d02344acb92a0e4aa67c3068` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:34:59.066613 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66cebd6e-8630-4f0e-a561-9a86eadce09e None admin] RBAC: Authorizing `identity:get_user(user_id=7b0aed92d02344acb92a0e4aa67c3068)` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:34:59.068047 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66cebd6e-8630-4f0e-a561-9a86eadce09e None admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:34:59.069648 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 40/84] 10.222.0.25 () {56 vars in 1177 bytes} [Tue Sep 13 19:34:58 2022] GET /identity/v3/users/7b0aed92d02344acb92a0e4aa67c3068 => generated 247 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:34:59.074821 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66cebd6e-8630-4f0e-a561-9a86eadce09e None admin] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:34:59.093048 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c281d532-477f-4bc3-8436-334a1b0ecd4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:34:59.093628 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c281d532-477f-4bc3-8436-334a1b0ecd4d None admin] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:34:59.093914 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c281d532-477f-4bc3-8436-334a1b0ecd4d None admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:34:59.094185 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c281d532-477f-4bc3-8436-334a1b0ecd4d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:34:59.161177 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c281d532-477f-4bc3-8436-334a1b0ecd4d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:34:59.162668 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c281d532-477f-4bc3-8436-334a1b0ecd4d None admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:34:59.169428 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66cebd6e-8630-4f0e-a561-9a86eadce09e None admin] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:34:59.203065 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b1cdbf-cd44-40ee-ab6e-fc835dd1dad5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:34:59.203692 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b1cdbf-cd44-40ee-ab6e-fc835dd1dad5 None admin] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:34:59.203972 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b1cdbf-cd44-40ee-ab6e-fc835dd1dad5 None admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:34:59.204269 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b1cdbf-cd44-40ee-ab6e-fc835dd1dad5 None admin] PATH_INFO: `/v3/projects/8aefa5062b7b4e4390554359e5669a9b` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:34:59.205404 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b1cdbf-cd44-40ee-ab6e-fc835dd1dad5 None admin] RBAC: Authorizing `identity:get_project(project_id=8aefa5062b7b4e4390554359e5669a9b)` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:34:59.206834 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b1cdbf-cd44-40ee-ab6e-fc835dd1dad5 None admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:34:59.208752 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 41/85] 10.222.0.25 () {56 vars in 1186 bytes} [Tue Sep 13 19:34:59 2022] GET /identity/v3/projects/8aefa5062b7b4e4390554359e5669a9b => generated 298 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:34:59.209592 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b1cdbf-cd44-40ee-ab6e-fc835dd1dad5 None admin] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:34:59.247200 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG dbcounter [-] [87934] Writing DB stats keystone:SELECT=100 {{(pid=87934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:34:59.264942 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 45/86] 10.222.0.25 () {58 vars in 1282 bytes} [Tue Sep 13 19:34:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 13 19:34:59.270235 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c281d532-477f-4bc3-8436-334a1b0ecd4d None admin] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:34:59.272742 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG dbcounter [-] [87935] Writing DB stats keystone:SELECT=100 {{(pid=87935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:34:59.312520 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b1cdbf-cd44-40ee-ab6e-fc835dd1dad5 None admin] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:34:59.355135 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d970e5-8d3d-42f3-8cb1-c2f9ed6910c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:34:59.356119 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d970e5-8d3d-42f3-8cb1-c2f9ed6910c7 None admin] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:34:59.356666 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d970e5-8d3d-42f3-8cb1-c2f9ed6910c7 None admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:34:59.357167 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d970e5-8d3d-42f3-8cb1-c2f9ed6910c7 None admin] PATH_INFO: `/v3/users/d2e76fe7aad644f59888b9590b97c20c` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:34:59.359113 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d970e5-8d3d-42f3-8cb1-c2f9ed6910c7 None admin] RBAC: Authorizing `identity:get_user(user_id=d2e76fe7aad644f59888b9590b97c20c)` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:34:59.361924 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d970e5-8d3d-42f3-8cb1-c2f9ed6910c7 None admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:34:59.370090 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 42/87] 10.222.0.25 () {56 vars in 1177 bytes} [Tue Sep 13 19:34:59 2022] GET /identity/v3/users/d2e76fe7aad644f59888b9590b97c20c => generated 275 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:34:59.370090 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d970e5-8d3d-42f3-8cb1-c2f9ed6910c7 None admin] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:34:59.379833 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c281d532-477f-4bc3-8436-334a1b0ecd4d None admin] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:34:59.414734 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845dcd07-6734-4c76-a74f-4cc6ab170385 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:34:59.415336 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845dcd07-6734-4c76-a74f-4cc6ab170385 None admin] REQUEST_METHOD: `POST` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:34:59.415613 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845dcd07-6734-4c76-a74f-4cc6ab170385 None admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:34:59.415887 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845dcd07-6734-4c76-a74f-4cc6ab170385 None admin] PATH_INFO: `/v3/users` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:34:59.416574 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-845dcd07-6734-4c76-a74f-4cc6ab170385 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:34:59.418031 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-845dcd07-6734-4c76-a74f-4cc6ab170385 None admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:34:59.439521 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 46/88] 10.222.0.25 () {60 vars in 1132 bytes} [Tue Sep 13 19:34:59 2022] POST /identity/v3/users => generated 289 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 19:34:59.440408 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845dcd07-6734-4c76-a74f-4cc6ab170385 None admin] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:34:59.476792 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d970e5-8d3d-42f3-8cb1-c2f9ed6910c7 None admin] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:34:59.489809 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG dbcounter [-] [87934] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:34:59.511546 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG dbcounter [-] [87935] Writing DB stats keystone:SELECT=100 {{(pid=87935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:34:59.518560 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3dc0c3-6ea0-4ee4-bca4-cdd6d49987e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:34:59.519196 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3dc0c3-6ea0-4ee4-bca4-cdd6d49987e6 None admin] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:34:59.519480 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3dc0c3-6ea0-4ee4-bca4-cdd6d49987e6 None admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:34:59.519758 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3dc0c3-6ea0-4ee4-bca4-cdd6d49987e6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:34:59.567629 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845dcd07-6734-4c76-a74f-4cc6ab170385 None admin] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:34:59.601340 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e3dc0c3-6ea0-4ee4-bca4-cdd6d49987e6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:34:59.603516 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e3dc0c3-6ea0-4ee4-bca4-cdd6d49987e6 None admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:34:59.608020 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4571f24-911d-45bd-8f6f-4be678e5fc4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:34:59.608873 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4571f24-911d-45bd-8f6f-4be678e5fc4c None admin] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:34:59.609304 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4571f24-911d-45bd-8f6f-4be678e5fc4c None admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:34:59.609724 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4571f24-911d-45bd-8f6f-4be678e5fc4c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:34:59.610618 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4571f24-911d-45bd-8f6f-4be678e5fc4c None admin] RBAC: Adding query filter params (role.id=a259191f6d0e46fabd9f34536bb28747, scope.project.id=8aefa5062b7b4e4390554359e5669a9b, user.id=d2e76fe7aad644f59888b9590b97c20c) {{(pid=87934) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:34:59.610933 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4571f24-911d-45bd-8f6f-4be678e5fc4c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:34:59.612528 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4571f24-911d-45bd-8f6f-4be678e5fc4c None admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:34:59.620108 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 47/89] 10.222.0.25 () {56 vars in 1374 bytes} [Tue Sep 13 19:34:59 2022] GET /identity/v3/role_assignments?user.id=d2e76fe7aad644f59888b9590b97c20c&scope.project.id=8aefa5062b7b4e4390554359e5669a9b&role.id=a259191f6d0e46fabd9f34536bb28747 => generated 259 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:34:59.628413 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4571f24-911d-45bd-8f6f-4be678e5fc4c None admin] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:34:59.765914 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 43/90] 10.222.0.25 () {58 vars in 1282 bytes} [Tue Sep 13 19:34:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 400 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 13 19:34:59.767352 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3dc0c3-6ea0-4ee4-bca4-cdd6d49987e6 None admin] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:34:59.790495 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4571f24-911d-45bd-8f6f-4be678e5fc4c None admin] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:34:59.794837 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG dbcounter [-] [87934] Writing DB stats keystone:SELECT=100 {{(pid=87934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:34:59.824676 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG dbcounter [-] [87935] Writing DB stats keystone:SELECT=100 {{(pid=87935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:34:59.843379 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b605fcdf-d605-431e-a724-6d68ad072807 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:34:59.844031 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b605fcdf-d605-431e-a724-6d68ad072807 None admin] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:34:59.844362 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b605fcdf-d605-431e-a724-6d68ad072807 None admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:34:59.845270 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b605fcdf-d605-431e-a724-6d68ad072807 None admin] PATH_INFO: `/v3/projects/8aefa5062b7b4e4390554359e5669a9b` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:34:59.846514 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b605fcdf-d605-431e-a724-6d68ad072807 None admin] RBAC: Authorizing `identity:get_project(project_id=8aefa5062b7b4e4390554359e5669a9b)` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:34:59.847968 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b605fcdf-d605-431e-a724-6d68ad072807 None admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:34:59.850319 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 48/91] 10.222.0.25 () {56 vars in 1186 bytes} [Tue Sep 13 19:34:59 2022] GET /identity/v3/projects/8aefa5062b7b4e4390554359e5669a9b => generated 298 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:34:59.851166 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b605fcdf-d605-431e-a724-6d68ad072807 None admin] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:34:59.969639 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3dc0c3-6ea0-4ee4-bca4-cdd6d49987e6 None admin] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:35:00.043656 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d61038-b72b-419a-9091-9506187a231c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:35:00.044305 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d61038-b72b-419a-9091-9506187a231c None admin] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:35:00.044591 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d61038-b72b-419a-9091-9506187a231c None admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:35:00.044861 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d61038-b72b-419a-9091-9506187a231c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:35:00.060905 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b605fcdf-d605-431e-a724-6d68ad072807 None admin] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:35:00.103156 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd77c4e-a24e-4895-86e7-8c1f204dc517 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:35:00.103800 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd77c4e-a24e-4895-86e7-8c1f204dc517 None admin] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:35:00.104237 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd77c4e-a24e-4895-86e7-8c1f204dc517 None admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:35:00.104508 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd77c4e-a24e-4895-86e7-8c1f204dc517 None admin] PATH_INFO: `/v3/projects/8aefa5062b7b4e4390554359e5669a9b` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:35:00.105837 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd77c4e-a24e-4895-86e7-8c1f204dc517 None admin] RBAC: Authorizing `identity:get_project(project_id=8aefa5062b7b4e4390554359e5669a9b)` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:35:00.107282 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd77c4e-a24e-4895-86e7-8c1f204dc517 None admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:35:00.109112 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 49/92] 10.222.0.25 () {56 vars in 1186 bytes} [Tue Sep 13 19:34:59 2022] GET /identity/v3/projects/8aefa5062b7b4e4390554359e5669a9b => generated 298 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:35:00.110388 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd77c4e-a24e-4895-86e7-8c1f204dc517 None admin] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:35:00.179925 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d61038-b72b-419a-9091-9506187a231c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:35:00.181728 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d61038-b72b-419a-9091-9506187a231c None admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:35:00.184575 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG dbcounter [-] [87934] Writing DB stats keystone:SELECT=100 {{(pid=87934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:35:00.228923 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG dbcounter [-] [87935] Writing DB stats keystone:SELECT=100 {{(pid=87935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:35:00.296584 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd77c4e-a24e-4895-86e7-8c1f204dc517 None admin] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:35:00.316850 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 44/93] 10.222.0.25 () {58 vars in 1282 bytes} [Tue Sep 13 19:34:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 550 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 13 19:35:00.317714 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d61038-b72b-419a-9091-9506187a231c None admin] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:35:00.341587 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b55559-fbf9-4d9e-a17e-4b8dbf74c659 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:35:00.342198 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b55559-fbf9-4d9e-a17e-4b8dbf74c659 None admin] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:35:00.342479 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b55559-fbf9-4d9e-a17e-4b8dbf74c659 None admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:35:00.342853 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b55559-fbf9-4d9e-a17e-4b8dbf74c659 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:35:00.343588 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b55559-fbf9-4d9e-a17e-4b8dbf74c659 None admin] RBAC: Adding query filter params (role.id=8af3d83a03144ae8bacdb82d9a108110, scope.project.id=8aefa5062b7b4e4390554359e5669a9b, user.id=d2e76fe7aad644f59888b9590b97c20c) {{(pid=87934) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:35:00.343896 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b55559-fbf9-4d9e-a17e-4b8dbf74c659 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:35:00.345520 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b55559-fbf9-4d9e-a17e-4b8dbf74c659 None admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:35:00.351461 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 50/94] 10.222.0.25 () {56 vars in 1374 bytes} [Tue Sep 13 19:35:00 2022] GET /identity/v3/role_assignments?user.id=d2e76fe7aad644f59888b9590b97c20c&scope.project.id=8aefa5062b7b4e4390554359e5669a9b&role.id=8af3d83a03144ae8bacdb82d9a108110 => generated 259 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:35:00.352526 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b55559-fbf9-4d9e-a17e-4b8dbf74c659 None admin] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:35:00.494193 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b55559-fbf9-4d9e-a17e-4b8dbf74c659 None admin] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:35:00.508828 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d61038-b72b-419a-9091-9506187a231c None admin] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:35:00.512662 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG dbcounter [-] [87934] Writing DB stats keystone:SELECT=100 {{(pid=87934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:35:00.536814 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50bec410-d788-4027-893b-ec4beb56ac50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:35:00.537488 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50bec410-d788-4027-893b-ec4beb56ac50 None admin] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:35:00.537775 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50bec410-d788-4027-893b-ec4beb56ac50 None admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:35:00.538057 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50bec410-d788-4027-893b-ec4beb56ac50 None admin] PATH_INFO: `/v3/projects/345a09ee00cc4ce39a05041a4cb5e591` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:35:00.539568 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50bec410-d788-4027-893b-ec4beb56ac50 None admin] RBAC: Authorizing `identity:get_project(project_id=345a09ee00cc4ce39a05041a4cb5e591)` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:35:00.541118 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50bec410-d788-4027-893b-ec4beb56ac50 None admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:35:00.542879 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 51/95] 10.222.0.25 () {56 vars in 1186 bytes} [Tue Sep 13 19:35:00 2022] GET /identity/v3/projects/345a09ee00cc4ce39a05041a4cb5e591 => generated 312 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:35:00.549595 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50bec410-d788-4027-893b-ec4beb56ac50 None admin] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:35:00.566050 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG dbcounter [-] [87935] Writing DB stats keystone:SELECT=100 {{(pid=87935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:35:00.576979 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e347f7fc-b588-44c7-ac01-085c33ae4cab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:35:00.577663 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e347f7fc-b588-44c7-ac01-085c33ae4cab None admin] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:35:00.577971 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e347f7fc-b588-44c7-ac01-085c33ae4cab None admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:35:00.578245 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e347f7fc-b588-44c7-ac01-085c33ae4cab None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:35:00.579047 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e347f7fc-b588-44c7-ac01-085c33ae4cab None admin] RBAC: Adding query filter params (role.id=6ca1d4427ff64e0a9d25d96cfb1445f6, scope.project.id=8aefa5062b7b4e4390554359e5669a9b, user.id=7b0aed92d02344acb92a0e4aa67c3068) {{(pid=87935) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:35:00.579384 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e347f7fc-b588-44c7-ac01-085c33ae4cab None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:35:00.580944 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e347f7fc-b588-44c7-ac01-085c33ae4cab None admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:35:00.603892 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 45/96] 10.222.0.25 () {56 vars in 1374 bytes} [Tue Sep 13 19:35:00 2022] GET /identity/v3/role_assignments?user.id=7b0aed92d02344acb92a0e4aa67c3068&scope.project.id=8aefa5062b7b4e4390554359e5669a9b&role.id=6ca1d4427ff64e0a9d25d96cfb1445f6 => generated 259 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:35:00.732846 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50bec410-d788-4027-893b-ec4beb56ac50 None admin] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:35:00.782832 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86a61de-1ecc-40b7-a48e-9611f2c79fae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:35:00.783367 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86a61de-1ecc-40b7-a48e-9611f2c79fae None admin] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:35:00.783650 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86a61de-1ecc-40b7-a48e-9611f2c79fae None admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:35:00.783929 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86a61de-1ecc-40b7-a48e-9611f2c79fae None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:35:00.784694 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f86a61de-1ecc-40b7-a48e-9611f2c79fae None admin] RBAC: Adding query filter params (role.id=a259191f6d0e46fabd9f34536bb28747, scope.project.id=345a09ee00cc4ce39a05041a4cb5e591, user.id=d2e76fe7aad644f59888b9590b97c20c) {{(pid=87934) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:35:00.785008 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f86a61de-1ecc-40b7-a48e-9611f2c79fae None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:35:00.786477 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f86a61de-1ecc-40b7-a48e-9611f2c79fae None admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:35:00.796926 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 52/97] 10.222.0.25 () {56 vars in 1374 bytes} [Tue Sep 13 19:35:00 2022] GET /identity/v3/role_assignments?user.id=d2e76fe7aad644f59888b9590b97c20c&scope.project.id=345a09ee00cc4ce39a05041a4cb5e591&role.id=a259191f6d0e46fabd9f34536bb28747 => generated 259 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 19:35:03.001556 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff96a4c0-d57d-4d30-aac2-dbd45d71201d None None] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:35:03.002066 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff96a4c0-d57d-4d30-aac2-dbd45d71201d None None] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:35:03.002138 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff96a4c0-d57d-4d30-aac2-dbd45d71201d None None] PATH_INFO: `/` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:35:03.003462 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 46/98] 10.222.0.25 () {54 vars in 927 bytes} [Tue Sep 13 19:35:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:35:03.009987 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e6e55a-dbb7-4bd5-a921-bbe1ad528d6e None None] REQUEST_METHOD: `POST` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:35:03.010412 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e6e55a-dbb7-4bd5-a921-bbe1ad528d6e None None] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:35:03.010586 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e6e55a-dbb7-4bd5-a921-bbe1ad528d6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:35:03.028855 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4be2bf-d3dc-4989-8163-365e8ca46cfb None None] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:35:03.029160 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4be2bf-d3dc-4989-8163-365e8ca46cfb None None] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:35:03.029500 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4be2bf-d3dc-4989-8163-365e8ca46cfb None None] PATH_INFO: `/` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:35:03.031278 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 47/99] 10.222.0.25 () {54 vars in 927 bytes} [Tue Sep 13 19:35:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 13 19:35:03.036532 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da69c08-a828-4e88-a394-83e5eb6bee40 None None] REQUEST_METHOD: `POST` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:35:03.037074 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da69c08-a828-4e88-a394-83e5eb6bee40 None None] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:35:03.037556 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da69c08-a828-4e88-a394-83e5eb6bee40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:35:03.044341 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.auth.core [None req-56e6e55a-dbb7-4bd5-a921-bbe1ad528d6e None None] MFA Rules not processed for user `7b0aed92d02344acb92a0e4aa67c3068`. Rule list: `[]` (Enabled: `True`). {{(pid=87934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:35:03.045545 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.fernet_utils [None req-56e6e55a-dbb7-4bd5-a921-bbe1ad528d6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:35:03.073628 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.auth.core [None req-3da69c08-a828-4e88-a394-83e5eb6bee40 None None] MFA Rules not processed for user `7b0aed92d02344acb92a0e4aa67c3068`. Rule list: `[]` (Enabled: `True`). {{(pid=87935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:35:03.075733 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.fernet_utils [None req-3da69c08-a828-4e88-a394-83e5eb6bee40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:35:03.098231 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG dbcounter [-] [87934] Writing DB stats keystone:SELECT=100 {{(pid=87934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:35:03.168706 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 53/100] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Sep 13 19:35:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 19:35:03.175208 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511368c9-7325-4e3e-b8cf-df9a501bb8f5 None None] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:35:03.176474 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511368c9-7325-4e3e-b8cf-df9a501bb8f5 None None] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:35:03.177124 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511368c9-7325-4e3e-b8cf-df9a501bb8f5 None None] PATH_INFO: `/` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:35:03.180176 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 54/101] 10.222.0.25 () {54 vars in 927 bytes} [Tue Sep 13 19:35:03 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:35:03.186501 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be18574c-ac37-4744-bc6d-e2d35a1307ad None None] REQUEST_METHOD: `POST` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:35:03.187652 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be18574c-ac37-4744-bc6d-e2d35a1307ad None None] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:35:03.188312 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be18574c-ac37-4744-bc6d-e2d35a1307ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:35:03.200321 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 48/102] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Sep 13 19:35:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 19:35:03.216526 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.auth.core [None req-be18574c-ac37-4744-bc6d-e2d35a1307ad None None] MFA Rules not processed for user `7b0aed92d02344acb92a0e4aa67c3068`. Rule list: `[]` (Enabled: `True`). {{(pid=87934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:35:03.218076 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.fernet_utils [None req-be18574c-ac37-4744-bc6d-e2d35a1307ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:35:03.322678 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 55/103] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Sep 13 19:35:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 19:35:03.573559 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a6950f-f80d-412c-8e16-118dcc0caffb None None] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:35:03.574219 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a6950f-f80d-412c-8e16-118dcc0caffb None None] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:35:03.574695 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a6950f-f80d-412c-8e16-118dcc0caffb None None] PATH_INFO: `/` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:35:03.576723 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 49/104] 10.222.0.25 () {54 vars in 927 bytes} [Tue Sep 13 19:35:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:35:03.581835 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339fafbe-de29-4467-9e5a-6cc96b1c8a8f None None] REQUEST_METHOD: `POST` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:35:03.582629 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339fafbe-de29-4467-9e5a-6cc96b1c8a8f None None] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:35:03.583093 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339fafbe-de29-4467-9e5a-6cc96b1c8a8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:35:03.608315 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a6950f-f80d-412c-8e16-118dcc0caffb None None] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:35:03.619166 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.auth.core [None req-339fafbe-de29-4467-9e5a-6cc96b1c8a8f None None] MFA Rules not processed for user `7b0aed92d02344acb92a0e4aa67c3068`. Rule list: `[]` (Enabled: `True`). {{(pid=87934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:35:03.622384 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.fernet_utils [None req-339fafbe-de29-4467-9e5a-6cc96b1c8a8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:35:03.752473 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 56/105] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Sep 13 19:35:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 19:35:03.753692 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339fafbe-de29-4467-9e5a-6cc96b1c8a8f None None] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:35:03.789237 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG dbcounter [-] [87934] Writing DB stats keystone:SELECT=100 {{(pid=87934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:35:03.852865 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a6950f-f80d-412c-8e16-118dcc0caffb None None] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:35:03.870847 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339fafbe-de29-4467-9e5a-6cc96b1c8a8f None None] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:35:03.922265 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36377881-08e0-4f8a-8917-f29af0280665 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:35:03.923316 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36377881-08e0-4f8a-8917-f29af0280665 None admin] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:35:03.923820 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36377881-08e0-4f8a-8917-f29af0280665 None admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:35:03.924331 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36377881-08e0-4f8a-8917-f29af0280665 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:35:03.934619 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG dbcounter [-] [87935] Writing DB stats keystone:SELECT=100 {{(pid=87935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:35:03.947897 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36377881-08e0-4f8a-8917-f29af0280665 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 19:35:03.955462 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application [None req-36377881-08e0-4f8a-8917-f29af0280665 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 13 19:35:03.955462 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:35:03.955462 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:35:03.955462 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:35:03.955462 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:35:03.955462 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:35:03.955462 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:35:03.955462 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:35:03.955462 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:35:03.955462 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:35:03.955462 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:35:03.955462 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:35:03.955462 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 19:35:03.955462 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 19:35:03.955462 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 19:35:03.955462 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 19:35:03.956439 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 19:35:03.956439 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 19:35:03.956439 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 19:35:03.956439 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 19:35:03.956439 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:35:03.956439 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:35:03.956439 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:35:03.956439 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:35:03.956439 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:35:03.956439 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:35:03.956439 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:35:03.956439 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application with Lock( Sep 13 19:35:03.956439 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:35:03.956439 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:35:03.956439 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:35:03.956439 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:35:03.957202 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:35:03.957202 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:35:03.957202 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:35:03.957202 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:35:03.957202 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 19:35:03.957202 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 19:35:03.957202 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 19:35:03.957202 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 19:35:03.957202 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 19:35:03.957202 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 19:35:03.957202 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 13 19:35:03.957202 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application Sep 13 19:35:03.961992 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 57/106] 10.222.0.25 () {56 vars in 1099 bytes} [Tue Sep 13 19:35:03 2022] GET /identity/v3/roles/reader => generated 84 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:35:03.964046 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36377881-08e0-4f8a-8917-f29af0280665 None admin] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:35:03.964918 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3c8112-ed1b-4102-b8b0-52627ae169b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:35:03.965822 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3c8112-ed1b-4102-b8b0-52627ae169b9 None admin] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:35:03.966285 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3c8112-ed1b-4102-b8b0-52627ae169b9 None admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:35:03.966834 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3c8112-ed1b-4102-b8b0-52627ae169b9 None admin] PATH_INFO: `/v3/domains/default` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:35:03.968557 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa3c8112-ed1b-4102-b8b0-52627ae169b9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:35:03.971499 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa3c8112-ed1b-4102-b8b0-52627ae169b9 None admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:35:03.976721 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 50/107] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Sep 13 19:35:03 2022] GET /identity/v3/domains/default => generated 199 bytes in 368 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:35:03.977923 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3c8112-ed1b-4102-b8b0-52627ae169b9 None admin] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:35:04.068490 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG dbcounter [-] [87934] Writing DB stats keystone:SELECT=100 {{(pid=87934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:35:04.083773 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36377881-08e0-4f8a-8917-f29af0280665 None admin] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:35:04.116976 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3c8112-ed1b-4102-b8b0-52627ae169b9 None admin] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:35:04.119032 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a930b7bc-5ffa-4c67-84a0-47135bc1781b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:35:04.119669 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a930b7bc-5ffa-4c67-84a0-47135bc1781b None admin] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:35:04.119950 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a930b7bc-5ffa-4c67-84a0-47135bc1781b None admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:35:04.120239 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a930b7bc-5ffa-4c67-84a0-47135bc1781b None admin] PATH_INFO: `/v3/roles/member` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:35:04.130375 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a930b7bc-5ffa-4c67-84a0-47135bc1781b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 19:35:04.135184 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application [None req-a930b7bc-5ffa-4c67-84a0-47135bc1781b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 13 19:35:04.135184 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:35:04.135184 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:35:04.135184 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:35:04.135184 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:35:04.135184 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:35:04.135184 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:35:04.135184 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:35:04.135184 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:35:04.135184 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:35:04.135184 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:35:04.135184 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:35:04.135184 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 19:35:04.135184 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 19:35:04.135184 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 19:35:04.135184 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 19:35:04.136046 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 19:35:04.136046 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 19:35:04.136046 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 19:35:04.136046 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 19:35:04.136046 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:35:04.136046 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:35:04.136046 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:35:04.136046 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:35:04.136046 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:35:04.136046 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:35:04.136046 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:35:04.136046 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application with Lock( Sep 13 19:35:04.136046 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:35:04.136046 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:35:04.136046 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:35:04.136046 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:35:04.136874 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:35:04.136874 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:35:04.136874 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:35:04.136874 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:35:04.136874 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 19:35:04.136874 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 19:35:04.136874 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 19:35:04.136874 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 19:35:04.136874 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 19:35:04.136874 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 19:35:04.136874 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 13 19:35:04.136874 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application Sep 13 19:35:04.136874 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 58/108] 10.222.0.25 () {56 vars in 1099 bytes} [Tue Sep 13 19:35:03 2022] GET /identity/v3/roles/member => generated 84 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:35:04.137662 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a930b7bc-5ffa-4c67-84a0-47135bc1781b None admin] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:35:04.153170 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce414109-b96d-4025-9549-101d02e0d2a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:35:04.153788 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce414109-b96d-4025-9549-101d02e0d2a7 None admin] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:35:04.154065 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce414109-b96d-4025-9549-101d02e0d2a7 None admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:35:04.154340 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce414109-b96d-4025-9549-101d02e0d2a7 None admin] PATH_INFO: `/v3/roles` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:35:04.155006 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce414109-b96d-4025-9549-101d02e0d2a7 None admin] RBAC: Adding query filter params (name=reader) {{(pid=87935) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:35:04.155307 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce414109-b96d-4025-9549-101d02e0d2a7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:35:04.156743 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce414109-b96d-4025-9549-101d02e0d2a7 None admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:35:04.165794 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 51/109] 10.222.0.25 () {56 vars in 1101 bytes} [Tue Sep 13 19:35:03 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:35:04.166966 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe077e83-ec28-4c0f-bb4e-9601f5881518 None None] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:35:04.167248 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe077e83-ec28-4c0f-bb4e-9601f5881518 None None] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:35:04.167681 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe077e83-ec28-4c0f-bb4e-9601f5881518 None None] PATH_INFO: `/` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:35:04.168902 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 52/110] 10.222.0.25 () {54 vars in 927 bytes} [Tue Sep 13 19:35:04 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:35:04.173762 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645b32e4-56ae-4de5-b694-a6de229f099a None None] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:35:04.174048 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645b32e4-56ae-4de5-b694-a6de229f099a None None] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:35:04.175078 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645b32e4-56ae-4de5-b694-a6de229f099a None None] PATH_INFO: `/` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:35:04.175559 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 53/111] 10.222.0.25 () {54 vars in 927 bytes} [Tue Sep 13 19:35:04 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:35:04.180857 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645b32e4-56ae-4de5-b694-a6de229f099a None None] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:35:04.238910 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG dbcounter [-] [87935] Writing DB stats keystone:SELECT=100 {{(pid=87935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:35:04.240558 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a930b7bc-5ffa-4c67-84a0-47135bc1781b None admin] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:35:04.277136 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488f3e25-ebd9-4090-bcf8-92c2706b14df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:35:04.277753 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488f3e25-ebd9-4090-bcf8-92c2706b14df None admin] REQUEST_METHOD: `POST` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:35:04.278031 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488f3e25-ebd9-4090-bcf8-92c2706b14df None admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:35:04.278305 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488f3e25-ebd9-4090-bcf8-92c2706b14df None admin] PATH_INFO: `/v3/projects` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:35:04.278962 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-488f3e25-ebd9-4090-bcf8-92c2706b14df None admin] RBAC: Authorizing `identity:create_project()` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:35:04.280438 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-488f3e25-ebd9-4090-bcf8-92c2706b14df None admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:35:04.287899 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645b32e4-56ae-4de5-b694-a6de229f099a None None] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:35:04.306499 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG dbcounter [-] [87934] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:35:04.314215 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 59/112] 10.222.0.25 () {60 vars in 1141 bytes} [Tue Sep 13 19:35:04 2022] POST /identity/v3/projects => generated 302 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 19:35:04.315403 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488f3e25-ebd9-4090-bcf8-92c2706b14df None admin] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:35:04.334027 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280b5c85-8b95-4fb4-aad8-c9ae9e81f227 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:35:04.334664 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280b5c85-8b95-4fb4-aad8-c9ae9e81f227 None admin] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:35:04.334948 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280b5c85-8b95-4fb4-aad8-c9ae9e81f227 None admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:35:04.335276 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280b5c85-8b95-4fb4-aad8-c9ae9e81f227 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:35:04.347944 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-280b5c85-8b95-4fb4-aad8-c9ae9e81f227 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 19:35:04.353567 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application [None req-280b5c85-8b95-4fb4-aad8-c9ae9e81f227 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 13 19:35:04.353567 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:35:04.353567 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:35:04.353567 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:35:04.353567 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:35:04.353567 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:35:04.353567 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:35:04.353567 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:35:04.353567 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:35:04.353567 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:35:04.353567 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:35:04.353567 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:35:04.353567 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 19:35:04.353567 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 19:35:04.353567 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 19:35:04.353567 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 19:35:04.354505 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 19:35:04.354505 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 19:35:04.354505 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 19:35:04.354505 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 19:35:04.354505 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:35:04.354505 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:35:04.354505 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:35:04.354505 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:35:04.354505 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:35:04.354505 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:35:04.354505 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:35:04.354505 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application with Lock( Sep 13 19:35:04.354505 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:35:04.354505 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:35:04.354505 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:35:04.354505 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:35:04.355270 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:35:04.355270 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:35:04.355270 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:35:04.355270 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:35:04.355270 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 19:35:04.355270 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 19:35:04.355270 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 19:35:04.355270 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 19:35:04.355270 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 19:35:04.355270 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 19:35:04.355270 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 13 19:35:04.355270 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application Sep 13 19:35:04.355270 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 54/113] 10.222.0.25 () {56 vars in 1114 bytes} [Tue Sep 13 19:35:04 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:35:04.360638 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280b5c85-8b95-4fb4-aad8-c9ae9e81f227 None admin] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:35:04.446616 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488f3e25-ebd9-4090-bcf8-92c2706b14df None admin] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:35:04.487308 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b37869b-e0b7-4e5c-bef0-5b507fe6daae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:35:04.487882 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280b5c85-8b95-4fb4-aad8-c9ae9e81f227 None admin] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:35:04.487989 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b37869b-e0b7-4e5c-bef0-5b507fe6daae None admin] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:35:04.488296 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b37869b-e0b7-4e5c-bef0-5b507fe6daae None admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:35:04.488628 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b37869b-e0b7-4e5c-bef0-5b507fe6daae None admin] PATH_INFO: `/v3/roles` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:35:04.489316 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b37869b-e0b7-4e5c-bef0-5b507fe6daae None admin] RBAC: Adding query filter params (name=member) {{(pid=87934) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:35:04.489627 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b37869b-e0b7-4e5c-bef0-5b507fe6daae None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:35:04.491054 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b37869b-e0b7-4e5c-bef0-5b507fe6daae None admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:35:04.501436 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 60/114] 10.222.0.25 () {56 vars in 1101 bytes} [Tue Sep 13 19:35:04 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:35:04.502698 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d8dc89-fa40-4c3a-9178-780e7617da7c None None] REQUEST_METHOD: `POST` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:35:04.503019 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d8dc89-fa40-4c3a-9178-780e7617da7c None None] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:35:04.503261 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d8dc89-fa40-4c3a-9178-780e7617da7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:35:04.509060 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG dbcounter [-] [87935] Writing DB stats keystone:SELECT=100 {{(pid=87935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:35:04.523268 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.auth.core [None req-19d8dc89-fa40-4c3a-9178-780e7617da7c None None] MFA Rules not processed for user `7b0aed92d02344acb92a0e4aa67c3068`. Rule list: `[]` (Enabled: `True`). {{(pid=87934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:35:04.524757 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.fernet_utils [None req-19d8dc89-fa40-4c3a-9178-780e7617da7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:35:04.535727 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3963d0b1-b6cd-43b2-b3d0-981fc4352667 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:35:04.537106 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3963d0b1-b6cd-43b2-b3d0-981fc4352667 None admin] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:35:04.537530 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3963d0b1-b6cd-43b2-b3d0-981fc4352667 None admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:35:04.537942 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3963d0b1-b6cd-43b2-b3d0-981fc4352667 None admin] PATH_INFO: `/v3/users/3e259c73a2ae4ccf98905d4334cc8d1a` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:35:04.555446 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3963d0b1-b6cd-43b2-b3d0-981fc4352667 None admin] RBAC: Authorizing `identity:get_user(user_id=3e259c73a2ae4ccf98905d4334cc8d1a)` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:35:04.557080 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3963d0b1-b6cd-43b2-b3d0-981fc4352667 None admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:35:04.558766 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 55/115] 10.222.0.25 () {56 vars in 1177 bytes} [Tue Sep 13 19:35:04 2022] GET /identity/v3/users/3e259c73a2ae4ccf98905d4334cc8d1a => generated 289 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:35:04.559956 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362be8cc-d90f-4d06-984c-d458c948a5e7 None None] REQUEST_METHOD: `POST` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:35:04.560193 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362be8cc-d90f-4d06-984c-d458c948a5e7 None None] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:35:04.560510 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362be8cc-d90f-4d06-984c-d458c948a5e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:35:04.588229 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.auth.core [None req-362be8cc-d90f-4d06-984c-d458c948a5e7 None None] MFA Rules not processed for user `7b0aed92d02344acb92a0e4aa67c3068`. Rule list: `[]` (Enabled: `True`). {{(pid=87935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:35:04.589895 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.fernet_utils [None req-362be8cc-d90f-4d06-984c-d458c948a5e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:35:04.597451 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG dbcounter [-] [87934] Writing DB stats keystone:SELECT=100 {{(pid=87934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:35:04.612113 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 61/116] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Sep 13 19:35:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 19:35:04.617168 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d8dc89-fa40-4c3a-9178-780e7617da7c None None] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:35:04.673584 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 56/117] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Sep 13 19:35:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 19:35:04.674896 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362be8cc-d90f-4d06-984c-d458c948a5e7 None None] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:35:04.725687 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d8dc89-fa40-4c3a-9178-780e7617da7c None None] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:35:04.793686 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeed81af-38c7-456f-8317-e554d2e41322 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:35:04.794309 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeed81af-38c7-456f-8317-e554d2e41322 None admin] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:35:04.794584 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeed81af-38c7-456f-8317-e554d2e41322 None admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:35:04.794849 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeed81af-38c7-456f-8317-e554d2e41322 None admin] PATH_INFO: `/v3/roles` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:35:04.795516 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeed81af-38c7-456f-8317-e554d2e41322 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=87934) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:35:04.795817 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeed81af-38c7-456f-8317-e554d2e41322 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:35:04.798103 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeed81af-38c7-456f-8317-e554d2e41322 None admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:35:04.818168 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 62/118] 10.222.0.25 () {56 vars in 1111 bytes} [Tue Sep 13 19:35:04 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:35:04.819043 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeed81af-38c7-456f-8317-e554d2e41322 None admin] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:35:04.875434 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362be8cc-d90f-4d06-984c-d458c948a5e7 None None] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:35:04.877150 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG dbcounter [-] [87935] Writing DB stats keystone:SELECT=100 {{(pid=87935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:35:04.912543 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG dbcounter [-] [87934] Writing DB stats keystone:SELECT=100 {{(pid=87934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:35:04.936314 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c6423a-c85a-4bc1-84d3-ae81e912b929 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:35:04.936958 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c6423a-c85a-4bc1-84d3-ae81e912b929 None admin] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:35:04.937232 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c6423a-c85a-4bc1-84d3-ae81e912b929 None admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:35:04.937504 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c6423a-c85a-4bc1-84d3-ae81e912b929 None admin] PATH_INFO: `/v3/users/d2e76fe7aad644f59888b9590b97c20c` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:35:04.938639 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c6423a-c85a-4bc1-84d3-ae81e912b929 None admin] RBAC: Authorizing `identity:get_user(user_id=d2e76fe7aad644f59888b9590b97c20c)` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:35:04.940093 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c6423a-c85a-4bc1-84d3-ae81e912b929 None admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:35:04.942483 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 57/119] 10.222.0.25 () {56 vars in 1177 bytes} [Tue Sep 13 19:35:04 2022] GET /identity/v3/users/d2e76fe7aad644f59888b9590b97c20c => generated 275 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:35:04.943088 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c6423a-c85a-4bc1-84d3-ae81e912b929 None admin] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:35:04.948456 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeed81af-38c7-456f-8317-e554d2e41322 None admin] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:35:05.008022 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5700aa27-cc98-4667-8c84-2ebb8439f1cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:35:05.009012 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5700aa27-cc98-4667-8c84-2ebb8439f1cd None admin] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:35:05.009522 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5700aa27-cc98-4667-8c84-2ebb8439f1cd None admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:35:05.010018 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5700aa27-cc98-4667-8c84-2ebb8439f1cd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:35:05.082784 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c6423a-c85a-4bc1-84d3-ae81e912b929 None admin] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:35:05.090589 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5700aa27-cc98-4667-8c84-2ebb8439f1cd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:35:05.092082 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5700aa27-cc98-4667-8c84-2ebb8439f1cd None admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:35:05.122122 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf89854-c2a6-43c7-9732-8867f40e7cfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:35:05.122797 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf89854-c2a6-43c7-9732-8867f40e7cfc None admin] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:35:05.123042 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf89854-c2a6-43c7-9732-8867f40e7cfc None admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:35:05.123312 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf89854-c2a6-43c7-9732-8867f40e7cfc None admin] PATH_INFO: `/v3/users/d2e76fe7aad644f59888b9590b97c20c` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:35:05.124480 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf89854-c2a6-43c7-9732-8867f40e7cfc None admin] RBAC: Authorizing `identity:get_user(user_id=d2e76fe7aad644f59888b9590b97c20c)` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:35:05.125995 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf89854-c2a6-43c7-9732-8867f40e7cfc None admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:35:05.127732 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 58/120] 10.222.0.25 () {56 vars in 1177 bytes} [Tue Sep 13 19:35:04 2022] GET /identity/v3/users/d2e76fe7aad644f59888b9590b97c20c => generated 275 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:35:05.128447 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf89854-c2a6-43c7-9732-8867f40e7cfc None admin] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:35:05.168841 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG dbcounter [-] [87934] Writing DB stats keystone:SELECT=100 {{(pid=87934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:35:05.174952 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG dbcounter [-] [87935] Writing DB stats keystone:SELECT=100 {{(pid=87935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:35:05.234213 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 63/121] 10.222.0.25 () {58 vars in 1282 bytes} [Tue Sep 13 19:35:04 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 411 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 13 19:35:05.234213 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5700aa27-cc98-4667-8c84-2ebb8439f1cd None admin] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:35:05.243577 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf89854-c2a6-43c7-9732-8867f40e7cfc None admin] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:35:05.286573 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754e88a6-8460-4450-8c1c-67b371e8f966 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:35:05.287486 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754e88a6-8460-4450-8c1c-67b371e8f966 None admin] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:35:05.287767 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754e88a6-8460-4450-8c1c-67b371e8f966 None admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:35:05.288030 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754e88a6-8460-4450-8c1c-67b371e8f966 None admin] PATH_INFO: `/v3/projects/8aefa5062b7b4e4390554359e5669a9b` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:35:05.289692 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-754e88a6-8460-4450-8c1c-67b371e8f966 None admin] RBAC: Authorizing `identity:get_project(project_id=8aefa5062b7b4e4390554359e5669a9b)` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:35:05.291010 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-754e88a6-8460-4450-8c1c-67b371e8f966 None admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:35:05.292714 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 59/122] 10.222.0.25 () {56 vars in 1186 bytes} [Tue Sep 13 19:35:05 2022] GET /identity/v3/projects/8aefa5062b7b4e4390554359e5669a9b => generated 298 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:35:05.293496 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754e88a6-8460-4450-8c1c-67b371e8f966 None admin] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:35:05.360834 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5700aa27-cc98-4667-8c84-2ebb8439f1cd None admin] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:35:05.400440 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc81126a-fe6a-4dcd-9986-76b4f37b1def None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:35:05.401072 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc81126a-fe6a-4dcd-9986-76b4f37b1def None admin] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:35:05.401352 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc81126a-fe6a-4dcd-9986-76b4f37b1def None admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:35:05.401622 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc81126a-fe6a-4dcd-9986-76b4f37b1def None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:35:05.408911 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754e88a6-8460-4450-8c1c-67b371e8f966 None admin] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:35:05.412642 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc81126a-fe6a-4dcd-9986-76b4f37b1def None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 19:35:05.417973 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG dbcounter [-] [87935] Writing DB stats keystone:SELECT=100 {{(pid=87935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:35:05.418656 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application [None req-cc81126a-fe6a-4dcd-9986-76b4f37b1def None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 19:35:05.418656 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:35:05.418656 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:35:05.418656 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:35:05.418656 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:35:05.418656 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:35:05.418656 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:35:05.418656 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:35:05.418656 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:35:05.418656 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:35:05.418656 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:35:05.418656 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:35:05.418656 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 19:35:05.418656 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 19:35:05.418656 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 19:35:05.418656 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 19:35:05.419567 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 19:35:05.419567 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 19:35:05.419567 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 19:35:05.419567 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 19:35:05.419567 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:35:05.419567 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:35:05.419567 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:35:05.419567 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:35:05.419567 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:35:05.419567 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:35:05.419567 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:35:05.419567 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application with Lock( Sep 13 19:35:05.419567 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:35:05.419567 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:35:05.419567 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:35:05.419567 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:35:05.420439 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:35:05.420439 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:35:05.420439 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:35:05.420439 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:35:05.420439 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 19:35:05.420439 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 19:35:05.420439 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 19:35:05.420439 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 19:35:05.420439 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 19:35:05.420439 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 19:35:05.420439 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 19:35:05.420439 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application Sep 13 19:35:05.420439 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 64/123] 10.222.0.25 () {56 vars in 1096 bytes} [Tue Sep 13 19:35:05 2022] GET /identity/v3/roles/admin => generated 83 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:35:05.421264 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc81126a-fe6a-4dcd-9986-76b4f37b1def None admin] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:35:05.437951 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG dbcounter [-] [87934] Writing DB stats keystone:SELECT=100 {{(pid=87934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:35:05.461698 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b5f358-6d4f-4eda-9b2c-9d53ee3d7521 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:35:05.462351 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b5f358-6d4f-4eda-9b2c-9d53ee3d7521 None admin] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:35:05.462628 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b5f358-6d4f-4eda-9b2c-9d53ee3d7521 None admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:35:05.462902 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b5f358-6d4f-4eda-9b2c-9d53ee3d7521 None admin] PATH_INFO: `/v3/roles/member` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:35:05.474024 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b5f358-6d4f-4eda-9b2c-9d53ee3d7521 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 19:35:05.479429 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application [None req-51b5f358-6d4f-4eda-9b2c-9d53ee3d7521 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 13 19:35:05.479429 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:35:05.479429 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:35:05.479429 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:35:05.479429 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:35:05.479429 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:35:05.479429 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:35:05.479429 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:35:05.479429 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:35:05.479429 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:35:05.479429 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:35:05.479429 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:35:05.479429 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 19:35:05.479429 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 19:35:05.479429 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 19:35:05.479429 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 19:35:05.480346 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 19:35:05.480346 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 19:35:05.480346 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 19:35:05.480346 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 19:35:05.480346 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:35:05.480346 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:35:05.480346 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:35:05.480346 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:35:05.480346 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:35:05.480346 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:35:05.480346 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:35:05.480346 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application with Lock( Sep 13 19:35:05.480346 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:35:05.480346 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:35:05.480346 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:35:05.480346 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:35:05.481126 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:35:05.481126 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:35:05.481126 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:35:05.481126 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:35:05.481126 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 19:35:05.481126 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 19:35:05.481126 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 19:35:05.481126 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 19:35:05.481126 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 19:35:05.481126 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 19:35:05.481126 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 13 19:35:05.481126 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application Sep 13 19:35:05.481126 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 60/124] 10.222.0.25 () {56 vars in 1099 bytes} [Tue Sep 13 19:35:05 2022] GET /identity/v3/roles/member => generated 84 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:35:05.481790 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b5f358-6d4f-4eda-9b2c-9d53ee3d7521 None admin] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:35:05.551524 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc81126a-fe6a-4dcd-9986-76b4f37b1def None admin] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:35:05.590214 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e598b74-52ff-461e-8023-5d4d3d487c28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:35:05.590886 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e598b74-52ff-461e-8023-5d4d3d487c28 None admin] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:35:05.591238 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e598b74-52ff-461e-8023-5d4d3d487c28 None admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:35:05.591443 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e598b74-52ff-461e-8023-5d4d3d487c28 None admin] PATH_INFO: `/v3/projects/8aefa5062b7b4e4390554359e5669a9b` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:35:05.592630 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e598b74-52ff-461e-8023-5d4d3d487c28 None admin] RBAC: Authorizing `identity:get_project(project_id=8aefa5062b7b4e4390554359e5669a9b)` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:35:05.594116 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e598b74-52ff-461e-8023-5d4d3d487c28 None admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:35:05.595890 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 65/125] 10.222.0.25 () {56 vars in 1186 bytes} [Tue Sep 13 19:35:05 2022] GET /identity/v3/projects/8aefa5062b7b4e4390554359e5669a9b => generated 298 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:35:05.596551 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e598b74-52ff-461e-8023-5d4d3d487c28 None admin] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:35:05.614448 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b5f358-6d4f-4eda-9b2c-9d53ee3d7521 None admin] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:35:05.651129 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48e1099-9ebd-4971-8181-e646f4c954ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:35:05.651774 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48e1099-9ebd-4971-8181-e646f4c954ac None admin] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:35:05.652050 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48e1099-9ebd-4971-8181-e646f4c954ac None admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:35:05.652341 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48e1099-9ebd-4971-8181-e646f4c954ac None admin] PATH_INFO: `/v3/projects/8aefa5062b7b4e4390554359e5669a9b` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:35:05.653570 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a48e1099-9ebd-4971-8181-e646f4c954ac None admin] RBAC: Authorizing `identity:get_project(project_id=8aefa5062b7b4e4390554359e5669a9b)` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:35:05.655022 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a48e1099-9ebd-4971-8181-e646f4c954ac None admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:35:05.657164 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 61/126] 10.222.0.25 () {56 vars in 1186 bytes} [Tue Sep 13 19:35:05 2022] GET /identity/v3/projects/8aefa5062b7b4e4390554359e5669a9b => generated 298 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:35:05.657791 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48e1099-9ebd-4971-8181-e646f4c954ac None admin] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:35:05.683427 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG dbcounter [-] [87934] Writing DB stats keystone:SELECT=100 {{(pid=87934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:35:05.695555 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG dbcounter [-] [87935] Writing DB stats keystone:SELECT=100 {{(pid=87935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:35:05.706234 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e598b74-52ff-461e-8023-5d4d3d487c28 None admin] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:35:05.745357 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b470f83e-985d-4724-84aa-800a8a954ba0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:35:05.746027 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b470f83e-985d-4724-84aa-800a8a954ba0 None admin] REQUEST_METHOD: `PUT` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:35:05.746311 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b470f83e-985d-4724-84aa-800a8a954ba0 None admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:35:05.746593 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b470f83e-985d-4724-84aa-800a8a954ba0 None admin] PATH_INFO: `/v3/projects/8aefa5062b7b4e4390554359e5669a9b/users/d2e76fe7aad644f59888b9590b97c20c/roles/a259191f6d0e46fabd9f34536bb28747` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:35:05.748542 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b470f83e-985d-4724-84aa-800a8a954ba0 None admin] RBAC: Authorizing `identity:create_grant(project_id=8aefa5062b7b4e4390554359e5669a9b, user_id=d2e76fe7aad644f59888b9590b97c20c, role_id=a259191f6d0e46fabd9f34536bb28747)` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:35:05.750012 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b470f83e-985d-4724-84aa-800a8a954ba0 None admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:35:05.763325 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 66/127] 10.222.0.25 () {58 vars in 1439 bytes} [Tue Sep 13 19:35:05 2022] PUT /identity/v3/projects/8aefa5062b7b4e4390554359e5669a9b/users/d2e76fe7aad644f59888b9590b97c20c/roles/a259191f6d0e46fabd9f34536bb28747 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 19:35:05.764157 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b470f83e-985d-4724-84aa-800a8a954ba0 None admin] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:35:05.778286 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48e1099-9ebd-4971-8181-e646f4c954ac None admin] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:35:05.822724 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ac8329-b573-47b8-949d-7be324cf2296 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:35:05.823021 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ac8329-b573-47b8-949d-7be324cf2296 None admin] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:35:05.823121 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ac8329-b573-47b8-949d-7be324cf2296 None admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:35:05.823458 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ac8329-b573-47b8-949d-7be324cf2296 None admin] PATH_INFO: `/v3/roles` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:35:05.824328 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ac8329-b573-47b8-949d-7be324cf2296 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87935) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:35:05.824644 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ac8329-b573-47b8-949d-7be324cf2296 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:35:05.826373 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ac8329-b573-47b8-949d-7be324cf2296 None admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:35:05.836329 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 62/128] 10.222.0.25 () {56 vars in 1099 bytes} [Tue Sep 13 19:35:05 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:35:05.842163 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ac8329-b573-47b8-949d-7be324cf2296 None admin] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:35:05.903174 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b470f83e-985d-4724-84aa-800a8a954ba0 None admin] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:35:05.950444 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b0faaf-1d28-4092-91e7-3ed1769ae5af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:35:05.951355 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b0faaf-1d28-4092-91e7-3ed1769ae5af None admin] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:35:05.951774 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b0faaf-1d28-4092-91e7-3ed1769ae5af None admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:35:05.952806 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b0faaf-1d28-4092-91e7-3ed1769ae5af None admin] PATH_INFO: `/v3/roles` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:35:05.953623 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b0faaf-1d28-4092-91e7-3ed1769ae5af None admin] RBAC: Adding query filter params (name=member) {{(pid=87934) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:35:05.954065 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b0faaf-1d28-4092-91e7-3ed1769ae5af None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:35:05.956536 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b0faaf-1d28-4092-91e7-3ed1769ae5af None admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:35:05.968645 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 67/129] 10.222.0.25 () {56 vars in 1101 bytes} [Tue Sep 13 19:35:05 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:35:05.969973 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b0faaf-1d28-4092-91e7-3ed1769ae5af None admin] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:35:05.974049 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG dbcounter [-] [87934] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:35:05.978957 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG dbcounter [-] [87935] Writing DB stats keystone:SELECT=100 {{(pid=87935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:35:05.985776 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ac8329-b573-47b8-949d-7be324cf2296 None admin] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:35:06.037582 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e980cb-d6a2-4262-84ad-b0ca60e0de2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:35:06.038451 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e980cb-d6a2-4262-84ad-b0ca60e0de2e None admin] REQUEST_METHOD: `PUT` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:35:06.039319 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e980cb-d6a2-4262-84ad-b0ca60e0de2e None admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:35:06.039728 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e980cb-d6a2-4262-84ad-b0ca60e0de2e None admin] PATH_INFO: `/v3/projects/8aefa5062b7b4e4390554359e5669a9b/users/d2e76fe7aad644f59888b9590b97c20c/roles/8af3d83a03144ae8bacdb82d9a108110` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:35:06.042684 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e980cb-d6a2-4262-84ad-b0ca60e0de2e None admin] RBAC: Authorizing `identity:create_grant(project_id=8aefa5062b7b4e4390554359e5669a9b, user_id=d2e76fe7aad644f59888b9590b97c20c, role_id=8af3d83a03144ae8bacdb82d9a108110)` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:35:06.044722 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e980cb-d6a2-4262-84ad-b0ca60e0de2e None admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:35:06.065311 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 63/130] 10.222.0.25 () {58 vars in 1439 bytes} [Tue Sep 13 19:35:05 2022] PUT /identity/v3/projects/8aefa5062b7b4e4390554359e5669a9b/users/d2e76fe7aad644f59888b9590b97c20c/roles/8af3d83a03144ae8bacdb82d9a108110 => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 19:35:06.066450 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e980cb-d6a2-4262-84ad-b0ca60e0de2e None admin] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:35:06.136268 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b0faaf-1d28-4092-91e7-3ed1769ae5af None admin] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:35:06.181124 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224c3c78-7844-4157-b16f-bffd1eaa9e2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:35:06.182084 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224c3c78-7844-4157-b16f-bffd1eaa9e2d None admin] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:35:06.182516 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224c3c78-7844-4157-b16f-bffd1eaa9e2d None admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:35:06.182936 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224c3c78-7844-4157-b16f-bffd1eaa9e2d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:35:06.183911 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-224c3c78-7844-4157-b16f-bffd1eaa9e2d None admin] RBAC: Adding query filter params (role.id=85e5149eef184d349b4b1859b84dd789, scope.project.id=8aefa5062b7b4e4390554359e5669a9b, user.id=3e259c73a2ae4ccf98905d4334cc8d1a) {{(pid=87934) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:35:06.184449 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-224c3c78-7844-4157-b16f-bffd1eaa9e2d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:35:06.186244 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-224c3c78-7844-4157-b16f-bffd1eaa9e2d None admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:35:06.193023 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 68/131] 10.222.0.25 () {56 vars in 1374 bytes} [Tue Sep 13 19:35:05 2022] GET /identity/v3/role_assignments?user.id=3e259c73a2ae4ccf98905d4334cc8d1a&scope.project.id=8aefa5062b7b4e4390554359e5669a9b&role.id=85e5149eef184d349b4b1859b84dd789 => generated 259 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:35:06.194339 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224c3c78-7844-4157-b16f-bffd1eaa9e2d None admin] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:35:06.218260 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e980cb-d6a2-4262-84ad-b0ca60e0de2e None admin] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:35:06.261316 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86503128-fa96-4167-b0a5-1cb766ef5029 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:35:06.262104 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86503128-fa96-4167-b0a5-1cb766ef5029 None admin] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:35:06.262465 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86503128-fa96-4167-b0a5-1cb766ef5029 None admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:35:06.262835 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86503128-fa96-4167-b0a5-1cb766ef5029 None admin] PATH_INFO: `/v3/users/7b0aed92d02344acb92a0e4aa67c3068` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:35:06.264239 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86503128-fa96-4167-b0a5-1cb766ef5029 None admin] RBAC: Authorizing `identity:get_user(user_id=7b0aed92d02344acb92a0e4aa67c3068)` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:35:06.265918 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86503128-fa96-4167-b0a5-1cb766ef5029 None admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:35:06.268015 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 64/132] 10.222.0.25 () {56 vars in 1177 bytes} [Tue Sep 13 19:35:06 2022] GET /identity/v3/users/7b0aed92d02344acb92a0e4aa67c3068 => generated 247 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:35:06.273939 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86503128-fa96-4167-b0a5-1cb766ef5029 None admin] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:35:06.280833 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG dbcounter [-] [87934] Writing DB stats keystone:SELECT=100 {{(pid=87934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:35:06.309282 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG dbcounter [-] [87935] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:35:06.335013 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224c3c78-7844-4157-b16f-bffd1eaa9e2d None admin] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:35:06.377821 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac21794b-e516-42b9-86ed-2644cc32110f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:35:06.378852 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac21794b-e516-42b9-86ed-2644cc32110f None admin] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:35:06.379362 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac21794b-e516-42b9-86ed-2644cc32110f None admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:35:06.379848 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac21794b-e516-42b9-86ed-2644cc32110f None admin] PATH_INFO: `/v3/users/d2e76fe7aad644f59888b9590b97c20c` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:35:06.381498 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac21794b-e516-42b9-86ed-2644cc32110f None admin] RBAC: Authorizing `identity:get_user(user_id=d2e76fe7aad644f59888b9590b97c20c)` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:35:06.383680 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac21794b-e516-42b9-86ed-2644cc32110f None admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:35:06.385994 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 69/133] 10.222.0.25 () {56 vars in 1177 bytes} [Tue Sep 13 19:35:06 2022] GET /identity/v3/users/d2e76fe7aad644f59888b9590b97c20c => generated 275 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:35:06.393262 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac21794b-e516-42b9-86ed-2644cc32110f None admin] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:35:06.414612 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86503128-fa96-4167-b0a5-1cb766ef5029 None admin] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:35:06.466801 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f649fe8-6678-4ee0-94a8-c5252406af40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:35:06.469430 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f649fe8-6678-4ee0-94a8-c5252406af40 None admin] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:35:06.470549 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f649fe8-6678-4ee0-94a8-c5252406af40 None admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:35:06.471362 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f649fe8-6678-4ee0-94a8-c5252406af40 None admin] PATH_INFO: `/v3/projects/8aefa5062b7b4e4390554359e5669a9b` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:35:06.473271 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f649fe8-6678-4ee0-94a8-c5252406af40 None admin] RBAC: Authorizing `identity:get_project(project_id=8aefa5062b7b4e4390554359e5669a9b)` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:35:06.475610 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f649fe8-6678-4ee0-94a8-c5252406af40 None admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:35:06.479302 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 65/134] 10.222.0.25 () {56 vars in 1186 bytes} [Tue Sep 13 19:35:06 2022] GET /identity/v3/projects/8aefa5062b7b4e4390554359e5669a9b => generated 298 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:35:06.486745 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f649fe8-6678-4ee0-94a8-c5252406af40 None admin] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:35:06.549060 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac21794b-e516-42b9-86ed-2644cc32110f None admin] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:35:06.591195 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722560f2-ab31-45d6-b88c-786eeb5b4dcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:35:06.591850 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722560f2-ab31-45d6-b88c-786eeb5b4dcc None admin] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:35:06.592503 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722560f2-ab31-45d6-b88c-786eeb5b4dcc None admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:35:06.592503 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722560f2-ab31-45d6-b88c-786eeb5b4dcc None admin] PATH_INFO: `/v3/projects/345a09ee00cc4ce39a05041a4cb5e591` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:35:06.593665 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-722560f2-ab31-45d6-b88c-786eeb5b4dcc None admin] RBAC: Authorizing `identity:get_project(project_id=345a09ee00cc4ce39a05041a4cb5e591)` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:35:06.595212 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-722560f2-ab31-45d6-b88c-786eeb5b4dcc None admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:35:06.597276 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 70/135] 10.222.0.25 () {56 vars in 1186 bytes} [Tue Sep 13 19:35:06 2022] GET /identity/v3/projects/345a09ee00cc4ce39a05041a4cb5e591 => generated 312 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 19:35:06.604151 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722560f2-ab31-45d6-b88c-786eeb5b4dcc None admin] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:35:06.608057 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG dbcounter [-] [87934] Writing DB stats keystone:SELECT=100 {{(pid=87934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:35:06.646672 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG dbcounter [-] [87935] Writing DB stats keystone:SELECT=100 {{(pid=87935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:35:06.666548 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f649fe8-6678-4ee0-94a8-c5252406af40 None admin] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:35:06.728625 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cabaecf-b64e-4199-9041-692157bb3611 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:35:06.729319 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cabaecf-b64e-4199-9041-692157bb3611 None admin] REQUEST_METHOD: `PUT` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:35:06.729603 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cabaecf-b64e-4199-9041-692157bb3611 None admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:35:06.729883 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cabaecf-b64e-4199-9041-692157bb3611 None admin] PATH_INFO: `/v3/projects/8aefa5062b7b4e4390554359e5669a9b/users/7b0aed92d02344acb92a0e4aa67c3068/roles/6ca1d4427ff64e0a9d25d96cfb1445f6` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:35:06.734902 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722560f2-ab31-45d6-b88c-786eeb5b4dcc None admin] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:35:06.737937 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cabaecf-b64e-4199-9041-692157bb3611 None admin] RBAC: Authorizing `identity:create_grant(project_id=8aefa5062b7b4e4390554359e5669a9b, user_id=7b0aed92d02344acb92a0e4aa67c3068, role_id=6ca1d4427ff64e0a9d25d96cfb1445f6)` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:35:06.739864 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cabaecf-b64e-4199-9041-692157bb3611 None admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:35:06.768438 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 66/136] 10.222.0.25 () {58 vars in 1439 bytes} [Tue Sep 13 19:35:06 2022] PUT /identity/v3/projects/8aefa5062b7b4e4390554359e5669a9b/users/7b0aed92d02344acb92a0e4aa67c3068/roles/6ca1d4427ff64e0a9d25d96cfb1445f6 => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 19:35:06.787805 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e11885-d410-4184-817c-c6c4e2fa81b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:35:06.789060 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e11885-d410-4184-817c-c6c4e2fa81b9 None admin] REQUEST_METHOD: `PUT` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:35:06.789566 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e11885-d410-4184-817c-c6c4e2fa81b9 None admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:35:06.790039 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e11885-d410-4184-817c-c6c4e2fa81b9 None admin] PATH_INFO: `/v3/projects/345a09ee00cc4ce39a05041a4cb5e591/users/d2e76fe7aad644f59888b9590b97c20c/roles/a259191f6d0e46fabd9f34536bb28747` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:35:06.792504 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e11885-d410-4184-817c-c6c4e2fa81b9 None admin] RBAC: Authorizing `identity:create_grant(project_id=345a09ee00cc4ce39a05041a4cb5e591, user_id=d2e76fe7aad644f59888b9590b97c20c, role_id=a259191f6d0e46fabd9f34536bb28747)` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:35:06.794350 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e11885-d410-4184-817c-c6c4e2fa81b9 None admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:35:06.814222 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 71/137] 10.222.0.25 () {58 vars in 1439 bytes} [Tue Sep 13 19:35:06 2022] PUT /identity/v3/projects/345a09ee00cc4ce39a05041a4cb5e591/users/d2e76fe7aad644f59888b9590b97c20c/roles/a259191f6d0e46fabd9f34536bb28747 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 19:35:07.015280 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0270027-9ffd-4a40-a0cb-ef4eb10a012d None None] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:35:07.015666 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0270027-9ffd-4a40-a0cb-ef4eb10a012d None None] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:35:07.015845 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0270027-9ffd-4a40-a0cb-ef4eb10a012d None None] PATH_INFO: `/` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:35:07.017528 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 67/138] 10.222.0.25 () {54 vars in 927 bytes} [Tue Sep 13 19:35:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:35:07.022958 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96df42b-856c-46d3-8417-f95362ab07f3 None None] REQUEST_METHOD: `POST` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:35:07.023537 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96df42b-856c-46d3-8417-f95362ab07f3 None None] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:35:07.024110 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96df42b-856c-46d3-8417-f95362ab07f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:35:07.046931 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.auth.core [None req-d96df42b-856c-46d3-8417-f95362ab07f3 None None] MFA Rules not processed for user `7b0aed92d02344acb92a0e4aa67c3068`. Rule list: `[]` (Enabled: `True`). {{(pid=87934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:35:07.049382 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.fernet_utils [None req-d96df42b-856c-46d3-8417-f95362ab07f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:35:07.135418 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG dbcounter [-] [87934] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:35:07.150853 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 72/139] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Sep 13 19:35:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 19:35:07.598554 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0270027-9ffd-4a40-a0cb-ef4eb10a012d None None] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:35:07.715067 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0270027-9ffd-4a40-a0cb-ef4eb10a012d None None] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:35:07.751285 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9356e92-58e6-4d3c-9cec-b1bbbab185ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:35:07.751975 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9356e92-58e6-4d3c-9cec-b1bbbab185ea None admin] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:35:07.752283 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9356e92-58e6-4d3c-9cec-b1bbbab185ea None admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:35:07.752563 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9356e92-58e6-4d3c-9cec-b1bbbab185ea None admin] PATH_INFO: `/v3/domains/default` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:35:07.753694 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9356e92-58e6-4d3c-9cec-b1bbbab185ea None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:35:07.755146 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9356e92-58e6-4d3c-9cec-b1bbbab185ea None admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:35:07.762027 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 68/140] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Sep 13 19:35:07 2022] GET /identity/v3/domains/default => generated 199 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:35:07.763480 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96df42b-856c-46d3-8417-f95362ab07f3 None None] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:35:07.872982 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96df42b-856c-46d3-8417-f95362ab07f3 None None] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:35:07.917505 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a37d5c1-7ff3-4d36-bf78-05aa0c7b6afe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:35:07.918125 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a37d5c1-7ff3-4d36-bf78-05aa0c7b6afe None admin] REQUEST_METHOD: `POST` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:35:07.918402 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a37d5c1-7ff3-4d36-bf78-05aa0c7b6afe None admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:35:07.918668 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a37d5c1-7ff3-4d36-bf78-05aa0c7b6afe None admin] PATH_INFO: `/v3/users` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:35:07.919341 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a37d5c1-7ff3-4d36-bf78-05aa0c7b6afe None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:35:07.920836 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a37d5c1-7ff3-4d36-bf78-05aa0c7b6afe None admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:35:07.952382 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 73/141] 10.222.0.25 () {60 vars in 1132 bytes} [Tue Sep 13 19:35:07 2022] POST /identity/v3/users => generated 283 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 19:35:08.730699 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12648321-ff72-45b8-a61e-d3caeade2420 None None] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:35:08.731250 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12648321-ff72-45b8-a61e-d3caeade2420 None None] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:35:08.731250 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12648321-ff72-45b8-a61e-d3caeade2420 None None] PATH_INFO: `/` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:35:08.733022 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 69/142] 10.222.0.25 () {54 vars in 927 bytes} [Tue Sep 13 19:35:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:35:08.738650 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203fae3b-540b-47a6-8e8e-3fa63b02db45 None None] REQUEST_METHOD: `POST` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:35:08.739126 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203fae3b-540b-47a6-8e8e-3fa63b02db45 None None] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:35:08.739199 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203fae3b-540b-47a6-8e8e-3fa63b02db45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:35:08.767683 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.auth.core [None req-203fae3b-540b-47a6-8e8e-3fa63b02db45 None None] MFA Rules not processed for user `7b0aed92d02344acb92a0e4aa67c3068`. Rule list: `[]` (Enabled: `True`). {{(pid=87934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:35:08.769571 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.fernet_utils [None req-203fae3b-540b-47a6-8e8e-3fa63b02db45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:35:08.842123 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG dbcounter [-] [87934] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:35:08.870046 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 74/143] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Sep 13 19:35:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 19:35:09.462211 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12648321-ff72-45b8-a61e-d3caeade2420 None None] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:35:09.488203 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG dbcounter [-] [87935] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:35:09.584351 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12648321-ff72-45b8-a61e-d3caeade2420 None None] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:35:09.632886 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97fea943-d5c5-4875-a201-29c5fdfd2491 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:35:09.633613 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fea943-d5c5-4875-a201-29c5fdfd2491 None admin] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:35:09.633899 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fea943-d5c5-4875-a201-29c5fdfd2491 None admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:35:09.634173 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fea943-d5c5-4875-a201-29c5fdfd2491 None admin] PATH_INFO: `/v3/roles/member` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:35:09.645715 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97fea943-d5c5-4875-a201-29c5fdfd2491 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 19:35:09.652134 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application [None req-97fea943-d5c5-4875-a201-29c5fdfd2491 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 13 19:35:09.652134 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:35:09.652134 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:35:09.652134 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:35:09.652134 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:35:09.652134 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:35:09.652134 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:35:09.652134 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:35:09.652134 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:35:09.652134 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:35:09.652134 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:35:09.652134 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:35:09.652134 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 19:35:09.652134 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 19:35:09.652134 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 19:35:09.652134 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 19:35:09.653036 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 19:35:09.653036 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 19:35:09.653036 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 19:35:09.653036 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 19:35:09.653036 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:35:09.653036 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:35:09.653036 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:35:09.653036 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:35:09.653036 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:35:09.653036 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:35:09.653036 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:35:09.653036 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application with Lock( Sep 13 19:35:09.653036 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:35:09.653036 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:35:09.653036 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:35:09.653036 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:35:09.653878 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:35:09.653878 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:35:09.653878 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:35:09.653878 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:35:09.653878 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 19:35:09.653878 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 19:35:09.653878 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 19:35:09.653878 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 19:35:09.653878 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 19:35:09.653878 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 19:35:09.653878 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 13 19:35:09.653878 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application Sep 13 19:35:09.653878 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 70/144] 10.222.0.25 () {56 vars in 1099 bytes} [Tue Sep 13 19:35:09 2022] GET /identity/v3/roles/member => generated 84 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:35:09.661164 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203fae3b-540b-47a6-8e8e-3fa63b02db45 None None] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:35:09.772730 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efb1f18-da9a-4a42-8c76-4970c8f4a14b None None] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:35:09.773526 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efb1f18-da9a-4a42-8c76-4970c8f4a14b None None] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:35:09.773526 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efb1f18-da9a-4a42-8c76-4970c8f4a14b None None] PATH_INFO: `/` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:35:09.774942 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 71/145] 10.222.0.25 () {54 vars in 927 bytes} [Tue Sep 13 19:35:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:35:09.781323 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13aa1428-c600-463e-8470-bc1b637a95db None None] REQUEST_METHOD: `POST` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:35:09.781633 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13aa1428-c600-463e-8470-bc1b637a95db None None] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:35:09.781861 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13aa1428-c600-463e-8470-bc1b637a95db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:35:09.811046 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.auth.core [None req-13aa1428-c600-463e-8470-bc1b637a95db None None] MFA Rules not processed for user `7b0aed92d02344acb92a0e4aa67c3068`. Rule list: `[]` (Enabled: `True`). {{(pid=87935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:35:09.813601 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.fernet_utils [None req-13aa1428-c600-463e-8470-bc1b637a95db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:35:09.848167 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203fae3b-540b-47a6-8e8e-3fa63b02db45 None None] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:35:09.902677 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 72/146] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Sep 13 19:35:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 19:35:09.917359 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae800ff-6820-4ccc-91d0-b051d4fb3668 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:35:09.918004 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae800ff-6820-4ccc-91d0-b051d4fb3668 None admin] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:35:09.918284 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae800ff-6820-4ccc-91d0-b051d4fb3668 None admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:35:09.918560 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae800ff-6820-4ccc-91d0-b051d4fb3668 None admin] PATH_INFO: `/v3/roles` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:35:09.919254 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae800ff-6820-4ccc-91d0-b051d4fb3668 None admin] RBAC: Adding query filter params (name=member) {{(pid=87934) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:35:09.919579 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae800ff-6820-4ccc-91d0-b051d4fb3668 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:35:09.921064 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae800ff-6820-4ccc-91d0-b051d4fb3668 None admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:35:09.935980 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 75/147] 10.222.0.25 () {56 vars in 1101 bytes} [Tue Sep 13 19:35:09 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:35:09.942421 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13aa1428-c600-463e-8470-bc1b637a95db None None] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:35:09.963337 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG dbcounter [-] [87935] Writing DB stats keystone:SELECT=100 {{(pid=87935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:35:10.097351 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13aa1428-c600-463e-8470-bc1b637a95db None None] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:35:10.134867 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10dee10d-7846-406f-96e5-cd6a6e6cc42a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:35:10.135429 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10dee10d-7846-406f-96e5-cd6a6e6cc42a None admin] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:35:10.135704 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10dee10d-7846-406f-96e5-cd6a6e6cc42a None admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:35:10.135972 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10dee10d-7846-406f-96e5-cd6a6e6cc42a None admin] PATH_INFO: `/v3/users/d2e76fe7aad644f59888b9590b97c20c` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:35:10.137135 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10dee10d-7846-406f-96e5-cd6a6e6cc42a None admin] RBAC: Authorizing `identity:get_user(user_id=d2e76fe7aad644f59888b9590b97c20c)` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:35:10.138587 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10dee10d-7846-406f-96e5-cd6a6e6cc42a None admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:35:10.140282 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 73/148] 10.222.0.25 () {56 vars in 1177 bytes} [Tue Sep 13 19:35:09 2022] GET /identity/v3/users/d2e76fe7aad644f59888b9590b97c20c => generated 275 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:35:10.149360 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae800ff-6820-4ccc-91d0-b051d4fb3668 None admin] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:35:10.161958 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b5d333-4c02-4fd3-8937-1cb533925196 None None] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:35:10.162257 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b5d333-4c02-4fd3-8937-1cb533925196 None None] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:35:10.162508 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b5d333-4c02-4fd3-8937-1cb533925196 None None] PATH_INFO: `/` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:35:10.164262 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 74/149] 10.222.0.25 () {54 vars in 927 bytes} [Tue Sep 13 19:35:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:35:10.194980 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e36d868-0754-4c7b-a7da-d695986b5ad4 None None] REQUEST_METHOD: `POST` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:35:10.195271 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e36d868-0754-4c7b-a7da-d695986b5ad4 None None] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:35:10.195505 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e36d868-0754-4c7b-a7da-d695986b5ad4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:35:10.219283 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG dbcounter [-] [87934] Writing DB stats keystone:SELECT=100 {{(pid=87934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:35:10.224658 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.auth.core [None req-0e36d868-0754-4c7b-a7da-d695986b5ad4 None None] MFA Rules not processed for user `7b0aed92d02344acb92a0e4aa67c3068`. Rule list: `[]` (Enabled: `True`). {{(pid=87935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:35:10.226685 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.fernet_utils [None req-0e36d868-0754-4c7b-a7da-d695986b5ad4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:35:10.325774 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 75/150] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Sep 13 19:35:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (3 switches on core 0) Sep 13 19:35:10.327296 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85da3446-371d-4812-ac6c-56200b5a3996 None None] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:35:10.327576 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85da3446-371d-4812-ac6c-56200b5a3996 None None] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:35:10.327845 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85da3446-371d-4812-ac6c-56200b5a3996 None None] PATH_INFO: `/` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:35:10.335389 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 76/151] 10.222.0.25 () {54 vars in 927 bytes} [Tue Sep 13 19:35:10 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:35:10.342768 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85da3446-371d-4812-ac6c-56200b5a3996 None None] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:35:10.364844 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG dbcounter [-] [87935] Writing DB stats keystone:SELECT=100 {{(pid=87935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:35:10.378912 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae800ff-6820-4ccc-91d0-b051d4fb3668 None admin] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:35:10.450353 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c5b1f5-a7b0-4ca9-9465-f5b9a9c25fd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:35:10.450901 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c5b1f5-a7b0-4ca9-9465-f5b9a9c25fd9 None admin] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:35:10.451179 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c5b1f5-a7b0-4ca9-9465-f5b9a9c25fd9 None admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:35:10.451451 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c5b1f5-a7b0-4ca9-9465-f5b9a9c25fd9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:35:10.571161 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85da3446-371d-4812-ac6c-56200b5a3996 None None] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:35:10.600496 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c5b1f5-a7b0-4ca9-9465-f5b9a9c25fd9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:35:10.602355 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c5b1f5-a7b0-4ca9-9465-f5b9a9c25fd9 None admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:35:10.610425 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c241939-7696-41d2-9289-50136dd9ecef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:35:10.611056 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c241939-7696-41d2-9289-50136dd9ecef None admin] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:35:10.611329 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c241939-7696-41d2-9289-50136dd9ecef None admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:35:10.611589 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c241939-7696-41d2-9289-50136dd9ecef None admin] PATH_INFO: `/v3/roles/reader` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:35:10.623555 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c241939-7696-41d2-9289-50136dd9ecef None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 19:35:10.629166 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application [None req-8c241939-7696-41d2-9289-50136dd9ecef None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 13 19:35:10.629166 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:35:10.629166 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:35:10.629166 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:35:10.629166 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:35:10.629166 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:35:10.629166 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:35:10.629166 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:35:10.629166 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:35:10.629166 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:35:10.629166 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:35:10.629166 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:35:10.629166 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 19:35:10.629166 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 19:35:10.629166 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 19:35:10.629166 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 19:35:10.630119 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 19:35:10.630119 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 19:35:10.630119 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 19:35:10.630119 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 19:35:10.630119 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:35:10.630119 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:35:10.630119 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:35:10.630119 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:35:10.630119 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:35:10.630119 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:35:10.630119 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:35:10.630119 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application with Lock( Sep 13 19:35:10.630119 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:35:10.630119 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:35:10.630119 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:35:10.630119 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:35:10.630961 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:35:10.630961 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:35:10.630961 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:35:10.630961 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:35:10.630961 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 19:35:10.630961 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 19:35:10.630961 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 19:35:10.630961 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 19:35:10.630961 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 19:35:10.630961 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 19:35:10.630961 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 13 19:35:10.630961 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application Sep 13 19:35:10.630961 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 77/152] 10.222.0.25 () {56 vars in 1099 bytes} [Tue Sep 13 19:35:10 2022] GET /identity/v3/roles/reader => generated 84 bytes in 288 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:35:10.631672 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f39a36f-60a0-4a85-969d-27a45a6224db None None] REQUEST_METHOD: `POST` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:35:10.633709 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f39a36f-60a0-4a85-969d-27a45a6224db None None] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:35:10.633709 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f39a36f-60a0-4a85-969d-27a45a6224db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:35:10.651844 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.auth.core [None req-1f39a36f-60a0-4a85-969d-27a45a6224db None None] MFA Rules not processed for user `7b0aed92d02344acb92a0e4aa67c3068`. Rule list: `[]` (Enabled: `True`). {{(pid=87935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:35:10.653146 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.fernet_utils [None req-1f39a36f-60a0-4a85-969d-27a45a6224db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:35:10.704682 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG dbcounter [-] [87934] Writing DB stats keystone:SELECT=100 {{(pid=87934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:35:10.814268 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 76/153] 10.222.0.25 () {58 vars in 1282 bytes} [Tue Sep 13 19:35:10 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 665 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 13 19:35:10.815035 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG dbcounter [-] [87935] Writing DB stats keystone:SELECT=100 {{(pid=87935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:35:10.815467 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c5b1f5-a7b0-4ca9-9465-f5b9a9c25fd9 None admin] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:35:10.837667 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 78/154] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Sep 13 19:35:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 19:35:10.838822 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f39a36f-60a0-4a85-969d-27a45a6224db None None] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:35:10.993442 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c5b1f5-a7b0-4ca9-9465-f5b9a9c25fd9 None admin] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:35:11.075177 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f39a36f-60a0-4a85-969d-27a45a6224db None None] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:35:11.124364 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6715613b-127b-4274-89ca-8f8d2c0b5bc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:35:11.125314 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6715613b-127b-4274-89ca-8f8d2c0b5bc1 None admin] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:35:11.125737 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6715613b-127b-4274-89ca-8f8d2c0b5bc1 None admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:35:11.126149 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6715613b-127b-4274-89ca-8f8d2c0b5bc1 None admin] PATH_INFO: `/v3/roles` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:35:11.127008 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6715613b-127b-4274-89ca-8f8d2c0b5bc1 None admin] RBAC: Adding query filter params (name=reader) {{(pid=87934) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:35:11.127458 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6715613b-127b-4274-89ca-8f8d2c0b5bc1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:35:11.129021 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6715613b-127b-4274-89ca-8f8d2c0b5bc1 None admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:35:11.134836 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb91332-9633-47c2-b8e4-861aa0cc5cea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:35:11.135550 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb91332-9633-47c2-b8e4-861aa0cc5cea None admin] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:35:11.135888 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb91332-9633-47c2-b8e4-861aa0cc5cea None admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:35:11.136166 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb91332-9633-47c2-b8e4-861aa0cc5cea None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:35:11.147883 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 77/155] 10.222.0.25 () {56 vars in 1101 bytes} [Tue Sep 13 19:35:10 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 333 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:35:11.149229 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6715613b-127b-4274-89ca-8f8d2c0b5bc1 None admin] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:35:11.154214 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb91332-9633-47c2-b8e4-861aa0cc5cea None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 19:35:11.155222 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG dbcounter [-] [87934] Writing DB stats keystone:SELECT=100 {{(pid=87934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:35:11.167595 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application [None req-ebb91332-9633-47c2-b8e4-861aa0cc5cea None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 13 19:35:11.167595 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:35:11.167595 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:35:11.167595 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:35:11.167595 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:35:11.167595 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:35:11.167595 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:35:11.167595 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:35:11.167595 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:35:11.167595 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:35:11.167595 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:35:11.167595 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:35:11.167595 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 19:35:11.167595 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 19:35:11.167595 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 19:35:11.167595 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 19:35:11.168935 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 19:35:11.168935 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 19:35:11.168935 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 19:35:11.168935 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 19:35:11.168935 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:35:11.168935 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:35:11.168935 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:35:11.168935 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:35:11.168935 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:35:11.168935 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:35:11.168935 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:35:11.168935 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application with Lock( Sep 13 19:35:11.168935 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:35:11.168935 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:35:11.168935 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:35:11.168935 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:35:11.169995 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:35:11.169995 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:35:11.169995 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:35:11.169995 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:35:11.169995 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 19:35:11.169995 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 19:35:11.169995 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 19:35:11.169995 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 19:35:11.169995 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 19:35:11.169995 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 19:35:11.169995 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 13 19:35:11.169995 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application Sep 13 19:35:11.169995 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 79/156] 10.222.0.25 () {56 vars in 1114 bytes} [Tue Sep 13 19:35:10 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 329 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:35:11.172566 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb91332-9633-47c2-b8e4-861aa0cc5cea None admin] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:35:11.279351 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG dbcounter [-] [87935] Writing DB stats keystone:SELECT=100 {{(pid=87935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:35:11.355616 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb91332-9633-47c2-b8e4-861aa0cc5cea None admin] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:35:11.382711 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6715613b-127b-4274-89ca-8f8d2c0b5bc1 None admin] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:35:11.417706 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6643afe1-a045-466e-bf5c-a08a8cdba856 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:35:11.418350 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6643afe1-a045-466e-bf5c-a08a8cdba856 None admin] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:35:11.418627 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6643afe1-a045-466e-bf5c-a08a8cdba856 None admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:35:11.418890 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6643afe1-a045-466e-bf5c-a08a8cdba856 None admin] PATH_INFO: `/v3/users/3e259c73a2ae4ccf98905d4334cc8d1a` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:35:11.420023 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6643afe1-a045-466e-bf5c-a08a8cdba856 None admin] RBAC: Authorizing `identity:get_user(user_id=3e259c73a2ae4ccf98905d4334cc8d1a)` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:35:11.421514 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6643afe1-a045-466e-bf5c-a08a8cdba856 None admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:35:11.423288 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 80/157] 10.222.0.25 () {56 vars in 1177 bytes} [Tue Sep 13 19:35:11 2022] GET /identity/v3/users/3e259c73a2ae4ccf98905d4334cc8d1a => generated 289 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:35:11.423860 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6643afe1-a045-466e-bf5c-a08a8cdba856 None admin] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:35:11.477609 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d30f45-5a06-4de8-b38a-0786688bcd7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:35:11.478265 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d30f45-5a06-4de8-b38a-0786688bcd7b None admin] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:35:11.478545 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d30f45-5a06-4de8-b38a-0786688bcd7b None admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:35:11.478828 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d30f45-5a06-4de8-b38a-0786688bcd7b None admin] PATH_INFO: `/v3/projects/8aefa5062b7b4e4390554359e5669a9b` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:35:11.481668 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d30f45-5a06-4de8-b38a-0786688bcd7b None admin] RBAC: Authorizing `identity:get_project(project_id=8aefa5062b7b4e4390554359e5669a9b)` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:35:11.483225 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d30f45-5a06-4de8-b38a-0786688bcd7b None admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:35:11.485094 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 78/158] 10.222.0.25 () {56 vars in 1186 bytes} [Tue Sep 13 19:35:11 2022] GET /identity/v3/projects/8aefa5062b7b4e4390554359e5669a9b => generated 298 bytes in 336 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:35:11.486095 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59fcc37-fc76-49ca-bdab-f909000a46ef None None] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:35:11.486374 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59fcc37-fc76-49ca-bdab-f909000a46ef None None] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:35:11.486645 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59fcc37-fc76-49ca-bdab-f909000a46ef None None] PATH_INFO: `/` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:35:11.496403 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 79/159] 10.222.0.25 () {54 vars in 927 bytes} [Tue Sep 13 19:35:11 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:35:11.497608 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59fcc37-fc76-49ca-bdab-f909000a46ef None None] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:35:11.534762 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6643afe1-a045-466e-bf5c-a08a8cdba856 None admin] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:35:11.564979 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG dbcounter [-] [87935] Writing DB stats keystone:SELECT=100 {{(pid=87935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:35:11.574595 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b078fa-16e2-44e1-8d12-2e0ae76210a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:35:11.575173 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b078fa-16e2-44e1-8d12-2e0ae76210a7 None admin] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:35:11.575453 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b078fa-16e2-44e1-8d12-2e0ae76210a7 None admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:35:11.575726 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b078fa-16e2-44e1-8d12-2e0ae76210a7 None admin] PATH_INFO: `/v3/roles` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:35:11.576724 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b078fa-16e2-44e1-8d12-2e0ae76210a7 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=87935) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:35:11.576724 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b078fa-16e2-44e1-8d12-2e0ae76210a7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:35:11.578310 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b078fa-16e2-44e1-8d12-2e0ae76210a7 None admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:35:11.589436 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 81/160] 10.222.0.25 () {56 vars in 1111 bytes} [Tue Sep 13 19:35:11 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:35:11.590110 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b078fa-16e2-44e1-8d12-2e0ae76210a7 None admin] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:35:11.608588 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG dbcounter [-] [87934] Writing DB stats keystone:SELECT=100 {{(pid=87934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:35:11.641697 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59fcc37-fc76-49ca-bdab-f909000a46ef None None] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:35:11.684332 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1131e1c-d723-4487-9c1b-fad2c16a3848 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:35:11.685717 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1131e1c-d723-4487-9c1b-fad2c16a3848 None admin] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:35:11.686356 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1131e1c-d723-4487-9c1b-fad2c16a3848 None admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:35:11.686852 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1131e1c-d723-4487-9c1b-fad2c16a3848 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:35:11.710375 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1131e1c-d723-4487-9c1b-fad2c16a3848 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 19:35:11.718451 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b078fa-16e2-44e1-8d12-2e0ae76210a7 None admin] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:35:11.722215 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application [None req-e1131e1c-d723-4487-9c1b-fad2c16a3848 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 19:35:11.722215 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:35:11.722215 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:35:11.722215 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:35:11.722215 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:35:11.722215 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:35:11.722215 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:35:11.722215 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:35:11.722215 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:35:11.722215 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:35:11.722215 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:35:11.722215 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:35:11.722215 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 19:35:11.722215 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 19:35:11.722215 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 19:35:11.722215 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 19:35:11.723169 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 19:35:11.723169 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 19:35:11.723169 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 19:35:11.723169 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 19:35:11.723169 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:35:11.723169 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:35:11.723169 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:35:11.723169 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:35:11.723169 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:35:11.723169 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:35:11.723169 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:35:11.723169 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application with Lock( Sep 13 19:35:11.723169 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:35:11.723169 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:35:11.723169 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:35:11.723169 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:35:11.723941 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:35:11.723941 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:35:11.723941 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:35:11.723941 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:35:11.723941 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 19:35:11.723941 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 19:35:11.723941 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 19:35:11.723941 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 19:35:11.723941 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 19:35:11.723941 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 19:35:11.723941 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 19:35:11.723941 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application Sep 13 19:35:11.727555 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 80/161] 10.222.0.25 () {56 vars in 1096 bytes} [Tue Sep 13 19:35:11 2022] GET /identity/v3/roles/admin => generated 83 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:35:11.733408 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1131e1c-d723-4487-9c1b-fad2c16a3848 None admin] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:35:11.817115 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ef04d2-e2cb-442f-8eb5-563dc4050cfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:35:11.817758 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ef04d2-e2cb-442f-8eb5-563dc4050cfa None admin] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:35:11.817973 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ef04d2-e2cb-442f-8eb5-563dc4050cfa None admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:35:11.818244 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ef04d2-e2cb-442f-8eb5-563dc4050cfa None admin] PATH_INFO: `/v3/projects/8aefa5062b7b4e4390554359e5669a9b` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:35:11.820243 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ef04d2-e2cb-442f-8eb5-563dc4050cfa None admin] RBAC: Authorizing `identity:get_project(project_id=8aefa5062b7b4e4390554359e5669a9b)` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:35:11.821591 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ef04d2-e2cb-442f-8eb5-563dc4050cfa None admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:35:11.823287 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 82/162] 10.222.0.25 () {56 vars in 1186 bytes} [Tue Sep 13 19:35:11 2022] GET /identity/v3/projects/8aefa5062b7b4e4390554359e5669a9b => generated 298 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:35:11.829234 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a52f61-b0cc-42b2-a1bf-edabfd41b4ea None None] REQUEST_METHOD: `POST` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:35:11.829615 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a52f61-b0cc-42b2-a1bf-edabfd41b4ea None None] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:35:11.829784 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a52f61-b0cc-42b2-a1bf-edabfd41b4ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:35:11.873270 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.auth.core [None req-93a52f61-b0cc-42b2-a1bf-edabfd41b4ea None None] MFA Rules not processed for user `7b0aed92d02344acb92a0e4aa67c3068`. Rule list: `[]` (Enabled: `True`). {{(pid=87935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:35:11.874493 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.fernet_utils [None req-93a52f61-b0cc-42b2-a1bf-edabfd41b4ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:35:11.888033 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1131e1c-d723-4487-9c1b-fad2c16a3848 None admin] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:35:11.952625 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG dbcounter [-] [87934] Writing DB stats keystone:SELECT=100 {{(pid=87934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:35:11.966509 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb93524-4ed3-4218-899c-3b712488bc4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:35:11.967136 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb93524-4ed3-4218-899c-3b712488bc4a None admin] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:35:11.967415 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb93524-4ed3-4218-899c-3b712488bc4a None admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:35:11.967684 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb93524-4ed3-4218-899c-3b712488bc4a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:35:11.968446 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb93524-4ed3-4218-899c-3b712488bc4a None admin] RBAC: Adding query filter params (role.id=a259191f6d0e46fabd9f34536bb28747, scope.project.id=8aefa5062b7b4e4390554359e5669a9b, user.id=d2e76fe7aad644f59888b9590b97c20c) {{(pid=87934) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:35:11.968754 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb93524-4ed3-4218-899c-3b712488bc4a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:35:11.970199 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb93524-4ed3-4218-899c-3b712488bc4a None admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:35:11.981020 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 81/163] 10.222.0.25 () {56 vars in 1374 bytes} [Tue Sep 13 19:35:11 2022] GET /identity/v3/role_assignments?user.id=d2e76fe7aad644f59888b9590b97c20c&scope.project.id=8aefa5062b7b4e4390554359e5669a9b&role.id=a259191f6d0e46fabd9f34536bb28747 => generated 608 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:35:11.981795 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb93524-4ed3-4218-899c-3b712488bc4a None admin] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:35:11.987221 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG dbcounter [-] [87935] Writing DB stats keystone:SELECT=100 {{(pid=87935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:35:12.041094 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 83/164] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Sep 13 19:35:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 19:35:12.042425 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a52f61-b0cc-42b2-a1bf-edabfd41b4ea None None] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:35:12.155986 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb93524-4ed3-4218-899c-3b712488bc4a None admin] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:35:12.263152 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50bd5d37-4b7e-4b26-9ffc-f6b8f60f420e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:35:12.263456 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50bd5d37-4b7e-4b26-9ffc-f6b8f60f420e None admin] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:35:12.263698 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50bd5d37-4b7e-4b26-9ffc-f6b8f60f420e None admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:35:12.263882 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50bd5d37-4b7e-4b26-9ffc-f6b8f60f420e None admin] PATH_INFO: `/v3/users/d2e76fe7aad644f59888b9590b97c20c` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:35:12.268358 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50bd5d37-4b7e-4b26-9ffc-f6b8f60f420e None admin] RBAC: Authorizing `identity:get_user(user_id=d2e76fe7aad644f59888b9590b97c20c)` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:35:12.269940 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50bd5d37-4b7e-4b26-9ffc-f6b8f60f420e None admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:35:12.271555 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 82/165] 10.222.0.25 () {56 vars in 1177 bytes} [Tue Sep 13 19:35:11 2022] GET /identity/v3/users/d2e76fe7aad644f59888b9590b97c20c => generated 275 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:35:12.272402 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50bd5d37-4b7e-4b26-9ffc-f6b8f60f420e None admin] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:35:12.300824 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a52f61-b0cc-42b2-a1bf-edabfd41b4ea None None] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:35:12.353877 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee25355-0226-48e7-af1c-2db87c52a811 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:35:12.354645 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee25355-0226-48e7-af1c-2db87c52a811 None admin] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:35:12.354935 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee25355-0226-48e7-af1c-2db87c52a811 None admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:35:12.355203 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee25355-0226-48e7-af1c-2db87c52a811 None admin] PATH_INFO: `/v3/roles` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:35:12.355881 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee25355-0226-48e7-af1c-2db87c52a811 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87935) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:35:12.356187 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee25355-0226-48e7-af1c-2db87c52a811 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:35:12.357786 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee25355-0226-48e7-af1c-2db87c52a811 None admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:35:12.370744 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 84/166] 10.222.0.25 () {56 vars in 1099 bytes} [Tue Sep 13 19:35:12 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 329 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:35:12.371852 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee25355-0226-48e7-af1c-2db87c52a811 None admin] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:35:12.453888 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG dbcounter [-] [87934] Writing DB stats keystone:SELECT=100 {{(pid=87934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:35:12.469882 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG dbcounter [-] [87935] Writing DB stats keystone:SELECT=100 {{(pid=87935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:35:12.537696 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50bd5d37-4b7e-4b26-9ffc-f6b8f60f420e None admin] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:35:12.573855 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee25355-0226-48e7-af1c-2db87c52a811 None admin] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:35:12.609822 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1956d455-29b3-4c7a-964c-9d52f41fb01e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:35:12.610613 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1956d455-29b3-4c7a-964c-9d52f41fb01e None admin] REQUEST_METHOD: `PUT` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:35:12.610899 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1956d455-29b3-4c7a-964c-9d52f41fb01e None admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:35:12.611172 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1956d455-29b3-4c7a-964c-9d52f41fb01e None admin] PATH_INFO: `/v3/projects/8aefa5062b7b4e4390554359e5669a9b/users/3e259c73a2ae4ccf98905d4334cc8d1a/roles/85e5149eef184d349b4b1859b84dd789` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:35:12.613422 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1956d455-29b3-4c7a-964c-9d52f41fb01e None admin] RBAC: Authorizing `identity:create_grant(project_id=8aefa5062b7b4e4390554359e5669a9b, user_id=3e259c73a2ae4ccf98905d4334cc8d1a, role_id=85e5149eef184d349b4b1859b84dd789)` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:35:12.614929 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1956d455-29b3-4c7a-964c-9d52f41fb01e None admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:35:12.636970 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 83/167] 10.222.0.25 () {58 vars in 1439 bytes} [Tue Sep 13 19:35:12 2022] PUT /identity/v3/projects/8aefa5062b7b4e4390554359e5669a9b/users/3e259c73a2ae4ccf98905d4334cc8d1a/roles/85e5149eef184d349b4b1859b84dd789 => generated 0 bytes in 365 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 19:35:12.637812 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1956d455-29b3-4c7a-964c-9d52f41fb01e None admin] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:35:12.655021 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9808fa64-6650-498e-a870-c9e1a57e2f7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:35:12.655654 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9808fa64-6650-498e-a870-c9e1a57e2f7b None admin] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:35:12.655938 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9808fa64-6650-498e-a870-c9e1a57e2f7b None admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:35:12.656223 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9808fa64-6650-498e-a870-c9e1a57e2f7b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:35:12.780662 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9808fa64-6650-498e-a870-c9e1a57e2f7b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:35:12.782470 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9808fa64-6650-498e-a870-c9e1a57e2f7b None admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:35:12.790501 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1956d455-29b3-4c7a-964c-9d52f41fb01e None admin] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:35:12.824932 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG dbcounter [-] [87934] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:35:12.838608 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG dbcounter [-] [87935] Writing DB stats keystone:SELECT=100 {{(pid=87935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:35:12.840945 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51b59c8-db5a-41ea-9290-791febc8ed41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:35:12.842194 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51b59c8-db5a-41ea-9290-791febc8ed41 None admin] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:35:12.842732 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51b59c8-db5a-41ea-9290-791febc8ed41 None admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:35:12.843174 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51b59c8-db5a-41ea-9290-791febc8ed41 None admin] PATH_INFO: `/v3/users/7b0aed92d02344acb92a0e4aa67c3068` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:35:12.845162 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a51b59c8-db5a-41ea-9290-791febc8ed41 None admin] RBAC: Authorizing `identity:get_user(user_id=7b0aed92d02344acb92a0e4aa67c3068)` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:35:12.847233 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a51b59c8-db5a-41ea-9290-791febc8ed41 None admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:35:12.849749 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 84/168] 10.222.0.25 () {56 vars in 1177 bytes} [Tue Sep 13 19:35:12 2022] GET /identity/v3/users/7b0aed92d02344acb92a0e4aa67c3068 => generated 247 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:35:12.852469 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51b59c8-db5a-41ea-9290-791febc8ed41 None admin] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:35:12.905071 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 85/169] 10.222.0.25 () {58 vars in 1282 bytes} [Tue Sep 13 19:35:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 534 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 13 19:35:12.906859 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8c55dc-60ac-42d3-a373-0a77c3309bc6 None None] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:35:12.907211 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8c55dc-60ac-42d3-a373-0a77c3309bc6 None None] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:35:12.907598 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8c55dc-60ac-42d3-a373-0a77c3309bc6 None None] PATH_INFO: `/` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:35:12.916556 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 86/170] 10.222.0.25 () {54 vars in 927 bytes} [Tue Sep 13 19:35:12 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:35:12.917531 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8c55dc-60ac-42d3-a373-0a77c3309bc6 None None] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:35:13.003082 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51b59c8-db5a-41ea-9290-791febc8ed41 None admin] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:35:13.044843 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd338d16-9154-4c26-972f-3de48f7ce9e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:35:13.045464 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd338d16-9154-4c26-972f-3de48f7ce9e0 None admin] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:35:13.045749 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd338d16-9154-4c26-972f-3de48f7ce9e0 None admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:35:13.046023 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd338d16-9154-4c26-972f-3de48f7ce9e0 None admin] PATH_INFO: `/v3/roles/member` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:35:13.063841 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd338d16-9154-4c26-972f-3de48f7ce9e0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 19:35:13.067952 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application [None req-bd338d16-9154-4c26-972f-3de48f7ce9e0 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 13 19:35:13.067952 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:35:13.067952 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:35:13.067952 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:35:13.067952 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:35:13.067952 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:35:13.067952 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:35:13.067952 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:35:13.067952 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:35:13.067952 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:35:13.067952 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:35:13.067952 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:35:13.067952 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 19:35:13.067952 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 19:35:13.067952 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 19:35:13.067952 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 19:35:13.069117 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 19:35:13.069117 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 19:35:13.069117 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 19:35:13.069117 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 19:35:13.069117 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:35:13.069117 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:35:13.069117 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:35:13.069117 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:35:13.069117 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:35:13.069117 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:35:13.069117 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:35:13.069117 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application with Lock( Sep 13 19:35:13.069117 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:35:13.069117 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:35:13.069117 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:35:13.069117 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:35:13.070958 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:35:13.070958 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:35:13.070958 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:35:13.070958 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:35:13.070958 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 19:35:13.070958 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 19:35:13.070958 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 19:35:13.070958 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 19:35:13.070958 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 19:35:13.070958 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 19:35:13.070958 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 13 19:35:13.070958 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application Sep 13 19:35:13.070958 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 85/171] 10.222.0.25 () {56 vars in 1099 bytes} [Tue Sep 13 19:35:12 2022] GET /identity/v3/roles/member => generated 84 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:35:13.071728 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd338d16-9154-4c26-972f-3de48f7ce9e0 None admin] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:35:13.073790 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8c55dc-60ac-42d3-a373-0a77c3309bc6 None None] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:35:13.134101 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b551b54a-5cd5-41d8-ba71-fd4079557be1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:35:13.136405 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b551b54a-5cd5-41d8-ba71-fd4079557be1 None admin] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:35:13.137301 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b551b54a-5cd5-41d8-ba71-fd4079557be1 None admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:35:13.138527 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b551b54a-5cd5-41d8-ba71-fd4079557be1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:35:13.146322 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG dbcounter [-] [87934] Writing DB stats keystone:SELECT=100 {{(pid=87934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:35:13.185780 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG dbcounter [-] [87935] Writing DB stats keystone:SELECT=100 {{(pid=87935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:35:13.253944 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd338d16-9154-4c26-972f-3de48f7ce9e0 None admin] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:35:13.295430 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b551b54a-5cd5-41d8-ba71-fd4079557be1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:35:13.296974 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b551b54a-5cd5-41d8-ba71-fd4079557be1 None admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:35:13.321168 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f1bb70-acbf-4bfa-b5ef-69ed7864bc46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:35:13.322248 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f1bb70-acbf-4bfa-b5ef-69ed7864bc46 None admin] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:35:13.322800 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f1bb70-acbf-4bfa-b5ef-69ed7864bc46 None admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:35:13.323315 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f1bb70-acbf-4bfa-b5ef-69ed7864bc46 None admin] PATH_INFO: `/v3/projects/8aefa5062b7b4e4390554359e5669a9b` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:35:13.324931 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f1bb70-acbf-4bfa-b5ef-69ed7864bc46 None admin] RBAC: Authorizing `identity:get_project(project_id=8aefa5062b7b4e4390554359e5669a9b)` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:35:13.326769 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f1bb70-acbf-4bfa-b5ef-69ed7864bc46 None admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:35:13.328907 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 86/172] 10.222.0.25 () {56 vars in 1186 bytes} [Tue Sep 13 19:35:13 2022] GET /identity/v3/projects/8aefa5062b7b4e4390554359e5669a9b => generated 298 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:35:13.332621 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20dd804e-a323-4c47-b47f-d81479f614f4 None None] REQUEST_METHOD: `POST` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:35:13.336803 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20dd804e-a323-4c47-b47f-d81479f614f4 None None] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:35:13.337181 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20dd804e-a323-4c47-b47f-d81479f614f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:35:13.358220 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.auth.core [None req-20dd804e-a323-4c47-b47f-d81479f614f4 None None] MFA Rules not processed for user `7b0aed92d02344acb92a0e4aa67c3068`. Rule list: `[]` (Enabled: `True`). {{(pid=87934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:35:13.359694 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.fernet_utils [None req-20dd804e-a323-4c47-b47f-d81479f614f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:35:13.440426 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 87/173] 10.222.0.25 () {58 vars in 1282 bytes} [Tue Sep 13 19:35:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 523 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 13 19:35:13.441352 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b551b54a-5cd5-41d8-ba71-fd4079557be1 None admin] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:35:13.447618 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 87/174] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Sep 13 19:35:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 19:35:13.449420 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b346146f-11f9-41c5-a684-ef4466c6b783 None None] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:35:13.449877 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b346146f-11f9-41c5-a684-ef4466c6b783 None None] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:35:13.450220 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b346146f-11f9-41c5-a684-ef4466c6b783 None None] PATH_INFO: `/` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:35:13.451666 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 88/175] 10.222.0.25 () {54 vars in 927 bytes} [Tue Sep 13 19:35:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:35:13.452596 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b346146f-11f9-41c5-a684-ef4466c6b783 None None] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:35:13.500544 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG dbcounter [-] [87935] Writing DB stats keystone:SELECT=100 {{(pid=87935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:35:13.517497 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG dbcounter [-] [87934] Writing DB stats keystone:SELECT=100 {{(pid=87934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:35:13.570424 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b551b54a-5cd5-41d8-ba71-fd4079557be1 None admin] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:35:13.579137 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b346146f-11f9-41c5-a684-ef4466c6b783 None None] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:35:13.615843 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595e4e7f-244b-40db-9255-f57d9a397147 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:35:13.616811 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a03670b-2e70-4e54-9a7b-61f71904ab4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:35:13.617068 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595e4e7f-244b-40db-9255-f57d9a397147 None admin] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:35:13.617542 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a03670b-2e70-4e54-9a7b-61f71904ab4f None admin] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:35:13.617726 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595e4e7f-244b-40db-9255-f57d9a397147 None admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:35:13.617955 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a03670b-2e70-4e54-9a7b-61f71904ab4f None admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:35:13.618282 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a03670b-2e70-4e54-9a7b-61f71904ab4f None admin] PATH_INFO: `/v3/roles` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:35:13.618457 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595e4e7f-244b-40db-9255-f57d9a397147 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:35:13.619064 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a03670b-2e70-4e54-9a7b-61f71904ab4f None admin] RBAC: Adding query filter params (name=member) {{(pid=87935) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:35:13.619426 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a03670b-2e70-4e54-9a7b-61f71904ab4f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:35:13.619617 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-595e4e7f-244b-40db-9255-f57d9a397147 None admin] RBAC: Adding query filter params (role.id=8af3d83a03144ae8bacdb82d9a108110, scope.project.id=8aefa5062b7b4e4390554359e5669a9b, user.id=d2e76fe7aad644f59888b9590b97c20c) {{(pid=87934) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:35:13.620051 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-595e4e7f-244b-40db-9255-f57d9a397147 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:35:13.621000 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a03670b-2e70-4e54-9a7b-61f71904ab4f None admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:35:13.621871 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-595e4e7f-244b-40db-9255-f57d9a397147 None admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:35:13.629207 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 89/176] 10.222.0.25 () {56 vars in 1374 bytes} [Tue Sep 13 19:35:13 2022] GET /identity/v3/role_assignments?user.id=d2e76fe7aad644f59888b9590b97c20c&scope.project.id=8aefa5062b7b4e4390554359e5669a9b&role.id=8af3d83a03144ae8bacdb82d9a108110 => generated 608 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:35:13.630369 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595e4e7f-244b-40db-9255-f57d9a397147 None admin] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:35:13.631529 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 88/177] 10.222.0.25 () {56 vars in 1101 bytes} [Tue Sep 13 19:35:13 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:35:13.638822 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7737dae7-4896-429c-9a9e-e76e4080069b None None] REQUEST_METHOD: `POST` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:35:13.640602 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7737dae7-4896-429c-9a9e-e76e4080069b None None] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:35:13.640878 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7737dae7-4896-429c-9a9e-e76e4080069b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:35:13.677375 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.auth.core [None req-7737dae7-4896-429c-9a9e-e76e4080069b None None] MFA Rules not processed for user `7b0aed92d02344acb92a0e4aa67c3068`. Rule list: `[]` (Enabled: `True`). {{(pid=87935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:35:13.678703 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.fernet_utils [None req-7737dae7-4896-429c-9a9e-e76e4080069b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:35:13.754770 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595e4e7f-244b-40db-9255-f57d9a397147 None admin] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:35:13.770449 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG dbcounter [-] [87934] Writing DB stats keystone:SELECT=100 {{(pid=87934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:35:13.779691 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 89/178] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Sep 13 19:35:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 19:35:13.787892 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a212b2-fad4-4c0d-b4be-cec0d32531df None None] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:35:13.787892 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a212b2-fad4-4c0d-b4be-cec0d32531df None None] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:35:13.787892 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a212b2-fad4-4c0d-b4be-cec0d32531df None None] PATH_INFO: `/` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:35:13.787892 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 90/179] 10.222.0.25 () {54 vars in 927 bytes} [Tue Sep 13 19:35:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:35:13.787892 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a212b2-fad4-4c0d-b4be-cec0d32531df None None] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:35:13.825161 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32458ef7-f582-46bb-8719-c71095c508c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:35:13.826085 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32458ef7-f582-46bb-8719-c71095c508c0 None admin] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:35:13.826374 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32458ef7-f582-46bb-8719-c71095c508c0 None admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:35:13.826644 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32458ef7-f582-46bb-8719-c71095c508c0 None admin] PATH_INFO: `/v3/projects/8aefa5062b7b4e4390554359e5669a9b` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:35:13.827948 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32458ef7-f582-46bb-8719-c71095c508c0 None admin] RBAC: Authorizing `identity:get_project(project_id=8aefa5062b7b4e4390554359e5669a9b)` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:35:13.829522 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32458ef7-f582-46bb-8719-c71095c508c0 None admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:35:13.831327 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 90/180] 10.222.0.25 () {56 vars in 1186 bytes} [Tue Sep 13 19:35:13 2022] GET /identity/v3/projects/8aefa5062b7b4e4390554359e5669a9b => generated 298 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:35:13.832170 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32458ef7-f582-46bb-8719-c71095c508c0 None admin] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:35:13.840389 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG dbcounter [-] [87935] Writing DB stats keystone:SELECT=100 {{(pid=87935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:35:13.914912 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a212b2-fad4-4c0d-b4be-cec0d32531df None None] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:35:13.955408 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9d3867-e3af-4f6d-bdf3-21d6e8e40b80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:35:13.956434 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9d3867-e3af-4f6d-bdf3-21d6e8e40b80 None admin] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:35:13.956926 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9d3867-e3af-4f6d-bdf3-21d6e8e40b80 None admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:35:13.957643 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9d3867-e3af-4f6d-bdf3-21d6e8e40b80 None admin] PATH_INFO: `/v3/users/d2e76fe7aad644f59888b9590b97c20c` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:35:13.958986 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c9d3867-e3af-4f6d-bdf3-21d6e8e40b80 None admin] RBAC: Authorizing `identity:get_user(user_id=d2e76fe7aad644f59888b9590b97c20c)` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:35:13.961930 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c9d3867-e3af-4f6d-bdf3-21d6e8e40b80 None admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:35:13.963589 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32458ef7-f582-46bb-8719-c71095c508c0 None admin] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:35:13.964588 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 91/181] 10.222.0.25 () {56 vars in 1177 bytes} [Tue Sep 13 19:35:13 2022] GET /identity/v3/users/d2e76fe7aad644f59888b9590b97c20c => generated 275 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:35:13.965944 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a96ab40-3556-4d28-9429-0f6e77776553 None None] REQUEST_METHOD: `POST` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:35:13.966416 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a96ab40-3556-4d28-9429-0f6e77776553 None None] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:35:13.966891 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a96ab40-3556-4d28-9429-0f6e77776553 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:35:13.998789 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.auth.core [None req-2a96ab40-3556-4d28-9429-0f6e77776553 None None] MFA Rules not processed for user `7b0aed92d02344acb92a0e4aa67c3068`. Rule list: `[]` (Enabled: `True`). {{(pid=87935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:35:14.000613 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.fernet_utils [None req-2a96ab40-3556-4d28-9429-0f6e77776553 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:35:14.020089 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9011eafe-52f9-4c95-8f8a-0fd79709fca8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:35:14.020804 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9011eafe-52f9-4c95-8f8a-0fd79709fca8 None admin] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:35:14.021085 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9011eafe-52f9-4c95-8f8a-0fd79709fca8 None admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:35:14.021342 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9011eafe-52f9-4c95-8f8a-0fd79709fca8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:35:14.033701 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9011eafe-52f9-4c95-8f8a-0fd79709fca8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 19:35:14.039404 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application [None req-9011eafe-52f9-4c95-8f8a-0fd79709fca8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 19:35:14.039404 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:35:14.039404 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:35:14.039404 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:35:14.039404 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:35:14.039404 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:35:14.039404 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:35:14.039404 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:35:14.039404 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:35:14.039404 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:35:14.039404 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:35:14.039404 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:35:14.039404 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 19:35:14.039404 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 19:35:14.039404 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 19:35:14.039404 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 19:35:14.040361 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 19:35:14.040361 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 19:35:14.040361 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 19:35:14.040361 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 19:35:14.040361 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:35:14.040361 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:35:14.040361 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:35:14.040361 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:35:14.040361 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:35:14.040361 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:35:14.040361 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:35:14.040361 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application with Lock( Sep 13 19:35:14.040361 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:35:14.040361 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:35:14.040361 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:35:14.040361 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:35:14.041136 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:35:14.041136 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:35:14.041136 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:35:14.041136 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:35:14.041136 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 19:35:14.041136 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 19:35:14.041136 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 19:35:14.041136 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 19:35:14.041136 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 19:35:14.041136 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 19:35:14.041136 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 19:35:14.041136 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application Sep 13 19:35:14.041136 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 91/182] 10.222.0.25 () {56 vars in 1096 bytes} [Tue Sep 13 19:35:13 2022] GET /identity/v3/roles/admin => generated 83 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:35:14.041800 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9011eafe-52f9-4c95-8f8a-0fd79709fca8 None admin] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:35:14.090788 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 92/183] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Sep 13 19:35:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 19:35:14.091571 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a96ab40-3556-4d28-9429-0f6e77776553 None None] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:35:14.106001 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG dbcounter [-] [87934] Writing DB stats keystone:SELECT=100 {{(pid=87934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:35:14.152765 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG dbcounter [-] [87935] Writing DB stats keystone:SELECT=100 {{(pid=87935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:35:14.194113 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9011eafe-52f9-4c95-8f8a-0fd79709fca8 None admin] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:35:14.239336 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489c75df-06b3-4cb1-bdb9-c6dbdd575654 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:35:14.239949 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489c75df-06b3-4cb1-bdb9-c6dbdd575654 None admin] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:35:14.240262 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489c75df-06b3-4cb1-bdb9-c6dbdd575654 None admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:35:14.240540 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489c75df-06b3-4cb1-bdb9-c6dbdd575654 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:35:14.242534 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-489c75df-06b3-4cb1-bdb9-c6dbdd575654 None admin] RBAC: Adding query filter params (role.id=6ca1d4427ff64e0a9d25d96cfb1445f6, scope.project.id=8aefa5062b7b4e4390554359e5669a9b, user.id=7b0aed92d02344acb92a0e4aa67c3068) {{(pid=87934) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:35:14.243169 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-489c75df-06b3-4cb1-bdb9-c6dbdd575654 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:35:14.244734 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-489c75df-06b3-4cb1-bdb9-c6dbdd575654 None admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:35:14.256556 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a96ab40-3556-4d28-9429-0f6e77776553 None None] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:35:14.257581 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 92/184] 10.222.0.25 () {56 vars in 1374 bytes} [Tue Sep 13 19:35:14 2022] GET /identity/v3/role_assignments?user.id=7b0aed92d02344acb92a0e4aa67c3068&scope.project.id=8aefa5062b7b4e4390554359e5669a9b&role.id=6ca1d4427ff64e0a9d25d96cfb1445f6 => generated 608 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:35:14.260412 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489c75df-06b3-4cb1-bdb9-c6dbdd575654 None admin] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:35:14.344047 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58999fb5-f4da-4516-bc2b-db36aac1a6b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:35:14.345297 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58999fb5-f4da-4516-bc2b-db36aac1a6b2 None admin] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:35:14.347969 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58999fb5-f4da-4516-bc2b-db36aac1a6b2 None admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:35:14.348537 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58999fb5-f4da-4516-bc2b-db36aac1a6b2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:35:14.459512 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489c75df-06b3-4cb1-bdb9-c6dbdd575654 None admin] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:35:14.462780 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG dbcounter [-] [87934] Writing DB stats keystone:SELECT=100 {{(pid=87934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:35:14.474458 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58999fb5-f4da-4516-bc2b-db36aac1a6b2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:35:14.476896 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58999fb5-f4da-4516-bc2b-db36aac1a6b2 None admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:35:14.503591 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ff0fcc-ac42-4748-af98-50aa4cd34284 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:35:14.504790 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ff0fcc-ac42-4748-af98-50aa4cd34284 None admin] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:35:14.505477 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ff0fcc-ac42-4748-af98-50aa4cd34284 None admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:35:14.505943 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ff0fcc-ac42-4748-af98-50aa4cd34284 None admin] PATH_INFO: `/v3/roles` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:35:14.507988 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ff0fcc-ac42-4748-af98-50aa4cd34284 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87934) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:35:14.508514 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ff0fcc-ac42-4748-af98-50aa4cd34284 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:35:14.510367 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ff0fcc-ac42-4748-af98-50aa4cd34284 None admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:35:14.524321 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 93/185] 10.222.0.25 () {56 vars in 1099 bytes} [Tue Sep 13 19:35:14 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:35:14.525416 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ff0fcc-ac42-4748-af98-50aa4cd34284 None admin] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:35:14.526998 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG dbcounter [-] [87935] Writing DB stats keystone:SELECT=100 {{(pid=87935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:35:14.610948 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 93/186] 10.222.0.25 () {58 vars in 1282 bytes} [Tue Sep 13 19:35:14 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 519 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 13 19:35:14.612609 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58999fb5-f4da-4516-bc2b-db36aac1a6b2 None admin] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:35:14.663187 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ff0fcc-ac42-4748-af98-50aa4cd34284 None admin] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:35:14.699595 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6365bef-98ac-43f3-b132-2aa132915dcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:35:14.700248 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6365bef-98ac-43f3-b132-2aa132915dcd None admin] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:35:14.700533 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6365bef-98ac-43f3-b132-2aa132915dcd None admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:35:14.700804 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6365bef-98ac-43f3-b132-2aa132915dcd None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:35:14.712116 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6365bef-98ac-43f3-b132-2aa132915dcd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 19:35:14.717631 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application [None req-d6365bef-98ac-43f3-b132-2aa132915dcd None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 13 19:35:14.717631 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:35:14.717631 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:35:14.717631 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:35:14.717631 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:35:14.717631 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:35:14.717631 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:35:14.717631 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:35:14.717631 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:35:14.717631 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:35:14.717631 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:35:14.717631 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:35:14.717631 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 19:35:14.717631 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 19:35:14.717631 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 19:35:14.717631 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 19:35:14.718570 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 19:35:14.718570 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 19:35:14.718570 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 19:35:14.718570 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 19:35:14.718570 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:35:14.718570 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:35:14.718570 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:35:14.718570 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:35:14.718570 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:35:14.718570 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:35:14.718570 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:35:14.718570 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application with Lock( Sep 13 19:35:14.718570 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:35:14.718570 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:35:14.718570 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:35:14.718570 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:35:14.719377 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:35:14.719377 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:35:14.719377 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:35:14.719377 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:35:14.719377 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 19:35:14.719377 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 19:35:14.719377 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 19:35:14.719377 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 19:35:14.719377 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 19:35:14.719377 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 19:35:14.719377 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 13 19:35:14.719377 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application Sep 13 19:35:14.719377 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 94/187] 10.222.0.25 () {56 vars in 1114 bytes} [Tue Sep 13 19:35:14 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:35:14.720054 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6365bef-98ac-43f3-b132-2aa132915dcd None admin] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:35:14.733876 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58999fb5-f4da-4516-bc2b-db36aac1a6b2 None admin] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:35:14.752668 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG dbcounter [-] [87934] Writing DB stats keystone:SELECT=100 {{(pid=87934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:35:14.777601 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6117ff9f-7bf5-4e51-834b-791c3e378727 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:35:14.778636 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6117ff9f-7bf5-4e51-834b-791c3e378727 None admin] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:35:14.779117 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6117ff9f-7bf5-4e51-834b-791c3e378727 None admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:35:14.779582 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6117ff9f-7bf5-4e51-834b-791c3e378727 None admin] PATH_INFO: `/v3/domains/default` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:35:14.781460 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6117ff9f-7bf5-4e51-834b-791c3e378727 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:35:14.784349 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6117ff9f-7bf5-4e51-834b-791c3e378727 None admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:35:14.787275 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 94/188] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Sep 13 19:35:14 2022] GET /identity/v3/domains/default => generated 199 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:35:14.790096 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6117ff9f-7bf5-4e51-834b-791c3e378727 None admin] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:35:14.801427 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG dbcounter [-] [87935] Writing DB stats keystone:SELECT=100 {{(pid=87935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:35:14.845163 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6365bef-98ac-43f3-b132-2aa132915dcd None admin] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:35:14.880202 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6070c6-92c1-415a-94e2-fa62f5a84d69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:35:14.880803 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6070c6-92c1-415a-94e2-fa62f5a84d69 None admin] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:35:14.881079 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6070c6-92c1-415a-94e2-fa62f5a84d69 None admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:35:14.881350 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6070c6-92c1-415a-94e2-fa62f5a84d69 None admin] PATH_INFO: `/v3/users/c2092d127b9542acbd73594cc26290a3` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:35:14.901624 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a6070c6-92c1-415a-94e2-fa62f5a84d69 None admin] RBAC: Authorizing `identity:get_user(user_id=c2092d127b9542acbd73594cc26290a3)` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:35:14.903100 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a6070c6-92c1-415a-94e2-fa62f5a84d69 None admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:35:14.909313 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 95/189] 10.222.0.25 () {56 vars in 1177 bytes} [Tue Sep 13 19:35:14 2022] GET /identity/v3/users/c2092d127b9542acbd73594cc26290a3 => generated 283 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:35:14.909313 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6070c6-92c1-415a-94e2-fa62f5a84d69 None admin] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:35:14.919958 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6117ff9f-7bf5-4e51-834b-791c3e378727 None admin] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:35:14.957755 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05eded3-b43a-45d3-b07e-71bcb19d69f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:35:14.958618 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05eded3-b43a-45d3-b07e-71bcb19d69f1 None admin] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:35:14.959061 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05eded3-b43a-45d3-b07e-71bcb19d69f1 None admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:35:14.959490 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05eded3-b43a-45d3-b07e-71bcb19d69f1 None admin] PATH_INFO: `/v3/projects/345a09ee00cc4ce39a05041a4cb5e591` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:35:14.960854 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f05eded3-b43a-45d3-b07e-71bcb19d69f1 None admin] RBAC: Authorizing `identity:get_project(project_id=345a09ee00cc4ce39a05041a4cb5e591)` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:35:14.962880 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f05eded3-b43a-45d3-b07e-71bcb19d69f1 None admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:35:14.969598 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 95/190] 10.222.0.25 () {56 vars in 1186 bytes} [Tue Sep 13 19:35:14 2022] GET /identity/v3/projects/345a09ee00cc4ce39a05041a4cb5e591 => generated 312 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:35:14.970367 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05eded3-b43a-45d3-b07e-71bcb19d69f1 None admin] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:35:15.003443 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG dbcounter [-] [87934] Writing DB stats keystone:SELECT=100 {{(pid=87934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:35:15.022698 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6070c6-92c1-415a-94e2-fa62f5a84d69 None admin] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:35:15.059104 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG dbcounter [-] [87935] Writing DB stats keystone:SELECT=100 {{(pid=87935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:35:15.059629 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2da06d0-560b-49fa-b30f-ba19d18a0bf6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:35:15.060528 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2da06d0-560b-49fa-b30f-ba19d18a0bf6 None admin] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:35:15.060528 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2da06d0-560b-49fa-b30f-ba19d18a0bf6 None admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:35:15.060809 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2da06d0-560b-49fa-b30f-ba19d18a0bf6 None admin] PATH_INFO: `/v3/roles` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:35:15.061547 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2da06d0-560b-49fa-b30f-ba19d18a0bf6 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=87934) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:35:15.061789 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2da06d0-560b-49fa-b30f-ba19d18a0bf6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:35:15.063157 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2da06d0-560b-49fa-b30f-ba19d18a0bf6 None admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:35:15.072744 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 96/191] 10.222.0.25 () {56 vars in 1111 bytes} [Tue Sep 13 19:35:14 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:35:15.073424 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2da06d0-560b-49fa-b30f-ba19d18a0bf6 None admin] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:35:15.093252 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05eded3-b43a-45d3-b07e-71bcb19d69f1 None admin] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:35:15.129196 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ca3338-009d-4c18-872f-05f0daa6d307 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:35:15.129793 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ca3338-009d-4c18-872f-05f0daa6d307 None admin] REQUEST_METHOD: `POST` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:35:15.130072 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ca3338-009d-4c18-872f-05f0daa6d307 None admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:35:15.130394 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ca3338-009d-4c18-872f-05f0daa6d307 None admin] PATH_INFO: `/v3/users` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:35:15.130990 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ca3338-009d-4c18-872f-05f0daa6d307 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:35:15.132897 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ca3338-009d-4c18-872f-05f0daa6d307 None admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:35:15.172252 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 96/192] 10.222.0.25 () {60 vars in 1132 bytes} [Tue Sep 13 19:35:14 2022] POST /identity/v3/users => generated 297 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 19:35:15.172252 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ca3338-009d-4c18-872f-05f0daa6d307 None admin] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:35:15.221701 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2da06d0-560b-49fa-b30f-ba19d18a0bf6 None admin] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:35:15.287164 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fdb2537-3828-434a-a9cb-d1f9689000e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:35:15.287797 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fdb2537-3828-434a-a9cb-d1f9689000e7 None admin] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:35:15.288816 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fdb2537-3828-434a-a9cb-d1f9689000e7 None admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:35:15.289251 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fdb2537-3828-434a-a9cb-d1f9689000e7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:35:15.310478 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG dbcounter [-] [87934] Writing DB stats keystone:SELECT=100 {{(pid=87934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:35:15.338046 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ca3338-009d-4c18-872f-05f0daa6d307 None admin] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:35:15.374565 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG dbcounter [-] [87935] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:35:15.388554 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8acddd7c-ea57-4700-baa3-22becf8a154d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:35:15.389133 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fdb2537-3828-434a-a9cb-d1f9689000e7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:35:15.389695 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acddd7c-ea57-4700-baa3-22becf8a154d None admin] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:35:15.389970 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acddd7c-ea57-4700-baa3-22becf8a154d None admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:35:15.390242 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acddd7c-ea57-4700-baa3-22becf8a154d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:35:15.390716 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fdb2537-3828-434a-a9cb-d1f9689000e7 None admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:35:15.390974 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8acddd7c-ea57-4700-baa3-22becf8a154d None admin] RBAC: Adding query filter params (role.id=a259191f6d0e46fabd9f34536bb28747, scope.project.id=345a09ee00cc4ce39a05041a4cb5e591, user.id=d2e76fe7aad644f59888b9590b97c20c) {{(pid=87935) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:35:15.391282 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8acddd7c-ea57-4700-baa3-22becf8a154d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:35:15.393468 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8acddd7c-ea57-4700-baa3-22becf8a154d None admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:35:15.401799 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 97/193] 10.222.0.25 () {56 vars in 1374 bytes} [Tue Sep 13 19:35:15 2022] GET /identity/v3/role_assignments?user.id=d2e76fe7aad644f59888b9590b97c20c&scope.project.id=345a09ee00cc4ce39a05041a4cb5e591&role.id=a259191f6d0e46fabd9f34536bb28747 => generated 608 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:35:15.401799 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8acddd7c-ea57-4700-baa3-22becf8a154d None admin] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:35:15.534927 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 97/194] 10.222.0.25 () {58 vars in 1282 bytes} [Tue Sep 13 19:35:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 462 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 13 19:35:15.536005 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8acddd7c-ea57-4700-baa3-22becf8a154d None admin] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:35:15.536392 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94049c18-b750-4e95-b1bc-c5e95be4895a None None] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:35:15.536572 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94049c18-b750-4e95-b1bc-c5e95be4895a None None] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:35:15.536823 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94049c18-b750-4e95-b1bc-c5e95be4895a None None] PATH_INFO: `/` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:35:15.538566 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 98/195] 10.222.0.25 () {54 vars in 927 bytes} [Tue Sep 13 19:35:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:35:15.541254 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94049c18-b750-4e95-b1bc-c5e95be4895a None None] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:35:15.587429 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd5ca19-1f2f-42d3-9f17-43d378946cee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:35:15.587755 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd5ca19-1f2f-42d3-9f17-43d378946cee None admin] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:35:15.588033 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd5ca19-1f2f-42d3-9f17-43d378946cee None admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:35:15.589137 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd5ca19-1f2f-42d3-9f17-43d378946cee None admin] PATH_INFO: `/v3/users/c2092d127b9542acbd73594cc26290a3` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:35:15.590494 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd5ca19-1f2f-42d3-9f17-43d378946cee None admin] RBAC: Authorizing `identity:get_user(user_id=c2092d127b9542acbd73594cc26290a3)` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:35:15.592006 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd5ca19-1f2f-42d3-9f17-43d378946cee None admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:35:15.593967 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 98/196] 10.222.0.25 () {56 vars in 1177 bytes} [Tue Sep 13 19:35:15 2022] GET /identity/v3/users/c2092d127b9542acbd73594cc26290a3 => generated 283 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:35:15.594984 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205d897c-fb29-4345-afd6-c0655e0f5858 None None] REQUEST_METHOD: `POST` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:35:15.595262 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205d897c-fb29-4345-afd6-c0655e0f5858 None None] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:35:15.595662 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205d897c-fb29-4345-afd6-c0655e0f5858 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:35:15.604543 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG dbcounter [-] [87934] Writing DB stats keystone:SELECT=100 {{(pid=87934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:35:15.623219 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.auth.core [None req-205d897c-fb29-4345-afd6-c0655e0f5858 None None] MFA Rules not processed for user `7b0aed92d02344acb92a0e4aa67c3068`. Rule list: `[]` (Enabled: `True`). {{(pid=87935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:35:15.625528 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.fernet_utils [None req-205d897c-fb29-4345-afd6-c0655e0f5858 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:35:15.689128 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94049c18-b750-4e95-b1bc-c5e95be4895a None None] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:35:15.707823 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG dbcounter [-] [87935] Writing DB stats keystone:SELECT=100 {{(pid=87935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:35:15.724250 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 99/197] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Sep 13 19:35:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 19:35:15.724250 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205d897c-fb29-4345-afd6-c0655e0f5858 None None] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:35:15.743012 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ad85d4-c143-42e4-bdb3-9eac43f84893 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:35:15.743654 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ad85d4-c143-42e4-bdb3-9eac43f84893 None admin] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:35:15.743927 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ad85d4-c143-42e4-bdb3-9eac43f84893 None admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:35:15.744192 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ad85d4-c143-42e4-bdb3-9eac43f84893 None admin] PATH_INFO: `/v3/projects/93e1f3226d564df686b8ca37cfd3a42c` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:35:15.747423 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ad85d4-c143-42e4-bdb3-9eac43f84893 None admin] RBAC: Authorizing `identity:get_project(project_id=93e1f3226d564df686b8ca37cfd3a42c)` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:35:15.750248 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ad85d4-c143-42e4-bdb3-9eac43f84893 None admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:35:15.752869 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 99/198] 10.222.0.25 () {56 vars in 1186 bytes} [Tue Sep 13 19:35:15 2022] GET /identity/v3/projects/93e1f3226d564df686b8ca37cfd3a42c => generated 302 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 19:35:15.759336 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ad85d4-c143-42e4-bdb3-9eac43f84893 None admin] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:35:15.920263 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ad85d4-c143-42e4-bdb3-9eac43f84893 None admin] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:35:15.936159 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205d897c-fb29-4345-afd6-c0655e0f5858 None None] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:35:15.940371 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG dbcounter [-] [87934] Writing DB stats keystone:SELECT=100 {{(pid=87934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:35:15.977258 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87a2869-4272-4f02-a565-3a6ce4ad09fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:35:15.977878 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87a2869-4272-4f02-a565-3a6ce4ad09fe None admin] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:35:15.978158 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87a2869-4272-4f02-a565-3a6ce4ad09fe None admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:35:15.978425 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87a2869-4272-4f02-a565-3a6ce4ad09fe None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:35:15.979153 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a87a2869-4272-4f02-a565-3a6ce4ad09fe None admin] RBAC: Adding query filter params (role.id=6ca1d4427ff64e0a9d25d96cfb1445f6, scope.project.id=93e1f3226d564df686b8ca37cfd3a42c, user.id=c2092d127b9542acbd73594cc26290a3) {{(pid=87934) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:35:15.979458 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a87a2869-4272-4f02-a565-3a6ce4ad09fe None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:35:15.985462 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a87a2869-4272-4f02-a565-3a6ce4ad09fe None admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:35:15.990722 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 100/199] 10.222.0.25 () {56 vars in 1374 bytes} [Tue Sep 13 19:35:15 2022] GET /identity/v3/role_assignments?user.id=c2092d127b9542acbd73594cc26290a3&scope.project.id=93e1f3226d564df686b8ca37cfd3a42c&role.id=6ca1d4427ff64e0a9d25d96cfb1445f6 => generated 259 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:35:16.001442 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29b7582-85dc-41c9-a1bc-ec881b23c514 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:35:16.002080 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29b7582-85dc-41c9-a1bc-ec881b23c514 None admin] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:35:16.002355 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29b7582-85dc-41c9-a1bc-ec881b23c514 None admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:35:16.002620 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29b7582-85dc-41c9-a1bc-ec881b23c514 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:35:16.051440 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87a2869-4272-4f02-a565-3a6ce4ad09fe None admin] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:35:16.086218 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG dbcounter [-] [87935] Writing DB stats keystone:SELECT=100 {{(pid=87935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:35:16.098956 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b29b7582-85dc-41c9-a1bc-ec881b23c514 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:35:16.100572 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b29b7582-85dc-41c9-a1bc-ec881b23c514 None admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:35:16.230417 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 100/200] 10.222.0.25 () {58 vars in 1282 bytes} [Tue Sep 13 19:35:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 508 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 13 19:35:16.236317 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29b7582-85dc-41c9-a1bc-ec881b23c514 None admin] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:35:16.266275 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87a2869-4272-4f02-a565-3a6ce4ad09fe None admin] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:35:16.335695 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3217c0-d1e8-49f2-b439-5ea2e45e63a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:35:16.336564 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3217c0-d1e8-49f2-b439-5ea2e45e63a8 None admin] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:35:16.336843 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3217c0-d1e8-49f2-b439-5ea2e45e63a8 None admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:35:16.337103 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3217c0-d1e8-49f2-b439-5ea2e45e63a8 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:35:16.359978 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c3217c0-d1e8-49f2-b439-5ea2e45e63a8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 19:35:16.365392 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application [None req-6c3217c0-d1e8-49f2-b439-5ea2e45e63a8 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 13 19:35:16.365392 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:35:16.365392 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:35:16.365392 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:35:16.365392 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:35:16.365392 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:35:16.365392 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:35:16.365392 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:35:16.365392 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:35:16.365392 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:35:16.365392 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:35:16.365392 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:35:16.365392 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 19:35:16.365392 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 19:35:16.365392 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 19:35:16.365392 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 19:35:16.366900 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 19:35:16.366900 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 19:35:16.366900 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 19:35:16.366900 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 19:35:16.366900 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:35:16.366900 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:35:16.366900 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:35:16.366900 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:35:16.366900 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:35:16.366900 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:35:16.366900 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:35:16.366900 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application with Lock( Sep 13 19:35:16.366900 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:35:16.366900 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:35:16.366900 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:35:16.366900 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:35:16.368167 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:35:16.368167 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:35:16.368167 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:35:16.368167 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:35:16.368167 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 19:35:16.368167 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 19:35:16.368167 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 19:35:16.368167 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 19:35:16.368167 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 19:35:16.368167 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 19:35:16.368167 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 13 19:35:16.368167 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application Sep 13 19:35:16.368167 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 101/201] 10.222.0.25 () {56 vars in 1099 bytes} [Tue Sep 13 19:35:16 2022] GET /identity/v3/roles/reader => generated 84 bytes in 317 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 13 19:35:16.374809 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3217c0-d1e8-49f2-b439-5ea2e45e63a8 None admin] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:35:16.396469 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG dbcounter [-] [87935] Writing DB stats keystone:SELECT=100 {{(pid=87935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:35:16.422540 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29b7582-85dc-41c9-a1bc-ec881b23c514 None admin] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:35:16.427734 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG dbcounter [-] [87934] Writing DB stats keystone:SELECT=100 {{(pid=87934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:35:16.513451 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c6e18c-57eb-4c82-bfbe-b37a667d9abc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:35:16.514452 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c6e18c-57eb-4c82-bfbe-b37a667d9abc None admin] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:35:16.514923 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c6e18c-57eb-4c82-bfbe-b37a667d9abc None admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:35:16.515390 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c6e18c-57eb-4c82-bfbe-b37a667d9abc None admin] PATH_INFO: `/v3/projects/93e1f3226d564df686b8ca37cfd3a42c` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:35:16.521464 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c6e18c-57eb-4c82-bfbe-b37a667d9abc None admin] RBAC: Authorizing `identity:get_project(project_id=93e1f3226d564df686b8ca37cfd3a42c)` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:35:16.524252 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c6e18c-57eb-4c82-bfbe-b37a667d9abc None admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:35:16.527662 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 101/202] 10.222.0.25 () {56 vars in 1186 bytes} [Tue Sep 13 19:35:16 2022] GET /identity/v3/projects/93e1f3226d564df686b8ca37cfd3a42c => generated 302 bytes in 292 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 19:35:16.536632 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c6e18c-57eb-4c82-bfbe-b37a667d9abc None admin] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:35:16.537377 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3217c0-d1e8-49f2-b439-5ea2e45e63a8 None admin] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:35:16.592774 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5674a1-b62a-4393-8f44-c7ac7492577b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:35:16.593483 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5674a1-b62a-4393-8f44-c7ac7492577b None admin] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:35:16.593934 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5674a1-b62a-4393-8f44-c7ac7492577b None admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:35:16.594600 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5674a1-b62a-4393-8f44-c7ac7492577b None admin] PATH_INFO: `/v3/roles` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:35:16.596061 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea5674a1-b62a-4393-8f44-c7ac7492577b None admin] RBAC: Adding query filter params (name=reader) {{(pid=87934) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:35:16.596644 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea5674a1-b62a-4393-8f44-c7ac7492577b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:35:16.599495 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea5674a1-b62a-4393-8f44-c7ac7492577b None admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:35:16.615530 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 102/203] 10.222.0.25 () {56 vars in 1101 bytes} [Tue Sep 13 19:35:16 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:35:16.622934 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5674a1-b62a-4393-8f44-c7ac7492577b None admin] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:35:16.773836 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG dbcounter [-] [87934] Writing DB stats keystone:SELECT=100 {{(pid=87934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:35:16.777705 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5674a1-b62a-4393-8f44-c7ac7492577b None admin] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:35:16.818470 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2580f7fe-1101-4bb3-b448-cc38e5da5c2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:35:16.819113 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2580f7fe-1101-4bb3-b448-cc38e5da5c2f None admin] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:35:16.819930 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2580f7fe-1101-4bb3-b448-cc38e5da5c2f None admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:35:16.820219 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2580f7fe-1101-4bb3-b448-cc38e5da5c2f None admin] PATH_INFO: `/v3/users/3e259c73a2ae4ccf98905d4334cc8d1a` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:35:16.821553 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2580f7fe-1101-4bb3-b448-cc38e5da5c2f None admin] RBAC: Authorizing `identity:get_user(user_id=3e259c73a2ae4ccf98905d4334cc8d1a)` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:35:16.823019 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2580f7fe-1101-4bb3-b448-cc38e5da5c2f None admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:35:16.824154 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c6e18c-57eb-4c82-bfbe-b37a667d9abc None admin] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:35:16.825023 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 103/204] 10.222.0.25 () {56 vars in 1177 bytes} [Tue Sep 13 19:35:16 2022] GET /identity/v3/users/3e259c73a2ae4ccf98905d4334cc8d1a => generated 289 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 19:35:16.833654 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2580f7fe-1101-4bb3-b448-cc38e5da5c2f None admin] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:35:16.877947 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ca423b-b6bf-4bf1-a8ac-4203519cc76b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:35:16.878561 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ca423b-b6bf-4bf1-a8ac-4203519cc76b None admin] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:35:16.878839 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ca423b-b6bf-4bf1-a8ac-4203519cc76b None admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:35:16.879110 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ca423b-b6bf-4bf1-a8ac-4203519cc76b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:35:16.879850 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ca423b-b6bf-4bf1-a8ac-4203519cc76b None admin] RBAC: Adding query filter params (role.id=8af3d83a03144ae8bacdb82d9a108110, scope.project.id=93e1f3226d564df686b8ca37cfd3a42c, user.id=c2092d127b9542acbd73594cc26290a3) {{(pid=87935) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:35:16.880159 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ca423b-b6bf-4bf1-a8ac-4203519cc76b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:35:16.882170 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ca423b-b6bf-4bf1-a8ac-4203519cc76b None admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:35:16.889487 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 102/205] 10.222.0.25 () {56 vars in 1374 bytes} [Tue Sep 13 19:35:16 2022] GET /identity/v3/role_assignments?user.id=c2092d127b9542acbd73594cc26290a3&scope.project.id=93e1f3226d564df686b8ca37cfd3a42c&role.id=8af3d83a03144ae8bacdb82d9a108110 => generated 259 bytes in 354 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 19:35:16.982103 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2580f7fe-1101-4bb3-b448-cc38e5da5c2f None admin] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:35:17.021295 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba7a102-b5c0-48ac-be24-4c8301edcb7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:35:17.021920 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba7a102-b5c0-48ac-be24-4c8301edcb7c None admin] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:35:17.022203 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba7a102-b5c0-48ac-be24-4c8301edcb7c None admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:35:17.023016 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba7a102-b5c0-48ac-be24-4c8301edcb7c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:35:17.065753 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG dbcounter [-] [87934] Writing DB stats keystone:SELECT=100 {{(pid=87934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:35:17.105750 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba7a102-b5c0-48ac-be24-4c8301edcb7c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:35:17.107246 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba7a102-b5c0-48ac-be24-4c8301edcb7c None admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:35:17.219552 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 104/206] 10.222.0.25 () {58 vars in 1282 bytes} [Tue Sep 13 19:35:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 386 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 13 19:35:17.229336 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ca423b-b6bf-4bf1-a8ac-4203519cc76b None admin] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:35:17.264234 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG dbcounter [-] [87935] Writing DB stats keystone:SELECT=100 {{(pid=87935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:35:17.345314 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ca423b-b6bf-4bf1-a8ac-4203519cc76b None admin] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:35:17.387842 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7f7dde-d21b-4ce1-a54a-762a00d61f05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:35:17.388516 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7f7dde-d21b-4ce1-a54a-762a00d61f05 None admin] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:35:17.388801 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7f7dde-d21b-4ce1-a54a-762a00d61f05 None admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:35:17.389072 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7f7dde-d21b-4ce1-a54a-762a00d61f05 None admin] PATH_INFO: `/v3/projects/8aefa5062b7b4e4390554359e5669a9b` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:35:17.392920 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce7f7dde-d21b-4ce1-a54a-762a00d61f05 None admin] RBAC: Authorizing `identity:get_project(project_id=8aefa5062b7b4e4390554359e5669a9b)` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:35:17.394390 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce7f7dde-d21b-4ce1-a54a-762a00d61f05 None admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:35:17.396065 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 103/207] 10.222.0.25 () {56 vars in 1186 bytes} [Tue Sep 13 19:35:17 2022] GET /identity/v3/projects/8aefa5062b7b4e4390554359e5669a9b => generated 298 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:35:17.403003 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba7a102-b5c0-48ac-be24-4c8301edcb7c None admin] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:35:17.483020 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG dbcounter [-] [87934] Writing DB stats keystone:SELECT=100 {{(pid=87934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:35:17.521476 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba7a102-b5c0-48ac-be24-4c8301edcb7c None admin] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:35:17.563884 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4dd80bf-94a2-4255-97c4-a908e9b66f7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:35:17.564536 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4dd80bf-94a2-4255-97c4-a908e9b66f7b None admin] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:35:17.564822 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4dd80bf-94a2-4255-97c4-a908e9b66f7b None admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:35:17.565095 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4dd80bf-94a2-4255-97c4-a908e9b66f7b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:35:17.565843 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4dd80bf-94a2-4255-97c4-a908e9b66f7b None admin] RBAC: Adding query filter params (role.id=85e5149eef184d349b4b1859b84dd789, scope.project.id=8aefa5062b7b4e4390554359e5669a9b, user.id=3e259c73a2ae4ccf98905d4334cc8d1a) {{(pid=87934) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:35:17.566152 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4dd80bf-94a2-4255-97c4-a908e9b66f7b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:35:17.567613 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4dd80bf-94a2-4255-97c4-a908e9b66f7b None admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:35:17.575166 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 105/208] 10.222.0.25 () {56 vars in 1374 bytes} [Tue Sep 13 19:35:17 2022] GET /identity/v3/role_assignments?user.id=3e259c73a2ae4ccf98905d4334cc8d1a&scope.project.id=8aefa5062b7b4e4390554359e5669a9b&role.id=85e5149eef184d349b4b1859b84dd789 => generated 608 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:35:18.186661 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7eb5cfb-82de-4ce5-8d37-d94f4f6a7309 None None] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:35:18.187143 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7eb5cfb-82de-4ce5-8d37-d94f4f6a7309 None None] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:35:18.187913 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7eb5cfb-82de-4ce5-8d37-d94f4f6a7309 None None] PATH_INFO: `/` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:35:18.190982 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 104/209] 10.222.0.25 () {54 vars in 927 bytes} [Tue Sep 13 19:35:18 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:35:18.199343 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f98a3f-a562-4f43-9b2f-3efc9d4b185e None None] REQUEST_METHOD: `POST` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:35:18.199625 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f98a3f-a562-4f43-9b2f-3efc9d4b185e None None] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:35:18.199894 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f98a3f-a562-4f43-9b2f-3efc9d4b185e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:35:18.224136 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.auth.core [None req-07f98a3f-a562-4f43-9b2f-3efc9d4b185e None None] MFA Rules not processed for user `7b0aed92d02344acb92a0e4aa67c3068`. Rule list: `[]` (Enabled: `True`). {{(pid=87934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:35:18.225361 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.fernet_utils [None req-07f98a3f-a562-4f43-9b2f-3efc9d4b185e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:35:18.322828 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 106/210] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Sep 13 19:35:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 19:35:18.614586 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7eb5cfb-82de-4ce5-8d37-d94f4f6a7309 None None] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:35:18.634259 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82330fe6-d38b-4c73-a4c6-37b50fef3154 None None] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:35:18.634809 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82330fe6-d38b-4c73-a4c6-37b50fef3154 None None] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:35:18.635161 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82330fe6-d38b-4c73-a4c6-37b50fef3154 None None] PATH_INFO: `/` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:35:18.636927 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 107/211] 10.222.0.25 () {54 vars in 927 bytes} [Tue Sep 13 19:35:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:35:18.642568 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c7667a-8044-4c3f-a194-24233d92a5fc None None] REQUEST_METHOD: `POST` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:35:18.643122 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c7667a-8044-4c3f-a194-24233d92a5fc None None] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:35:18.643597 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c7667a-8044-4c3f-a194-24233d92a5fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:35:18.664635 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.auth.core [None req-24c7667a-8044-4c3f-a194-24233d92a5fc None None] MFA Rules not processed for user `7b0aed92d02344acb92a0e4aa67c3068`. Rule list: `[]` (Enabled: `True`). {{(pid=87934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:35:18.666280 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.fernet_utils [None req-24c7667a-8044-4c3f-a194-24233d92a5fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:35:18.734372 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG dbcounter [-] [87934] Writing DB stats keystone:SELECT=100 {{(pid=87934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:35:18.746748 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 108/212] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Sep 13 19:35:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 13 19:35:18.753847 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG dbcounter [-] [87935] Writing DB stats keystone:SELECT=100 {{(pid=87935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:35:18.759314 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7eb5cfb-82de-4ce5-8d37-d94f4f6a7309 None None] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:35:18.796176 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70c83cb-ca5c-48a4-955f-f8a235d14095 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:35:18.796841 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70c83cb-ca5c-48a4-955f-f8a235d14095 None admin] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:35:18.797119 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70c83cb-ca5c-48a4-955f-f8a235d14095 None admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:35:18.797388 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70c83cb-ca5c-48a4-955f-f8a235d14095 None admin] PATH_INFO: `/v3/roles/member` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:35:18.809611 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c70c83cb-ca5c-48a4-955f-f8a235d14095 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 19:35:18.814695 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application [None req-c70c83cb-ca5c-48a4-955f-f8a235d14095 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 13 19:35:18.814695 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:35:18.814695 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:35:18.814695 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:35:18.814695 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:35:18.814695 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:35:18.814695 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:35:18.814695 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:35:18.814695 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:35:18.814695 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:35:18.814695 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:35:18.814695 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:35:18.814695 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 19:35:18.814695 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 19:35:18.814695 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 19:35:18.814695 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 19:35:18.815612 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 19:35:18.815612 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 19:35:18.815612 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 19:35:18.815612 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 19:35:18.815612 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:35:18.815612 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:35:18.815612 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:35:18.815612 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:35:18.815612 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:35:18.815612 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:35:18.815612 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:35:18.815612 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application with Lock( Sep 13 19:35:18.815612 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:35:18.815612 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:35:18.815612 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:35:18.815612 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:35:18.816431 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:35:18.816431 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:35:18.816431 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:35:18.816431 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:35:18.816431 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 19:35:18.816431 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 19:35:18.816431 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 19:35:18.816431 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 19:35:18.816431 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 19:35:18.816431 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 19:35:18.816431 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 13 19:35:18.816431 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application Sep 13 19:35:18.816431 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 105/213] 10.222.0.25 () {56 vars in 1099 bytes} [Tue Sep 13 19:35:18 2022] GET /identity/v3/roles/member => generated 84 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:35:18.824271 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c7667a-8044-4c3f-a194-24233d92a5fc None None] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:35:18.940006 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c7667a-8044-4c3f-a194-24233d92a5fc None None] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:35:18.980238 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214b5d3b-c101-4372-9c82-1c80a008fc41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:35:18.980868 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214b5d3b-c101-4372-9c82-1c80a008fc41 None admin] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:35:18.981151 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214b5d3b-c101-4372-9c82-1c80a008fc41 None admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:35:18.981427 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214b5d3b-c101-4372-9c82-1c80a008fc41 None admin] PATH_INFO: `/v3/roles` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:35:18.982106 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-214b5d3b-c101-4372-9c82-1c80a008fc41 None admin] RBAC: Adding query filter params (name=member) {{(pid=87934) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:35:18.982410 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-214b5d3b-c101-4372-9c82-1c80a008fc41 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:35:18.983802 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-214b5d3b-c101-4372-9c82-1c80a008fc41 None admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:35:18.994603 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 109/214] 10.222.0.25 () {56 vars in 1101 bytes} [Tue Sep 13 19:35:18 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:35:19.001723 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70c83cb-ca5c-48a4-955f-f8a235d14095 None admin] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:35:19.050214 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214b5d3b-c101-4372-9c82-1c80a008fc41 None admin] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:35:19.114583 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG dbcounter [-] [87934] Writing DB stats keystone:SELECT=100 {{(pid=87934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:35:19.119954 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70c83cb-ca5c-48a4-955f-f8a235d14095 None admin] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:35:19.167842 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126b1472-36d9-451f-b2dc-b6fafcfbe139 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:35:19.168045 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214b5d3b-c101-4372-9c82-1c80a008fc41 None admin] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:35:19.168894 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126b1472-36d9-451f-b2dc-b6fafcfbe139 None admin] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:35:19.169642 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126b1472-36d9-451f-b2dc-b6fafcfbe139 None admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:35:19.170090 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126b1472-36d9-451f-b2dc-b6fafcfbe139 None admin] PATH_INFO: `/v3/users/f964a30cce9b4f058e5d0a6bcd67c477` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:35:19.188526 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-126b1472-36d9-451f-b2dc-b6fafcfbe139 None admin] RBAC: Authorizing `identity:get_user(user_id=f964a30cce9b4f058e5d0a6bcd67c477)` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:35:19.190077 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-126b1472-36d9-451f-b2dc-b6fafcfbe139 None admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:35:19.196291 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 106/215] 10.222.0.25 () {56 vars in 1177 bytes} [Tue Sep 13 19:35:19 2022] GET /identity/v3/users/f964a30cce9b4f058e5d0a6bcd67c477 => generated 297 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:35:19.196291 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187b2fb6-3f8d-439c-a388-05284390f2d3 None None] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:35:19.196291 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187b2fb6-3f8d-439c-a388-05284390f2d3 None None] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:35:19.196291 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187b2fb6-3f8d-439c-a388-05284390f2d3 None None] PATH_INFO: `/` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:35:19.196291 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 107/216] 10.222.0.25 () {54 vars in 927 bytes} [Tue Sep 13 19:35:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:35:19.200309 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187b2fb6-3f8d-439c-a388-05284390f2d3 None None] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:35:19.209552 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c5d824-66f0-456b-89ee-edd2d0db497c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:35:19.210813 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c5d824-66f0-456b-89ee-edd2d0db497c None admin] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:35:19.211091 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c5d824-66f0-456b-89ee-edd2d0db497c None admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:35:19.211358 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c5d824-66f0-456b-89ee-edd2d0db497c None admin] PATH_INFO: `/v3/domains/default` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:35:19.212505 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c5d824-66f0-456b-89ee-edd2d0db497c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:35:19.214115 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c5d824-66f0-456b-89ee-edd2d0db497c None admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:35:19.215590 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG dbcounter [-] [87935] Writing DB stats keystone:SELECT=100 {{(pid=87935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:35:19.215951 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 110/217] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Sep 13 19:35:19 2022] GET /identity/v3/domains/default => generated 199 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 19:35:19.217187 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d005678-9e47-42ad-ac49-2a018ef04105 None None] REQUEST_METHOD: `POST` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:35:19.217470 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d005678-9e47-42ad-ac49-2a018ef04105 None None] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:35:19.217741 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d005678-9e47-42ad-ac49-2a018ef04105 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:35:19.238231 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.auth.core [None req-5d005678-9e47-42ad-ac49-2a018ef04105 None None] MFA Rules not processed for user `7b0aed92d02344acb92a0e4aa67c3068`. Rule list: `[]` (Enabled: `True`). {{(pid=87934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:35:19.239424 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.fernet_utils [None req-5d005678-9e47-42ad-ac49-2a018ef04105 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:35:19.318651 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 111/218] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Sep 13 19:35:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 19:35:19.328445 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d005678-9e47-42ad-ac49-2a018ef04105 None None] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:35:19.338611 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187b2fb6-3f8d-439c-a388-05284390f2d3 None None] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:35:19.379207 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0f9cb3-1459-4c97-8a12-8130e3a400d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:35:19.379971 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0f9cb3-1459-4c97-8a12-8130e3a400d7 None admin] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:35:19.380407 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0f9cb3-1459-4c97-8a12-8130e3a400d7 None admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:35:19.380747 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0f9cb3-1459-4c97-8a12-8130e3a400d7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:35:19.384708 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG dbcounter [-] [87934] Writing DB stats keystone:SELECT=100 {{(pid=87934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:35:19.441100 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d005678-9e47-42ad-ac49-2a018ef04105 None None] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:35:19.463218 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea0f9cb3-1459-4c97-8a12-8130e3a400d7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:35:19.465327 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea0f9cb3-1459-4c97-8a12-8130e3a400d7 None admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:35:19.478690 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG dbcounter [-] [87935] Writing DB stats keystone:SELECT=100 {{(pid=87935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:35:19.479556 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ebcc44-5c2a-4214-a065-d046c1c9dfcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:35:19.480280 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ebcc44-5c2a-4214-a065-d046c1c9dfcb None admin] REQUEST_METHOD: `POST` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:35:19.480653 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ebcc44-5c2a-4214-a065-d046c1c9dfcb None admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:35:19.481058 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ebcc44-5c2a-4214-a065-d046c1c9dfcb None admin] PATH_INFO: `/v3/users` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:35:19.481763 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ebcc44-5c2a-4214-a065-d046c1c9dfcb None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:35:19.483216 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ebcc44-5c2a-4214-a065-d046c1c9dfcb None admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:35:19.509728 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 112/219] 10.222.0.25 () {60 vars in 1132 bytes} [Tue Sep 13 19:35:19 2022] POST /identity/v3/users => generated 297 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 19:35:19.591753 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 108/220] 10.222.0.25 () {58 vars in 1282 bytes} [Tue Sep 13 19:35:19 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 392 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 13 19:35:19.597479 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ebcc44-5c2a-4214-a065-d046c1c9dfcb None admin] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:35:19.674051 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0f9cb3-1459-4c97-8a12-8130e3a400d7 None admin] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:35:19.732900 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ebcc44-5c2a-4214-a065-d046c1c9dfcb None admin] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:35:19.744427 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG dbcounter [-] [87934] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:35:19.773513 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96aea51-6709-4bec-bb21-cdd47591af0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:35:19.774275 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96aea51-6709-4bec-bb21-cdd47591af0b None admin] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:35:19.774553 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96aea51-6709-4bec-bb21-cdd47591af0b None admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:35:19.774818 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96aea51-6709-4bec-bb21-cdd47591af0b None admin] PATH_INFO: `/v3/projects/93e1f3226d564df686b8ca37cfd3a42c` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:35:19.777579 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f96aea51-6709-4bec-bb21-cdd47591af0b None admin] RBAC: Authorizing `identity:get_project(project_id=93e1f3226d564df686b8ca37cfd3a42c)` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:35:19.781276 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f96aea51-6709-4bec-bb21-cdd47591af0b None admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:35:19.783137 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 113/221] 10.222.0.25 () {56 vars in 1186 bytes} [Tue Sep 13 19:35:19 2022] GET /identity/v3/projects/93e1f3226d564df686b8ca37cfd3a42c => generated 302 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:35:19.785075 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd0a361-9ce8-4037-9d74-bbf4687aa66e None None] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:35:19.785374 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd0a361-9ce8-4037-9d74-bbf4687aa66e None None] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:35:19.785657 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd0a361-9ce8-4037-9d74-bbf4687aa66e None None] PATH_INFO: `/` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:35:19.788785 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 114/222] 10.222.0.25 () {54 vars in 927 bytes} [Tue Sep 13 19:35:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:35:19.790006 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd0a361-9ce8-4037-9d74-bbf4687aa66e None None] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:35:19.815637 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0f9cb3-1459-4c97-8a12-8130e3a400d7 None admin] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:35:19.828800 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG dbcounter [-] [87935] Writing DB stats keystone:SELECT=100 {{(pid=87935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:35:19.870974 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44ed586-9d50-4e7b-a5e7-62082fb4c797 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:35:19.871857 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44ed586-9d50-4e7b-a5e7-62082fb4c797 None admin] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:35:19.872138 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44ed586-9d50-4e7b-a5e7-62082fb4c797 None admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:35:19.872446 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44ed586-9d50-4e7b-a5e7-62082fb4c797 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:35:19.889898 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a44ed586-9d50-4e7b-a5e7-62082fb4c797 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 19:35:19.895301 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application [None req-a44ed586-9d50-4e7b-a5e7-62082fb4c797 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 19:35:19.895301 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:35:19.895301 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:35:19.895301 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:35:19.895301 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:35:19.895301 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:35:19.895301 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:35:19.895301 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:35:19.895301 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:35:19.895301 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:35:19.895301 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:35:19.895301 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:35:19.895301 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 19:35:19.895301 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 19:35:19.895301 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 19:35:19.895301 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 19:35:19.896230 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 19:35:19.896230 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 19:35:19.896230 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 19:35:19.896230 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 19:35:19.896230 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:35:19.896230 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:35:19.896230 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:35:19.896230 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:35:19.896230 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:35:19.896230 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:35:19.896230 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:35:19.896230 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application with Lock( Sep 13 19:35:19.896230 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:35:19.896230 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:35:19.896230 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:35:19.896230 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:35:19.897042 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:35:19.897042 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:35:19.897042 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:35:19.897042 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:35:19.897042 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 19:35:19.897042 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 19:35:19.897042 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 19:35:19.897042 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 19:35:19.897042 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 19:35:19.897042 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 19:35:19.897042 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 19:35:19.897042 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application Sep 13 19:35:19.897042 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 109/223] 10.222.0.25 () {56 vars in 1096 bytes} [Tue Sep 13 19:35:19 2022] GET /identity/v3/roles/admin => generated 83 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 13 19:35:19.898340 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cccfc01-314a-44ee-9fc1-1aa09b42d3cd None None] REQUEST_METHOD: `POST` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:35:19.898340 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cccfc01-314a-44ee-9fc1-1aa09b42d3cd None None] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:35:19.898340 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cccfc01-314a-44ee-9fc1-1aa09b42d3cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:35:19.917502 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd0a361-9ce8-4037-9d74-bbf4687aa66e None None] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:35:19.919482 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.auth.core [None req-6cccfc01-314a-44ee-9fc1-1aa09b42d3cd None None] MFA Rules not processed for user `7b0aed92d02344acb92a0e4aa67c3068`. Rule list: `[]` (Enabled: `True`). {{(pid=87935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:35:19.921598 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.fernet_utils [None req-6cccfc01-314a-44ee-9fc1-1aa09b42d3cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:35:19.958388 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670bd6f8-78ee-4f51-957c-cd5ad3c6ab6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:35:19.959051 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670bd6f8-78ee-4f51-957c-cd5ad3c6ab6b None admin] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:35:19.959326 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670bd6f8-78ee-4f51-957c-cd5ad3c6ab6b None admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:35:19.959597 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670bd6f8-78ee-4f51-957c-cd5ad3c6ab6b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:35:19.960907 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-670bd6f8-78ee-4f51-957c-cd5ad3c6ab6b None admin] RBAC: Adding query filter params (role.id=a259191f6d0e46fabd9f34536bb28747, scope.project.id=93e1f3226d564df686b8ca37cfd3a42c, user.id=f964a30cce9b4f058e5d0a6bcd67c477) {{(pid=87934) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:35:19.961231 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-670bd6f8-78ee-4f51-957c-cd5ad3c6ab6b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:35:19.962656 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-670bd6f8-78ee-4f51-957c-cd5ad3c6ab6b None admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:35:19.971190 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 115/224] 10.222.0.25 () {56 vars in 1374 bytes} [Tue Sep 13 19:35:19 2022] GET /identity/v3/role_assignments?user.id=f964a30cce9b4f058e5d0a6bcd67c477&scope.project.id=93e1f3226d564df686b8ca37cfd3a42c&role.id=a259191f6d0e46fabd9f34536bb28747 => generated 259 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 19:35:19.972100 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670bd6f8-78ee-4f51-957c-cd5ad3c6ab6b None admin] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:35:20.021295 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 110/225] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Sep 13 19:35:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 19:35:20.044616 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG dbcounter [-] [87934] Writing DB stats keystone:SELECT=100 {{(pid=87934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:35:20.125136 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670bd6f8-78ee-4f51-957c-cd5ad3c6ab6b None admin] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:35:20.171632 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9051cd96-befc-4d09-b3c5-d307069d96ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:35:20.172582 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9051cd96-befc-4d09-b3c5-d307069d96ec None admin] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:35:20.173014 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9051cd96-befc-4d09-b3c5-d307069d96ec None admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:35:20.173422 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9051cd96-befc-4d09-b3c5-d307069d96ec None admin] PATH_INFO: `/v3/roles` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:35:20.174305 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9051cd96-befc-4d09-b3c5-d307069d96ec None admin] RBAC: Adding query filter params (name=admin) {{(pid=87934) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:35:20.174760 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9051cd96-befc-4d09-b3c5-d307069d96ec None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:35:20.176289 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9051cd96-befc-4d09-b3c5-d307069d96ec None admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:35:20.186842 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 116/226] 10.222.0.25 () {56 vars in 1099 bytes} [Tue Sep 13 19:35:19 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:35:20.192642 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cccfc01-314a-44ee-9fc1-1aa09b42d3cd None None] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:35:20.332895 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9051cd96-befc-4d09-b3c5-d307069d96ec None admin] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:35:20.337584 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG dbcounter [-] [87935] Writing DB stats keystone:SELECT=100 {{(pid=87935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:35:20.342736 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cccfc01-314a-44ee-9fc1-1aa09b42d3cd None None] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:35:20.399615 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5a26b0-9705-4f65-ad77-0c270b3e0937 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:35:20.401191 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5a26b0-9705-4f65-ad77-0c270b3e0937 None admin] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:35:20.401339 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5a26b0-9705-4f65-ad77-0c270b3e0937 None admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:35:20.401608 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5a26b0-9705-4f65-ad77-0c270b3e0937 None admin] PATH_INFO: `/v3/users/c2092d127b9542acbd73594cc26290a3` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:35:20.403396 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf5a26b0-9705-4f65-ad77-0c270b3e0937 None admin] RBAC: Authorizing `identity:get_user(user_id=c2092d127b9542acbd73594cc26290a3)` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:35:20.404905 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf5a26b0-9705-4f65-ad77-0c270b3e0937 None admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:35:20.406551 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 111/227] 10.222.0.25 () {56 vars in 1177 bytes} [Tue Sep 13 19:35:20 2022] GET /identity/v3/users/c2092d127b9542acbd73594cc26290a3 => generated 283 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:35:20.415560 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5a26b0-9705-4f65-ad77-0c270b3e0937 None admin] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:35:20.532909 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5a26b0-9705-4f65-ad77-0c270b3e0937 None admin] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:35:20.569823 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6134b98-9c0b-4d88-b4b7-931e6a734424 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:35:20.570420 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6134b98-9c0b-4d88-b4b7-931e6a734424 None admin] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:35:20.570709 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6134b98-9c0b-4d88-b4b7-931e6a734424 None admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:35:20.570934 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6134b98-9c0b-4d88-b4b7-931e6a734424 None admin] PATH_INFO: `/v3/projects/93e1f3226d564df686b8ca37cfd3a42c` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:35:20.572121 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6134b98-9c0b-4d88-b4b7-931e6a734424 None admin] RBAC: Authorizing `identity:get_project(project_id=93e1f3226d564df686b8ca37cfd3a42c)` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:35:20.573889 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6134b98-9c0b-4d88-b4b7-931e6a734424 None admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:35:20.575824 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 112/228] 10.222.0.25 () {56 vars in 1186 bytes} [Tue Sep 13 19:35:20 2022] GET /identity/v3/projects/93e1f3226d564df686b8ca37cfd3a42c => generated 302 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:35:20.581531 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6134b98-9c0b-4d88-b4b7-931e6a734424 None admin] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:35:20.598241 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9051cd96-befc-4d09-b3c5-d307069d96ec None admin] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:35:20.608593 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG dbcounter [-] [87934] Writing DB stats keystone:SELECT=100 {{(pid=87934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:35:20.621754 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG dbcounter [-] [87935] Writing DB stats keystone:SELECT=100 {{(pid=87935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:35:20.681937 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88f1088-3794-4e08-beae-b26ddad17866 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:35:20.682585 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88f1088-3794-4e08-beae-b26ddad17866 None admin] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:35:20.682867 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88f1088-3794-4e08-beae-b26ddad17866 None admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:35:20.683172 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88f1088-3794-4e08-beae-b26ddad17866 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:35:20.696426 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6134b98-9c0b-4d88-b4b7-931e6a734424 None admin] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:35:20.706343 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d88f1088-3794-4e08-beae-b26ddad17866 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 19:35:20.713178 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application [None req-d88f1088-3794-4e08-beae-b26ddad17866 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 13 19:35:20.713178 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:35:20.713178 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:35:20.713178 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:35:20.713178 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:35:20.713178 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:35:20.713178 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:35:20.713178 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:35:20.713178 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:35:20.713178 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:35:20.713178 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:35:20.713178 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:35:20.713178 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 19:35:20.713178 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 19:35:20.713178 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 19:35:20.713178 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 19:35:20.714954 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 19:35:20.714954 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 19:35:20.714954 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 19:35:20.714954 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 19:35:20.714954 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:35:20.714954 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:35:20.714954 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:35:20.714954 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:35:20.714954 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:35:20.714954 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:35:20.714954 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:35:20.714954 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application with Lock( Sep 13 19:35:20.714954 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:35:20.714954 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:35:20.714954 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:35:20.714954 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:35:20.716605 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:35:20.716605 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:35:20.716605 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:35:20.716605 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:35:20.716605 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 19:35:20.716605 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 19:35:20.716605 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 19:35:20.716605 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 19:35:20.716605 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 19:35:20.716605 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 19:35:20.716605 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 13 19:35:20.716605 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application Sep 13 19:35:20.724240 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 117/229] 10.222.0.25 () {56 vars in 1114 bytes} [Tue Sep 13 19:35:20 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 383 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 13 19:35:20.728684 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88f1088-3794-4e08-beae-b26ddad17866 None admin] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:35:20.732893 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5a870a-c0ea-465e-bf17-3332ea94bea6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:35:20.733555 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5a870a-c0ea-465e-bf17-3332ea94bea6 None admin] REQUEST_METHOD: `PUT` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:35:20.733816 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5a870a-c0ea-465e-bf17-3332ea94bea6 None admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:35:20.734201 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5a870a-c0ea-465e-bf17-3332ea94bea6 None admin] PATH_INFO: `/v3/projects/93e1f3226d564df686b8ca37cfd3a42c/users/c2092d127b9542acbd73594cc26290a3/roles/6ca1d4427ff64e0a9d25d96cfb1445f6` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:35:20.736116 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c5a870a-c0ea-465e-bf17-3332ea94bea6 None admin] RBAC: Authorizing `identity:create_grant(project_id=93e1f3226d564df686b8ca37cfd3a42c, user_id=c2092d127b9542acbd73594cc26290a3, role_id=6ca1d4427ff64e0a9d25d96cfb1445f6)` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:35:20.737645 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c5a870a-c0ea-465e-bf17-3332ea94bea6 None admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:35:20.751886 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 113/230] 10.222.0.25 () {58 vars in 1439 bytes} [Tue Sep 13 19:35:20 2022] PUT /identity/v3/projects/93e1f3226d564df686b8ca37cfd3a42c/users/c2092d127b9542acbd73594cc26290a3/roles/6ca1d4427ff64e0a9d25d96cfb1445f6 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 19:35:20.894805 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88f1088-3794-4e08-beae-b26ddad17866 None admin] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:35:20.943862 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ad5d5e-2772-4d47-adea-40deb52b72ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:35:20.945171 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ad5d5e-2772-4d47-adea-40deb52b72ac None admin] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:35:20.945662 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ad5d5e-2772-4d47-adea-40deb52b72ac None admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:35:20.946156 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ad5d5e-2772-4d47-adea-40deb52b72ac None admin] PATH_INFO: `/v3/roles` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:35:20.947039 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ad5d5e-2772-4d47-adea-40deb52b72ac None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=87934) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:35:20.947598 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ad5d5e-2772-4d47-adea-40deb52b72ac None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:35:20.949249 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ad5d5e-2772-4d47-adea-40deb52b72ac None admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:35:20.958658 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 118/231] 10.222.0.25 () {56 vars in 1111 bytes} [Tue Sep 13 19:35:20 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 19:35:20.964830 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5a870a-c0ea-465e-bf17-3332ea94bea6 None admin] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:35:21.092677 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG dbcounter [-] [87935] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:35:21.098586 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5a870a-c0ea-465e-bf17-3332ea94bea6 None admin] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:35:21.138006 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa7665b-8385-472f-9479-a7280b908495 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:35:21.138647 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa7665b-8385-472f-9479-a7280b908495 None admin] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:35:21.138923 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa7665b-8385-472f-9479-a7280b908495 None admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:35:21.139194 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa7665b-8385-472f-9479-a7280b908495 None admin] PATH_INFO: `/v3/users/c2092d127b9542acbd73594cc26290a3` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:35:21.140327 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa7665b-8385-472f-9479-a7280b908495 None admin] RBAC: Authorizing `identity:get_user(user_id=c2092d127b9542acbd73594cc26290a3)` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:35:21.141886 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa7665b-8385-472f-9479-a7280b908495 None admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:35:21.143868 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 114/232] 10.222.0.25 () {56 vars in 1177 bytes} [Tue Sep 13 19:35:20 2022] GET /identity/v3/users/c2092d127b9542acbd73594cc26290a3 => generated 283 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:35:21.149589 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ad5d5e-2772-4d47-adea-40deb52b72ac None admin] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:35:21.190900 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG dbcounter [-] [87934] Writing DB stats keystone:SELECT=100 {{(pid=87934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:35:21.337847 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ad5d5e-2772-4d47-adea-40deb52b72ac None admin] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:35:21.398219 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35763536-4fdd-4712-9b47-9d5316f6a949 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:35:21.399001 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35763536-4fdd-4712-9b47-9d5316f6a949 None admin] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:35:21.399284 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35763536-4fdd-4712-9b47-9d5316f6a949 None admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:35:21.399554 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35763536-4fdd-4712-9b47-9d5316f6a949 None admin] PATH_INFO: `/v3/projects/93e1f3226d564df686b8ca37cfd3a42c` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:35:21.400782 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35763536-4fdd-4712-9b47-9d5316f6a949 None admin] RBAC: Authorizing `identity:get_project(project_id=93e1f3226d564df686b8ca37cfd3a42c)` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:35:21.402159 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35763536-4fdd-4712-9b47-9d5316f6a949 None admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:35:21.403948 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 119/233] 10.222.0.25 () {56 vars in 1186 bytes} [Tue Sep 13 19:35:21 2022] GET /identity/v3/projects/93e1f3226d564df686b8ca37cfd3a42c => generated 302 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:35:21.409777 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa7665b-8385-472f-9479-a7280b908495 None admin] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:35:21.583413 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa7665b-8385-472f-9479-a7280b908495 None admin] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:35:21.634362 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff4d419-accc-4bcd-964a-c96c733c23bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:35:21.635028 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff4d419-accc-4bcd-964a-c96c733c23bb None admin] REQUEST_METHOD: `PUT` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:35:21.635307 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff4d419-accc-4bcd-964a-c96c733c23bb None admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:35:21.635580 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff4d419-accc-4bcd-964a-c96c733c23bb None admin] PATH_INFO: `/v3/projects/93e1f3226d564df686b8ca37cfd3a42c/users/c2092d127b9542acbd73594cc26290a3/roles/8af3d83a03144ae8bacdb82d9a108110` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:35:21.642068 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff4d419-accc-4bcd-964a-c96c733c23bb None admin] RBAC: Authorizing `identity:create_grant(project_id=93e1f3226d564df686b8ca37cfd3a42c, user_id=c2092d127b9542acbd73594cc26290a3, role_id=8af3d83a03144ae8bacdb82d9a108110)` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:35:21.643549 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff4d419-accc-4bcd-964a-c96c733c23bb None admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:35:21.662661 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 115/234] 10.222.0.25 () {58 vars in 1439 bytes} [Tue Sep 13 19:35:21 2022] PUT /identity/v3/projects/93e1f3226d564df686b8ca37cfd3a42c/users/c2092d127b9542acbd73594cc26290a3/roles/8af3d83a03144ae8bacdb82d9a108110 => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 19:35:22.389277 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52d6a3f-722d-4363-a1d1-04094c34a022 None None] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:35:22.389789 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52d6a3f-722d-4363-a1d1-04094c34a022 None None] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:35:22.389789 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52d6a3f-722d-4363-a1d1-04094c34a022 None None] PATH_INFO: `/` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:35:22.391691 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 120/235] 10.222.0.25 () {54 vars in 927 bytes} [Tue Sep 13 19:35:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:35:22.397731 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15a4933-abc4-4918-9f87-c4df80fa4c29 None None] REQUEST_METHOD: `POST` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:35:22.398155 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15a4933-abc4-4918-9f87-c4df80fa4c29 None None] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:35:22.398327 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15a4933-abc4-4918-9f87-c4df80fa4c29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:35:22.427954 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.auth.core [None req-f15a4933-abc4-4918-9f87-c4df80fa4c29 None None] MFA Rules not processed for user `7b0aed92d02344acb92a0e4aa67c3068`. Rule list: `[]` (Enabled: `True`). {{(pid=87935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:35:22.429812 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.fernet_utils [None req-f15a4933-abc4-4918-9f87-c4df80fa4c29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:35:22.455805 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG dbcounter [-] [87935] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:35:22.520688 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 116/236] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Sep 13 19:35:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 13 19:35:22.705682 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89db8292-32c3-4564-a954-7e3dcc0363f0 None None] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:35:22.706027 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89db8292-32c3-4564-a954-7e3dcc0363f0 None None] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:35:22.706144 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89db8292-32c3-4564-a954-7e3dcc0363f0 None None] PATH_INFO: `/` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:35:22.708171 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 121/237] 10.222.0.25 () {54 vars in 927 bytes} [Tue Sep 13 19:35:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:35:22.714139 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5cdec3-72d9-4b1c-91c0-66a675caf46f None None] REQUEST_METHOD: `POST` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:35:22.714451 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5cdec3-72d9-4b1c-91c0-66a675caf46f None None] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:35:22.714688 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5cdec3-72d9-4b1c-91c0-66a675caf46f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:35:22.736087 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.auth.core [None req-ae5cdec3-72d9-4b1c-91c0-66a675caf46f None None] MFA Rules not processed for user `7b0aed92d02344acb92a0e4aa67c3068`. Rule list: `[]` (Enabled: `True`). {{(pid=87935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:35:22.737381 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.fernet_utils [None req-ae5cdec3-72d9-4b1c-91c0-66a675caf46f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:35:22.827329 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 117/238] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Sep 13 19:35:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 19:35:22.880589 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89db8292-32c3-4564-a954-7e3dcc0363f0 None None] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:35:22.969486 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52599a24-b842-446c-ac98-0c5f2c62b5cc None None] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:35:22.969974 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52599a24-b842-446c-ac98-0c5f2c62b5cc None None] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:35:22.970618 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52599a24-b842-446c-ac98-0c5f2c62b5cc None None] PATH_INFO: `/` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:35:22.976025 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 118/239] 10.222.0.25 () {54 vars in 927 bytes} [Tue Sep 13 19:35:22 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:35:22.981636 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9846dd-4a0e-473b-a7f5-a299f0ba9665 None None] REQUEST_METHOD: `POST` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:35:22.981907 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9846dd-4a0e-473b-a7f5-a299f0ba9665 None None] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:35:22.982184 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9846dd-4a0e-473b-a7f5-a299f0ba9665 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:35:23.010079 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.auth.core [None req-de9846dd-4a0e-473b-a7f5-a299f0ba9665 None None] MFA Rules not processed for user `7b0aed92d02344acb92a0e4aa67c3068`. Rule list: `[]` (Enabled: `True`). {{(pid=87935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:35:23.011266 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.fernet_utils [None req-de9846dd-4a0e-473b-a7f5-a299f0ba9665 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:35:23.023021 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG dbcounter [-] [87934] Writing DB stats keystone:SELECT=100 {{(pid=87934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:35:23.045922 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89db8292-32c3-4564-a954-7e3dcc0363f0 None None] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:35:23.088045 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 119/240] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Sep 13 19:35:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (3 switches on core 0) Sep 13 19:35:23.130870 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ceca585-20b1-49e5-a8be-db09d4dcf1dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:35:23.131906 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ceca585-20b1-49e5-a8be-db09d4dcf1dd None admin] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:35:23.132309 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ceca585-20b1-49e5-a8be-db09d4dcf1dd None admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:35:23.132697 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ceca585-20b1-49e5-a8be-db09d4dcf1dd None admin] PATH_INFO: `/v3/roles/reader` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:35:23.148070 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ceca585-20b1-49e5-a8be-db09d4dcf1dd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 19:35:23.153189 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application [None req-1ceca585-20b1-49e5-a8be-db09d4dcf1dd None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 13 19:35:23.153189 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:35:23.153189 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:35:23.153189 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:35:23.153189 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:35:23.153189 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:35:23.153189 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:35:23.153189 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:35:23.153189 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:35:23.153189 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:35:23.153189 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:35:23.153189 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:35:23.153189 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 19:35:23.153189 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 19:35:23.153189 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 19:35:23.153189 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 19:35:23.154122 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 19:35:23.154122 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 19:35:23.154122 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 19:35:23.154122 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 19:35:23.154122 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:35:23.154122 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:35:23.154122 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:35:23.154122 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:35:23.154122 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:35:23.154122 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:35:23.154122 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:35:23.154122 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application with Lock( Sep 13 19:35:23.154122 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:35:23.154122 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:35:23.154122 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:35:23.154122 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:35:23.155071 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:35:23.155071 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:35:23.155071 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:35:23.155071 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:35:23.155071 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 19:35:23.155071 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 19:35:23.155071 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 19:35:23.155071 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 19:35:23.155071 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 19:35:23.155071 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 19:35:23.155071 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 13 19:35:23.155071 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application Sep 13 19:35:23.155071 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 122/241] 10.222.0.25 () {56 vars in 1099 bytes} [Tue Sep 13 19:35:22 2022] GET /identity/v3/roles/reader => generated 84 bytes in 275 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:35:23.160503 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9846dd-4a0e-473b-a7f5-a299f0ba9665 None None] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:35:23.196596 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG dbcounter [-] [87935] Writing DB stats keystone:SELECT=100 {{(pid=87935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:35:23.286517 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ceca585-20b1-49e5-a8be-db09d4dcf1dd None admin] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:35:23.296158 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9846dd-4a0e-473b-a7f5-a299f0ba9665 None None] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:35:23.335394 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371b718f-eb7b-4d54-a351-5b18ea66f2c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:35:23.336025 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371b718f-eb7b-4d54-a351-5b18ea66f2c9 None admin] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:35:23.336921 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371b718f-eb7b-4d54-a351-5b18ea66f2c9 None admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:35:23.337202 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371b718f-eb7b-4d54-a351-5b18ea66f2c9 None admin] PATH_INFO: `/v3/roles` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:35:23.337903 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-371b718f-eb7b-4d54-a351-5b18ea66f2c9 None admin] RBAC: Adding query filter params (name=reader) {{(pid=87935) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:35:23.338210 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-371b718f-eb7b-4d54-a351-5b18ea66f2c9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:35:23.339639 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-371b718f-eb7b-4d54-a351-5b18ea66f2c9 None admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:35:23.351268 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 120/242] 10.222.0.25 () {56 vars in 1101 bytes} [Tue Sep 13 19:35:23 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 19:35:23.357403 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371b718f-eb7b-4d54-a351-5b18ea66f2c9 None admin] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:35:23.445338 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG dbcounter [-] [87935] Writing DB stats keystone:SELECT=100 {{(pid=87935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:35:23.468598 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371b718f-eb7b-4d54-a351-5b18ea66f2c9 None admin] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:35:23.515513 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b421d5-0f56-4964-bdb4-b690824e8a27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:35:23.516421 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b421d5-0f56-4964-bdb4-b690824e8a27 None admin] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:35:23.516874 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b421d5-0f56-4964-bdb4-b690824e8a27 None admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:35:23.517271 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b421d5-0f56-4964-bdb4-b690824e8a27 None admin] PATH_INFO: `/v3/users/84602aa8c37c474a82fdab3c4c5157dc` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:35:23.527267 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ceca585-20b1-49e5-a8be-db09d4dcf1dd None admin] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:35:23.531738 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b421d5-0f56-4964-bdb4-b690824e8a27 None admin] RBAC: Authorizing `identity:get_user(user_id=84602aa8c37c474a82fdab3c4c5157dc)` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:35:23.533221 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b421d5-0f56-4964-bdb4-b690824e8a27 None admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:35:23.539860 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 121/243] 10.222.0.25 () {56 vars in 1177 bytes} [Tue Sep 13 19:35:23 2022] GET /identity/v3/users/84602aa8c37c474a82fdab3c4c5157dc => generated 297 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:35:23.540936 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff96979-c697-4118-811b-5a0ff3c9ede4 None None] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:35:23.541215 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff96979-c697-4118-811b-5a0ff3c9ede4 None None] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:35:23.541480 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff96979-c697-4118-811b-5a0ff3c9ede4 None None] PATH_INFO: `/` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:35:23.542868 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 122/244] 10.222.0.25 () {54 vars in 927 bytes} [Tue Sep 13 19:35:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:35:23.543488 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff96979-c697-4118-811b-5a0ff3c9ede4 None None] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:35:23.570461 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b90b3c-5881-4ffc-be50-c1f39d37fd3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:35:23.571097 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b90b3c-5881-4ffc-be50-c1f39d37fd3b None admin] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:35:23.571372 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b90b3c-5881-4ffc-be50-c1f39d37fd3b None admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:35:23.571640 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b90b3c-5881-4ffc-be50-c1f39d37fd3b None admin] PATH_INFO: `/v3/domains/default` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:35:23.572772 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b90b3c-5881-4ffc-be50-c1f39d37fd3b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:35:23.574267 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b90b3c-5881-4ffc-be50-c1f39d37fd3b None admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:35:23.575830 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 123/245] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Sep 13 19:35:23 2022] GET /identity/v3/domains/default => generated 199 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:35:23.576612 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b90b3c-5881-4ffc-be50-c1f39d37fd3b None admin] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:35:23.601292 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG dbcounter [-] [87934] Writing DB stats keystone:SELECT=100 {{(pid=87934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:35:23.664261 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff96979-c697-4118-811b-5a0ff3c9ede4 None None] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:35:23.696256 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b90b3c-5881-4ffc-be50-c1f39d37fd3b None admin] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:35:23.701965 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d722f83-cd1d-46bd-8e81-411e22f62231 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:35:23.702591 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d722f83-cd1d-46bd-8e81-411e22f62231 None admin] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:35:23.702862 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d722f83-cd1d-46bd-8e81-411e22f62231 None admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:35:23.703127 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d722f83-cd1d-46bd-8e81-411e22f62231 None admin] PATH_INFO: `/v3/roles/member` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:35:23.705183 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG dbcounter [-] [87935] Writing DB stats keystone:SELECT=100 {{(pid=87935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:35:23.715245 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d722f83-cd1d-46bd-8e81-411e22f62231 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 19:35:23.720101 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application [None req-9d722f83-cd1d-46bd-8e81-411e22f62231 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 13 19:35:23.720101 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:35:23.720101 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:35:23.720101 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:35:23.720101 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:35:23.720101 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:35:23.720101 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:35:23.720101 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:35:23.720101 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:35:23.720101 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:35:23.720101 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:35:23.720101 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:35:23.720101 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 19:35:23.720101 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 19:35:23.720101 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 19:35:23.720101 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 19:35:23.721167 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 19:35:23.721167 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 19:35:23.721167 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 19:35:23.721167 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 19:35:23.721167 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:35:23.721167 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:35:23.721167 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:35:23.721167 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:35:23.721167 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:35:23.721167 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:35:23.721167 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:35:23.721167 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application with Lock( Sep 13 19:35:23.721167 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:35:23.721167 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:35:23.721167 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:35:23.721167 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:35:23.721951 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:35:23.721951 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:35:23.721951 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:35:23.721951 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:35:23.721951 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 19:35:23.721951 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 19:35:23.721951 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 19:35:23.721951 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 19:35:23.721951 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 19:35:23.721951 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 19:35:23.721951 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 13 19:35:23.721951 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application Sep 13 19:35:23.726289 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 123/246] 10.222.0.25 () {56 vars in 1099 bytes} [Tue Sep 13 19:35:23 2022] GET /identity/v3/roles/member => generated 84 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:35:23.728135 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5059d095-445d-465c-93e1-bc951b8c2b8f None None] REQUEST_METHOD: `POST` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:35:23.728549 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5059d095-445d-465c-93e1-bc951b8c2b8f None None] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:35:23.728829 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5059d095-445d-465c-93e1-bc951b8c2b8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:35:23.735380 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ecac8d-d259-49d0-aad2-54406dcef34c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:35:23.736389 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ecac8d-d259-49d0-aad2-54406dcef34c None admin] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:35:23.736389 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ecac8d-d259-49d0-aad2-54406dcef34c None admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:35:23.736569 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ecac8d-d259-49d0-aad2-54406dcef34c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:35:23.746955 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.auth.core [None req-5059d095-445d-465c-93e1-bc951b8c2b8f None None] MFA Rules not processed for user `7b0aed92d02344acb92a0e4aa67c3068`. Rule list: `[]` (Enabled: `True`). {{(pid=87935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:35:23.748153 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.fernet_utils [None req-5059d095-445d-465c-93e1-bc951b8c2b8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:35:23.817496 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ecac8d-d259-49d0-aad2-54406dcef34c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:35:23.819224 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ecac8d-d259-49d0-aad2-54406dcef34c None admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:35:23.832489 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 124/247] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Sep 13 19:35:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 19:35:23.832489 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5059d095-445d-465c-93e1-bc951b8c2b8f None None] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:35:23.851923 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG dbcounter [-] [87934] Writing DB stats keystone:SELECT=100 {{(pid=87934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:35:23.943535 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 124/248] 10.222.0.25 () {58 vars in 1282 bytes} [Tue Sep 13 19:35:23 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 13 19:35:23.945500 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ecac8d-d259-49d0-aad2-54406dcef34c None admin] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:35:23.963361 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5059d095-445d-465c-93e1-bc951b8c2b8f None None] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:35:23.989429 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG dbcounter [-] [87935] Writing DB stats keystone:SELECT=100 {{(pid=87935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:35:24.002608 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a7de92-3760-4d9a-97a4-de8fe425c0da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:35:24.003227 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a7de92-3760-4d9a-97a4-de8fe425c0da None admin] REQUEST_METHOD: `POST` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:35:24.003507 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a7de92-3760-4d9a-97a4-de8fe425c0da None admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:35:24.003777 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a7de92-3760-4d9a-97a4-de8fe425c0da None admin] PATH_INFO: `/v3/users` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:35:24.004622 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a7de92-3760-4d9a-97a4-de8fe425c0da None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:35:24.006094 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a7de92-3760-4d9a-97a4-de8fe425c0da None admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:35:24.030806 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 125/249] 10.222.0.25 () {60 vars in 1132 bytes} [Tue Sep 13 19:35:23 2022] POST /identity/v3/users => generated 293 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 19:35:24.031734 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a7de92-3760-4d9a-97a4-de8fe425c0da None admin] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:35:24.059787 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ecac8d-d259-49d0-aad2-54406dcef34c None admin] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:35:24.083131 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG dbcounter [-] [87934] Writing DB stats keystone:SELECT=100 {{(pid=87934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:35:24.099195 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84a599c-d452-42fb-b482-f05bc5c364af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:35:24.099968 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84a599c-d452-42fb-b482-f05bc5c364af None admin] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:35:24.101084 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84a599c-d452-42fb-b482-f05bc5c364af None admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:35:24.101568 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84a599c-d452-42fb-b482-f05bc5c364af None admin] PATH_INFO: `/v3/roles` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:35:24.102446 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c84a599c-d452-42fb-b482-f05bc5c364af None admin] RBAC: Adding query filter params (name=member) {{(pid=87934) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:35:24.102850 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c84a599c-d452-42fb-b482-f05bc5c364af None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:35:24.104366 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c84a599c-d452-42fb-b482-f05bc5c364af None admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:35:24.113736 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 125/250] 10.222.0.25 () {56 vars in 1101 bytes} [Tue Sep 13 19:35:23 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:35:24.120014 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84a599c-d452-42fb-b482-f05bc5c364af None admin] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:35:24.162475 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a7de92-3760-4d9a-97a4-de8fe425c0da None admin] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:35:24.205513 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75a22ea-ab1c-4884-aafe-5ca15f275970 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:35:24.206431 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75a22ea-ab1c-4884-aafe-5ca15f275970 None admin] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:35:24.206861 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75a22ea-ab1c-4884-aafe-5ca15f275970 None admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:35:24.207589 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75a22ea-ab1c-4884-aafe-5ca15f275970 None admin] PATH_INFO: `/v3/projects/93e1f3226d564df686b8ca37cfd3a42c` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:35:24.209647 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c75a22ea-ab1c-4884-aafe-5ca15f275970 None admin] RBAC: Authorizing `identity:get_project(project_id=93e1f3226d564df686b8ca37cfd3a42c)` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:35:24.211382 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c75a22ea-ab1c-4884-aafe-5ca15f275970 None admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:35:24.214003 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 126/251] 10.222.0.25 () {56 vars in 1186 bytes} [Tue Sep 13 19:35:24 2022] GET /identity/v3/projects/93e1f3226d564df686b8ca37cfd3a42c => generated 302 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:35:24.219838 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75a22ea-ab1c-4884-aafe-5ca15f275970 None admin] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:35:24.234414 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84a599c-d452-42fb-b482-f05bc5c364af None admin] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:35:24.280026 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881b798c-7087-4433-a289-41bf529cb31b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:35:24.280867 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881b798c-7087-4433-a289-41bf529cb31b None admin] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:35:24.281297 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881b798c-7087-4433-a289-41bf529cb31b None admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:35:24.281548 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881b798c-7087-4433-a289-41bf529cb31b None admin] PATH_INFO: `/v3/users/f964a30cce9b4f058e5d0a6bcd67c477` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:35:24.283014 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-881b798c-7087-4433-a289-41bf529cb31b None admin] RBAC: Authorizing `identity:get_user(user_id=f964a30cce9b4f058e5d0a6bcd67c477)` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:35:24.284417 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-881b798c-7087-4433-a289-41bf529cb31b None admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:35:24.286047 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG dbcounter [-] [87935] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:35:24.286835 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 126/252] 10.222.0.25 () {56 vars in 1177 bytes} [Tue Sep 13 19:35:24 2022] GET /identity/v3/users/f964a30cce9b4f058e5d0a6bcd67c477 => generated 297 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:35:24.293201 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881b798c-7087-4433-a289-41bf529cb31b None admin] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:35:24.352563 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75a22ea-ab1c-4884-aafe-5ca15f275970 None admin] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:35:24.364585 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG dbcounter [-] [87934] Writing DB stats keystone:SELECT=100 {{(pid=87934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:35:24.406574 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d8a110-7fb2-4292-8682-240123eec48a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:35:24.406574 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d8a110-7fb2-4292-8682-240123eec48a None admin] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:35:24.407266 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d8a110-7fb2-4292-8682-240123eec48a None admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:35:24.410813 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d8a110-7fb2-4292-8682-240123eec48a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:35:24.430166 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d8a110-7fb2-4292-8682-240123eec48a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 19:35:24.435665 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application [None req-66d8a110-7fb2-4292-8682-240123eec48a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 19:35:24.435665 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:35:24.435665 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:35:24.435665 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:35:24.435665 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:35:24.435665 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:35:24.435665 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:35:24.435665 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:35:24.435665 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:35:24.435665 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:35:24.435665 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:35:24.435665 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:35:24.435665 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 19:35:24.435665 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 19:35:24.435665 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 19:35:24.435665 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 19:35:24.436632 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 19:35:24.436632 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 19:35:24.436632 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 19:35:24.436632 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 19:35:24.436632 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:35:24.436632 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:35:24.436632 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:35:24.436632 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:35:24.436632 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:35:24.436632 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:35:24.436632 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:35:24.436632 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application with Lock( Sep 13 19:35:24.436632 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:35:24.436632 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:35:24.436632 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:35:24.436632 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:35:24.437427 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:35:24.437427 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:35:24.437427 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:35:24.437427 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:35:24.437427 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 19:35:24.437427 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 19:35:24.437427 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 19:35:24.437427 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 19:35:24.437427 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 19:35:24.437427 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 19:35:24.437427 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 19:35:24.437427 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application Sep 13 19:35:24.438441 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881b798c-7087-4433-a289-41bf529cb31b None admin] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:35:24.439649 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 127/253] 10.222.0.25 () {56 vars in 1096 bytes} [Tue Sep 13 19:35:24 2022] GET /identity/v3/roles/admin => generated 83 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:35:24.440250 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d8a110-7fb2-4292-8682-240123eec48a None admin] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:35:24.487128 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f45ef61-665a-4255-a930-00797997f7ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:35:24.487924 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f45ef61-665a-4255-a930-00797997f7ea None admin] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:35:24.488268 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f45ef61-665a-4255-a930-00797997f7ea None admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:35:24.488559 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f45ef61-665a-4255-a930-00797997f7ea None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:35:24.490162 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f45ef61-665a-4255-a930-00797997f7ea None admin] RBAC: Adding query filter params (role.id=85e5149eef184d349b4b1859b84dd789, scope.project.id=93e1f3226d564df686b8ca37cfd3a42c, user.id=84602aa8c37c474a82fdab3c4c5157dc) {{(pid=87934) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:35:24.490479 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f45ef61-665a-4255-a930-00797997f7ea None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:35:24.492899 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f45ef61-665a-4255-a930-00797997f7ea None admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:35:24.503987 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 127/254] 10.222.0.25 () {56 vars in 1374 bytes} [Tue Sep 13 19:35:24 2022] GET /identity/v3/role_assignments?user.id=84602aa8c37c474a82fdab3c4c5157dc&scope.project.id=93e1f3226d564df686b8ca37cfd3a42c&role.id=85e5149eef184d349b4b1859b84dd789 => generated 259 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:35:24.504631 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f45ef61-665a-4255-a930-00797997f7ea None admin] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:35:24.585811 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d8a110-7fb2-4292-8682-240123eec48a None admin] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:35:24.600624 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG dbcounter [-] [87935] Writing DB stats keystone:SELECT=100 {{(pid=87935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:35:24.638257 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2925f0-be40-4e0d-bd88-6058e674cf23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:35:24.639266 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2925f0-be40-4e0d-bd88-6058e674cf23 None admin] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:35:24.639714 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2925f0-be40-4e0d-bd88-6058e674cf23 None admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:35:24.640338 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2925f0-be40-4e0d-bd88-6058e674cf23 None admin] PATH_INFO: `/v3/projects/93e1f3226d564df686b8ca37cfd3a42c` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:35:24.641868 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad2925f0-be40-4e0d-bd88-6058e674cf23 None admin] RBAC: Authorizing `identity:get_project(project_id=93e1f3226d564df686b8ca37cfd3a42c)` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:35:24.643778 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad2925f0-be40-4e0d-bd88-6058e674cf23 None admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:35:24.648709 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 128/255] 10.222.0.25 () {56 vars in 1186 bytes} [Tue Sep 13 19:35:24 2022] GET /identity/v3/projects/93e1f3226d564df686b8ca37cfd3a42c => generated 302 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:35:24.656254 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2925f0-be40-4e0d-bd88-6058e674cf23 None admin] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:35:24.669284 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f45ef61-665a-4255-a930-00797997f7ea None admin] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:35:24.690175 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG dbcounter [-] [87934] Writing DB stats keystone:SELECT=100 {{(pid=87934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:35:24.718516 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe55c46-34e5-436b-b43c-075f77f955d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:35:24.719146 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe55c46-34e5-436b-b43c-075f77f955d8 None admin] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:35:24.719426 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe55c46-34e5-436b-b43c-075f77f955d8 None admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:35:24.719699 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe55c46-34e5-436b-b43c-075f77f955d8 None admin] PATH_INFO: `/v3/roles` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:35:24.720404 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe55c46-34e5-436b-b43c-075f77f955d8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87934) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:35:24.721048 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe55c46-34e5-436b-b43c-075f77f955d8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:35:24.722752 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe55c46-34e5-436b-b43c-075f77f955d8 None admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:35:24.734936 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 128/256] 10.222.0.25 () {56 vars in 1099 bytes} [Tue Sep 13 19:35:24 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:35:24.741182 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe55c46-34e5-436b-b43c-075f77f955d8 None admin] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:35:24.791688 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2925f0-be40-4e0d-bd88-6058e674cf23 None admin] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:35:24.836635 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285ebe62-87a4-49bd-9fbe-78fba6954e6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:35:24.837705 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285ebe62-87a4-49bd-9fbe-78fba6954e6d None admin] REQUEST_METHOD: `PUT` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:35:24.838241 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285ebe62-87a4-49bd-9fbe-78fba6954e6d None admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:35:24.838705 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285ebe62-87a4-49bd-9fbe-78fba6954e6d None admin] PATH_INFO: `/v3/projects/93e1f3226d564df686b8ca37cfd3a42c/users/f964a30cce9b4f058e5d0a6bcd67c477/roles/a259191f6d0e46fabd9f34536bb28747` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:35:24.848100 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-285ebe62-87a4-49bd-9fbe-78fba6954e6d None admin] RBAC: Authorizing `identity:create_grant(project_id=93e1f3226d564df686b8ca37cfd3a42c, user_id=f964a30cce9b4f058e5d0a6bcd67c477, role_id=a259191f6d0e46fabd9f34536bb28747)` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:35:24.848100 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-285ebe62-87a4-49bd-9fbe-78fba6954e6d None admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:35:24.860790 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 129/257] 10.222.0.25 () {58 vars in 1439 bytes} [Tue Sep 13 19:35:24 2022] PUT /identity/v3/projects/93e1f3226d564df686b8ca37cfd3a42c/users/f964a30cce9b4f058e5d0a6bcd67c477/roles/a259191f6d0e46fabd9f34536bb28747 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 19:35:24.862130 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954902ca-4406-4b0b-b183-624e6b68510c None None] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:35:24.862783 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954902ca-4406-4b0b-b183-624e6b68510c None None] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:35:24.863157 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954902ca-4406-4b0b-b183-624e6b68510c None None] PATH_INFO: `/` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:35:24.865697 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 130/258] 10.222.0.25 () {54 vars in 927 bytes} [Tue Sep 13 19:35:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:35:24.874702 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de30d4f2-c8be-45ae-94a5-f9b9946357b0 None None] REQUEST_METHOD: `POST` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:35:24.875361 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de30d4f2-c8be-45ae-94a5-f9b9946357b0 None None] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:35:24.875703 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de30d4f2-c8be-45ae-94a5-f9b9946357b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:35:24.877217 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe55c46-34e5-436b-b43c-075f77f955d8 None admin] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:35:24.912359 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.auth.core [None req-de30d4f2-c8be-45ae-94a5-f9b9946357b0 None None] MFA Rules not processed for user `7b0aed92d02344acb92a0e4aa67c3068`. Rule list: `[]` (Enabled: `True`). {{(pid=87935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:35:24.914039 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.fernet_utils [None req-de30d4f2-c8be-45ae-94a5-f9b9946357b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:35:24.940545 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5983c8d4-5a00-4eed-a834-25b0a02c35e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:35:24.941201 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5983c8d4-5a00-4eed-a834-25b0a02c35e3 None admin] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:35:24.941481 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5983c8d4-5a00-4eed-a834-25b0a02c35e3 None admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:35:24.941755 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5983c8d4-5a00-4eed-a834-25b0a02c35e3 None admin] PATH_INFO: `/v3/users/c2092d127b9542acbd73594cc26290a3` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:35:24.943314 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5983c8d4-5a00-4eed-a834-25b0a02c35e3 None admin] RBAC: Authorizing `identity:get_user(user_id=c2092d127b9542acbd73594cc26290a3)` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:35:24.944885 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5983c8d4-5a00-4eed-a834-25b0a02c35e3 None admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:35:24.949492 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 129/259] 10.222.0.25 () {56 vars in 1177 bytes} [Tue Sep 13 19:35:24 2022] GET /identity/v3/users/c2092d127b9542acbd73594cc26290a3 => generated 283 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:35:24.954253 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5983c8d4-5a00-4eed-a834-25b0a02c35e3 None admin] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:35:24.983889 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG dbcounter [-] [87935] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:35:25.034411 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG dbcounter [-] [87934] Writing DB stats keystone:SELECT=100 {{(pid=87934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:35:25.087927 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 131/260] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Sep 13 19:35:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 13 19:35:25.125213 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5983c8d4-5a00-4eed-a834-25b0a02c35e3 None admin] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:35:25.175718 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7d3461-be86-49fa-b87a-298d11b6383e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:35:25.176287 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7d3461-be86-49fa-b87a-298d11b6383e None admin] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:35:25.176562 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7d3461-be86-49fa-b87a-298d11b6383e None admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:35:25.176870 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7d3461-be86-49fa-b87a-298d11b6383e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:35:25.263628 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7d3461-be86-49fa-b87a-298d11b6383e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:35:25.265331 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7d3461-be86-49fa-b87a-298d11b6383e None admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:35:25.321802 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG dbcounter [-] [87934] Writing DB stats keystone:SELECT=100 {{(pid=87934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:35:25.399970 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 130/261] 10.222.0.25 () {58 vars in 1282 bytes} [Tue Sep 13 19:35:24 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 446 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 13 19:35:25.405556 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de30d4f2-c8be-45ae-94a5-f9b9946357b0 None None] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:35:25.419750 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7d3461-be86-49fa-b87a-298d11b6383e None admin] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:35:25.627955 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de30d4f2-c8be-45ae-94a5-f9b9946357b0 None None] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:35:25.646557 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7d3461-be86-49fa-b87a-298d11b6383e None admin] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:35:25.722391 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f5d5d2-249c-4f8b-bbee-aa539d69c658 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:35:25.723384 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c1fd83-1763-4fc5-8b1e-dec387d06aa1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:35:25.723543 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f5d5d2-249c-4f8b-bbee-aa539d69c658 None admin] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:35:25.723543 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f5d5d2-249c-4f8b-bbee-aa539d69c658 None admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:35:25.723543 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f5d5d2-249c-4f8b-bbee-aa539d69c658 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:35:25.724160 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c1fd83-1763-4fc5-8b1e-dec387d06aa1 None admin] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:35:25.724491 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c1fd83-1763-4fc5-8b1e-dec387d06aa1 None admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:35:25.724959 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c1fd83-1763-4fc5-8b1e-dec387d06aa1 None admin] PATH_INFO: `/v3/projects/93e1f3226d564df686b8ca37cfd3a42c` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:35:25.727582 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c1fd83-1763-4fc5-8b1e-dec387d06aa1 None admin] RBAC: Authorizing `identity:get_project(project_id=93e1f3226d564df686b8ca37cfd3a42c)` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:35:25.730385 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c1fd83-1763-4fc5-8b1e-dec387d06aa1 None admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:35:25.741755 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 132/262] 10.222.0.25 () {56 vars in 1186 bytes} [Tue Sep 13 19:35:25 2022] GET /identity/v3/projects/93e1f3226d564df686b8ca37cfd3a42c => generated 302 bytes in 337 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:35:25.748394 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c1fd83-1763-4fc5-8b1e-dec387d06aa1 None admin] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:35:25.749213 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f5d5d2-249c-4f8b-bbee-aa539d69c658 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 19:35:25.754163 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application [None req-76f5d5d2-249c-4f8b-bbee-aa539d69c658 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 13 19:35:25.754163 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:35:25.754163 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:35:25.754163 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:35:25.754163 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:35:25.754163 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:35:25.754163 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:35:25.754163 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:35:25.754163 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:35:25.754163 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:35:25.754163 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:35:25.754163 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:35:25.754163 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 19:35:25.754163 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 19:35:25.754163 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 19:35:25.754163 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 19:35:25.755306 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 19:35:25.755306 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 19:35:25.755306 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 19:35:25.755306 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 19:35:25.755306 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:35:25.755306 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:35:25.755306 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:35:25.755306 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:35:25.755306 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:35:25.755306 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:35:25.755306 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:35:25.755306 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application with Lock( Sep 13 19:35:25.755306 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:35:25.755306 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:35:25.755306 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:35:25.755306 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:35:25.756116 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:35:25.756116 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:35:25.756116 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:35:25.756116 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:35:25.756116 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 19:35:25.756116 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 19:35:25.756116 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 19:35:25.756116 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 19:35:25.756116 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 19:35:25.756116 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 19:35:25.756116 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 13 19:35:25.756116 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application Sep 13 19:35:25.756116 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 131/263] 10.222.0.25 () {56 vars in 1114 bytes} [Tue Sep 13 19:35:25 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 336 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 13 19:35:25.764406 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f5d5d2-249c-4f8b-bbee-aa539d69c658 None admin] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:35:25.776647 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG dbcounter [-] [87934] Writing DB stats keystone:SELECT=100 {{(pid=87934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:35:25.836575 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG dbcounter [-] [87935] Writing DB stats keystone:SELECT=100 {{(pid=87935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:35:25.964328 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f5d5d2-249c-4f8b-bbee-aa539d69c658 None admin] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:35:25.982610 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c1fd83-1763-4fc5-8b1e-dec387d06aa1 None admin] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:35:26.033209 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a47368-cf9e-407a-8fbf-02eb3b825417 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:35:26.033825 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a47368-cf9e-407a-8fbf-02eb3b825417 None admin] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:35:26.034105 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a47368-cf9e-407a-8fbf-02eb3b825417 None admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:35:26.034376 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a47368-cf9e-407a-8fbf-02eb3b825417 None admin] PATH_INFO: `/v3/roles` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:35:26.035045 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a47368-cf9e-407a-8fbf-02eb3b825417 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=87934) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:35:26.035345 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a47368-cf9e-407a-8fbf-02eb3b825417 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:35:26.036777 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a47368-cf9e-407a-8fbf-02eb3b825417 None admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:35:26.057369 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3992f4f-fa47-4ba7-bd97-7e416d9110f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:35:26.058046 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3992f4f-fa47-4ba7-bd97-7e416d9110f8 None admin] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:35:26.058328 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3992f4f-fa47-4ba7-bd97-7e416d9110f8 None admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:35:26.058597 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3992f4f-fa47-4ba7-bd97-7e416d9110f8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:35:26.059328 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3992f4f-fa47-4ba7-bd97-7e416d9110f8 None admin] RBAC: Adding query filter params (role.id=6ca1d4427ff64e0a9d25d96cfb1445f6, scope.project.id=93e1f3226d564df686b8ca37cfd3a42c, user.id=c2092d127b9542acbd73594cc26290a3) {{(pid=87935) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:35:26.059635 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3992f4f-fa47-4ba7-bd97-7e416d9110f8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:35:26.061107 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3992f4f-fa47-4ba7-bd97-7e416d9110f8 None admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:35:26.063037 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 132/264] 10.222.0.25 () {56 vars in 1111 bytes} [Tue Sep 13 19:35:25 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 299 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:35:26.063923 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a47368-cf9e-407a-8fbf-02eb3b825417 None admin] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:35:26.077678 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 133/265] 10.222.0.25 () {56 vars in 1374 bytes} [Tue Sep 13 19:35:25 2022] GET /identity/v3/role_assignments?user.id=c2092d127b9542acbd73594cc26290a3&scope.project.id=93e1f3226d564df686b8ca37cfd3a42c&role.id=6ca1d4427ff64e0a9d25d96cfb1445f6 => generated 608 bytes in 330 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 19:35:26.147650 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG dbcounter [-] [87934] Writing DB stats keystone:SELECT=100 {{(pid=87934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:35:26.185956 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a47368-cf9e-407a-8fbf-02eb3b825417 None admin] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:35:26.232004 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85fd38d0-fd96-4c8a-b898-c3db7ffad28c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:35:26.232690 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fd38d0-fd96-4c8a-b898-c3db7ffad28c None admin] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:35:26.232971 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fd38d0-fd96-4c8a-b898-c3db7ffad28c None admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:35:26.233243 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fd38d0-fd96-4c8a-b898-c3db7ffad28c None admin] PATH_INFO: `/v3/users/c2092d127b9542acbd73594cc26290a3` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:35:26.234459 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85fd38d0-fd96-4c8a-b898-c3db7ffad28c None admin] RBAC: Authorizing `identity:get_user(user_id=c2092d127b9542acbd73594cc26290a3)` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:35:26.235939 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85fd38d0-fd96-4c8a-b898-c3db7ffad28c None admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:35:26.237633 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 133/266] 10.222.0.25 () {56 vars in 1177 bytes} [Tue Sep 13 19:35:26 2022] GET /identity/v3/users/c2092d127b9542acbd73594cc26290a3 => generated 283 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:35:26.243567 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3992f4f-fa47-4ba7-bd97-7e416d9110f8 None admin] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:35:26.417521 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG dbcounter [-] [87935] Writing DB stats keystone:SELECT=100 {{(pid=87935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:35:26.421469 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3992f4f-fa47-4ba7-bd97-7e416d9110f8 None admin] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:35:26.464494 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38474346-6f21-4d0c-8e64-1ef79c135d0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:35:26.465565 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38474346-6f21-4d0c-8e64-1ef79c135d0e None admin] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:35:26.466064 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38474346-6f21-4d0c-8e64-1ef79c135d0e None admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:35:26.466944 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38474346-6f21-4d0c-8e64-1ef79c135d0e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:35:26.579794 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38474346-6f21-4d0c-8e64-1ef79c135d0e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:35:26.581641 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38474346-6f21-4d0c-8e64-1ef79c135d0e None admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:35:26.708936 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG dbcounter [-] [87935] Writing DB stats keystone:SELECT=100 {{(pid=87935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:35:26.714229 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 134/267] 10.222.0.25 () {58 vars in 1282 bytes} [Tue Sep 13 19:35:26 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 471 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 13 19:35:26.721279 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85fd38d0-fd96-4c8a-b898-c3db7ffad28c None admin] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:35:26.871133 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85fd38d0-fd96-4c8a-b898-c3db7ffad28c None admin] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:35:26.925831 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e7f329-c48b-4494-b0d5-78a7ac910b09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:35:26.926468 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e7f329-c48b-4494-b0d5-78a7ac910b09 None admin] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:35:26.926748 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e7f329-c48b-4494-b0d5-78a7ac910b09 None admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:35:26.927021 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e7f329-c48b-4494-b0d5-78a7ac910b09 None admin] PATH_INFO: `/v3/projects/93e1f3226d564df686b8ca37cfd3a42c` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:35:26.929686 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e7f329-c48b-4494-b0d5-78a7ac910b09 None admin] RBAC: Authorizing `identity:get_project(project_id=93e1f3226d564df686b8ca37cfd3a42c)` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:35:26.931137 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e7f329-c48b-4494-b0d5-78a7ac910b09 None admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:35:26.933095 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 134/268] 10.222.0.25 () {56 vars in 1186 bytes} [Tue Sep 13 19:35:26 2022] GET /identity/v3/projects/93e1f3226d564df686b8ca37cfd3a42c => generated 302 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:35:26.938940 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38474346-6f21-4d0c-8e64-1ef79c135d0e None admin] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:35:27.059357 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38474346-6f21-4d0c-8e64-1ef79c135d0e None admin] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:35:27.095640 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a5f0fb-c7c3-450b-b59d-264429a5f9e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:35:27.096637 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a5f0fb-c7c3-450b-b59d-264429a5f9e6 None admin] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:35:27.097109 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a5f0fb-c7c3-450b-b59d-264429a5f9e6 None admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:35:27.097591 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a5f0fb-c7c3-450b-b59d-264429a5f9e6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:35:27.098504 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a5f0fb-c7c3-450b-b59d-264429a5f9e6 None admin] RBAC: Adding query filter params (role.id=8af3d83a03144ae8bacdb82d9a108110, scope.project.id=93e1f3226d564df686b8ca37cfd3a42c, user.id=c2092d127b9542acbd73594cc26290a3) {{(pid=87935) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:35:27.099017 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a5f0fb-c7c3-450b-b59d-264429a5f9e6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:35:27.101316 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a5f0fb-c7c3-450b-b59d-264429a5f9e6 None admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:35:27.107944 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 135/269] 10.222.0.25 () {56 vars in 1374 bytes} [Tue Sep 13 19:35:26 2022] GET /identity/v3/role_assignments?user.id=c2092d127b9542acbd73594cc26290a3&scope.project.id=93e1f3226d564df686b8ca37cfd3a42c&role.id=8af3d83a03144ae8bacdb82d9a108110 => generated 608 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:35:27.511792 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd592a95-691f-43ca-8c91-197e2cafe414 None None] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:35:27.512493 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd592a95-691f-43ca-8c91-197e2cafe414 None None] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:35:27.512974 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd592a95-691f-43ca-8c91-197e2cafe414 None None] PATH_INFO: `/` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:35:27.514838 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 135/270] 10.222.0.25 () {54 vars in 927 bytes} [Tue Sep 13 19:35:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:35:27.521248 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bc71a3-4669-44cf-b687-475278fc92b5 None None] REQUEST_METHOD: `POST` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:35:27.521537 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bc71a3-4669-44cf-b687-475278fc92b5 None None] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:35:27.521792 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bc71a3-4669-44cf-b687-475278fc92b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:35:27.543701 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.auth.core [None req-a2bc71a3-4669-44cf-b687-475278fc92b5 None None] MFA Rules not processed for user `7b0aed92d02344acb92a0e4aa67c3068`. Rule list: `[]` (Enabled: `True`). {{(pid=87935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:35:27.544948 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.fernet_utils [None req-a2bc71a3-4669-44cf-b687-475278fc92b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:35:27.628886 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG dbcounter [-] [87935] Writing DB stats keystone:SELECT=100 {{(pid=87935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:35:27.643074 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 136/271] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Sep 13 19:35:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 19:35:27.817140 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee83f89-921c-49e9-86cb-79781ebb9690 None None] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:35:27.817417 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee83f89-921c-49e9-86cb-79781ebb9690 None None] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:35:27.817688 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee83f89-921c-49e9-86cb-79781ebb9690 None None] PATH_INFO: `/` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:35:27.819443 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 136/272] 10.222.0.25 () {54 vars in 927 bytes} [Tue Sep 13 19:35:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:35:27.825463 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b87e52-4cb3-4383-81e9-087469a9cb2b None None] REQUEST_METHOD: `POST` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:35:27.826420 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b87e52-4cb3-4383-81e9-087469a9cb2b None None] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:35:27.826913 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b87e52-4cb3-4383-81e9-087469a9cb2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:35:27.842309 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a12fe1f-74e4-4282-92e8-69b1f27eb711 None None] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:35:27.842614 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a12fe1f-74e4-4282-92e8-69b1f27eb711 None None] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:35:27.842850 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a12fe1f-74e4-4282-92e8-69b1f27eb711 None None] PATH_INFO: `/` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:35:27.844495 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 137/273] 10.222.0.25 () {54 vars in 927 bytes} [Tue Sep 13 19:35:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 13 19:35:27.846928 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.auth.core [None req-34b87e52-4cb3-4383-81e9-087469a9cb2b None None] MFA Rules not processed for user `7b0aed92d02344acb92a0e4aa67c3068`. Rule list: `[]` (Enabled: `True`). {{(pid=87935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:35:27.848343 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.fernet_utils [None req-34b87e52-4cb3-4383-81e9-087469a9cb2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:35:27.849535 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1aa7775-ac56-4ffd-a9ac-593b95012c0b None None] REQUEST_METHOD: `POST` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:35:27.849819 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1aa7775-ac56-4ffd-a9ac-593b95012c0b None None] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:35:27.850092 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1aa7775-ac56-4ffd-a9ac-593b95012c0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:35:27.857417 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG dbcounter [-] [87934] Writing DB stats keystone:SELECT=100 {{(pid=87934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:35:27.871738 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.auth.core [None req-e1aa7775-ac56-4ffd-a9ac-593b95012c0b None None] MFA Rules not processed for user `7b0aed92d02344acb92a0e4aa67c3068`. Rule list: `[]` (Enabled: `True`). {{(pid=87934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:35:27.873101 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.fernet_utils [None req-e1aa7775-ac56-4ffd-a9ac-593b95012c0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:35:27.951335 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 137/274] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Sep 13 19:35:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 19:35:27.954212 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b87e52-4cb3-4383-81e9-087469a9cb2b None None] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:35:27.972825 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 138/275] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Sep 13 19:35:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 19:35:28.067415 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b87e52-4cb3-4383-81e9-087469a9cb2b None None] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:35:28.093941 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG dbcounter [-] [87935] Writing DB stats keystone:SELECT=100 {{(pid=87935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:35:28.107227 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6638a32d-72fc-4603-be57-d1b128b0a92a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:35:28.108286 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6638a32d-72fc-4603-be57-d1b128b0a92a None admin] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:35:28.108768 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6638a32d-72fc-4603-be57-d1b128b0a92a None admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:35:28.109234 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6638a32d-72fc-4603-be57-d1b128b0a92a None admin] PATH_INFO: `/v3/roles/member` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:35:28.122442 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6638a32d-72fc-4603-be57-d1b128b0a92a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 19:35:28.128144 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application [None req-6638a32d-72fc-4603-be57-d1b128b0a92a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 13 19:35:28.128144 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:35:28.128144 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:35:28.128144 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:35:28.128144 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:35:28.128144 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:35:28.128144 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:35:28.128144 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:35:28.128144 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:35:28.128144 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:35:28.128144 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:35:28.128144 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:35:28.128144 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 19:35:28.128144 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 19:35:28.128144 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 19:35:28.128144 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 19:35:28.129151 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 19:35:28.129151 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 19:35:28.129151 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 19:35:28.129151 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 19:35:28.129151 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:35:28.129151 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:35:28.129151 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:35:28.129151 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:35:28.129151 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:35:28.129151 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:35:28.129151 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:35:28.129151 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application with Lock( Sep 13 19:35:28.129151 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:35:28.129151 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:35:28.129151 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:35:28.129151 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:35:28.130060 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:35:28.130060 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:35:28.130060 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:35:28.130060 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:35:28.130060 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 19:35:28.130060 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 19:35:28.130060 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 19:35:28.130060 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 19:35:28.130060 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 19:35:28.130060 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 19:35:28.130060 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 13 19:35:28.130060 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application Sep 13 19:35:28.133095 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 138/276] 10.222.0.25 () {56 vars in 1099 bytes} [Tue Sep 13 19:35:27 2022] GET /identity/v3/roles/member => generated 84 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:35:28.139243 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1aa7775-ac56-4ffd-a9ac-593b95012c0b None None] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:35:28.243094 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6638a32d-72fc-4603-be57-d1b128b0a92a None admin] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:35:28.259074 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1aa7775-ac56-4ffd-a9ac-593b95012c0b None None] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:35:28.290091 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG dbcounter [-] [87934] Writing DB stats keystone:SELECT=100 {{(pid=87934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:35:28.296191 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5baacb0e-d166-4227-ad05-0165505d9220 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:35:28.296832 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5baacb0e-d166-4227-ad05-0165505d9220 None admin] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:35:28.297107 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5baacb0e-d166-4227-ad05-0165505d9220 None admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:35:28.297376 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5baacb0e-d166-4227-ad05-0165505d9220 None admin] PATH_INFO: `/v3/roles` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:35:28.298037 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5baacb0e-d166-4227-ad05-0165505d9220 None admin] RBAC: Adding query filter params (name=member) {{(pid=87934) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:35:28.298334 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5baacb0e-d166-4227-ad05-0165505d9220 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:35:28.299708 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5baacb0e-d166-4227-ad05-0165505d9220 None admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:35:28.308305 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 139/277] 10.222.0.25 () {56 vars in 1101 bytes} [Tue Sep 13 19:35:28 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:35:28.309643 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fb7382-4a59-469c-89d1-d416d654e164 None None] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:35:28.309923 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fb7382-4a59-469c-89d1-d416d654e164 None None] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:35:28.310189 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fb7382-4a59-469c-89d1-d416d654e164 None None] PATH_INFO: `/` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:35:28.311373 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 140/278] 10.222.0.25 () {54 vars in 927 bytes} [Tue Sep 13 19:35:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:35:28.312056 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37fb7382-4a59-469c-89d1-d416d654e164 None None] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:35:28.353204 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6638a32d-72fc-4603-be57-d1b128b0a92a None admin] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:35:28.387201 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef022dfb-fb56-48c3-808a-8aa180b9547c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:35:28.387818 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef022dfb-fb56-48c3-808a-8aa180b9547c None admin] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:35:28.388090 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef022dfb-fb56-48c3-808a-8aa180b9547c None admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:35:28.388388 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef022dfb-fb56-48c3-808a-8aa180b9547c None admin] PATH_INFO: `/v3/roles/reader` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:35:28.399030 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef022dfb-fb56-48c3-808a-8aa180b9547c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 19:35:28.403928 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application [None req-ef022dfb-fb56-48c3-808a-8aa180b9547c None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 13 19:35:28.403928 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:35:28.403928 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:35:28.403928 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:35:28.403928 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:35:28.403928 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:35:28.403928 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:35:28.403928 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:35:28.403928 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:35:28.403928 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:35:28.403928 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:35:28.403928 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:35:28.403928 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 19:35:28.403928 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 19:35:28.403928 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 19:35:28.403928 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 19:35:28.404862 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 19:35:28.404862 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 19:35:28.404862 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 19:35:28.404862 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 19:35:28.404862 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:35:28.404862 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:35:28.404862 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:35:28.404862 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:35:28.404862 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:35:28.404862 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:35:28.404862 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:35:28.404862 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application with Lock( Sep 13 19:35:28.404862 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:35:28.404862 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:35:28.404862 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:35:28.404862 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:35:28.405677 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:35:28.405677 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:35:28.405677 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:35:28.405677 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:35:28.405677 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 19:35:28.405677 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 19:35:28.405677 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 19:35:28.405677 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 19:35:28.405677 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 19:35:28.405677 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 19:35:28.405677 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 13 19:35:28.405677 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application Sep 13 19:35:28.405677 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 139/279] 10.222.0.25 () {56 vars in 1099 bytes} [Tue Sep 13 19:35:28 2022] GET /identity/v3/roles/reader => generated 84 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:35:28.406333 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef022dfb-fb56-48c3-808a-8aa180b9547c None admin] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:35:28.415549 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37fb7382-4a59-469c-89d1-d416d654e164 None None] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:35:28.450801 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f3855f-4259-4639-9acf-1c684e3e9220 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:35:28.451437 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f3855f-4259-4639-9acf-1c684e3e9220 None admin] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:35:28.451716 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f3855f-4259-4639-9acf-1c684e3e9220 None admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:35:28.451987 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f3855f-4259-4639-9acf-1c684e3e9220 None admin] PATH_INFO: `/v3/domains/default` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:35:28.453125 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f3855f-4259-4639-9acf-1c684e3e9220 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:35:28.454565 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f3855f-4259-4639-9acf-1c684e3e9220 None admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:35:28.456132 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 141/280] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Sep 13 19:35:28 2022] GET /identity/v3/domains/default => generated 199 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:35:28.458247 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b17930-593a-4a5f-a706-cbfa06366e7c None None] REQUEST_METHOD: `POST` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:35:28.458247 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b17930-593a-4a5f-a706-cbfa06366e7c None None] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:35:28.458247 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b17930-593a-4a5f-a706-cbfa06366e7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:35:28.476901 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG dbcounter [-] [87935] Writing DB stats keystone:SELECT=100 {{(pid=87935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:35:28.477333 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.auth.core [None req-e2b17930-593a-4a5f-a706-cbfa06366e7c None None] MFA Rules not processed for user `7b0aed92d02344acb92a0e4aa67c3068`. Rule list: `[]` (Enabled: `True`). {{(pid=87934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:35:28.478614 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.fernet_utils [None req-e2b17930-593a-4a5f-a706-cbfa06366e7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:35:28.543508 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef022dfb-fb56-48c3-808a-8aa180b9547c None admin] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:35:28.550259 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG dbcounter [-] [87934] Writing DB stats keystone:SELECT=100 {{(pid=87934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:35:28.561751 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 142/281] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Sep 13 19:35:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 19:35:28.562614 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b17930-593a-4a5f-a706-cbfa06366e7c None None] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:35:28.583510 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8c8caa-c7e0-4951-9acc-f8280ccb6678 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:35:28.584150 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8c8caa-c7e0-4951-9acc-f8280ccb6678 None admin] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:35:28.584477 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8c8caa-c7e0-4951-9acc-f8280ccb6678 None admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:35:28.585386 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8c8caa-c7e0-4951-9acc-f8280ccb6678 None admin] PATH_INFO: `/v3/users/344678e0b86245328db52a0438ba28c0` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:35:28.602747 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d8c8caa-c7e0-4951-9acc-f8280ccb6678 None admin] RBAC: Authorizing `identity:get_user(user_id=344678e0b86245328db52a0438ba28c0)` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:35:28.604396 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d8c8caa-c7e0-4951-9acc-f8280ccb6678 None admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:35:28.606371 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 140/282] 10.222.0.25 () {56 vars in 1177 bytes} [Tue Sep 13 19:35:28 2022] GET /identity/v3/users/344678e0b86245328db52a0438ba28c0 => generated 293 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:35:28.607021 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8c8caa-c7e0-4951-9acc-f8280ccb6678 None admin] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:35:28.712910 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b17930-593a-4a5f-a706-cbfa06366e7c None None] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:35:28.727045 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG dbcounter [-] [87935] Writing DB stats keystone:SELECT=100 {{(pid=87935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:35:28.730691 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8c8caa-c7e0-4951-9acc-f8280ccb6678 None admin] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:35:28.753213 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9e88f3-7680-4e3a-b667-4d7a47f76e2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:35:28.754034 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9e88f3-7680-4e3a-b667-4d7a47f76e2a None admin] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:35:28.754255 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9e88f3-7680-4e3a-b667-4d7a47f76e2a None admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:35:28.754512 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9e88f3-7680-4e3a-b667-4d7a47f76e2a None admin] PATH_INFO: `/v3/roles` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:35:28.755133 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a9e88f3-7680-4e3a-b667-4d7a47f76e2a None admin] RBAC: Adding query filter params (name=reader) {{(pid=87934) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:35:28.755427 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a9e88f3-7680-4e3a-b667-4d7a47f76e2a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:35:28.757365 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a9e88f3-7680-4e3a-b667-4d7a47f76e2a None admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:35:28.767853 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 143/283] 10.222.0.25 () {56 vars in 1101 bytes} [Tue Sep 13 19:35:28 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:35:28.773379 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9e88f3-7680-4e3a-b667-4d7a47f76e2a None admin] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:35:28.794675 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663afa09-28e2-4cc1-8412-c98bfb16fa86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:35:28.795198 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663afa09-28e2-4cc1-8412-c98bfb16fa86 None admin] REQUEST_METHOD: `POST` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:35:28.795472 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663afa09-28e2-4cc1-8412-c98bfb16fa86 None admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:35:28.795741 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663afa09-28e2-4cc1-8412-c98bfb16fa86 None admin] PATH_INFO: `/v3/users` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:35:28.796431 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-663afa09-28e2-4cc1-8412-c98bfb16fa86 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:35:28.797912 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-663afa09-28e2-4cc1-8412-c98bfb16fa86 None admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:35:28.832445 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 141/284] 10.222.0.25 () {60 vars in 1132 bytes} [Tue Sep 13 19:35:28 2022] POST /identity/v3/users => generated 293 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 19:35:28.832445 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663afa09-28e2-4cc1-8412-c98bfb16fa86 None admin] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:35:28.853685 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG dbcounter [-] [87934] Writing DB stats keystone:SELECT=100 {{(pid=87934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:35:28.911319 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9e88f3-7680-4e3a-b667-4d7a47f76e2a None admin] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:35:28.947312 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663afa09-28e2-4cc1-8412-c98bfb16fa86 None admin] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:35:28.950764 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49438bc-c536-4ac2-8cf9-2be6af5e070b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:35:28.951381 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49438bc-c536-4ac2-8cf9-2be6af5e070b None admin] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:35:28.951655 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49438bc-c536-4ac2-8cf9-2be6af5e070b None admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:35:28.951918 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49438bc-c536-4ac2-8cf9-2be6af5e070b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:35:28.952700 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c49438bc-c536-4ac2-8cf9-2be6af5e070b None admin] RBAC: Adding query filter params (role.id=a259191f6d0e46fabd9f34536bb28747, user.id=344678e0b86245328db52a0438ba28c0, scope.system=all) {{(pid=87934) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:35:28.953007 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c49438bc-c536-4ac2-8cf9-2be6af5e070b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:35:28.954519 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c49438bc-c536-4ac2-8cf9-2be6af5e070b None admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:35:28.972255 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 144/285] 10.222.0.25 () {56 vars in 1308 bytes} [Tue Sep 13 19:35:28 2022] GET /identity/v3/role_assignments?user.id=344678e0b86245328db52a0438ba28c0&scope.system=all&role.id=a259191f6d0e46fabd9f34536bb28747 => generated 226 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:35:28.972255 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49438bc-c536-4ac2-8cf9-2be6af5e070b None admin] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:35:29.007443 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7653436b-8cf9-4730-aac8-b6015acfc64a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:35:29.008109 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7653436b-8cf9-4730-aac8-b6015acfc64a None admin] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:35:29.008417 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7653436b-8cf9-4730-aac8-b6015acfc64a None admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:35:29.008686 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7653436b-8cf9-4730-aac8-b6015acfc64a None admin] PATH_INFO: `/v3/users/84602aa8c37c474a82fdab3c4c5157dc` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:35:29.010670 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7653436b-8cf9-4730-aac8-b6015acfc64a None admin] RBAC: Authorizing `identity:get_user(user_id=84602aa8c37c474a82fdab3c4c5157dc)` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:35:29.012713 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7653436b-8cf9-4730-aac8-b6015acfc64a None admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:35:29.015106 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 142/286] 10.222.0.25 () {56 vars in 1177 bytes} [Tue Sep 13 19:35:28 2022] GET /identity/v3/users/84602aa8c37c474a82fdab3c4c5157dc => generated 297 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:35:29.020956 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7653436b-8cf9-4730-aac8-b6015acfc64a None admin] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:35:29.056985 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG dbcounter [-] [87935] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:35:29.115254 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49438bc-c536-4ac2-8cf9-2be6af5e070b None admin] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:35:29.138505 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG dbcounter [-] [87934] Writing DB stats keystone:SELECT=100 {{(pid=87934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:35:29.161697 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7653436b-8cf9-4730-aac8-b6015acfc64a None admin] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:35:29.161959 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc6f93b-ac91-4768-8fe2-c2caa4af1e31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:35:29.162628 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc6f93b-ac91-4768-8fe2-c2caa4af1e31 None admin] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:35:29.163417 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc6f93b-ac91-4768-8fe2-c2caa4af1e31 None admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:35:29.163680 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc6f93b-ac91-4768-8fe2-c2caa4af1e31 None admin] PATH_INFO: `/v3/roles/member` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:35:29.179460 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc6f93b-ac91-4768-8fe2-c2caa4af1e31 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 19:35:29.185492 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application [None req-3dc6f93b-ac91-4768-8fe2-c2caa4af1e31 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 13 19:35:29.185492 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:35:29.185492 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:35:29.185492 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:35:29.185492 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:35:29.185492 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:35:29.185492 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:35:29.185492 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:35:29.185492 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:35:29.185492 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:35:29.185492 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:35:29.185492 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:35:29.185492 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 19:35:29.185492 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 19:35:29.185492 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 19:35:29.185492 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 19:35:29.186427 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 19:35:29.186427 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 19:35:29.186427 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 19:35:29.186427 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 19:35:29.186427 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:35:29.186427 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:35:29.186427 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:35:29.186427 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:35:29.186427 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:35:29.186427 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:35:29.186427 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:35:29.186427 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application with Lock( Sep 13 19:35:29.186427 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:35:29.186427 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:35:29.186427 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:35:29.186427 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:35:29.187370 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:35:29.187370 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:35:29.187370 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:35:29.187370 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:35:29.187370 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 19:35:29.187370 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 19:35:29.187370 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 19:35:29.187370 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 19:35:29.187370 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 19:35:29.187370 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 19:35:29.187370 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 13 19:35:29.187370 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application Sep 13 19:35:29.187370 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 145/287] 10.222.0.25 () {56 vars in 1099 bytes} [Tue Sep 13 19:35:28 2022] GET /identity/v3/roles/member => generated 84 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:35:29.196452 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc6f93b-ac91-4768-8fe2-c2caa4af1e31 None admin] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:35:29.206889 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d70f97b-c2af-4623-9d24-dfce8aa0f906 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:35:29.207832 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d70f97b-c2af-4623-9d24-dfce8aa0f906 None admin] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:35:29.208112 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d70f97b-c2af-4623-9d24-dfce8aa0f906 None admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:35:29.208421 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d70f97b-c2af-4623-9d24-dfce8aa0f906 None admin] PATH_INFO: `/v3/projects/93e1f3226d564df686b8ca37cfd3a42c` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:35:29.210134 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d70f97b-c2af-4623-9d24-dfce8aa0f906 None admin] RBAC: Authorizing `identity:get_project(project_id=93e1f3226d564df686b8ca37cfd3a42c)` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:35:29.211828 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d70f97b-c2af-4623-9d24-dfce8aa0f906 None admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:35:29.214557 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 143/288] 10.222.0.25 () {56 vars in 1186 bytes} [Tue Sep 13 19:35:29 2022] GET /identity/v3/projects/93e1f3226d564df686b8ca37cfd3a42c => generated 302 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:35:29.220357 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d70f97b-c2af-4623-9d24-dfce8aa0f906 None admin] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:35:29.342032 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc6f93b-ac91-4768-8fe2-c2caa4af1e31 None admin] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:35:29.348125 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG dbcounter [-] [87935] Writing DB stats keystone:SELECT=100 {{(pid=87935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:35:29.360861 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d70f97b-c2af-4623-9d24-dfce8aa0f906 None admin] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:35:29.398216 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b03fcca-49e6-4277-952e-4fabed697ad5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:35:29.399726 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b03fcca-49e6-4277-952e-4fabed697ad5 None admin] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:35:29.400589 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b03fcca-49e6-4277-952e-4fabed697ad5 None admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:35:29.401402 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b03fcca-49e6-4277-952e-4fabed697ad5 None admin] PATH_INFO: `/v3/roles` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:35:29.402940 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b03fcca-49e6-4277-952e-4fabed697ad5 None admin] RBAC: Adding query filter params (name=member) {{(pid=87934) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:35:29.403785 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b03fcca-49e6-4277-952e-4fabed697ad5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:35:29.407102 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2834451-8017-4e1d-9bbf-77e18f9a5f67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:35:29.407639 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b03fcca-49e6-4277-952e-4fabed697ad5 None admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:35:29.407975 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2834451-8017-4e1d-9bbf-77e18f9a5f67 None admin] REQUEST_METHOD: `PUT` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:35:29.408383 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2834451-8017-4e1d-9bbf-77e18f9a5f67 None admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:35:29.408772 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2834451-8017-4e1d-9bbf-77e18f9a5f67 None admin] PATH_INFO: `/v3/projects/93e1f3226d564df686b8ca37cfd3a42c/users/84602aa8c37c474a82fdab3c4c5157dc/roles/85e5149eef184d349b4b1859b84dd789` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:35:29.411262 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2834451-8017-4e1d-9bbf-77e18f9a5f67 None admin] RBAC: Authorizing `identity:create_grant(project_id=93e1f3226d564df686b8ca37cfd3a42c, user_id=84602aa8c37c474a82fdab3c4c5157dc, role_id=85e5149eef184d349b4b1859b84dd789)` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:35:29.413915 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2834451-8017-4e1d-9bbf-77e18f9a5f67 None admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:35:29.425068 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 146/289] 10.222.0.25 () {56 vars in 1101 bytes} [Tue Sep 13 19:35:29 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:35:29.430330 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b03fcca-49e6-4277-952e-4fabed697ad5 None admin] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:35:29.442527 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 144/290] 10.222.0.25 () {58 vars in 1439 bytes} [Tue Sep 13 19:35:29 2022] PUT /identity/v3/projects/93e1f3226d564df686b8ca37cfd3a42c/users/84602aa8c37c474a82fdab3c4c5157dc/roles/85e5149eef184d349b4b1859b84dd789 => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 19:35:29.514046 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG dbcounter [-] [87934] Writing DB stats keystone:SELECT=100 {{(pid=87934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:35:29.594761 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b03fcca-49e6-4277-952e-4fabed697ad5 None admin] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:35:29.636822 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff6dfe0-e911-455f-a5da-238ba48570e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:35:29.637855 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff6dfe0-e911-455f-a5da-238ba48570e3 None admin] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:35:29.638342 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff6dfe0-e911-455f-a5da-238ba48570e3 None admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:35:29.638817 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff6dfe0-e911-455f-a5da-238ba48570e3 None admin] PATH_INFO: `/v3/users/f964a30cce9b4f058e5d0a6bcd67c477` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:35:29.640323 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff6dfe0-e911-455f-a5da-238ba48570e3 None admin] RBAC: Authorizing `identity:get_user(user_id=f964a30cce9b4f058e5d0a6bcd67c477)` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:35:29.642122 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff6dfe0-e911-455f-a5da-238ba48570e3 None admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:35:29.643984 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 147/291] 10.222.0.25 () {56 vars in 1177 bytes} [Tue Sep 13 19:35:29 2022] GET /identity/v3/users/f964a30cce9b4f058e5d0a6bcd67c477 => generated 297 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 19:35:29.651032 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2834451-8017-4e1d-9bbf-77e18f9a5f67 None admin] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:35:29.772664 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2834451-8017-4e1d-9bbf-77e18f9a5f67 None admin] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:35:29.816550 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f3a827-4c46-4941-b6a9-712117f25b74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:35:29.817167 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f3a827-4c46-4941-b6a9-712117f25b74 None admin] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:35:29.817451 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f3a827-4c46-4941-b6a9-712117f25b74 None admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:35:29.817726 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f3a827-4c46-4941-b6a9-712117f25b74 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:35:29.843752 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG dbcounter [-] [87935] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:35:29.906462 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f3a827-4c46-4941-b6a9-712117f25b74 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:35:29.907896 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f3a827-4c46-4941-b6a9-712117f25b74 None admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:35:30.022444 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 145/292] 10.222.0.25 () {58 vars in 1282 bytes} [Tue Sep 13 19:35:29 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 13 19:35:30.028681 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff6dfe0-e911-455f-a5da-238ba48570e3 None admin] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:35:30.155071 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff6dfe0-e911-455f-a5da-238ba48570e3 None admin] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:35:30.165402 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG dbcounter [-] [87934] Writing DB stats keystone:SELECT=100 {{(pid=87934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:35:30.191843 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b229aa-3e95-4298-8e27-396041c76302 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:35:30.192500 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b229aa-3e95-4298-8e27-396041c76302 None admin] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:35:30.192775 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b229aa-3e95-4298-8e27-396041c76302 None admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:35:30.193043 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b229aa-3e95-4298-8e27-396041c76302 None admin] PATH_INFO: `/v3/projects/93e1f3226d564df686b8ca37cfd3a42c` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:35:30.194975 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b229aa-3e95-4298-8e27-396041c76302 None admin] RBAC: Authorizing `identity:get_project(project_id=93e1f3226d564df686b8ca37cfd3a42c)` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:35:30.196441 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b229aa-3e95-4298-8e27-396041c76302 None admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:35:30.198445 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 148/293] 10.222.0.25 () {56 vars in 1186 bytes} [Tue Sep 13 19:35:30 2022] GET /identity/v3/projects/93e1f3226d564df686b8ca37cfd3a42c => generated 302 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:35:30.204306 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f3a827-4c46-4941-b6a9-712117f25b74 None admin] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:35:30.273881 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG dbcounter [-] [87935] Writing DB stats keystone:SELECT=100 {{(pid=87935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:35:30.338294 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f3a827-4c46-4941-b6a9-712117f25b74 None admin] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:35:30.386241 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6547c8f2-3626-4e91-8fb3-8552d6897486 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:35:30.386844 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6547c8f2-3626-4e91-8fb3-8552d6897486 None admin] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:35:30.387118 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6547c8f2-3626-4e91-8fb3-8552d6897486 None admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:35:30.387383 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6547c8f2-3626-4e91-8fb3-8552d6897486 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:35:30.388103 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6547c8f2-3626-4e91-8fb3-8552d6897486 None admin] RBAC: Adding query filter params (role.id=a259191f6d0e46fabd9f34536bb28747, scope.project.id=93e1f3226d564df686b8ca37cfd3a42c, user.id=f964a30cce9b4f058e5d0a6bcd67c477) {{(pid=87935) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:35:30.388432 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6547c8f2-3626-4e91-8fb3-8552d6897486 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:35:30.389870 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6547c8f2-3626-4e91-8fb3-8552d6897486 None admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:35:30.400104 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 146/294] 10.222.0.25 () {56 vars in 1374 bytes} [Tue Sep 13 19:35:30 2022] GET /identity/v3/role_assignments?user.id=f964a30cce9b4f058e5d0a6bcd67c477&scope.project.id=93e1f3226d564df686b8ca37cfd3a42c&role.id=a259191f6d0e46fabd9f34536bb28747 => generated 608 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 19:35:31.542576 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb06c3b-3962-4129-9f00-d2e2d7ff5e82 None None] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:35:31.543388 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb06c3b-3962-4129-9f00-d2e2d7ff5e82 None None] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:35:31.543388 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb06c3b-3962-4129-9f00-d2e2d7ff5e82 None None] PATH_INFO: `/` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:35:31.544761 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 149/295] 10.222.0.25 () {54 vars in 927 bytes} [Tue Sep 13 19:35:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:35:31.549807 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9110dc-93be-438b-9c4f-46497c7a9843 None None] REQUEST_METHOD: `POST` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:35:31.549995 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9110dc-93be-438b-9c4f-46497c7a9843 None None] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:35:31.550272 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9110dc-93be-438b-9c4f-46497c7a9843 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:35:31.552938 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039d3e23-d1a2-46d3-9ea3-ff60635d3517 None None] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:35:31.553531 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039d3e23-d1a2-46d3-9ea3-ff60635d3517 None None] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:35:31.553707 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039d3e23-d1a2-46d3-9ea3-ff60635d3517 None None] PATH_INFO: `/` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:35:31.555562 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 147/296] 10.222.0.25 () {54 vars in 927 bytes} [Tue Sep 13 19:35:31 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:35:31.560807 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da5372a-9659-4308-929a-fdf41f3e1ed8 None None] REQUEST_METHOD: `POST` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:35:31.561079 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da5372a-9659-4308-929a-fdf41f3e1ed8 None None] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:35:31.561346 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da5372a-9659-4308-929a-fdf41f3e1ed8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:35:31.578645 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.auth.core [None req-df9110dc-93be-438b-9c4f-46497c7a9843 None None] MFA Rules not processed for user `7b0aed92d02344acb92a0e4aa67c3068`. Rule list: `[]` (Enabled: `True`). {{(pid=87934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:35:31.579814 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.fernet_utils [None req-df9110dc-93be-438b-9c4f-46497c7a9843 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:35:31.594232 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.auth.core [None req-5da5372a-9659-4308-929a-fdf41f3e1ed8 None None] MFA Rules not processed for user `7b0aed92d02344acb92a0e4aa67c3068`. Rule list: `[]` (Enabled: `True`). {{(pid=87935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:35:31.596181 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.fernet_utils [None req-5da5372a-9659-4308-929a-fdf41f3e1ed8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:35:31.658123 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 150/297] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Sep 13 19:35:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 13 19:35:31.689122 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 148/298] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Sep 13 19:35:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 19:35:31.915141 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002d7e37-8e5c-4c81-9c7a-c503ca3d820f None None] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:35:31.915432 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002d7e37-8e5c-4c81-9c7a-c503ca3d820f None None] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:35:31.915837 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002d7e37-8e5c-4c81-9c7a-c503ca3d820f None None] PATH_INFO: `/` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:35:31.917700 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 151/299] 10.222.0.25 () {54 vars in 927 bytes} [Tue Sep 13 19:35:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:35:31.923097 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3a54ad-00b0-4ca9-ad45-e4afb8bba1d6 None None] REQUEST_METHOD: `POST` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:35:31.923378 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3a54ad-00b0-4ca9-ad45-e4afb8bba1d6 None None] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:35:31.923650 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3a54ad-00b0-4ca9-ad45-e4afb8bba1d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:35:31.943227 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.auth.core [None req-3c3a54ad-00b0-4ca9-ad45-e4afb8bba1d6 None None] MFA Rules not processed for user `7b0aed92d02344acb92a0e4aa67c3068`. Rule list: `[]` (Enabled: `True`). {{(pid=87935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:35:31.944408 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002d7e37-8e5c-4c81-9c7a-c503ca3d820f None None] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:35:31.944847 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.fernet_utils [None req-3c3a54ad-00b0-4ca9-ad45-e4afb8bba1d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:35:31.996157 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG dbcounter [-] [87935] Writing DB stats keystone:SELECT=100 {{(pid=87935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:35:32.028260 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 149/300] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Sep 13 19:35:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 19:35:32.028260 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3a54ad-00b0-4ca9-ad45-e4afb8bba1d6 None None] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:35:32.079151 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002d7e37-8e5c-4c81-9c7a-c503ca3d820f None None] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:35:32.091304 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG dbcounter [-] [87934] Writing DB stats keystone:SELECT=100 {{(pid=87934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:35:32.134993 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47207097-1974-49c8-ad17-07a3a977b796 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:35:32.136116 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47207097-1974-49c8-ad17-07a3a977b796 None admin] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:35:32.136918 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47207097-1974-49c8-ad17-07a3a977b796 None admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:35:32.137645 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47207097-1974-49c8-ad17-07a3a977b796 None admin] PATH_INFO: `/v3/roles/member` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:35:32.139210 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3a54ad-00b0-4ca9-ad45-e4afb8bba1d6 None None] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:35:32.152739 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47207097-1974-49c8-ad17-07a3a977b796 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 19:35:32.160032 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application [None req-47207097-1974-49c8-ad17-07a3a977b796 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 13 19:35:32.160032 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:35:32.160032 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:35:32.160032 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:35:32.160032 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:35:32.160032 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:35:32.160032 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:35:32.160032 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:35:32.160032 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:35:32.160032 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:35:32.160032 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:35:32.160032 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:35:32.160032 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 19:35:32.160032 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 19:35:32.160032 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 19:35:32.160032 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 19:35:32.161200 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 19:35:32.161200 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 19:35:32.161200 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 19:35:32.161200 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 19:35:32.161200 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:35:32.161200 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:35:32.161200 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:35:32.161200 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:35:32.161200 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:35:32.161200 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:35:32.161200 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:35:32.161200 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application with Lock( Sep 13 19:35:32.161200 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:35:32.161200 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:35:32.161200 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:35:32.161200 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:35:32.162167 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:35:32.162167 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:35:32.162167 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:35:32.162167 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:35:32.162167 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 19:35:32.162167 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 19:35:32.162167 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 19:35:32.162167 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 19:35:32.162167 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 19:35:32.162167 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 19:35:32.162167 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 13 19:35:32.162167 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application Sep 13 19:35:32.170944 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 152/301] 10.222.0.25 () {56 vars in 1099 bytes} [Tue Sep 13 19:35:31 2022] GET /identity/v3/roles/member => generated 84 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 13 19:35:32.173034 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47207097-1974-49c8-ad17-07a3a977b796 None admin] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:35:32.199573 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bce45c5-d667-42b3-a60d-cfdaa36ce0ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:35:32.200587 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bce45c5-d667-42b3-a60d-cfdaa36ce0ec None admin] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:35:32.201321 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bce45c5-d667-42b3-a60d-cfdaa36ce0ec None admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:35:32.202337 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bce45c5-d667-42b3-a60d-cfdaa36ce0ec None admin] PATH_INFO: `/v3/roles/reader` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:35:32.219150 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bce45c5-d667-42b3-a60d-cfdaa36ce0ec None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 19:35:32.225468 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application [None req-4bce45c5-d667-42b3-a60d-cfdaa36ce0ec None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 13 19:35:32.225468 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:35:32.225468 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:35:32.225468 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:35:32.225468 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:35:32.225468 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:35:32.225468 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:35:32.225468 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:35:32.225468 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:35:32.225468 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:35:32.225468 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:35:32.225468 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:35:32.225468 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 19:35:32.225468 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 19:35:32.225468 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 19:35:32.225468 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 19:35:32.226363 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 19:35:32.226363 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 19:35:32.226363 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 19:35:32.226363 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 19:35:32.226363 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:35:32.226363 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:35:32.226363 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:35:32.226363 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:35:32.226363 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:35:32.226363 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:35:32.226363 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:35:32.226363 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application with Lock( Sep 13 19:35:32.226363 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:35:32.226363 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:35:32.226363 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:35:32.226363 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:35:32.227145 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:35:32.227145 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:35:32.227145 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:35:32.227145 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:35:32.227145 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 19:35:32.227145 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 19:35:32.227145 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 19:35:32.227145 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 19:35:32.227145 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 19:35:32.227145 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 19:35:32.227145 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 13 19:35:32.227145 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application Sep 13 19:35:32.229949 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 150/302] 10.222.0.25 () {56 vars in 1099 bytes} [Tue Sep 13 19:35:32 2022] GET /identity/v3/roles/reader => generated 84 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:35:32.235841 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bce45c5-d667-42b3-a60d-cfdaa36ce0ec None admin] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:35:32.285612 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG dbcounter [-] [87935] Writing DB stats keystone:SELECT=100 {{(pid=87935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:35:32.305088 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47207097-1974-49c8-ad17-07a3a977b796 None admin] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:35:32.341186 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3b175c-eecc-4be0-b1a8-41a8519eea2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:35:32.341792 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3b175c-eecc-4be0-b1a8-41a8519eea2a None admin] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:35:32.342071 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3b175c-eecc-4be0-b1a8-41a8519eea2a None admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:35:32.342341 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3b175c-eecc-4be0-b1a8-41a8519eea2a None admin] PATH_INFO: `/v3/roles` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:35:32.343007 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c3b175c-eecc-4be0-b1a8-41a8519eea2a None admin] RBAC: Adding query filter params (name=member) {{(pid=87934) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:35:32.343306 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c3b175c-eecc-4be0-b1a8-41a8519eea2a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:35:32.344739 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c3b175c-eecc-4be0-b1a8-41a8519eea2a None admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:35:32.353260 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 153/303] 10.222.0.25 () {56 vars in 1101 bytes} [Tue Sep 13 19:35:32 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:35:32.354484 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f953b56c-f587-4935-abc8-f856b063b506 None None] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:35:32.354760 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f953b56c-f587-4935-abc8-f856b063b506 None None] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:35:32.355031 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f953b56c-f587-4935-abc8-f856b063b506 None None] PATH_INFO: `/` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:35:32.356249 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 154/304] 10.222.0.25 () {54 vars in 927 bytes} [Tue Sep 13 19:35:32 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:35:32.356942 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f953b56c-f587-4935-abc8-f856b063b506 None None] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:35:32.364475 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bce45c5-d667-42b3-a60d-cfdaa36ce0ec None admin] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:35:32.386961 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG dbcounter [-] [87934] Writing DB stats keystone:SELECT=100 {{(pid=87934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:35:32.401810 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6c2ede-d484-4311-a2ba-58fda5bca514 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:35:32.402412 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6c2ede-d484-4311-a2ba-58fda5bca514 None admin] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:35:32.402686 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6c2ede-d484-4311-a2ba-58fda5bca514 None admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:35:32.402955 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6c2ede-d484-4311-a2ba-58fda5bca514 None admin] PATH_INFO: `/v3/roles` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:35:32.403616 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d6c2ede-d484-4311-a2ba-58fda5bca514 None admin] RBAC: Adding query filter params (name=reader) {{(pid=87935) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:35:32.403913 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d6c2ede-d484-4311-a2ba-58fda5bca514 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:35:32.405338 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d6c2ede-d484-4311-a2ba-58fda5bca514 None admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:35:32.413632 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 151/305] 10.222.0.25 () {56 vars in 1101 bytes} [Tue Sep 13 19:35:32 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:35:32.414557 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6c2ede-d484-4311-a2ba-58fda5bca514 None admin] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:35:32.463695 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f953b56c-f587-4935-abc8-f856b063b506 None None] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:35:32.498232 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cff840c-3150-4af4-ba74-4e22e0dab152 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:35:32.498862 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cff840c-3150-4af4-ba74-4e22e0dab152 None admin] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:35:32.499140 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cff840c-3150-4af4-ba74-4e22e0dab152 None admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:35:32.499412 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cff840c-3150-4af4-ba74-4e22e0dab152 None admin] PATH_INFO: `/v3/domains/default` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:35:32.500547 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cff840c-3150-4af4-ba74-4e22e0dab152 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:35:32.501984 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cff840c-3150-4af4-ba74-4e22e0dab152 None admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:35:32.503719 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 155/306] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Sep 13 19:35:32 2022] GET /identity/v3/domains/default => generated 199 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:35:32.504663 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed37de3-f7e9-474a-8d69-59472fbac1bc None None] REQUEST_METHOD: `POST` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:35:32.504944 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed37de3-f7e9-474a-8d69-59472fbac1bc None None] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:35:32.505217 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed37de3-f7e9-474a-8d69-59472fbac1bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:35:32.511499 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG dbcounter [-] [87935] Writing DB stats keystone:SELECT=100 {{(pid=87935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:35:32.515523 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6c2ede-d484-4311-a2ba-58fda5bca514 None admin] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:35:32.524929 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.auth.core [None req-3ed37de3-f7e9-474a-8d69-59472fbac1bc None None] MFA Rules not processed for user `7b0aed92d02344acb92a0e4aa67c3068`. Rule list: `[]` (Enabled: `True`). {{(pid=87934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:35:32.526146 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.fernet_utils [None req-3ed37de3-f7e9-474a-8d69-59472fbac1bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:35:32.554447 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5db7891-aa1b-4018-b415-d108b5e98855 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:35:32.554447 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5db7891-aa1b-4018-b415-d108b5e98855 None admin] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:35:32.554447 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5db7891-aa1b-4018-b415-d108b5e98855 None admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:35:32.554447 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5db7891-aa1b-4018-b415-d108b5e98855 None admin] PATH_INFO: `/v3/users/344678e0b86245328db52a0438ba28c0` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:35:32.555907 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5db7891-aa1b-4018-b415-d108b5e98855 None admin] RBAC: Authorizing `identity:get_user(user_id=344678e0b86245328db52a0438ba28c0)` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:35:32.557403 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5db7891-aa1b-4018-b415-d108b5e98855 None admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:35:32.559086 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 152/307] 10.222.0.25 () {56 vars in 1177 bytes} [Tue Sep 13 19:35:32 2022] GET /identity/v3/users/344678e0b86245328db52a0438ba28c0 => generated 293 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:35:32.559767 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5db7891-aa1b-4018-b415-d108b5e98855 None admin] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:35:32.596671 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 156/308] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Sep 13 19:35:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 19:35:32.608852 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed37de3-f7e9-474a-8d69-59472fbac1bc None None] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:35:32.624823 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG dbcounter [-] [87934] Writing DB stats keystone:SELECT=100 {{(pid=87934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:35:32.671438 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5db7891-aa1b-4018-b415-d108b5e98855 None admin] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:35:32.705041 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed37de3-f7e9-474a-8d69-59472fbac1bc None None] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:35:32.709148 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79c5f4d-47a8-4f50-9ddb-db322d4bbb35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:35:32.710096 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79c5f4d-47a8-4f50-9ddb-db322d4bbb35 None admin] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:35:32.710541 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79c5f4d-47a8-4f50-9ddb-db322d4bbb35 None admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:35:32.710817 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79c5f4d-47a8-4f50-9ddb-db322d4bbb35 None admin] PATH_INFO: `/v3/users/231009031e634738955d09f292c0c56c` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:35:32.724793 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c79c5f4d-47a8-4f50-9ddb-db322d4bbb35 None admin] RBAC: Authorizing `identity:get_user(user_id=231009031e634738955d09f292c0c56c)` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:35:32.726765 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c79c5f4d-47a8-4f50-9ddb-db322d4bbb35 None admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:35:32.733320 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 153/309] 10.222.0.25 () {56 vars in 1177 bytes} [Tue Sep 13 19:35:32 2022] GET /identity/v3/users/231009031e634738955d09f292c0c56c => generated 293 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:35:32.733320 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79c5f4d-47a8-4f50-9ddb-db322d4bbb35 None admin] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:35:32.748380 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7d5787-6492-4d4b-baf0-f5859705ce32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:35:32.749119 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7d5787-6492-4d4b-baf0-f5859705ce32 None admin] REQUEST_METHOD: `POST` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:35:32.749399 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7d5787-6492-4d4b-baf0-f5859705ce32 None admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:35:32.749775 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7d5787-6492-4d4b-baf0-f5859705ce32 None admin] PATH_INFO: `/v3/groups` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:35:32.750415 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e7d5787-6492-4d4b-baf0-f5859705ce32 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:35:32.752019 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e7d5787-6492-4d4b-baf0-f5859705ce32 None admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:35:32.757757 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG dbcounter [-] [87935] Writing DB stats keystone:SELECT=100 {{(pid=87935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:35:32.769765 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 157/310] 10.222.0.25 () {60 vars in 1134 bytes} [Tue Sep 13 19:35:32 2022] POST /identity/v3/groups => generated 229 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 19:35:32.770564 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7d5787-6492-4d4b-baf0-f5859705ce32 None admin] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:35:32.864090 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79c5f4d-47a8-4f50-9ddb-db322d4bbb35 None admin] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:35:32.899042 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG dbcounter [-] [87934] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:35:32.908467 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46148ec0-c7e3-4e56-817e-f6734388453b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:35:32.909231 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46148ec0-c7e3-4e56-817e-f6734388453b None admin] REQUEST_METHOD: `PUT` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:35:32.909514 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46148ec0-c7e3-4e56-817e-f6734388453b None admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:35:32.910015 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46148ec0-c7e3-4e56-817e-f6734388453b None admin] PATH_INFO: `/v3/system/users/344678e0b86245328db52a0438ba28c0/roles/a259191f6d0e46fabd9f34536bb28747` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:35:32.911599 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46148ec0-c7e3-4e56-817e-f6734388453b None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=344678e0b86245328db52a0438ba28c0, role_id=a259191f6d0e46fabd9f34536bb28747)` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:35:32.913109 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46148ec0-c7e3-4e56-817e-f6734388453b None admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:35:32.918164 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7d5787-6492-4d4b-baf0-f5859705ce32 None admin] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:35:32.928550 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 154/311] 10.222.0.25 () {58 vars in 1334 bytes} [Tue Sep 13 19:35:32 2022] PUT /identity/v3/system/users/344678e0b86245328db52a0438ba28c0/roles/a259191f6d0e46fabd9f34536bb28747 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 19:35:32.928550 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46148ec0-c7e3-4e56-817e-f6734388453b None admin] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:35:32.984541 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83be35ec-7410-4114-be83-786d18e5f645 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:35:32.985114 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83be35ec-7410-4114-be83-786d18e5f645 None admin] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:35:32.985391 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83be35ec-7410-4114-be83-786d18e5f645 None admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:35:32.985658 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83be35ec-7410-4114-be83-786d18e5f645 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:35:32.986416 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83be35ec-7410-4114-be83-786d18e5f645 None admin] RBAC: Adding query filter params (role.id=85e5149eef184d349b4b1859b84dd789, user.id=231009031e634738955d09f292c0c56c, scope.system=all) {{(pid=87934) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:35:32.986725 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83be35ec-7410-4114-be83-786d18e5f645 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:35:32.989328 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83be35ec-7410-4114-be83-786d18e5f645 None admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:35:32.996382 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 158/312] 10.222.0.25 () {56 vars in 1308 bytes} [Tue Sep 13 19:35:32 2022] GET /identity/v3/role_assignments?user.id=231009031e634738955d09f292c0c56c&scope.system=all&role.id=85e5149eef184d349b4b1859b84dd789 => generated 226 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:35:33.067490 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG dbcounter [-] [87935] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:35:33.085215 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46148ec0-c7e3-4e56-817e-f6734388453b None admin] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:35:33.140570 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9312fd80-a560-44f3-9540-abd843cb91e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:35:33.141226 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9312fd80-a560-44f3-9540-abd843cb91e5 None admin] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:35:33.141498 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9312fd80-a560-44f3-9540-abd843cb91e5 None admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:35:33.141768 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9312fd80-a560-44f3-9540-abd843cb91e5 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:35:33.155323 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9312fd80-a560-44f3-9540-abd843cb91e5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 19:35:33.161017 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application [None req-9312fd80-a560-44f3-9540-abd843cb91e5 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 13 19:35:33.161017 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:35:33.161017 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:35:33.161017 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:35:33.161017 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:35:33.161017 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:35:33.161017 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:35:33.161017 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:35:33.161017 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:35:33.161017 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:35:33.161017 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:35:33.161017 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:35:33.161017 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 19:35:33.161017 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 19:35:33.161017 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 19:35:33.161017 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 19:35:33.162076 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 19:35:33.162076 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 19:35:33.162076 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 19:35:33.162076 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 19:35:33.162076 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:35:33.162076 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:35:33.162076 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:35:33.162076 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:35:33.162076 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:35:33.162076 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:35:33.162076 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:35:33.162076 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application with Lock( Sep 13 19:35:33.162076 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:35:33.162076 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:35:33.162076 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:35:33.162076 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:35:33.163309 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:35:33.163309 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:35:33.163309 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:35:33.163309 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:35:33.163309 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 19:35:33.163309 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 19:35:33.163309 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 19:35:33.163309 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 19:35:33.163309 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 19:35:33.163309 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 19:35:33.163309 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 13 19:35:33.163309 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application Sep 13 19:35:33.163309 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 155/313] 10.222.0.25 () {56 vars in 1099 bytes} [Tue Sep 13 19:35:32 2022] GET /identity/v3/roles/reader => generated 84 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:35:33.168708 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83be35ec-7410-4114-be83-786d18e5f645 None admin] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:35:33.278054 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83be35ec-7410-4114-be83-786d18e5f645 None admin] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:35:33.313336 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ffc0526-e107-4b39-8bf9-f6304dcd9381 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:35:33.313944 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ffc0526-e107-4b39-8bf9-f6304dcd9381 None admin] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:35:33.314218 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ffc0526-e107-4b39-8bf9-f6304dcd9381 None admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:35:33.314483 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ffc0526-e107-4b39-8bf9-f6304dcd9381 None admin] PATH_INFO: `/v3/roles` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:35:33.315139 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ffc0526-e107-4b39-8bf9-f6304dcd9381 None admin] RBAC: Adding query filter params (name=reader) {{(pid=87934) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:35:33.315437 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ffc0526-e107-4b39-8bf9-f6304dcd9381 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:35:33.316836 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ffc0526-e107-4b39-8bf9-f6304dcd9381 None admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:35:33.326109 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 159/314] 10.222.0.25 () {56 vars in 1101 bytes} [Tue Sep 13 19:35:33 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:35:33.331776 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9312fd80-a560-44f3-9540-abd843cb91e5 None admin] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:35:33.438279 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9312fd80-a560-44f3-9540-abd843cb91e5 None admin] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:35:33.476225 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5422c867-c0c5-4237-84b8-0a40f46be436 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:35:33.477210 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5422c867-c0c5-4237-84b8-0a40f46be436 None admin] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:35:33.477712 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5422c867-c0c5-4237-84b8-0a40f46be436 None admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:35:33.478180 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5422c867-c0c5-4237-84b8-0a40f46be436 None admin] PATH_INFO: `/v3/users/84602aa8c37c474a82fdab3c4c5157dc` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:35:33.479564 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5422c867-c0c5-4237-84b8-0a40f46be436 None admin] RBAC: Authorizing `identity:get_user(user_id=84602aa8c37c474a82fdab3c4c5157dc)` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:35:33.481249 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5422c867-c0c5-4237-84b8-0a40f46be436 None admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:35:33.483138 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 156/315] 10.222.0.25 () {56 vars in 1177 bytes} [Tue Sep 13 19:35:33 2022] GET /identity/v3/users/84602aa8c37c474a82fdab3c4c5157dc => generated 297 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:35:33.491634 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ffc0526-e107-4b39-8bf9-f6304dcd9381 None admin] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:35:33.504941 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG dbcounter [-] [87934] Writing DB stats keystone:SELECT=100 {{(pid=87934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:35:33.600325 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ffc0526-e107-4b39-8bf9-f6304dcd9381 None admin] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:35:33.637604 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a9907a-6e95-4741-ab61-68be1e79f7b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:35:33.638215 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a9907a-6e95-4741-ab61-68be1e79f7b9 None admin] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:35:33.638492 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a9907a-6e95-4741-ab61-68be1e79f7b9 None admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:35:33.638763 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a9907a-6e95-4741-ab61-68be1e79f7b9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:35:33.712877 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a9907a-6e95-4741-ab61-68be1e79f7b9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:35:33.714538 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a9907a-6e95-4741-ab61-68be1e79f7b9 None admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:35:33.730040 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG dbcounter [-] [87934] Writing DB stats keystone:SELECT=100 {{(pid=87934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:35:33.821506 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 160/316] 10.222.0.25 () {58 vars in 1282 bytes} [Tue Sep 13 19:35:33 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 13 19:35:33.829393 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5422c867-c0c5-4237-84b8-0a40f46be436 None admin] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:35:33.858710 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG dbcounter [-] [87935] Writing DB stats keystone:SELECT=100 {{(pid=87935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:35:33.946401 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5422c867-c0c5-4237-84b8-0a40f46be436 None admin] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:35:33.984498 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6873c2-3987-4f59-9882-74e612ee25b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:35:33.985189 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6873c2-3987-4f59-9882-74e612ee25b4 None admin] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:35:33.985475 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6873c2-3987-4f59-9882-74e612ee25b4 None admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:35:33.985750 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6873c2-3987-4f59-9882-74e612ee25b4 None admin] PATH_INFO: `/v3/projects/93e1f3226d564df686b8ca37cfd3a42c` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:35:33.987697 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af6873c2-3987-4f59-9882-74e612ee25b4 None admin] RBAC: Authorizing `identity:get_project(project_id=93e1f3226d564df686b8ca37cfd3a42c)` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:35:33.989864 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af6873c2-3987-4f59-9882-74e612ee25b4 None admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:35:33.992788 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 157/317] 10.222.0.25 () {56 vars in 1186 bytes} [Tue Sep 13 19:35:33 2022] GET /identity/v3/projects/93e1f3226d564df686b8ca37cfd3a42c => generated 302 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:35:33.998725 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a9907a-6e95-4741-ab61-68be1e79f7b9 None admin] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:35:34.106084 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a9907a-6e95-4741-ab61-68be1e79f7b9 None admin] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:35:34.120350 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG dbcounter [-] [87934] Writing DB stats keystone:SELECT=100 {{(pid=87934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:35:34.142440 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d410bdd7-1048-4170-be2d-d5bcb49f5f1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:35:34.143052 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d410bdd7-1048-4170-be2d-d5bcb49f5f1d None admin] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:35:34.143332 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d410bdd7-1048-4170-be2d-d5bcb49f5f1d None admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:35:34.143636 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d410bdd7-1048-4170-be2d-d5bcb49f5f1d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:35:34.144363 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d410bdd7-1048-4170-be2d-d5bcb49f5f1d None admin] RBAC: Adding query filter params (role.id=85e5149eef184d349b4b1859b84dd789, scope.project.id=93e1f3226d564df686b8ca37cfd3a42c, user.id=84602aa8c37c474a82fdab3c4c5157dc) {{(pid=87934) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:35:34.144674 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d410bdd7-1048-4170-be2d-d5bcb49f5f1d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:35:34.146112 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d410bdd7-1048-4170-be2d-d5bcb49f5f1d None admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:35:34.153442 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 161/318] 10.222.0.25 () {56 vars in 1374 bytes} [Tue Sep 13 19:35:33 2022] GET /identity/v3/role_assignments?user.id=84602aa8c37c474a82fdab3c4c5157dc&scope.project.id=93e1f3226d564df686b8ca37cfd3a42c&role.id=85e5149eef184d349b4b1859b84dd789 => generated 608 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:35:35.179861 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314db97f-38c5-4420-97fa-22c16f610b5d None None] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:35:35.180410 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314db97f-38c5-4420-97fa-22c16f610b5d None None] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:35:35.180410 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314db97f-38c5-4420-97fa-22c16f610b5d None None] PATH_INFO: `/` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:35:35.181901 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 158/319] 10.222.0.25 () {54 vars in 927 bytes} [Tue Sep 13 19:35:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:35:35.187000 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70cccc02-0989-40b0-b08d-ce8fa7161e0e None None] REQUEST_METHOD: `POST` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:35:35.187398 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70cccc02-0989-40b0-b08d-ce8fa7161e0e None None] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:35:35.187561 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70cccc02-0989-40b0-b08d-ce8fa7161e0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:35:35.206643 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.auth.core [None req-70cccc02-0989-40b0-b08d-ce8fa7161e0e None None] MFA Rules not processed for user `7b0aed92d02344acb92a0e4aa67c3068`. Rule list: `[]` (Enabled: `True`). {{(pid=87934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:35:35.208115 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.fernet_utils [None req-70cccc02-0989-40b0-b08d-ce8fa7161e0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:35:35.220134 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c35494-2e56-49fb-811b-64b504bf0960 None None] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:35:35.220493 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c35494-2e56-49fb-811b-64b504bf0960 None None] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:35:35.220724 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c35494-2e56-49fb-811b-64b504bf0960 None None] PATH_INFO: `/` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:35:35.222259 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 159/320] 10.222.0.25 () {54 vars in 927 bytes} [Tue Sep 13 19:35:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 13 19:35:35.228649 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfadc851-e58a-478c-8dd2-ebf90e9c4f91 None None] REQUEST_METHOD: `POST` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:35:35.228980 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfadc851-e58a-478c-8dd2-ebf90e9c4f91 None None] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:35:35.229197 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfadc851-e58a-478c-8dd2-ebf90e9c4f91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:35:35.248487 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.auth.core [None req-bfadc851-e58a-478c-8dd2-ebf90e9c4f91 None None] MFA Rules not processed for user `7b0aed92d02344acb92a0e4aa67c3068`. Rule list: `[]` (Enabled: `True`). {{(pid=87935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:35:35.249673 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.fernet_utils [None req-bfadc851-e58a-478c-8dd2-ebf90e9c4f91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:35:35.288738 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 162/321] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Sep 13 19:35:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 19:35:35.324754 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 160/322] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Sep 13 19:35:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 13 19:35:35.332462 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42df4e58-d928-4f71-98cb-2721c430a2fb None None] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:35:35.332758 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42df4e58-d928-4f71-98cb-2721c430a2fb None None] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:35:35.333031 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42df4e58-d928-4f71-98cb-2721c430a2fb None None] PATH_INFO: `/` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:35:35.334518 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 163/323] 10.222.0.25 () {54 vars in 927 bytes} [Tue Sep 13 19:35:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:35:35.339455 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f037dd46-e17f-44d7-ba42-a11849a63c77 None None] REQUEST_METHOD: `POST` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:35:35.339740 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f037dd46-e17f-44d7-ba42-a11849a63c77 None None] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:35:35.340009 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f037dd46-e17f-44d7-ba42-a11849a63c77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:35:35.358448 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.auth.core [None req-f037dd46-e17f-44d7-ba42-a11849a63c77 None None] MFA Rules not processed for user `7b0aed92d02344acb92a0e4aa67c3068`. Rule list: `[]` (Enabled: `True`). {{(pid=87935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:35:35.359628 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.fernet_utils [None req-f037dd46-e17f-44d7-ba42-a11849a63c77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:35:35.369354 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG dbcounter [-] [87935] Writing DB stats keystone:SELECT=100 {{(pid=87935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:35:35.427383 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 161/324] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Sep 13 19:35:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 19:35:35.557007 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42df4e58-d928-4f71-98cb-2721c430a2fb None None] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:35:35.609775 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f037dd46-e17f-44d7-ba42-a11849a63c77 None None] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:35:35.664634 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42df4e58-d928-4f71-98cb-2721c430a2fb None None] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:35:35.676778 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG dbcounter [-] [87934] Writing DB stats keystone:SELECT=100 {{(pid=87934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:35:35.706203 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970b96a5-a50f-48b4-8215-b6014088e68f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:35:35.706831 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970b96a5-a50f-48b4-8215-b6014088e68f None admin] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:35:35.707107 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970b96a5-a50f-48b4-8215-b6014088e68f None admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:35:35.707638 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970b96a5-a50f-48b4-8215-b6014088e68f None admin] PATH_INFO: `/v3/domains/default` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:35:35.708759 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-970b96a5-a50f-48b4-8215-b6014088e68f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:35:35.711135 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-970b96a5-a50f-48b4-8215-b6014088e68f None admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:35:35.712724 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 164/325] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Sep 13 19:35:35 2022] GET /identity/v3/domains/default => generated 199 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:35:35.713525 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970b96a5-a50f-48b4-8215-b6014088e68f None admin] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:35:35.719113 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f037dd46-e17f-44d7-ba42-a11849a63c77 None None] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:35:35.752450 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e80e3d-2e23-471e-9ffa-603305934db0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:35:35.753075 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e80e3d-2e23-471e-9ffa-603305934db0 None admin] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:35:35.753352 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e80e3d-2e23-471e-9ffa-603305934db0 None admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:35:35.753620 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e80e3d-2e23-471e-9ffa-603305934db0 None admin] PATH_INFO: `/v3/roles/member` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:35:35.764002 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e80e3d-2e23-471e-9ffa-603305934db0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 19:35:35.768923 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application [None req-c8e80e3d-2e23-471e-9ffa-603305934db0 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 13 19:35:35.768923 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:35:35.768923 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:35:35.768923 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:35:35.768923 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:35:35.768923 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:35:35.768923 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:35:35.768923 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:35:35.768923 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:35:35.768923 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:35:35.768923 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:35:35.768923 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:35:35.768923 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 19:35:35.768923 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 19:35:35.768923 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 19:35:35.768923 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 19:35:35.769931 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 19:35:35.769931 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 19:35:35.769931 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 19:35:35.769931 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 19:35:35.769931 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:35:35.769931 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:35:35.769931 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:35:35.769931 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:35:35.769931 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:35:35.769931 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:35:35.769931 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:35:35.769931 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application with Lock( Sep 13 19:35:35.769931 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:35:35.769931 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:35:35.769931 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:35:35.769931 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:35:35.770778 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:35:35.770778 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:35:35.770778 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:35:35.770778 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:35:35.770778 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 19:35:35.770778 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 19:35:35.770778 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 19:35:35.770778 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 19:35:35.770778 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 19:35:35.770778 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 19:35:35.770778 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 13 19:35:35.770778 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application Sep 13 19:35:35.770778 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 162/326] 10.222.0.25 () {56 vars in 1099 bytes} [Tue Sep 13 19:35:35 2022] GET /identity/v3/roles/member => generated 84 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 13 19:35:35.771461 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e80e3d-2e23-471e-9ffa-603305934db0 None admin] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:35:35.776307 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG dbcounter [-] [87935] Writing DB stats keystone:SELECT=100 {{(pid=87935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:35:35.816129 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970b96a5-a50f-48b4-8215-b6014088e68f None admin] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:35:35.851397 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2414df49-7be8-40b5-8a8f-92e11c391868 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:35:35.852001 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2414df49-7be8-40b5-8a8f-92e11c391868 None admin] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:35:35.852305 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2414df49-7be8-40b5-8a8f-92e11c391868 None admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:35:35.852587 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2414df49-7be8-40b5-8a8f-92e11c391868 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:35:35.862837 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2414df49-7be8-40b5-8a8f-92e11c391868 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 19:35:35.868251 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application [None req-2414df49-7be8-40b5-8a8f-92e11c391868 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 13 19:35:35.868251 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:35:35.868251 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:35:35.868251 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:35:35.868251 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:35:35.868251 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:35:35.868251 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:35:35.868251 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:35:35.868251 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:35:35.868251 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:35:35.868251 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:35:35.868251 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:35:35.868251 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 19:35:35.868251 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 19:35:35.868251 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 19:35:35.868251 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 19:35:35.869342 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 19:35:35.869342 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 19:35:35.869342 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 19:35:35.869342 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 19:35:35.869342 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:35:35.869342 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:35:35.869342 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:35:35.869342 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:35:35.869342 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:35:35.869342 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:35:35.869342 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:35:35.869342 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application with Lock( Sep 13 19:35:35.869342 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:35:35.869342 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:35:35.869342 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:35:35.869342 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:35:35.870248 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:35:35.870248 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:35:35.870248 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:35:35.870248 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:35:35.870248 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 19:35:35.870248 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 19:35:35.870248 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 19:35:35.870248 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 19:35:35.870248 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 19:35:35.870248 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 19:35:35.870248 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 13 19:35:35.870248 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application Sep 13 19:35:35.870248 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 165/327] 10.222.0.25 () {56 vars in 1099 bytes} [Tue Sep 13 19:35:35 2022] GET /identity/v3/roles/reader => generated 84 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:35:35.870248 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2414df49-7be8-40b5-8a8f-92e11c391868 None admin] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:35:35.876300 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e80e3d-2e23-471e-9ffa-603305934db0 None admin] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:35:35.905431 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG dbcounter [-] [87934] Writing DB stats keystone:SELECT=100 {{(pid=87934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:35:35.911092 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f912106b-b93f-47f9-9eab-1638fac629de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:35:35.911692 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f912106b-b93f-47f9-9eab-1638fac629de None admin] REQUEST_METHOD: `POST` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:35:35.911962 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f912106b-b93f-47f9-9eab-1638fac629de None admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:35:35.912250 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f912106b-b93f-47f9-9eab-1638fac629de None admin] PATH_INFO: `/v3/groups` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:35:35.913431 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f912106b-b93f-47f9-9eab-1638fac629de None admin] RBAC: Authorizing `identity:create_group()` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:35:35.914966 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f912106b-b93f-47f9-9eab-1638fac629de None admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:35:35.930669 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 163/328] 10.222.0.25 () {60 vars in 1134 bytes} [Tue Sep 13 19:35:35 2022] POST /identity/v3/groups => generated 226 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 19:35:35.931477 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f912106b-b93f-47f9-9eab-1638fac629de None admin] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:35:35.979883 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2414df49-7be8-40b5-8a8f-92e11c391868 None admin] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:35:36.020506 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb5eb74-9581-4d99-895f-e848c0b8eee3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:35:36.020771 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG dbcounter [-] [87935] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:35:36.021294 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb5eb74-9581-4d99-895f-e848c0b8eee3 None admin] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:35:36.021503 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb5eb74-9581-4d99-895f-e848c0b8eee3 None admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:35:36.022025 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb5eb74-9581-4d99-895f-e848c0b8eee3 None admin] PATH_INFO: `/v3/roles` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:35:36.023014 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb5eb74-9581-4d99-895f-e848c0b8eee3 None admin] RBAC: Adding query filter params (name=member) {{(pid=87934) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:35:36.023356 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb5eb74-9581-4d99-895f-e848c0b8eee3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:35:36.024855 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb5eb74-9581-4d99-895f-e848c0b8eee3 None admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:35:36.035174 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 166/329] 10.222.0.25 () {56 vars in 1101 bytes} [Tue Sep 13 19:35:35 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:35:36.042017 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb5eb74-9581-4d99-895f-e848c0b8eee3 None admin] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:35:36.071106 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f912106b-b93f-47f9-9eab-1638fac629de None admin] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:35:36.110310 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9df0212-2798-47ed-8a27-ac848734e31e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:35:36.110920 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9df0212-2798-47ed-8a27-ac848734e31e None admin] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:35:36.111195 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9df0212-2798-47ed-8a27-ac848734e31e None admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:35:36.111457 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9df0212-2798-47ed-8a27-ac848734e31e None admin] PATH_INFO: `/v3/roles` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:35:36.112116 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9df0212-2798-47ed-8a27-ac848734e31e None admin] RBAC: Adding query filter params (name=reader) {{(pid=87935) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:35:36.112448 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9df0212-2798-47ed-8a27-ac848734e31e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:35:36.113905 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9df0212-2798-47ed-8a27-ac848734e31e None admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:35:36.124378 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 164/330] 10.222.0.25 () {56 vars in 1101 bytes} [Tue Sep 13 19:35:35 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:35:36.129680 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9df0212-2798-47ed-8a27-ac848734e31e None admin] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:35:36.154717 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG dbcounter [-] [87934] Writing DB stats keystone:SELECT=100 {{(pid=87934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:35:36.162143 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb5eb74-9581-4d99-895f-e848c0b8eee3 None admin] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:35:36.210462 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49244986-48f3-4c19-8fd1-2a20e12bbcac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:35:36.212342 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49244986-48f3-4c19-8fd1-2a20e12bbcac None admin] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:35:36.212787 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49244986-48f3-4c19-8fd1-2a20e12bbcac None admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:35:36.213216 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49244986-48f3-4c19-8fd1-2a20e12bbcac None admin] PATH_INFO: `/v3/users/344678e0b86245328db52a0438ba28c0` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:35:36.215040 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49244986-48f3-4c19-8fd1-2a20e12bbcac None admin] RBAC: Authorizing `identity:get_user(user_id=344678e0b86245328db52a0438ba28c0)` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:35:36.217746 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49244986-48f3-4c19-8fd1-2a20e12bbcac None admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:35:36.219854 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 167/331] 10.222.0.25 () {56 vars in 1177 bytes} [Tue Sep 13 19:35:36 2022] GET /identity/v3/users/344678e0b86245328db52a0438ba28c0 => generated 293 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 19:35:36.226678 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49244986-48f3-4c19-8fd1-2a20e12bbcac None admin] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:35:36.262246 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9df0212-2798-47ed-8a27-ac848734e31e None admin] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:35:36.292520 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG dbcounter [-] [87935] Writing DB stats keystone:SELECT=100 {{(pid=87935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:35:36.305722 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ce1469-e9c4-4b65-90cc-59854522890d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:35:36.306843 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ce1469-e9c4-4b65-90cc-59854522890d None admin] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:35:36.307130 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ce1469-e9c4-4b65-90cc-59854522890d None admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:35:36.307474 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ce1469-e9c4-4b65-90cc-59854522890d None admin] PATH_INFO: `/v3/users/231009031e634738955d09f292c0c56c` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:35:36.309162 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ce1469-e9c4-4b65-90cc-59854522890d None admin] RBAC: Authorizing `identity:get_user(user_id=231009031e634738955d09f292c0c56c)` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:35:36.311153 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ce1469-e9c4-4b65-90cc-59854522890d None admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:35:36.316498 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 165/332] 10.222.0.25 () {56 vars in 1177 bytes} [Tue Sep 13 19:35:36 2022] GET /identity/v3/users/231009031e634738955d09f292c0c56c => generated 293 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:35:36.317676 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ce1469-e9c4-4b65-90cc-59854522890d None admin] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:35:36.375969 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49244986-48f3-4c19-8fd1-2a20e12bbcac None admin] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:35:36.421501 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ffa5a70-b01e-46df-b2bf-c8a60493f3a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:35:36.422148 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffa5a70-b01e-46df-b2bf-c8a60493f3a0 None admin] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:35:36.422400 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffa5a70-b01e-46df-b2bf-c8a60493f3a0 None admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:35:36.422674 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffa5a70-b01e-46df-b2bf-c8a60493f3a0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:35:36.423822 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ffa5a70-b01e-46df-b2bf-c8a60493f3a0 None admin] RBAC: Adding query filter params (role.id=a259191f6d0e46fabd9f34536bb28747, user.id=344678e0b86245328db52a0438ba28c0, scope.system=all) {{(pid=87934) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:35:36.424136 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ffa5a70-b01e-46df-b2bf-c8a60493f3a0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:35:36.425688 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ffa5a70-b01e-46df-b2bf-c8a60493f3a0 None admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:35:36.440007 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 168/333] 10.222.0.25 () {56 vars in 1308 bytes} [Tue Sep 13 19:35:36 2022] GET /identity/v3/role_assignments?user.id=344678e0b86245328db52a0438ba28c0&scope.system=all&role.id=a259191f6d0e46fabd9f34536bb28747 => generated 510 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 19:35:36.452734 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ce1469-e9c4-4b65-90cc-59854522890d None admin] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:35:36.507902 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ca83d5-c14d-45f2-9087-aa606417aa0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:35:36.508621 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ca83d5-c14d-45f2-9087-aa606417aa0b None admin] REQUEST_METHOD: `PUT` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:35:36.508895 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ca83d5-c14d-45f2-9087-aa606417aa0b None admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:35:36.509164 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ca83d5-c14d-45f2-9087-aa606417aa0b None admin] PATH_INFO: `/v3/system/users/231009031e634738955d09f292c0c56c/roles/85e5149eef184d349b4b1859b84dd789` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:35:36.510796 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ca83d5-c14d-45f2-9087-aa606417aa0b None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=231009031e634738955d09f292c0c56c, role_id=85e5149eef184d349b4b1859b84dd789)` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:35:36.512350 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ca83d5-c14d-45f2-9087-aa606417aa0b None admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:35:36.523127 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 166/334] 10.222.0.25 () {58 vars in 1334 bytes} [Tue Sep 13 19:35:36 2022] PUT /identity/v3/system/users/231009031e634738955d09f292c0c56c/roles/85e5149eef184d349b4b1859b84dd789 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 19:35:38.572103 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7149ffc0-fa6a-4cd3-b120-38f602bd85e9 None None] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:35:38.573105 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7149ffc0-fa6a-4cd3-b120-38f602bd85e9 None None] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:35:38.573612 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7149ffc0-fa6a-4cd3-b120-38f602bd85e9 None None] PATH_INFO: `/` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:35:38.575434 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 169/335] 10.222.0.25 () {54 vars in 927 bytes} [Tue Sep 13 19:35:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:35:38.580675 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7290064e-4832-454f-b0f5-55d7aaac4f82 None None] REQUEST_METHOD: `POST` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:35:38.581107 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7290064e-4832-454f-b0f5-55d7aaac4f82 None None] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:35:38.581224 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7290064e-4832-454f-b0f5-55d7aaac4f82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:35:38.605302 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.auth.core [None req-7290064e-4832-454f-b0f5-55d7aaac4f82 None None] MFA Rules not processed for user `7b0aed92d02344acb92a0e4aa67c3068`. Rule list: `[]` (Enabled: `True`). {{(pid=87935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:35:38.606893 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.fernet_utils [None req-7290064e-4832-454f-b0f5-55d7aaac4f82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:35:38.677239 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG dbcounter [-] [87935] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:35:38.702742 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 167/336] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Sep 13 19:35:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 19:35:38.786835 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a1ce4e-f265-4f66-b920-e5a28729cc70 None None] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:35:38.787135 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a1ce4e-f265-4f66-b920-e5a28729cc70 None None] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:35:38.787452 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a1ce4e-f265-4f66-b920-e5a28729cc70 None None] PATH_INFO: `/` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:35:38.789259 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 170/337] 10.222.0.25 () {54 vars in 927 bytes} [Tue Sep 13 19:35:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:35:38.795568 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c659e577-db1b-4557-b347-ac723aa0644d None None] REQUEST_METHOD: `POST` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:35:38.795846 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c659e577-db1b-4557-b347-ac723aa0644d None None] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:35:38.796111 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c659e577-db1b-4557-b347-ac723aa0644d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:35:38.819550 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.auth.core [None req-c659e577-db1b-4557-b347-ac723aa0644d None None] MFA Rules not processed for user `7b0aed92d02344acb92a0e4aa67c3068`. Rule list: `[]` (Enabled: `True`). {{(pid=87935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:35:38.820785 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.fernet_utils [None req-c659e577-db1b-4557-b347-ac723aa0644d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:35:38.906387 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 168/338] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Sep 13 19:35:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 19:35:39.143851 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b176d5-83e8-4d7d-895d-3a1451132c54 None None] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:35:39.144245 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b176d5-83e8-4d7d-895d-3a1451132c54 None None] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:35:39.144452 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b176d5-83e8-4d7d-895d-3a1451132c54 None None] PATH_INFO: `/` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:35:39.146045 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 171/339] 10.222.0.25 () {54 vars in 927 bytes} [Tue Sep 13 19:35:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:35:39.158004 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ef0dbf-91e8-4744-bbc5-b029e6509c7e None None] REQUEST_METHOD: `POST` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:35:39.158272 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ef0dbf-91e8-4744-bbc5-b029e6509c7e None None] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:35:39.158477 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ef0dbf-91e8-4744-bbc5-b029e6509c7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:35:39.184638 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.auth.core [None req-84ef0dbf-91e8-4744-bbc5-b029e6509c7e None None] MFA Rules not processed for user `7b0aed92d02344acb92a0e4aa67c3068`. Rule list: `[]` (Enabled: `True`). {{(pid=87935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:35:39.185872 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.fernet_utils [None req-84ef0dbf-91e8-4744-bbc5-b029e6509c7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:35:39.216376 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b176d5-83e8-4d7d-895d-3a1451132c54 None None] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:35:39.267204 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG dbcounter [-] [87934] Writing DB stats keystone:SELECT=100 {{(pid=87934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:35:39.278829 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 169/340] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Sep 13 19:35:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 19:35:39.373236 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b176d5-83e8-4d7d-895d-3a1451132c54 None None] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:35:39.414129 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27bc720d-e0d3-4f80-8d7b-31b47286aaf4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:35:39.415004 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bc720d-e0d3-4f80-8d7b-31b47286aaf4 None admin] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:35:39.415425 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bc720d-e0d3-4f80-8d7b-31b47286aaf4 None admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:35:39.415834 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bc720d-e0d3-4f80-8d7b-31b47286aaf4 None admin] PATH_INFO: `/v3/roles/member` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:35:39.429676 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27bc720d-e0d3-4f80-8d7b-31b47286aaf4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 19:35:39.435390 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application [None req-27bc720d-e0d3-4f80-8d7b-31b47286aaf4 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 13 19:35:39.435390 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:35:39.435390 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:35:39.435390 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:35:39.435390 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:35:39.435390 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:35:39.435390 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:35:39.435390 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:35:39.435390 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:35:39.435390 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:35:39.435390 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:35:39.435390 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:35:39.435390 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 19:35:39.435390 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 19:35:39.435390 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 19:35:39.435390 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 19:35:39.436517 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 19:35:39.436517 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 19:35:39.436517 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 19:35:39.436517 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 19:35:39.436517 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:35:39.436517 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:35:39.436517 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:35:39.436517 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:35:39.436517 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:35:39.436517 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:35:39.436517 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:35:39.436517 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application with Lock( Sep 13 19:35:39.436517 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:35:39.436517 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:35:39.436517 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:35:39.436517 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:35:39.437536 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:35:39.437536 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:35:39.437536 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:35:39.437536 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:35:39.437536 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 19:35:39.437536 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 19:35:39.437536 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 19:35:39.437536 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 19:35:39.437536 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 19:35:39.437536 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 19:35:39.437536 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 13 19:35:39.437536 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application Sep 13 19:35:39.439770 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 172/341] 10.222.0.25 () {56 vars in 1099 bytes} [Tue Sep 13 19:35:39 2022] GET /identity/v3/roles/member => generated 84 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:35:39.449446 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ef0dbf-91e8-4744-bbc5-b029e6509c7e None None] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:35:39.513649 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG dbcounter [-] [87935] Writing DB stats keystone:SELECT=100 {{(pid=87935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:35:39.562458 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27bc720d-e0d3-4f80-8d7b-31b47286aaf4 None admin] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:35:39.588098 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ef0dbf-91e8-4744-bbc5-b029e6509c7e None None] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:35:39.659673 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498e0361-80c2-48ef-9a67-29c2434011f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:35:39.660321 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498e0361-80c2-48ef-9a67-29c2434011f6 None admin] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:35:39.660589 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498e0361-80c2-48ef-9a67-29c2434011f6 None admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:35:39.660855 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498e0361-80c2-48ef-9a67-29c2434011f6 None admin] PATH_INFO: `/v3/roles` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:35:39.661523 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-498e0361-80c2-48ef-9a67-29c2434011f6 None admin] RBAC: Adding query filter params (name=member) {{(pid=87935) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:35:39.661826 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-498e0361-80c2-48ef-9a67-29c2434011f6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:35:39.662121 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG dbcounter [-] [87934] Writing DB stats keystone:SELECT=100 {{(pid=87934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:35:39.663800 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-498e0361-80c2-48ef-9a67-29c2434011f6 None admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:35:39.683870 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 170/342] 10.222.0.25 () {56 vars in 1101 bytes} [Tue Sep 13 19:35:39 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:35:39.685514 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99ff892-a73f-42bc-a352-4053938fe832 None None] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:35:39.685954 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99ff892-a73f-42bc-a352-4053938fe832 None None] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:35:39.686360 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99ff892-a73f-42bc-a352-4053938fe832 None None] PATH_INFO: `/` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:35:39.687794 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 171/343] 10.222.0.25 () {54 vars in 927 bytes} [Tue Sep 13 19:35:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:35:39.689608 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27bc720d-e0d3-4f80-8d7b-31b47286aaf4 None admin] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:35:39.693943 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1caaf4-6e5d-4e8c-a4fc-eb586b441489 None None] REQUEST_METHOD: `POST` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:35:39.694387 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1caaf4-6e5d-4e8c-a4fc-eb586b441489 None None] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:35:39.694844 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1caaf4-6e5d-4e8c-a4fc-eb586b441489 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:35:39.720958 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.auth.core [None req-5f1caaf4-6e5d-4e8c-a4fc-eb586b441489 None None] MFA Rules not processed for user `7b0aed92d02344acb92a0e4aa67c3068`. Rule list: `[]` (Enabled: `True`). {{(pid=87935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:35:39.722145 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.fernet_utils [None req-5f1caaf4-6e5d-4e8c-a4fc-eb586b441489 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:35:39.733471 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92a36b4-3164-47d0-a236-b970466fb66f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:35:39.734117 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92a36b4-3164-47d0-a236-b970466fb66f None admin] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:35:39.734393 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92a36b4-3164-47d0-a236-b970466fb66f None admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:35:39.734666 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92a36b4-3164-47d0-a236-b970466fb66f None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:35:39.746192 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b92a36b4-3164-47d0-a236-b970466fb66f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 19:35:39.751984 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application [None req-b92a36b4-3164-47d0-a236-b970466fb66f None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 13 19:35:39.751984 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:35:39.751984 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:35:39.751984 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:35:39.751984 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:35:39.751984 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:35:39.751984 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:35:39.751984 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:35:39.751984 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:35:39.751984 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:35:39.751984 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:35:39.751984 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:35:39.751984 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 19:35:39.751984 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 19:35:39.751984 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 19:35:39.751984 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 19:35:39.753039 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 19:35:39.753039 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 19:35:39.753039 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 19:35:39.753039 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 19:35:39.753039 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:35:39.753039 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:35:39.753039 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:35:39.753039 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:35:39.753039 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:35:39.753039 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:35:39.753039 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:35:39.753039 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application with Lock( Sep 13 19:35:39.753039 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:35:39.753039 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:35:39.753039 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:35:39.753039 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:35:39.753859 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:35:39.753859 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:35:39.753859 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:35:39.753859 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:35:39.753859 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 19:35:39.753859 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 19:35:39.753859 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 19:35:39.753859 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 19:35:39.753859 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 19:35:39.753859 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 19:35:39.753859 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 13 19:35:39.753859 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application Sep 13 19:35:39.754469 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 173/344] 10.222.0.25 () {56 vars in 1114 bytes} [Tue Sep 13 19:35:39 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 13 19:35:39.758276 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92a36b4-3164-47d0-a236-b970466fb66f None admin] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:35:39.823647 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 172/345] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Sep 13 19:35:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 13 19:35:39.824587 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1caaf4-6e5d-4e8c-a4fc-eb586b441489 None None] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:35:39.870388 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG dbcounter [-] [87935] Writing DB stats keystone:SELECT=100 {{(pid=87935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:35:39.885797 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92a36b4-3164-47d0-a236-b970466fb66f None admin] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:35:39.925551 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60de6aa4-353b-4c38-a45f-aab3701b6caf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:35:39.926503 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60de6aa4-353b-4c38-a45f-aab3701b6caf None admin] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:35:39.926992 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60de6aa4-353b-4c38-a45f-aab3701b6caf None admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:35:39.927486 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60de6aa4-353b-4c38-a45f-aab3701b6caf None admin] PATH_INFO: `/v3/roles/reader` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:35:39.934900 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1caaf4-6e5d-4e8c-a4fc-eb586b441489 None None] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:35:39.941722 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60de6aa4-353b-4c38-a45f-aab3701b6caf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 19:35:39.952183 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application [None req-60de6aa4-353b-4c38-a45f-aab3701b6caf None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 13 19:35:39.952183 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:35:39.952183 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:35:39.952183 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:35:39.952183 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:35:39.952183 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:35:39.952183 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:35:39.952183 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:35:39.952183 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:35:39.952183 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:35:39.952183 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:35:39.952183 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:35:39.952183 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 19:35:39.952183 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 19:35:39.952183 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 19:35:39.952183 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 19:35:39.953171 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 19:35:39.953171 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 19:35:39.953171 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 19:35:39.953171 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 19:35:39.953171 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:35:39.953171 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:35:39.953171 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:35:39.953171 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:35:39.953171 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:35:39.953171 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:35:39.953171 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:35:39.953171 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application with Lock( Sep 13 19:35:39.953171 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:35:39.953171 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:35:39.953171 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:35:39.953171 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:35:39.954080 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:35:39.954080 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:35:39.954080 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:35:39.954080 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:35:39.954080 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 19:35:39.954080 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 19:35:39.954080 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 19:35:39.954080 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 19:35:39.954080 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 19:35:39.954080 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 19:35:39.954080 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 13 19:35:39.954080 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application Sep 13 19:35:39.956085 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 174/346] 10.222.0.25 () {56 vars in 1099 bytes} [Tue Sep 13 19:35:39 2022] GET /identity/v3/roles/reader => generated 84 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:35:39.957063 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60de6aa4-353b-4c38-a45f-aab3701b6caf None admin] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:35:39.960759 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG dbcounter [-] [87934] Writing DB stats keystone:SELECT=100 {{(pid=87934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:35:39.973991 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65983998-2920-44da-8c4a-8c0b4801a6f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:35:39.975333 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65983998-2920-44da-8c4a-8c0b4801a6f5 None admin] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:35:39.975523 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65983998-2920-44da-8c4a-8c0b4801a6f5 None admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:35:39.975698 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65983998-2920-44da-8c4a-8c0b4801a6f5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:35:40.050931 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65983998-2920-44da-8c4a-8c0b4801a6f5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:35:40.052439 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65983998-2920-44da-8c4a-8c0b4801a6f5 None admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:35:40.074305 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60de6aa4-353b-4c38-a45f-aab3701b6caf None admin] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:35:40.095314 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG dbcounter [-] [87935] Writing DB stats keystone:SELECT=100 {{(pid=87935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:35:40.114729 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdfd5ab9-7e22-4599-b47d-927dc2733294 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:35:40.116275 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfd5ab9-7e22-4599-b47d-927dc2733294 None admin] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:35:40.116975 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfd5ab9-7e22-4599-b47d-927dc2733294 None admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:35:40.117556 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfd5ab9-7e22-4599-b47d-927dc2733294 None admin] PATH_INFO: `/v3/roles` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:35:40.118410 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdfd5ab9-7e22-4599-b47d-927dc2733294 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=87934) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:35:40.118917 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdfd5ab9-7e22-4599-b47d-927dc2733294 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:35:40.120499 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdfd5ab9-7e22-4599-b47d-927dc2733294 None admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:35:40.129636 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 175/347] 10.222.0.25 () {56 vars in 1111 bytes} [Tue Sep 13 19:35:39 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:35:40.130856 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdfd5ab9-7e22-4599-b47d-927dc2733294 None admin] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:35:40.159054 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 173/348] 10.222.0.25 () {58 vars in 1282 bytes} [Tue Sep 13 19:35:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 13 19:35:40.159939 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65983998-2920-44da-8c4a-8c0b4801a6f5 None admin] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:35:40.202103 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG dbcounter [-] [87934] Writing DB stats keystone:SELECT=100 {{(pid=87934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:35:40.253882 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdfd5ab9-7e22-4599-b47d-927dc2733294 None admin] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:35:40.273049 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65983998-2920-44da-8c4a-8c0b4801a6f5 None admin] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:35:40.293769 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601fb002-3ea2-4c9b-b65c-a35c6e90eafc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:35:40.300413 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601fb002-3ea2-4c9b-b65c-a35c6e90eafc None admin] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:35:40.301012 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601fb002-3ea2-4c9b-b65c-a35c6e90eafc None admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:35:40.301486 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601fb002-3ea2-4c9b-b65c-a35c6e90eafc None admin] PATH_INFO: `/v3/roles` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:35:40.302401 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-601fb002-3ea2-4c9b-b65c-a35c6e90eafc None admin] RBAC: Adding query filter params (name=reader) {{(pid=87934) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:35:40.303700 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-601fb002-3ea2-4c9b-b65c-a35c6e90eafc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:35:40.305719 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-601fb002-3ea2-4c9b-b65c-a35c6e90eafc None admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:35:40.309494 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6c41e9-42e7-46b8-bdcb-71e51bea0474 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:35:40.310172 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6c41e9-42e7-46b8-bdcb-71e51bea0474 None admin] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:35:40.310532 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6c41e9-42e7-46b8-bdcb-71e51bea0474 None admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:35:40.310848 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6c41e9-42e7-46b8-bdcb-71e51bea0474 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:35:40.316390 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 176/349] 10.222.0.25 () {56 vars in 1101 bytes} [Tue Sep 13 19:35:40 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:35:40.317480 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601fb002-3ea2-4c9b-b65c-a35c6e90eafc None admin] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:35:40.324293 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG dbcounter [-] [87935] Writing DB stats keystone:SELECT=100 {{(pid=87935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:35:40.431854 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601fb002-3ea2-4c9b-b65c-a35c6e90eafc None admin] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:35:40.446354 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd6c41e9-42e7-46b8-bdcb-71e51bea0474 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:35:40.448452 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd6c41e9-42e7-46b8-bdcb-71e51bea0474 None admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:35:40.463659 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG dbcounter [-] [87934] Writing DB stats keystone:SELECT=100 {{(pid=87934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:35:40.477907 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a5f89c-5709-47af-9f6e-adbc5be4542f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:35:40.478551 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a5f89c-5709-47af-9f6e-adbc5be4542f None admin] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:35:40.478835 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a5f89c-5709-47af-9f6e-adbc5be4542f None admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:35:40.479109 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a5f89c-5709-47af-9f6e-adbc5be4542f None admin] PATH_INFO: `/v3/projects/8aefa5062b7b4e4390554359e5669a9b` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:35:40.480327 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a5f89c-5709-47af-9f6e-adbc5be4542f None admin] RBAC: Authorizing `identity:get_project(project_id=8aefa5062b7b4e4390554359e5669a9b)` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:35:40.481794 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a5f89c-5709-47af-9f6e-adbc5be4542f None admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:35:40.483770 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 177/350] 10.222.0.25 () {56 vars in 1186 bytes} [Tue Sep 13 19:35:40 2022] GET /identity/v3/projects/8aefa5062b7b4e4390554359e5669a9b => generated 298 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:35:40.484621 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a5f89c-5709-47af-9f6e-adbc5be4542f None admin] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:35:40.581555 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 174/351] 10.222.0.25 () {58 vars in 1282 bytes} [Tue Sep 13 19:35:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 422 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 13 19:35:40.582695 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6c41e9-42e7-46b8-bdcb-71e51bea0474 None admin] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:35:40.624517 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a5f89c-5709-47af-9f6e-adbc5be4542f None admin] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:35:40.647172 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG dbcounter [-] [87935] Writing DB stats keystone:SELECT=100 {{(pid=87935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:35:40.683491 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feffdbad-4def-41a7-aa04-58cca0805224 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:35:40.688374 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feffdbad-4def-41a7-aa04-58cca0805224 None admin] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:35:40.688681 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feffdbad-4def-41a7-aa04-58cca0805224 None admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:35:40.688962 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feffdbad-4def-41a7-aa04-58cca0805224 None admin] PATH_INFO: `/v3/users/231009031e634738955d09f292c0c56c` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:35:40.690672 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feffdbad-4def-41a7-aa04-58cca0805224 None admin] RBAC: Authorizing `identity:get_user(user_id=231009031e634738955d09f292c0c56c)` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:35:40.692580 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feffdbad-4def-41a7-aa04-58cca0805224 None admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:35:40.696044 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 178/352] 10.222.0.25 () {56 vars in 1177 bytes} [Tue Sep 13 19:35:40 2022] GET /identity/v3/users/231009031e634738955d09f292c0c56c => generated 293 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:35:40.697555 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feffdbad-4def-41a7-aa04-58cca0805224 None admin] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:35:40.720932 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6c41e9-42e7-46b8-bdcb-71e51bea0474 None admin] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:35:40.766450 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ee6b3b-a746-47e7-95e2-811becc48a3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:35:40.767095 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ee6b3b-a746-47e7-95e2-811becc48a3e None admin] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:35:40.767438 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ee6b3b-a746-47e7-95e2-811becc48a3e None admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:35:40.767716 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ee6b3b-a746-47e7-95e2-811becc48a3e None admin] PATH_INFO: `/v3/roles/member` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:35:40.782272 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ee6b3b-a746-47e7-95e2-811becc48a3e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 19:35:40.783889 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG dbcounter [-] [87934] Writing DB stats keystone:SELECT=100 {{(pid=87934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:35:40.788628 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application [None req-23ee6b3b-a746-47e7-95e2-811becc48a3e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 13 19:35:40.788628 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:35:40.788628 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:35:40.788628 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:35:40.788628 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:35:40.788628 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:35:40.788628 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:35:40.788628 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:35:40.788628 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:35:40.788628 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:35:40.788628 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:35:40.788628 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:35:40.788628 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 19:35:40.788628 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 19:35:40.788628 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 19:35:40.788628 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 19:35:40.789636 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 19:35:40.789636 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 19:35:40.789636 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 19:35:40.789636 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 19:35:40.789636 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:35:40.789636 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:35:40.789636 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:35:40.789636 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:35:40.789636 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:35:40.789636 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:35:40.789636 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:35:40.789636 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application with Lock( Sep 13 19:35:40.789636 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:35:40.789636 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:35:40.789636 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:35:40.789636 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:35:40.790438 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:35:40.790438 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:35:40.790438 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:35:40.790438 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:35:40.790438 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 19:35:40.790438 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 19:35:40.790438 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 19:35:40.790438 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 19:35:40.790438 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 19:35:40.790438 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 19:35:40.790438 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 13 19:35:40.790438 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application Sep 13 19:35:40.790438 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 175/353] 10.222.0.25 () {56 vars in 1099 bytes} [Tue Sep 13 19:35:40 2022] GET /identity/v3/roles/member => generated 84 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:35:40.791080 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ee6b3b-a746-47e7-95e2-811becc48a3e None admin] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:35:40.839711 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feffdbad-4def-41a7-aa04-58cca0805224 None admin] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:35:40.888135 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a05de7-6750-46a2-b8b0-115e4d11067d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:35:40.888842 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a05de7-6750-46a2-b8b0-115e4d11067d None admin] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:35:40.889123 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a05de7-6750-46a2-b8b0-115e4d11067d None admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:35:40.889395 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a05de7-6750-46a2-b8b0-115e4d11067d None admin] PATH_INFO: `/v3/groups/e392f0a270074d3ea54b38df964ba25f` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:35:40.898844 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a05de7-6750-46a2-b8b0-115e4d11067d None admin] RBAC: Authorizing `identity:get_group(group_id=e392f0a270074d3ea54b38df964ba25f)` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:35:40.900366 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a05de7-6750-46a2-b8b0-115e4d11067d None admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:35:40.902342 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 179/354] 10.222.0.25 () {56 vars in 1180 bytes} [Tue Sep 13 19:35:40 2022] GET /identity/v3/groups/e392f0a270074d3ea54b38df964ba25f => generated 226 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:35:40.903140 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a05de7-6750-46a2-b8b0-115e4d11067d None admin] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:35:40.911005 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG dbcounter [-] [87935] Writing DB stats keystone:SELECT=100 {{(pid=87935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:35:40.915141 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ee6b3b-a746-47e7-95e2-811becc48a3e None admin] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:35:40.959430 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6500c0cb-23e9-4f7f-820a-81a2e8e41174 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:35:40.960616 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6500c0cb-23e9-4f7f-820a-81a2e8e41174 None admin] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:35:40.960900 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6500c0cb-23e9-4f7f-820a-81a2e8e41174 None admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:35:40.961171 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6500c0cb-23e9-4f7f-820a-81a2e8e41174 None admin] PATH_INFO: `/v3/projects/8aefa5062b7b4e4390554359e5669a9b` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:35:40.963613 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6500c0cb-23e9-4f7f-820a-81a2e8e41174 None admin] RBAC: Authorizing `identity:get_project(project_id=8aefa5062b7b4e4390554359e5669a9b)` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:35:40.965227 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6500c0cb-23e9-4f7f-820a-81a2e8e41174 None admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:35:40.967337 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 176/355] 10.222.0.25 () {56 vars in 1186 bytes} [Tue Sep 13 19:35:40 2022] GET /identity/v3/projects/8aefa5062b7b4e4390554359e5669a9b => generated 298 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:35:40.967528 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6500c0cb-23e9-4f7f-820a-81a2e8e41174 None admin] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:35:41.026672 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a05de7-6750-46a2-b8b0-115e4d11067d None admin] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:35:41.062838 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG dbcounter [-] [87934] Writing DB stats keystone:SELECT=100 {{(pid=87934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:35:41.077959 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da3e535-18d7-45cb-837d-56cd88eb60da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:35:41.079336 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da3e535-18d7-45cb-837d-56cd88eb60da None admin] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:35:41.079682 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da3e535-18d7-45cb-837d-56cd88eb60da None admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:35:41.080029 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da3e535-18d7-45cb-837d-56cd88eb60da None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:35:41.082019 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da3e535-18d7-45cb-837d-56cd88eb60da None admin] RBAC: Adding query filter params (role.id=85e5149eef184d349b4b1859b84dd789, user.id=231009031e634738955d09f292c0c56c, scope.system=all) {{(pid=87934) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:35:41.082019 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da3e535-18d7-45cb-837d-56cd88eb60da None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:35:41.083107 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da3e535-18d7-45cb-837d-56cd88eb60da None admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:35:41.098216 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 180/356] 10.222.0.25 () {56 vars in 1308 bytes} [Tue Sep 13 19:35:40 2022] GET /identity/v3/role_assignments?user.id=231009031e634738955d09f292c0c56c&scope.system=all&role.id=85e5149eef184d349b4b1859b84dd789 => generated 510 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:35:41.099281 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24686418-1a4d-4968-96b7-afd694a85261 None None] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:35:41.099572 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24686418-1a4d-4968-96b7-afd694a85261 None None] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:35:41.099895 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24686418-1a4d-4968-96b7-afd694a85261 None None] PATH_INFO: `/` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:35:41.101603 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 181/357] 10.222.0.25 () {54 vars in 927 bytes} [Tue Sep 13 19:35:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:35:41.102258 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6500c0cb-23e9-4f7f-820a-81a2e8e41174 None admin] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:35:41.102378 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24686418-1a4d-4968-96b7-afd694a85261 None None] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:35:41.160854 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a19fd7-1516-4bf2-af64-703c544fbaeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:35:41.161489 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a19fd7-1516-4bf2-af64-703c544fbaeb None admin] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:35:41.161807 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a19fd7-1516-4bf2-af64-703c544fbaeb None admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:35:41.162145 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a19fd7-1516-4bf2-af64-703c544fbaeb None admin] PATH_INFO: `/v3/roles` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:35:41.163788 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a19fd7-1516-4bf2-af64-703c544fbaeb None admin] RBAC: Adding query filter params (name=member) {{(pid=87935) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:35:41.164921 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a19fd7-1516-4bf2-af64-703c544fbaeb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:35:41.166521 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a19fd7-1516-4bf2-af64-703c544fbaeb None admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:35:41.180622 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 177/358] 10.222.0.25 () {56 vars in 1101 bytes} [Tue Sep 13 19:35:40 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:35:41.182191 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a19fd7-1516-4bf2-af64-703c544fbaeb None admin] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:35:41.229383 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG dbcounter [-] [87935] Writing DB stats keystone:SELECT=100 {{(pid=87935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:35:41.268322 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24686418-1a4d-4968-96b7-afd694a85261 None None] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:35:41.320821 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2712197-bd08-4ff6-a2ff-2d5d5c59d349 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:35:41.322116 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2712197-bd08-4ff6-a2ff-2d5d5c59d349 None admin] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:35:41.322849 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2712197-bd08-4ff6-a2ff-2d5d5c59d349 None admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:35:41.323546 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2712197-bd08-4ff6-a2ff-2d5d5c59d349 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:35:41.325051 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2712197-bd08-4ff6-a2ff-2d5d5c59d349 None admin] RBAC: Adding query filter params (group.id=e392f0a270074d3ea54b38df964ba25f, role.id=a259191f6d0e46fabd9f34536bb28747, scope.project.id=8aefa5062b7b4e4390554359e5669a9b) {{(pid=87934) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:35:41.325593 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2712197-bd08-4ff6-a2ff-2d5d5c59d349 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:35:41.328267 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2712197-bd08-4ff6-a2ff-2d5d5c59d349 None admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:35:41.343183 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 182/359] 10.222.0.25 () {56 vars in 1376 bytes} [Tue Sep 13 19:35:41 2022] GET /identity/v3/role_assignments?group.id=e392f0a270074d3ea54b38df964ba25f&scope.project.id=8aefa5062b7b4e4390554359e5669a9b&role.id=a259191f6d0e46fabd9f34536bb28747 => generated 260 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:35:41.345071 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fe8213-e2af-4648-964f-055f61b619e5 None None] REQUEST_METHOD: `POST` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:35:41.345071 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fe8213-e2af-4648-964f-055f61b619e5 None None] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:35:41.345265 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fe8213-e2af-4648-964f-055f61b619e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:35:41.378475 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.auth.core [None req-f2fe8213-e2af-4648-964f-055f61b619e5 None None] MFA Rules not processed for user `7b0aed92d02344acb92a0e4aa67c3068`. Rule list: `[]` (Enabled: `True`). {{(pid=87934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:35:41.379921 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.fernet_utils [None req-f2fe8213-e2af-4648-964f-055f61b619e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:35:41.393552 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a19fd7-1516-4bf2-af64-703c544fbaeb None admin] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:35:41.463702 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c89f8e-dcff-449c-8276-1ccb05e7add8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:35:41.464436 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG dbcounter [-] [87934] Writing DB stats keystone:SELECT=100 {{(pid=87934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:35:41.464545 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c89f8e-dcff-449c-8276-1ccb05e7add8 None admin] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:35:41.464740 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c89f8e-dcff-449c-8276-1ccb05e7add8 None admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:35:41.464989 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c89f8e-dcff-449c-8276-1ccb05e7add8 None admin] PATH_INFO: `/v3/groups/e392f0a270074d3ea54b38df964ba25f` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:35:41.469091 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c89f8e-dcff-449c-8276-1ccb05e7add8 None admin] RBAC: Authorizing `identity:get_group(group_id=e392f0a270074d3ea54b38df964ba25f)` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:35:41.470637 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c89f8e-dcff-449c-8276-1ccb05e7add8 None admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:35:41.472850 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 178/360] 10.222.0.25 () {56 vars in 1180 bytes} [Tue Sep 13 19:35:41 2022] GET /identity/v3/groups/e392f0a270074d3ea54b38df964ba25f => generated 226 bytes in 291 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:35:41.473787 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c89f8e-dcff-449c-8276-1ccb05e7add8 None admin] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:35:41.504851 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 183/361] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Sep 13 19:35:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 19:35:41.505723 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2fe8213-e2af-4648-964f-055f61b619e5 None None] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:35:41.637761 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2fe8213-e2af-4648-964f-055f61b619e5 None None] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:35:41.650695 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG dbcounter [-] [87935] Writing DB stats keystone:SELECT=100 {{(pid=87935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:35:41.659980 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c89f8e-dcff-449c-8276-1ccb05e7add8 None admin] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:35:41.692266 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e991fb-311d-4212-b0bd-1d1580f60cb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:35:41.692266 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e991fb-311d-4212-b0bd-1d1580f60cb6 None admin] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:35:41.692266 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e991fb-311d-4212-b0bd-1d1580f60cb6 None admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:35:41.692266 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e991fb-311d-4212-b0bd-1d1580f60cb6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:35:41.693034 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e991fb-311d-4212-b0bd-1d1580f60cb6 None admin] RBAC: Adding query filter params (group.id=e392f0a270074d3ea54b38df964ba25f, role.id=8af3d83a03144ae8bacdb82d9a108110, scope.project.id=8aefa5062b7b4e4390554359e5669a9b) {{(pid=87934) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:35:41.693034 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e991fb-311d-4212-b0bd-1d1580f60cb6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:35:41.693034 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e991fb-311d-4212-b0bd-1d1580f60cb6 None admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:35:41.694880 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 184/362] 10.222.0.25 () {56 vars in 1376 bytes} [Tue Sep 13 19:35:41 2022] GET /identity/v3/role_assignments?group.id=e392f0a270074d3ea54b38df964ba25f&scope.project.id=8aefa5062b7b4e4390554359e5669a9b&role.id=8af3d83a03144ae8bacdb82d9a108110 => generated 260 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:35:41.696134 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c240aaf7-a4df-452b-b250-dd16708bcacb None None] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:35:41.696442 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c240aaf7-a4df-452b-b250-dd16708bcacb None None] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:35:41.696833 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c240aaf7-a4df-452b-b250-dd16708bcacb None None] PATH_INFO: `/` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:35:41.698175 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 185/363] 10.222.0.25 () {54 vars in 927 bytes} [Tue Sep 13 19:35:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:35:41.706119 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec128f3-6366-4af8-8796-67e0cf33b960 None None] REQUEST_METHOD: `POST` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:35:41.706488 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec128f3-6366-4af8-8796-67e0cf33b960 None None] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:35:41.706862 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec128f3-6366-4af8-8796-67e0cf33b960 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:35:41.720453 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99089e4b-4517-46df-9a1e-64b39012ec33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:35:41.721434 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99089e4b-4517-46df-9a1e-64b39012ec33 None admin] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:35:41.721867 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99089e4b-4517-46df-9a1e-64b39012ec33 None admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:35:41.722374 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99089e4b-4517-46df-9a1e-64b39012ec33 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:35:41.742176 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.auth.core [None req-4ec128f3-6366-4af8-8796-67e0cf33b960 None None] MFA Rules not processed for user `7b0aed92d02344acb92a0e4aa67c3068`. Rule list: `[]` (Enabled: `True`). {{(pid=87934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:35:41.743500 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.fernet_utils [None req-4ec128f3-6366-4af8-8796-67e0cf33b960 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:35:41.805108 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG dbcounter [-] [87934] Writing DB stats keystone:SELECT=100 {{(pid=87934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:35:41.831122 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99089e4b-4517-46df-9a1e-64b39012ec33 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:35:41.834720 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99089e4b-4517-46df-9a1e-64b39012ec33 None admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:35:41.868048 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 186/364] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Sep 13 19:35:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 13 19:35:41.916992 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec128f3-6366-4af8-8796-67e0cf33b960 None None] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:35:41.961143 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG dbcounter [-] [87935] Writing DB stats keystone:SELECT=100 {{(pid=87935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:35:41.971455 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 179/365] 10.222.0.25 () {58 vars in 1282 bytes} [Tue Sep 13 19:35:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 498 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 13 19:35:41.972877 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99089e4b-4517-46df-9a1e-64b39012ec33 None admin] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:35:42.041013 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec128f3-6366-4af8-8796-67e0cf33b960 None None] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:35:42.084047 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7549f061-184c-4073-a412-987ecc81cceb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:35:42.085202 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7549f061-184c-4073-a412-987ecc81cceb None admin] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:35:42.085485 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7549f061-184c-4073-a412-987ecc81cceb None admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:35:42.085756 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7549f061-184c-4073-a412-987ecc81cceb None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:35:42.095748 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99089e4b-4517-46df-9a1e-64b39012ec33 None admin] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:35:42.100803 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7549f061-184c-4073-a412-987ecc81cceb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 19:35:42.110171 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application [None req-7549f061-184c-4073-a412-987ecc81cceb None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 13 19:35:42.110171 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:35:42.110171 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:35:42.110171 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:35:42.110171 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:35:42.110171 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:35:42.110171 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:35:42.110171 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:35:42.110171 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:35:42.110171 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:35:42.110171 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:35:42.110171 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:35:42.110171 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 19:35:42.110171 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 19:35:42.110171 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 19:35:42.110171 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 19:35:42.111131 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 19:35:42.111131 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 19:35:42.111131 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 19:35:42.111131 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 19:35:42.111131 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:35:42.111131 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:35:42.111131 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:35:42.111131 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:35:42.111131 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:35:42.111131 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:35:42.111131 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:35:42.111131 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application with Lock( Sep 13 19:35:42.111131 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:35:42.111131 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:35:42.111131 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:35:42.111131 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:35:42.111929 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:35:42.111929 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:35:42.111929 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:35:42.111929 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:35:42.111929 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 19:35:42.111929 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 19:35:42.111929 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 19:35:42.111929 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 19:35:42.111929 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 19:35:42.111929 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 19:35:42.111929 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 13 19:35:42.111929 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application Sep 13 19:35:42.111929 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 187/366] 10.222.0.25 () {56 vars in 1114 bytes} [Tue Sep 13 19:35:41 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:35:42.119585 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7549f061-184c-4073-a412-987ecc81cceb None admin] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:35:42.149497 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d2e20f-5ea7-4be2-92ad-9df016ac0e68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:35:42.150876 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d2e20f-5ea7-4be2-92ad-9df016ac0e68 None admin] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:35:42.152980 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d2e20f-5ea7-4be2-92ad-9df016ac0e68 None admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:35:42.153856 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d2e20f-5ea7-4be2-92ad-9df016ac0e68 None admin] PATH_INFO: `/v3/projects/93e1f3226d564df686b8ca37cfd3a42c` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:35:42.156324 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d2e20f-5ea7-4be2-92ad-9df016ac0e68 None admin] RBAC: Authorizing `identity:get_project(project_id=93e1f3226d564df686b8ca37cfd3a42c)` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:35:42.158125 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d2e20f-5ea7-4be2-92ad-9df016ac0e68 None admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:35:42.160344 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 180/367] 10.222.0.25 () {56 vars in 1186 bytes} [Tue Sep 13 19:35:41 2022] GET /identity/v3/projects/93e1f3226d564df686b8ca37cfd3a42c => generated 302 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:35:42.164637 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG dbcounter [-] [87934] Writing DB stats keystone:SELECT=100 {{(pid=87934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:35:42.168522 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d2e20f-5ea7-4be2-92ad-9df016ac0e68 None admin] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:35:42.261168 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7549f061-184c-4073-a412-987ecc81cceb None admin] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:35:42.268705 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG dbcounter [-] [87935] Writing DB stats keystone:SELECT=100 {{(pid=87935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:35:42.316105 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59014769-3380-46c1-b90f-6dd27bc87437 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:35:42.317037 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59014769-3380-46c1-b90f-6dd27bc87437 None admin] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:35:42.317465 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59014769-3380-46c1-b90f-6dd27bc87437 None admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:35:42.317880 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59014769-3380-46c1-b90f-6dd27bc87437 None admin] PATH_INFO: `/v3/roles` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:35:42.318982 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59014769-3380-46c1-b90f-6dd27bc87437 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=87934) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:35:42.319520 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59014769-3380-46c1-b90f-6dd27bc87437 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:35:42.321125 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59014769-3380-46c1-b90f-6dd27bc87437 None admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:35:42.332470 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d2e20f-5ea7-4be2-92ad-9df016ac0e68 None admin] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:35:42.337509 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 188/368] 10.222.0.25 () {56 vars in 1111 bytes} [Tue Sep 13 19:35:42 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:35:42.358173 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59014769-3380-46c1-b90f-6dd27bc87437 None admin] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:35:42.378280 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5945cb4c-aed5-40eb-8f8f-9930449a951b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:35:42.379263 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5945cb4c-aed5-40eb-8f8f-9930449a951b None admin] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:35:42.379263 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5945cb4c-aed5-40eb-8f8f-9930449a951b None admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:35:42.379543 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5945cb4c-aed5-40eb-8f8f-9930449a951b None admin] PATH_INFO: `/v3/groups/e392f0a270074d3ea54b38df964ba25f` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:35:42.382969 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5945cb4c-aed5-40eb-8f8f-9930449a951b None admin] RBAC: Authorizing `identity:get_group(group_id=e392f0a270074d3ea54b38df964ba25f)` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:35:42.384598 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5945cb4c-aed5-40eb-8f8f-9930449a951b None admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:35:42.386603 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 181/369] 10.222.0.25 () {56 vars in 1180 bytes} [Tue Sep 13 19:35:42 2022] GET /identity/v3/groups/e392f0a270074d3ea54b38df964ba25f => generated 226 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:35:42.402105 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5945cb4c-aed5-40eb-8f8f-9930449a951b None admin] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:35:42.497277 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG dbcounter [-] [87934] Writing DB stats keystone:SELECT=100 {{(pid=87934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:35:42.505392 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59014769-3380-46c1-b90f-6dd27bc87437 None admin] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:35:42.554359 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5945cb4c-aed5-40eb-8f8f-9930449a951b None admin] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:35:42.555058 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f445f8a-5eb1-479a-bab8-da7d4ad4ee8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:35:42.555950 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f445f8a-5eb1-479a-bab8-da7d4ad4ee8d None admin] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:35:42.556525 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f445f8a-5eb1-479a-bab8-da7d4ad4ee8d None admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:35:42.557882 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f445f8a-5eb1-479a-bab8-da7d4ad4ee8d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:35:42.609140 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5613ac8-571b-4724-b779-da531e55fc06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:35:42.609140 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5613ac8-571b-4724-b779-da531e55fc06 None admin] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:35:42.609646 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5613ac8-571b-4724-b779-da531e55fc06 None admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:35:42.610354 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5613ac8-571b-4724-b779-da531e55fc06 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:35:42.611278 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5613ac8-571b-4724-b779-da531e55fc06 None admin] RBAC: Adding query filter params (group.id=e392f0a270074d3ea54b38df964ba25f, role.id=a259191f6d0e46fabd9f34536bb28747, scope.project.id=93e1f3226d564df686b8ca37cfd3a42c) {{(pid=87935) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:35:42.611278 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5613ac8-571b-4724-b779-da531e55fc06 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:35:42.612934 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5613ac8-571b-4724-b779-da531e55fc06 None admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:35:42.615683 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG dbcounter [-] [87935] Writing DB stats keystone:SELECT=100 {{(pid=87935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:35:42.623599 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 182/370] 10.222.0.25 () {56 vars in 1376 bytes} [Tue Sep 13 19:35:42 2022] GET /identity/v3/role_assignments?group.id=e392f0a270074d3ea54b38df964ba25f&scope.project.id=93e1f3226d564df686b8ca37cfd3a42c&role.id=a259191f6d0e46fabd9f34536bb28747 => generated 260 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:35:42.624894 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5613ac8-571b-4724-b779-da531e55fc06 None admin] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:35:42.689483 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f445f8a-5eb1-479a-bab8-da7d4ad4ee8d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:35:42.691938 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f445f8a-5eb1-479a-bab8-da7d4ad4ee8d None admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:35:42.782691 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5613ac8-571b-4724-b779-da531e55fc06 None admin] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:35:42.837891 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be4b654-8ed8-4725-a923-cc65862e07cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:35:42.838921 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be4b654-8ed8-4725-a923-cc65862e07cb None admin] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:35:42.839440 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be4b654-8ed8-4725-a923-cc65862e07cb None admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:35:42.839951 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be4b654-8ed8-4725-a923-cc65862e07cb None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:35:42.854109 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be4b654-8ed8-4725-a923-cc65862e07cb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 19:35:42.855187 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 189/371] 10.222.0.25 () {58 vars in 1282 bytes} [Tue Sep 13 19:35:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 497 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 13 19:35:42.855629 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG dbcounter [-] [87934] Writing DB stats keystone:SELECT=100 {{(pid=87934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:35:42.862050 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application [None req-7be4b654-8ed8-4725-a923-cc65862e07cb None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 19:35:42.862050 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:35:42.862050 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:35:42.862050 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:35:42.862050 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:35:42.862050 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:35:42.862050 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:35:42.862050 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:35:42.862050 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:35:42.862050 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:35:42.862050 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:35:42.862050 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:35:42.862050 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 19:35:42.862050 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 19:35:42.862050 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 19:35:42.862050 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 19:35:42.863097 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 19:35:42.863097 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 19:35:42.863097 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 19:35:42.863097 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 19:35:42.863097 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:35:42.863097 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:35:42.863097 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:35:42.863097 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:35:42.863097 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:35:42.863097 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:35:42.863097 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:35:42.863097 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application with Lock( Sep 13 19:35:42.863097 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:35:42.863097 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:35:42.863097 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:35:42.863097 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:35:42.863922 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:35:42.863922 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:35:42.863922 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:35:42.863922 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:35:42.863922 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 19:35:42.863922 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 19:35:42.863922 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 19:35:42.863922 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 19:35:42.863922 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 19:35:42.863922 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 19:35:42.863922 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 19:35:42.863922 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application Sep 13 19:35:42.864568 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f445f8a-5eb1-479a-bab8-da7d4ad4ee8d None admin] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:35:42.869193 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 183/372] 10.222.0.25 () {56 vars in 1096 bytes} [Tue Sep 13 19:35:42 2022] GET /identity/v3/roles/admin => generated 83 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:35:42.887253 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be4b654-8ed8-4725-a923-cc65862e07cb None admin] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:35:43.007196 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG dbcounter [-] [87935] Writing DB stats keystone:SELECT=100 {{(pid=87935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:35:43.020773 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f445f8a-5eb1-479a-bab8-da7d4ad4ee8d None admin] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:35:43.085066 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d9fbee-0ff8-4d1c-ba4a-574aea0c89a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:35:43.085663 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d9fbee-0ff8-4d1c-ba4a-574aea0c89a4 None admin] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:35:43.085935 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d9fbee-0ff8-4d1c-ba4a-574aea0c89a4 None admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:35:43.086202 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d9fbee-0ff8-4d1c-ba4a-574aea0c89a4 None admin] PATH_INFO: `/v3/projects/93e1f3226d564df686b8ca37cfd3a42c` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:35:43.090428 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d9fbee-0ff8-4d1c-ba4a-574aea0c89a4 None admin] RBAC: Authorizing `identity:get_project(project_id=93e1f3226d564df686b8ca37cfd3a42c)` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:35:43.092394 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d9fbee-0ff8-4d1c-ba4a-574aea0c89a4 None admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:35:43.094423 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 190/373] 10.222.0.25 () {56 vars in 1186 bytes} [Tue Sep 13 19:35:42 2022] GET /identity/v3/projects/93e1f3226d564df686b8ca37cfd3a42c => generated 302 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:35:43.100026 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d9fbee-0ff8-4d1c-ba4a-574aea0c89a4 None admin] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:35:43.118231 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be4b654-8ed8-4725-a923-cc65862e07cb None admin] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:35:43.189694 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49829950-aa23-40e2-9326-c64783d4973e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:35:43.190435 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49829950-aa23-40e2-9326-c64783d4973e None admin] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:35:43.190712 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49829950-aa23-40e2-9326-c64783d4973e None admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:35:43.190982 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49829950-aa23-40e2-9326-c64783d4973e None admin] PATH_INFO: `/v3/roles` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:35:43.191656 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49829950-aa23-40e2-9326-c64783d4973e None admin] RBAC: Adding query filter params (name=admin) {{(pid=87935) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:35:43.191958 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49829950-aa23-40e2-9326-c64783d4973e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:35:43.193625 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49829950-aa23-40e2-9326-c64783d4973e None admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:35:43.205057 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG dbcounter [-] [87934] Writing DB stats keystone:SELECT=100 {{(pid=87934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:35:43.208763 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 184/374] 10.222.0.25 () {56 vars in 1099 bytes} [Tue Sep 13 19:35:42 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 322 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 19:35:43.216963 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49829950-aa23-40e2-9326-c64783d4973e None admin] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:35:43.277163 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d9fbee-0ff8-4d1c-ba4a-574aea0c89a4 None admin] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:35:43.357935 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d12d81-664f-497c-9627-81c6abad5e76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:35:43.358504 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d12d81-664f-497c-9627-81c6abad5e76 None admin] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:35:43.358779 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d12d81-664f-497c-9627-81c6abad5e76 None admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:35:43.359044 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d12d81-664f-497c-9627-81c6abad5e76 None admin] PATH_INFO: `/v3/groups/e392f0a270074d3ea54b38df964ba25f` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:35:43.362796 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d12d81-664f-497c-9627-81c6abad5e76 None admin] RBAC: Authorizing `identity:get_group(group_id=e392f0a270074d3ea54b38df964ba25f)` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:35:43.364275 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d12d81-664f-497c-9627-81c6abad5e76 None admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:35:43.367741 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 191/375] 10.222.0.25 () {56 vars in 1180 bytes} [Tue Sep 13 19:35:43 2022] GET /identity/v3/groups/e392f0a270074d3ea54b38df964ba25f => generated 226 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:35:43.374039 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d12d81-664f-497c-9627-81c6abad5e76 None admin] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:35:43.451353 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49829950-aa23-40e2-9326-c64783d4973e None admin] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:35:43.499963 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG dbcounter [-] [87935] Writing DB stats keystone:SELECT=100 {{(pid=87935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:35:43.531409 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e430aa-47ba-4102-8d2e-0630e5e8c67d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:35:43.532075 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e430aa-47ba-4102-8d2e-0630e5e8c67d None admin] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:35:43.532428 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e430aa-47ba-4102-8d2e-0630e5e8c67d None admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:35:43.532759 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e430aa-47ba-4102-8d2e-0630e5e8c67d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:35:43.583574 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d12d81-664f-497c-9627-81c6abad5e76 None admin] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:35:43.652319 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e430aa-47ba-4102-8d2e-0630e5e8c67d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:35:43.652319 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e430aa-47ba-4102-8d2e-0630e5e8c67d None admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:35:43.660896 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG dbcounter [-] [87934] Writing DB stats keystone:SELECT=100 {{(pid=87934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:35:43.704949 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4660ef09-fbc0-433b-a740-bae281397584 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:35:43.705743 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4660ef09-fbc0-433b-a740-bae281397584 None admin] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:35:43.706027 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4660ef09-fbc0-433b-a740-bae281397584 None admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:35:43.706373 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4660ef09-fbc0-433b-a740-bae281397584 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:35:43.707495 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4660ef09-fbc0-433b-a740-bae281397584 None admin] RBAC: Adding query filter params (group.id=e392f0a270074d3ea54b38df964ba25f, role.id=8af3d83a03144ae8bacdb82d9a108110, scope.project.id=93e1f3226d564df686b8ca37cfd3a42c) {{(pid=87934) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:35:43.707990 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4660ef09-fbc0-433b-a740-bae281397584 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:35:43.710762 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4660ef09-fbc0-433b-a740-bae281397584 None admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:35:43.738361 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 192/376] 10.222.0.25 () {56 vars in 1376 bytes} [Tue Sep 13 19:35:43 2022] GET /identity/v3/role_assignments?group.id=e392f0a270074d3ea54b38df964ba25f&scope.project.id=93e1f3226d564df686b8ca37cfd3a42c&role.id=8af3d83a03144ae8bacdb82d9a108110 => generated 260 bytes in 365 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 19:35:43.846819 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 185/377] 10.222.0.25 () {58 vars in 1282 bytes} [Tue Sep 13 19:35:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 627 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 13 19:35:43.848337 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4660ef09-fbc0-433b-a740-bae281397584 None admin] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:35:43.985351 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4660ef09-fbc0-433b-a740-bae281397584 None admin] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:35:44.045982 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13089b1-fe8d-410c-b476-58c09be2ff62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:35:44.046648 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13089b1-fe8d-410c-b476-58c09be2ff62 None admin] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:35:44.046933 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13089b1-fe8d-410c-b476-58c09be2ff62 None admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:35:44.047778 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13089b1-fe8d-410c-b476-58c09be2ff62 None admin] PATH_INFO: `/v3/projects/455c35cf3f4241039d612c7710aac324` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:35:44.050681 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c13089b1-fe8d-410c-b476-58c09be2ff62 None admin] RBAC: Authorizing `identity:get_project(project_id=455c35cf3f4241039d612c7710aac324)` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:35:44.052138 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c13089b1-fe8d-410c-b476-58c09be2ff62 None admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:35:44.053930 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 193/378] 10.222.0.25 () {56 vars in 1186 bytes} [Tue Sep 13 19:35:43 2022] GET /identity/v3/projects/455c35cf3f4241039d612c7710aac324 => generated 344 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:35:44.065117 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e430aa-47ba-4102-8d2e-0630e5e8c67d None admin] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:35:44.122748 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG dbcounter [-] [87935] Writing DB stats keystone:SELECT=100 {{(pid=87935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:35:44.291350 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e430aa-47ba-4102-8d2e-0630e5e8c67d None admin] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:35:44.343430 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6011d827-166d-44d7-8e3f-d1c320560e2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:35:44.344080 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6011d827-166d-44d7-8e3f-d1c320560e2a None admin] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:35:44.344391 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6011d827-166d-44d7-8e3f-d1c320560e2a None admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:35:44.344672 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6011d827-166d-44d7-8e3f-d1c320560e2a None admin] PATH_INFO: `/v3/groups/62f5f12c6f674fd4b2b04fe72d64489d` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:35:44.356951 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6011d827-166d-44d7-8e3f-d1c320560e2a None admin] RBAC: Authorizing `identity:get_group(group_id=62f5f12c6f674fd4b2b04fe72d64489d)` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:35:44.359105 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6011d827-166d-44d7-8e3f-d1c320560e2a None admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:35:44.362737 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 186/379] 10.222.0.25 () {56 vars in 1180 bytes} [Tue Sep 13 19:35:44 2022] GET /identity/v3/groups/62f5f12c6f674fd4b2b04fe72d64489d => generated 229 bytes in 298 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:35:44.370912 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13089b1-fe8d-410c-b476-58c09be2ff62 None admin] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:35:44.468962 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG dbcounter [-] [87934] Writing DB stats keystone:SELECT=100 {{(pid=87934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:35:44.522426 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13089b1-fe8d-410c-b476-58c09be2ff62 None admin] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:35:44.567533 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a93de98-e5e2-4b1d-b590-443467034dd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:35:44.568082 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a93de98-e5e2-4b1d-b590-443467034dd1 None admin] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:35:44.568932 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a93de98-e5e2-4b1d-b590-443467034dd1 None admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:35:44.569391 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a93de98-e5e2-4b1d-b590-443467034dd1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:35:44.570129 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a93de98-e5e2-4b1d-b590-443467034dd1 None admin] RBAC: Adding query filter params (group.id=62f5f12c6f674fd4b2b04fe72d64489d, role.id=6ca1d4427ff64e0a9d25d96cfb1445f6, scope.project.id=455c35cf3f4241039d612c7710aac324) {{(pid=87934) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:35:44.570432 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a93de98-e5e2-4b1d-b590-443467034dd1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:35:44.571879 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a93de98-e5e2-4b1d-b590-443467034dd1 None admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:35:44.578050 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 194/380] 10.222.0.25 () {56 vars in 1376 bytes} [Tue Sep 13 19:35:44 2022] GET /identity/v3/role_assignments?group.id=62f5f12c6f674fd4b2b04fe72d64489d&scope.project.id=455c35cf3f4241039d612c7710aac324&role.id=6ca1d4427ff64e0a9d25d96cfb1445f6 => generated 260 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:35:44.615945 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5cc0ac-1191-453d-9d23-ed2cbeedef26 None None] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:35:44.616480 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5cc0ac-1191-453d-9d23-ed2cbeedef26 None None] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:35:44.616984 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5cc0ac-1191-453d-9d23-ed2cbeedef26 None None] PATH_INFO: `/` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:35:44.619527 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 187/381] 10.222.0.25 () {54 vars in 927 bytes} [Tue Sep 13 19:35:44 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:35:44.625244 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0a8b8a-f970-4640-abd1-068400110731 None None] REQUEST_METHOD: `POST` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:35:44.625532 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0a8b8a-f970-4640-abd1-068400110731 None None] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:35:44.625789 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0a8b8a-f970-4640-abd1-068400110731 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:35:44.654489 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.auth.core [None req-6a0a8b8a-f970-4640-abd1-068400110731 None None] MFA Rules not processed for user `7b0aed92d02344acb92a0e4aa67c3068`. Rule list: `[]` (Enabled: `True`). {{(pid=87934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:35:44.655724 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.fernet_utils [None req-6a0a8b8a-f970-4640-abd1-068400110731 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:35:44.751841 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 195/382] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Sep 13 19:35:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 19:35:44.817146 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a737140d-f65a-43b8-8b40-26a47821b760 None None] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:35:44.817146 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a737140d-f65a-43b8-8b40-26a47821b760 None None] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:35:44.817146 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a737140d-f65a-43b8-8b40-26a47821b760 None None] PATH_INFO: `/` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:35:44.817867 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 188/383] 10.222.0.25 () {54 vars in 927 bytes} [Tue Sep 13 19:35:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:35:44.824376 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ec6d25-649e-4a92-bad9-a33fa8154696 None None] REQUEST_METHOD: `POST` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:35:44.824983 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ec6d25-649e-4a92-bad9-a33fa8154696 None None] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:35:44.825471 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ec6d25-649e-4a92-bad9-a33fa8154696 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:35:44.850502 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.auth.core [None req-e7ec6d25-649e-4a92-bad9-a33fa8154696 None None] MFA Rules not processed for user `7b0aed92d02344acb92a0e4aa67c3068`. Rule list: `[]` (Enabled: `True`). {{(pid=87934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:35:44.852145 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.fernet_utils [None req-e7ec6d25-649e-4a92-bad9-a33fa8154696 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:35:44.926981 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG dbcounter [-] [87934] Writing DB stats keystone:SELECT=100 {{(pid=87934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:35:44.958707 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 196/384] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Sep 13 19:35:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 19:35:45.241760 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a737140d-f65a-43b8-8b40-26a47821b760 None None] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:35:45.362298 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG dbcounter [-] [87935] Writing DB stats keystone:SELECT=100 {{(pid=87935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:35:45.376556 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ec6d25-649e-4a92-bad9-a33fa8154696 None None] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:35:45.384486 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a737140d-f65a-43b8-8b40-26a47821b760 None None] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:35:45.431250 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb83f3e-5da8-4612-a75f-422c2f13baa4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:35:45.431899 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb83f3e-5da8-4612-a75f-422c2f13baa4 None admin] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:35:45.432174 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb83f3e-5da8-4612-a75f-422c2f13baa4 None admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:35:45.432466 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb83f3e-5da8-4612-a75f-422c2f13baa4 None admin] PATH_INFO: `/v3/roles/member` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:35:45.470137 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb83f3e-5da8-4612-a75f-422c2f13baa4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 19:35:45.475656 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application [None req-edb83f3e-5da8-4612-a75f-422c2f13baa4 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 13 19:35:45.475656 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:35:45.475656 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:35:45.475656 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:35:45.475656 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:35:45.475656 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:35:45.475656 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:35:45.475656 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:35:45.475656 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:35:45.475656 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:35:45.475656 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:35:45.475656 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:35:45.475656 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 19:35:45.475656 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 19:35:45.475656 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 19:35:45.475656 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 19:35:45.476665 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 19:35:45.476665 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 19:35:45.476665 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 19:35:45.476665 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 19:35:45.476665 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:35:45.476665 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:35:45.476665 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:35:45.476665 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:35:45.476665 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:35:45.476665 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:35:45.476665 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:35:45.476665 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application with Lock( Sep 13 19:35:45.476665 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:35:45.476665 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:35:45.476665 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:35:45.476665 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:35:45.477856 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:35:45.477856 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:35:45.477856 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:35:45.477856 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:35:45.477856 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 19:35:45.477856 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 19:35:45.477856 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 19:35:45.477856 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 19:35:45.477856 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 19:35:45.477856 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 19:35:45.477856 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 13 19:35:45.477856 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application Sep 13 19:35:45.477856 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 189/385] 10.222.0.25 () {56 vars in 1099 bytes} [Tue Sep 13 19:35:45 2022] GET /identity/v3/roles/member => generated 84 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:35:45.502368 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb83f3e-5da8-4612-a75f-422c2f13baa4 None admin] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:35:45.572883 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ec6d25-649e-4a92-bad9-a33fa8154696 None None] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:35:45.621839 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787b2f6a-2262-4fcf-ba8e-8dea49068bf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:35:45.622820 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787b2f6a-2262-4fcf-ba8e-8dea49068bf2 None admin] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:35:45.623247 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787b2f6a-2262-4fcf-ba8e-8dea49068bf2 None admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:35:45.623762 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787b2f6a-2262-4fcf-ba8e-8dea49068bf2 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:35:45.644371 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-787b2f6a-2262-4fcf-ba8e-8dea49068bf2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 19:35:45.650488 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application [None req-787b2f6a-2262-4fcf-ba8e-8dea49068bf2 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 13 19:35:45.650488 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:35:45.650488 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:35:45.650488 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:35:45.650488 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:35:45.650488 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:35:45.650488 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:35:45.650488 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:35:45.650488 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:35:45.650488 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:35:45.650488 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:35:45.650488 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:35:45.650488 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 19:35:45.650488 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 19:35:45.650488 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 19:35:45.650488 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 19:35:45.651609 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 19:35:45.651609 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 19:35:45.651609 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 19:35:45.651609 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 19:35:45.651609 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:35:45.651609 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:35:45.651609 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:35:45.651609 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:35:45.651609 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:35:45.651609 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:35:45.651609 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:35:45.651609 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application with Lock( Sep 13 19:35:45.651609 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:35:45.651609 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:35:45.651609 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:35:45.651609 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:35:45.652471 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:35:45.652471 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:35:45.652471 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:35:45.652471 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:35:45.652471 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 19:35:45.652471 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 19:35:45.652471 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 19:35:45.652471 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 19:35:45.652471 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 19:35:45.652471 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 19:35:45.652471 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 13 19:35:45.652471 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application Sep 13 19:35:45.654991 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 197/386] 10.222.0.25 () {56 vars in 1114 bytes} [Tue Sep 13 19:35:45 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 279 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:35:45.661332 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787b2f6a-2262-4fcf-ba8e-8dea49068bf2 None admin] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:35:45.699822 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb83f3e-5da8-4612-a75f-422c2f13baa4 None admin] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:35:45.720734 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG dbcounter [-] [87934] Writing DB stats keystone:SELECT=100 {{(pid=87934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:35:45.772410 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4961a11d-8f81-495a-8412-aff6fdcebd83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:35:45.773257 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4961a11d-8f81-495a-8412-aff6fdcebd83 None admin] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:35:45.773698 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4961a11d-8f81-495a-8412-aff6fdcebd83 None admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:35:45.774113 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4961a11d-8f81-495a-8412-aff6fdcebd83 None admin] PATH_INFO: `/v3/roles` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:35:45.775046 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4961a11d-8f81-495a-8412-aff6fdcebd83 None admin] RBAC: Adding query filter params (name=member) {{(pid=87935) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:35:45.775496 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4961a11d-8f81-495a-8412-aff6fdcebd83 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:35:45.784238 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4961a11d-8f81-495a-8412-aff6fdcebd83 None admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:35:45.788620 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787b2f6a-2262-4fcf-ba8e-8dea49068bf2 None admin] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:35:45.798350 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 190/387] 10.222.0.25 () {56 vars in 1101 bytes} [Tue Sep 13 19:35:45 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 296 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 19:35:45.805272 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4961a11d-8f81-495a-8412-aff6fdcebd83 None admin] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:35:45.820247 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG dbcounter [-] [87935] Writing DB stats keystone:SELECT=100 {{(pid=87935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:35:45.848324 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0601e359-8b19-4fa4-95b0-3fccaaeeda2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:35:45.849346 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0601e359-8b19-4fa4-95b0-3fccaaeeda2e None admin] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:35:45.850560 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0601e359-8b19-4fa4-95b0-3fccaaeeda2e None admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:35:45.851287 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0601e359-8b19-4fa4-95b0-3fccaaeeda2e None admin] PATH_INFO: `/v3/roles` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:35:45.852183 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0601e359-8b19-4fa4-95b0-3fccaaeeda2e None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=87934) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:35:45.852664 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0601e359-8b19-4fa4-95b0-3fccaaeeda2e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:35:45.854256 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0601e359-8b19-4fa4-95b0-3fccaaeeda2e None admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:35:45.867617 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 198/388] 10.222.0.25 () {56 vars in 1111 bytes} [Tue Sep 13 19:35:45 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:35:45.874369 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0601e359-8b19-4fa4-95b0-3fccaaeeda2e None admin] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:35:46.024462 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4961a11d-8f81-495a-8412-aff6fdcebd83 None admin] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:35:46.091386 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2008830b-4d2c-4ebe-a474-23e71becb019 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:35:46.092034 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2008830b-4d2c-4ebe-a474-23e71becb019 None admin] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:35:46.092356 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2008830b-4d2c-4ebe-a474-23e71becb019 None admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:35:46.092625 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2008830b-4d2c-4ebe-a474-23e71becb019 None admin] PATH_INFO: `/v3/groups/e392f0a270074d3ea54b38df964ba25f` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:35:46.094397 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2008830b-4d2c-4ebe-a474-23e71becb019 None admin] RBAC: Authorizing `identity:get_group(group_id=e392f0a270074d3ea54b38df964ba25f)` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:35:46.095900 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2008830b-4d2c-4ebe-a474-23e71becb019 None admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:35:46.099386 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0601e359-8b19-4fa4-95b0-3fccaaeeda2e None admin] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:35:46.101952 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 191/389] 10.222.0.25 () {56 vars in 1180 bytes} [Tue Sep 13 19:35:45 2022] GET /identity/v3/groups/e392f0a270074d3ea54b38df964ba25f => generated 226 bytes in 297 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 19:35:46.104681 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2008830b-4d2c-4ebe-a474-23e71becb019 None admin] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:35:46.120599 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG dbcounter [-] [87934] Writing DB stats keystone:SELECT=100 {{(pid=87934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:35:46.179472 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffddfe36-4f2e-4ff6-9927-5c102feb6e69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:35:46.180134 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffddfe36-4f2e-4ff6-9927-5c102feb6e69 None admin] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:35:46.180458 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffddfe36-4f2e-4ff6-9927-5c102feb6e69 None admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:35:46.180733 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffddfe36-4f2e-4ff6-9927-5c102feb6e69 None admin] PATH_INFO: `/v3/groups/e392f0a270074d3ea54b38df964ba25f` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:35:46.184963 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffddfe36-4f2e-4ff6-9927-5c102feb6e69 None admin] RBAC: Authorizing `identity:get_group(group_id=e392f0a270074d3ea54b38df964ba25f)` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:35:46.186444 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffddfe36-4f2e-4ff6-9927-5c102feb6e69 None admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:35:46.188114 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 199/390] 10.222.0.25 () {56 vars in 1180 bytes} [Tue Sep 13 19:35:45 2022] GET /identity/v3/groups/e392f0a270074d3ea54b38df964ba25f => generated 226 bytes in 314 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 19:35:46.194559 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffddfe36-4f2e-4ff6-9927-5c102feb6e69 None admin] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:35:46.232590 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG dbcounter [-] [87935] Writing DB stats keystone:SELECT=100 {{(pid=87935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:35:46.266071 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2008830b-4d2c-4ebe-a474-23e71becb019 None admin] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:35:46.310678 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6817260b-ee9e-4cce-b3e1-f7c80bdef204 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:35:46.311588 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6817260b-ee9e-4cce-b3e1-f7c80bdef204 None admin] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:35:46.312005 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6817260b-ee9e-4cce-b3e1-f7c80bdef204 None admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:35:46.312446 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6817260b-ee9e-4cce-b3e1-f7c80bdef204 None admin] PATH_INFO: `/v3/projects/8aefa5062b7b4e4390554359e5669a9b` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:35:46.313975 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6817260b-ee9e-4cce-b3e1-f7c80bdef204 None admin] RBAC: Authorizing `identity:get_project(project_id=8aefa5062b7b4e4390554359e5669a9b)` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:35:46.315577 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6817260b-ee9e-4cce-b3e1-f7c80bdef204 None admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:35:46.317733 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 192/391] 10.222.0.25 () {56 vars in 1186 bytes} [Tue Sep 13 19:35:46 2022] GET /identity/v3/projects/8aefa5062b7b4e4390554359e5669a9b => generated 298 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:35:46.324246 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed9da28-749b-4f7e-817e-9f17f956e2f2 None None] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:35:46.324866 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed9da28-749b-4f7e-817e-9f17f956e2f2 None None] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:35:46.325317 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed9da28-749b-4f7e-817e-9f17f956e2f2 None None] PATH_INFO: `/` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:35:46.327177 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 193/392] 10.222.0.25 () {54 vars in 927 bytes} [Tue Sep 13 19:35:46 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:35:46.328108 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed9da28-749b-4f7e-817e-9f17f956e2f2 None None] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:35:46.333622 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffddfe36-4f2e-4ff6-9927-5c102feb6e69 None admin] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:35:46.375238 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab482599-9003-4a0c-b03a-3392af913f6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:35:46.375883 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab482599-9003-4a0c-b03a-3392af913f6c None admin] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:35:46.376293 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab482599-9003-4a0c-b03a-3392af913f6c None admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:35:46.376571 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab482599-9003-4a0c-b03a-3392af913f6c None admin] PATH_INFO: `/v3/projects/8aefa5062b7b4e4390554359e5669a9b` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:35:46.378060 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab482599-9003-4a0c-b03a-3392af913f6c None admin] RBAC: Authorizing `identity:get_project(project_id=8aefa5062b7b4e4390554359e5669a9b)` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:35:46.379427 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab482599-9003-4a0c-b03a-3392af913f6c None admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:35:46.382232 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 200/393] 10.222.0.25 () {56 vars in 1186 bytes} [Tue Sep 13 19:35:46 2022] GET /identity/v3/projects/8aefa5062b7b4e4390554359e5669a9b => generated 298 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 19:35:46.384868 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4773d59-051d-402f-9282-ecb60d9c16c9 None None] REQUEST_METHOD: `POST` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:35:46.384868 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4773d59-051d-402f-9282-ecb60d9c16c9 None None] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:35:46.384868 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4773d59-051d-402f-9282-ecb60d9c16c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:35:46.405274 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.auth.core [None req-e4773d59-051d-402f-9282-ecb60d9c16c9 None None] MFA Rules not processed for user `7b0aed92d02344acb92a0e4aa67c3068`. Rule list: `[]` (Enabled: `True`). {{(pid=87934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:35:46.406594 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.fernet_utils [None req-e4773d59-051d-402f-9282-ecb60d9c16c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:35:46.449182 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed9da28-749b-4f7e-817e-9f17f956e2f2 None None] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:35:46.456982 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG dbcounter [-] [87934] Writing DB stats keystone:SELECT=100 {{(pid=87934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:35:46.492772 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199da6ba-2b2f-4e47-9e9e-b69f1e119ab7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:35:46.493455 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199da6ba-2b2f-4e47-9e9e-b69f1e119ab7 None admin] REQUEST_METHOD: `PUT` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:35:46.493730 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199da6ba-2b2f-4e47-9e9e-b69f1e119ab7 None admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:35:46.493998 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199da6ba-2b2f-4e47-9e9e-b69f1e119ab7 None admin] PATH_INFO: `/v3/projects/8aefa5062b7b4e4390554359e5669a9b/groups/e392f0a270074d3ea54b38df964ba25f/roles/a259191f6d0e46fabd9f34536bb28747` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:35:46.496193 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 201/394] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Sep 13 19:35:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 19:35:46.496899 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4773d59-051d-402f-9282-ecb60d9c16c9 None None] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:35:46.498512 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-199da6ba-2b2f-4e47-9e9e-b69f1e119ab7 None admin] RBAC: Authorizing `identity:create_grant(project_id=8aefa5062b7b4e4390554359e5669a9b, group_id=e392f0a270074d3ea54b38df964ba25f, role_id=a259191f6d0e46fabd9f34536bb28747)` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:35:46.499973 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-199da6ba-2b2f-4e47-9e9e-b69f1e119ab7 None admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:35:46.518505 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 194/395] 10.222.0.25 () {58 vars in 1442 bytes} [Tue Sep 13 19:35:46 2022] PUT /identity/v3/projects/8aefa5062b7b4e4390554359e5669a9b/groups/e392f0a270074d3ea54b38df964ba25f/roles/a259191f6d0e46fabd9f34536bb28747 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 19:35:46.638877 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4773d59-051d-402f-9282-ecb60d9c16c9 None None] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:35:46.679495 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43c0ebe-68c0-4138-a782-19b89d21cd60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:35:46.680314 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43c0ebe-68c0-4138-a782-19b89d21cd60 None admin] REQUEST_METHOD: `PUT` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:35:46.680591 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43c0ebe-68c0-4138-a782-19b89d21cd60 None admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:35:46.680858 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43c0ebe-68c0-4138-a782-19b89d21cd60 None admin] PATH_INFO: `/v3/projects/8aefa5062b7b4e4390554359e5669a9b/groups/e392f0a270074d3ea54b38df964ba25f/roles/8af3d83a03144ae8bacdb82d9a108110` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:35:46.686373 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d43c0ebe-68c0-4138-a782-19b89d21cd60 None admin] RBAC: Authorizing `identity:create_grant(project_id=8aefa5062b7b4e4390554359e5669a9b, group_id=e392f0a270074d3ea54b38df964ba25f, role_id=8af3d83a03144ae8bacdb82d9a108110)` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:35:46.687845 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d43c0ebe-68c0-4138-a782-19b89d21cd60 None admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:35:46.707690 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 202/396] 10.222.0.25 () {58 vars in 1442 bytes} [Tue Sep 13 19:35:46 2022] PUT /identity/v3/projects/8aefa5062b7b4e4390554359e5669a9b/groups/e392f0a270074d3ea54b38df964ba25f/roles/8af3d83a03144ae8bacdb82d9a108110 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 19:35:46.880364 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199da6ba-2b2f-4e47-9e9e-b69f1e119ab7 None admin] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:35:46.884177 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG dbcounter [-] [87935] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:35:47.012963 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199da6ba-2b2f-4e47-9e9e-b69f1e119ab7 None admin] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:35:47.055142 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933e4c90-e951-4f57-99e3-bc8a94e27c27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:35:47.055798 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933e4c90-e951-4f57-99e3-bc8a94e27c27 None admin] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:35:47.056078 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933e4c90-e951-4f57-99e3-bc8a94e27c27 None admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:35:47.056400 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933e4c90-e951-4f57-99e3-bc8a94e27c27 None admin] PATH_INFO: `/v3/roles/member` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:35:47.073027 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-933e4c90-e951-4f57-99e3-bc8a94e27c27 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 19:35:47.078519 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application [None req-933e4c90-e951-4f57-99e3-bc8a94e27c27 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 13 19:35:47.078519 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:35:47.078519 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:35:47.078519 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:35:47.078519 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:35:47.078519 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:35:47.078519 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:35:47.078519 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:35:47.078519 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:35:47.078519 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:35:47.078519 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:35:47.078519 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:35:47.078519 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 19:35:47.078519 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 19:35:47.078519 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 19:35:47.078519 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 19:35:47.079457 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 19:35:47.079457 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 19:35:47.079457 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 19:35:47.079457 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 19:35:47.079457 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:35:47.079457 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:35:47.079457 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:35:47.079457 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:35:47.079457 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:35:47.079457 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:35:47.079457 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:35:47.079457 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application with Lock( Sep 13 19:35:47.079457 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:35:47.079457 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:35:47.079457 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:35:47.079457 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:35:47.080350 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:35:47.080350 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:35:47.080350 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:35:47.080350 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:35:47.080350 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 19:35:47.080350 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 19:35:47.080350 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 19:35:47.080350 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 19:35:47.080350 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 19:35:47.080350 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 19:35:47.080350 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 13 19:35:47.080350 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application Sep 13 19:35:47.080350 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 195/397] 10.222.0.25 () {56 vars in 1099 bytes} [Tue Sep 13 19:35:46 2022] GET /identity/v3/roles/member => generated 84 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:35:47.089651 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43c0ebe-68c0-4138-a782-19b89d21cd60 None admin] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:35:47.106049 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233bd96b-9791-4ba6-845d-8f8431038bed None None] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:35:47.106385 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233bd96b-9791-4ba6-845d-8f8431038bed None None] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:35:47.106600 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233bd96b-9791-4ba6-845d-8f8431038bed None None] PATH_INFO: `/` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:35:47.108171 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 196/398] 10.222.0.25 () {54 vars in 927 bytes} [Tue Sep 13 19:35:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 13 19:35:47.113694 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5b46a1-1b45-495a-b8d8-b6846e57ca03 None None] REQUEST_METHOD: `POST` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:35:47.113980 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5b46a1-1b45-495a-b8d8-b6846e57ca03 None None] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:35:47.114225 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5b46a1-1b45-495a-b8d8-b6846e57ca03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:35:47.135750 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG dbcounter [-] [87934] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:35:47.142718 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.auth.core [None req-af5b46a1-1b45-495a-b8d8-b6846e57ca03 None None] MFA Rules not processed for user `7b0aed92d02344acb92a0e4aa67c3068`. Rule list: `[]` (Enabled: `True`). {{(pid=87935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:35:47.144324 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.fernet_utils [None req-af5b46a1-1b45-495a-b8d8-b6846e57ca03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:35:47.221310 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG dbcounter [-] [87935] Writing DB stats keystone:SELECT=100 {{(pid=87935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:35:47.237371 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 197/399] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Sep 13 19:35:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 13 19:35:47.244239 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43c0ebe-68c0-4138-a782-19b89d21cd60 None admin] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:35:47.282522 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67aab531-50e0-4127-bd0e-7a764397c7bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:35:47.283040 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67aab531-50e0-4127-bd0e-7a764397c7bd None admin] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:35:47.283314 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67aab531-50e0-4127-bd0e-7a764397c7bd None admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:35:47.283580 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67aab531-50e0-4127-bd0e-7a764397c7bd None admin] PATH_INFO: `/v3/roles` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:35:47.284340 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67aab531-50e0-4127-bd0e-7a764397c7bd None admin] RBAC: Adding query filter params (name=member) {{(pid=87934) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:35:47.284641 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67aab531-50e0-4127-bd0e-7a764397c7bd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:35:47.286022 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67aab531-50e0-4127-bd0e-7a764397c7bd None admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:35:47.301703 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 203/400] 10.222.0.25 () {56 vars in 1101 bytes} [Tue Sep 13 19:35:47 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:35:47.307450 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5b46a1-1b45-495a-b8d8-b6846e57ca03 None None] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:35:47.445864 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5b46a1-1b45-495a-b8d8-b6846e57ca03 None None] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:35:47.503020 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c440b4b-bb3f-4f8d-8b74-ec01c1a3769e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:35:47.503677 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c440b4b-bb3f-4f8d-8b74-ec01c1a3769e None admin] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:35:47.503953 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c440b4b-bb3f-4f8d-8b74-ec01c1a3769e None admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:35:47.504311 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c440b4b-bb3f-4f8d-8b74-ec01c1a3769e None admin] PATH_INFO: `/v3/groups/e392f0a270074d3ea54b38df964ba25f` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:35:47.505545 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c440b4b-bb3f-4f8d-8b74-ec01c1a3769e None admin] RBAC: Authorizing `identity:get_group(group_id=e392f0a270074d3ea54b38df964ba25f)` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:35:47.507525 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c440b4b-bb3f-4f8d-8b74-ec01c1a3769e None admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:35:47.509591 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 198/401] 10.222.0.25 () {56 vars in 1180 bytes} [Tue Sep 13 19:35:47 2022] GET /identity/v3/groups/e392f0a270074d3ea54b38df964ba25f => generated 226 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 19:35:47.515216 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67aab531-50e0-4127-bd0e-7a764397c7bd None admin] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:35:47.635192 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c440b4b-bb3f-4f8d-8b74-ec01c1a3769e None admin] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:35:47.664731 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG dbcounter [-] [87934] Writing DB stats keystone:SELECT=100 {{(pid=87934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:35:47.674285 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67aab531-50e0-4127-bd0e-7a764397c7bd None admin] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:35:47.725456 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1ef907-93f9-4083-90e0-c7fae7435c6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:35:47.726938 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1ef907-93f9-4083-90e0-c7fae7435c6a None admin] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:35:47.727429 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1ef907-93f9-4083-90e0-c7fae7435c6a None admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:35:47.728451 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1ef907-93f9-4083-90e0-c7fae7435c6a None admin] PATH_INFO: `/v3/projects/93e1f3226d564df686b8ca37cfd3a42c` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:35:47.730255 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d1ef907-93f9-4083-90e0-c7fae7435c6a None admin] RBAC: Authorizing `identity:get_project(project_id=93e1f3226d564df686b8ca37cfd3a42c)` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:35:47.732236 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d1ef907-93f9-4083-90e0-c7fae7435c6a None admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:35:47.733547 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG dbcounter [-] [87935] Writing DB stats keystone:SELECT=100 {{(pid=87935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:35:47.744034 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 204/402] 10.222.0.25 () {56 vars in 1186 bytes} [Tue Sep 13 19:35:47 2022] GET /identity/v3/projects/93e1f3226d564df686b8ca37cfd3a42c => generated 302 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:35:47.744034 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d920a1a-2d33-43b7-b6c2-da40907f80e3 None None] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:35:47.744034 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d920a1a-2d33-43b7-b6c2-da40907f80e3 None None] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:35:47.745023 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d920a1a-2d33-43b7-b6c2-da40907f80e3 None None] PATH_INFO: `/` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:35:47.747572 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 205/403] 10.222.0.25 () {54 vars in 927 bytes} [Tue Sep 13 19:35:47 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:35:47.751654 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d920a1a-2d33-43b7-b6c2-da40907f80e3 None None] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:35:47.802181 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c440b4b-bb3f-4f8d-8b74-ec01c1a3769e None admin] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:35:47.847861 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f332aed7-1f83-4648-b550-db32a3e15f12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:35:47.848789 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f332aed7-1f83-4648-b550-db32a3e15f12 None admin] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:35:47.849305 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f332aed7-1f83-4648-b550-db32a3e15f12 None admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:35:47.849965 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f332aed7-1f83-4648-b550-db32a3e15f12 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:35:47.870079 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f332aed7-1f83-4648-b550-db32a3e15f12 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 19:35:47.875562 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application [None req-f332aed7-1f83-4648-b550-db32a3e15f12 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 13 19:35:47.875562 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:35:47.875562 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:35:47.875562 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:35:47.875562 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:35:47.875562 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:35:47.875562 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:35:47.875562 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:35:47.875562 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:35:47.875562 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:35:47.875562 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:35:47.875562 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:35:47.875562 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 19:35:47.875562 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 19:35:47.875562 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 19:35:47.875562 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 19:35:47.876610 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 19:35:47.876610 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 19:35:47.876610 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 19:35:47.876610 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 19:35:47.876610 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:35:47.876610 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:35:47.876610 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:35:47.876610 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:35:47.876610 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:35:47.876610 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:35:47.876610 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:35:47.876610 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application with Lock( Sep 13 19:35:47.876610 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:35:47.876610 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:35:47.876610 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:35:47.876610 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:35:47.877407 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:35:47.877407 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:35:47.877407 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:35:47.877407 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:35:47.877407 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 19:35:47.877407 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 19:35:47.877407 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 19:35:47.877407 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 19:35:47.877407 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 19:35:47.877407 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 19:35:47.877407 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 13 19:35:47.877407 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application Sep 13 19:35:47.884335 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 199/404] 10.222.0.25 () {56 vars in 1114 bytes} [Tue Sep 13 19:35:47 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:35:47.887702 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32806a3a-f018-4d6b-b898-12464308d5ea None None] REQUEST_METHOD: `POST` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:35:47.888326 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32806a3a-f018-4d6b-b898-12464308d5ea None None] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:35:47.888806 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32806a3a-f018-4d6b-b898-12464308d5ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:35:47.907649 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d920a1a-2d33-43b7-b6c2-da40907f80e3 None None] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:35:47.914651 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.auth.core [None req-32806a3a-f018-4d6b-b898-12464308d5ea None None] MFA Rules not processed for user `7b0aed92d02344acb92a0e4aa67c3068`. Rule list: `[]` (Enabled: `True`). {{(pid=87935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:35:47.915970 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.fernet_utils [None req-32806a3a-f018-4d6b-b898-12464308d5ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:35:47.952264 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b46255a-0174-49cf-a73f-f88188d49d2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:35:47.952950 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b46255a-0174-49cf-a73f-f88188d49d2c None admin] REQUEST_METHOD: `PUT` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:35:47.953229 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b46255a-0174-49cf-a73f-f88188d49d2c None admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:35:47.953753 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b46255a-0174-49cf-a73f-f88188d49d2c None admin] PATH_INFO: `/v3/projects/93e1f3226d564df686b8ca37cfd3a42c/groups/e392f0a270074d3ea54b38df964ba25f/roles/a259191f6d0e46fabd9f34536bb28747` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:35:47.956484 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b46255a-0174-49cf-a73f-f88188d49d2c None admin] RBAC: Authorizing `identity:create_grant(project_id=93e1f3226d564df686b8ca37cfd3a42c, group_id=e392f0a270074d3ea54b38df964ba25f, role_id=a259191f6d0e46fabd9f34536bb28747)` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:35:47.958914 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b46255a-0174-49cf-a73f-f88188d49d2c None admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:35:47.979229 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 206/405] 10.222.0.25 () {58 vars in 1442 bytes} [Tue Sep 13 19:35:47 2022] PUT /identity/v3/projects/93e1f3226d564df686b8ca37cfd3a42c/groups/e392f0a270074d3ea54b38df964ba25f/roles/a259191f6d0e46fabd9f34536bb28747 => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 19:35:47.980646 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b46255a-0174-49cf-a73f-f88188d49d2c None admin] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:35:48.004767 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 200/406] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Sep 13 19:35:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 19:35:48.026744 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG dbcounter [-] [87934] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:35:48.125250 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b46255a-0174-49cf-a73f-f88188d49d2c None admin] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:35:48.176230 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be66275e-5b77-4741-b640-d29081579588 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:35:48.177087 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be66275e-5b77-4741-b640-d29081579588 None admin] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:35:48.177765 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be66275e-5b77-4741-b640-d29081579588 None admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:35:48.178230 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be66275e-5b77-4741-b640-d29081579588 None admin] PATH_INFO: `/v3/roles` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:35:48.179197 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be66275e-5b77-4741-b640-d29081579588 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=87934) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:35:48.179717 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be66275e-5b77-4741-b640-d29081579588 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:35:48.181301 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be66275e-5b77-4741-b640-d29081579588 None admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:35:48.197333 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 207/407] 10.222.0.25 () {56 vars in 1111 bytes} [Tue Sep 13 19:35:47 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:35:48.203490 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32806a3a-f018-4d6b-b898-12464308d5ea None None] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:35:48.272100 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG dbcounter [-] [87935] Writing DB stats keystone:SELECT=100 {{(pid=87935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:35:48.336776 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32806a3a-f018-4d6b-b898-12464308d5ea None None] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:35:48.375236 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1c6a6a-0158-43df-a088-25dfebda7f1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:35:48.376350 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1c6a6a-0158-43df-a088-25dfebda7f1c None admin] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:35:48.376843 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1c6a6a-0158-43df-a088-25dfebda7f1c None admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:35:48.377324 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1c6a6a-0158-43df-a088-25dfebda7f1c None admin] PATH_INFO: `/v3/groups/e392f0a270074d3ea54b38df964ba25f` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:35:48.378883 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f1c6a6a-0158-43df-a088-25dfebda7f1c None admin] RBAC: Authorizing `identity:get_group(group_id=e392f0a270074d3ea54b38df964ba25f)` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:35:48.380402 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f1c6a6a-0158-43df-a088-25dfebda7f1c None admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:35:48.387607 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 201/408] 10.222.0.25 () {56 vars in 1180 bytes} [Tue Sep 13 19:35:48 2022] GET /identity/v3/groups/e392f0a270074d3ea54b38df964ba25f => generated 226 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:35:48.389611 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be66275e-5b77-4741-b640-d29081579588 None admin] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:35:48.398309 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1c6a6a-0158-43df-a088-25dfebda7f1c None admin] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:35:48.529065 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG dbcounter [-] [87934] Writing DB stats keystone:SELECT=100 {{(pid=87934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:35:48.564253 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be66275e-5b77-4741-b640-d29081579588 None admin] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:35:48.592500 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1c6a6a-0158-43df-a088-25dfebda7f1c None admin] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:35:48.612372 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG dbcounter [-] [87935] Writing DB stats keystone:SELECT=100 {{(pid=87935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:35:48.632714 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6170a6-1f22-4192-b114-cb794745213d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:35:48.633747 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6170a6-1f22-4192-b114-cb794745213d None admin] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:35:48.634245 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6170a6-1f22-4192-b114-cb794745213d None admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:35:48.634749 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6170a6-1f22-4192-b114-cb794745213d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:35:48.638881 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0013f2c4-cda9-429b-aeb9-741a0e25d4f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:35:48.639914 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0013f2c4-cda9-429b-aeb9-741a0e25d4f5 None admin] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:35:48.640470 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0013f2c4-cda9-429b-aeb9-741a0e25d4f5 None admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:35:48.640942 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0013f2c4-cda9-429b-aeb9-741a0e25d4f5 None admin] PATH_INFO: `/v3/projects/93e1f3226d564df686b8ca37cfd3a42c` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:35:48.643979 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0013f2c4-cda9-429b-aeb9-741a0e25d4f5 None admin] RBAC: Authorizing `identity:get_project(project_id=93e1f3226d564df686b8ca37cfd3a42c)` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:35:48.647299 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0013f2c4-cda9-429b-aeb9-741a0e25d4f5 None admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:35:48.649052 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a6170a6-1f22-4192-b114-cb794745213d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 19:35:48.654747 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application [None req-0a6170a6-1f22-4192-b114-cb794745213d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 19:35:48.654747 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:35:48.654747 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:35:48.654747 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:35:48.654747 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:35:48.654747 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:35:48.654747 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:35:48.654747 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:35:48.654747 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:35:48.654747 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:35:48.654747 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:35:48.654747 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:35:48.654747 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 19:35:48.654747 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 19:35:48.654747 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 19:35:48.654747 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 19:35:48.655673 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 19:35:48.655673 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 19:35:48.655673 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 19:35:48.655673 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 19:35:48.655673 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:35:48.655673 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:35:48.655673 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:35:48.655673 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:35:48.655673 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:35:48.655673 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:35:48.655673 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:35:48.655673 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application with Lock( Sep 13 19:35:48.655673 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:35:48.655673 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:35:48.655673 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:35:48.655673 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:35:48.656497 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:35:48.656497 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:35:48.656497 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:35:48.656497 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:35:48.656497 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 19:35:48.656497 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 19:35:48.656497 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 19:35:48.656497 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 19:35:48.656497 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 19:35:48.656497 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 19:35:48.656497 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 19:35:48.656497 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application Sep 13 19:35:48.662779 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 208/409] 10.222.0.25 () {56 vars in 1186 bytes} [Tue Sep 13 19:35:48 2022] GET /identity/v3/projects/93e1f3226d564df686b8ca37cfd3a42c => generated 302 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:35:48.664595 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 202/410] 10.222.0.25 () {56 vars in 1096 bytes} [Tue Sep 13 19:35:48 2022] GET /identity/v3/roles/admin => generated 83 bytes in 267 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 13 19:35:48.666337 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0013f2c4-cda9-429b-aeb9-741a0e25d4f5 None admin] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:35:48.671331 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6170a6-1f22-4192-b114-cb794745213d None admin] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:35:48.792282 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6170a6-1f22-4192-b114-cb794745213d None admin] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:35:48.832411 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df69699-21e5-4714-912b-c0fa0e054a33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:35:48.833392 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df69699-21e5-4714-912b-c0fa0e054a33 None admin] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:35:48.834572 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df69699-21e5-4714-912b-c0fa0e054a33 None admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:35:48.835053 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df69699-21e5-4714-912b-c0fa0e054a33 None admin] PATH_INFO: `/v3/roles` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:35:48.835947 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df69699-21e5-4714-912b-c0fa0e054a33 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87935) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:35:48.836530 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df69699-21e5-4714-912b-c0fa0e054a33 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:35:48.838139 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df69699-21e5-4714-912b-c0fa0e054a33 None admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:35:48.848426 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 203/411] 10.222.0.25 () {56 vars in 1099 bytes} [Tue Sep 13 19:35:48 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 19:35:48.855581 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df69699-21e5-4714-912b-c0fa0e054a33 None admin] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:35:48.920626 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG dbcounter [-] [87935] Writing DB stats keystone:SELECT=100 {{(pid=87935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:35:48.987021 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df69699-21e5-4714-912b-c0fa0e054a33 None admin] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:35:49.031620 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727e6723-b6b7-480e-bacb-8c6098dcb7bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:35:49.032657 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727e6723-b6b7-480e-bacb-8c6098dcb7bd None admin] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:35:49.033560 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727e6723-b6b7-480e-bacb-8c6098dcb7bd None admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:35:49.034034 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727e6723-b6b7-480e-bacb-8c6098dcb7bd None admin] PATH_INFO: `/v3/groups/62f5f12c6f674fd4b2b04fe72d64489d` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:35:49.035444 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-727e6723-b6b7-480e-bacb-8c6098dcb7bd None admin] RBAC: Authorizing `identity:get_group(group_id=62f5f12c6f674fd4b2b04fe72d64489d)` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:35:49.038102 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-727e6723-b6b7-480e-bacb-8c6098dcb7bd None admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:35:49.040721 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 204/412] 10.222.0.25 () {56 vars in 1180 bytes} [Tue Sep 13 19:35:48 2022] GET /identity/v3/groups/62f5f12c6f674fd4b2b04fe72d64489d => generated 229 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:35:49.046198 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727e6723-b6b7-480e-bacb-8c6098dcb7bd None admin] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:35:49.054652 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0013f2c4-cda9-429b-aeb9-741a0e25d4f5 None admin] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:35:49.166318 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727e6723-b6b7-480e-bacb-8c6098dcb7bd None admin] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:35:49.185674 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86262683-b88c-4797-b67a-1f4dba651b58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:35:49.186367 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86262683-b88c-4797-b67a-1f4dba651b58 None admin] REQUEST_METHOD: `PUT` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:35:49.186905 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86262683-b88c-4797-b67a-1f4dba651b58 None admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:35:49.186905 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86262683-b88c-4797-b67a-1f4dba651b58 None admin] PATH_INFO: `/v3/projects/93e1f3226d564df686b8ca37cfd3a42c/groups/e392f0a270074d3ea54b38df964ba25f/roles/8af3d83a03144ae8bacdb82d9a108110` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:35:49.189424 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86262683-b88c-4797-b67a-1f4dba651b58 None admin] RBAC: Authorizing `identity:create_grant(project_id=93e1f3226d564df686b8ca37cfd3a42c, group_id=e392f0a270074d3ea54b38df964ba25f, role_id=8af3d83a03144ae8bacdb82d9a108110)` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:35:49.192093 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86262683-b88c-4797-b67a-1f4dba651b58 None admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:35:49.196691 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG dbcounter [-] [87935] Writing DB stats keystone:SELECT=100 {{(pid=87935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:35:49.211723 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86f31f5-4e20-489e-881d-a33febf2a8b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:35:49.212837 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86f31f5-4e20-489e-881d-a33febf2a8b7 None admin] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:35:49.213595 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86f31f5-4e20-489e-881d-a33febf2a8b7 None admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:35:49.214450 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86f31f5-4e20-489e-881d-a33febf2a8b7 None admin] PATH_INFO: `/v3/projects/455c35cf3f4241039d612c7710aac324` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:35:49.216165 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d86f31f5-4e20-489e-881d-a33febf2a8b7 None admin] RBAC: Authorizing `identity:get_project(project_id=455c35cf3f4241039d612c7710aac324)` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:35:49.218429 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d86f31f5-4e20-489e-881d-a33febf2a8b7 None admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:35:49.221576 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 205/413] 10.222.0.25 () {56 vars in 1186 bytes} [Tue Sep 13 19:35:49 2022] GET /identity/v3/projects/455c35cf3f4241039d612c7710aac324 => generated 344 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 19:35:49.229119 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86f31f5-4e20-489e-881d-a33febf2a8b7 None admin] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:35:49.230657 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 209/414] 10.222.0.25 () {58 vars in 1442 bytes} [Tue Sep 13 19:35:48 2022] PUT /identity/v3/projects/93e1f3226d564df686b8ca37cfd3a42c/groups/e392f0a270074d3ea54b38df964ba25f/roles/8af3d83a03144ae8bacdb82d9a108110 => generated 0 bytes in 565 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 19:35:49.391269 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86f31f5-4e20-489e-881d-a33febf2a8b7 None admin] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:35:49.421449 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca24df7-b4b6-4c1c-8ee0-8c46937f65bb None None] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:35:49.421749 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca24df7-b4b6-4c1c-8ee0-8c46937f65bb None None] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:35:49.422157 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca24df7-b4b6-4c1c-8ee0-8c46937f65bb None None] PATH_INFO: `/` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:35:49.423871 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 210/415] 10.222.0.25 () {54 vars in 927 bytes} [Tue Sep 13 19:35:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:35:49.430280 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c93d3b7-ba2d-4898-aa53-5f233edbbab1 None None] REQUEST_METHOD: `POST` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:35:49.430787 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c93d3b7-ba2d-4898-aa53-5f233edbbab1 None None] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:35:49.431178 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c93d3b7-ba2d-4898-aa53-5f233edbbab1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:35:49.434873 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832526c4-3ee2-4e06-968f-1248ff2843cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:35:49.435889 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832526c4-3ee2-4e06-968f-1248ff2843cf None admin] REQUEST_METHOD: `PUT` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:35:49.436373 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832526c4-3ee2-4e06-968f-1248ff2843cf None admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:35:49.436939 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832526c4-3ee2-4e06-968f-1248ff2843cf None admin] PATH_INFO: `/v3/projects/455c35cf3f4241039d612c7710aac324/groups/62f5f12c6f674fd4b2b04fe72d64489d/roles/6ca1d4427ff64e0a9d25d96cfb1445f6` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:35:49.439556 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-832526c4-3ee2-4e06-968f-1248ff2843cf None admin] RBAC: Authorizing `identity:create_grant(project_id=455c35cf3f4241039d612c7710aac324, group_id=62f5f12c6f674fd4b2b04fe72d64489d, role_id=6ca1d4427ff64e0a9d25d96cfb1445f6)` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:35:49.441307 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-832526c4-3ee2-4e06-968f-1248ff2843cf None admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:35:49.467756 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 206/416] 10.222.0.25 () {58 vars in 1442 bytes} [Tue Sep 13 19:35:49 2022] PUT /identity/v3/projects/455c35cf3f4241039d612c7710aac324/groups/62f5f12c6f674fd4b2b04fe72d64489d/roles/6ca1d4427ff64e0a9d25d96cfb1445f6 => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 19:35:49.471394 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.auth.core [None req-1c93d3b7-ba2d-4898-aa53-5f233edbbab1 None None] MFA Rules not processed for user `7b0aed92d02344acb92a0e4aa67c3068`. Rule list: `[]` (Enabled: `True`). {{(pid=87934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:35:49.473134 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.fernet_utils [None req-1c93d3b7-ba2d-4898-aa53-5f233edbbab1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:35:49.486590 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG dbcounter [-] [87934] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:35:49.577295 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 211/417] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Sep 13 19:35:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 13 19:35:49.801991 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47c8cef-4d81-46d1-9a3e-bb5711278110 None None] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:35:49.802282 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47c8cef-4d81-46d1-9a3e-bb5711278110 None None] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:35:49.802862 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47c8cef-4d81-46d1-9a3e-bb5711278110 None None] PATH_INFO: `/` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:35:49.804324 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 207/418] 10.222.0.25 () {54 vars in 927 bytes} [Tue Sep 13 19:35:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:35:49.812192 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34daf267-c210-4340-94a3-42e408f5c823 None None] REQUEST_METHOD: `POST` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:35:49.812603 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34daf267-c210-4340-94a3-42e408f5c823 None None] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:35:49.812966 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34daf267-c210-4340-94a3-42e408f5c823 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:35:49.838045 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.auth.core [None req-34daf267-c210-4340-94a3-42e408f5c823 None None] MFA Rules not processed for user `7b0aed92d02344acb92a0e4aa67c3068`. Rule list: `[]` (Enabled: `True`). {{(pid=87934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:35:49.839160 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.fernet_utils [None req-34daf267-c210-4340-94a3-42e408f5c823 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:35:49.899715 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47c8cef-4d81-46d1-9a3e-bb5711278110 None None] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:35:49.967666 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 212/419] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Sep 13 19:35:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 19:35:49.984627 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG dbcounter [-] [87935] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:35:50.077482 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47c8cef-4d81-46d1-9a3e-bb5711278110 None None] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:35:50.120684 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f42d072-f12b-409e-b0f7-5f76c1cc2630 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:35:50.121235 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f42d072-f12b-409e-b0f7-5f76c1cc2630 None admin] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:35:50.121507 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f42d072-f12b-409e-b0f7-5f76c1cc2630 None admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:35:50.121773 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f42d072-f12b-409e-b0f7-5f76c1cc2630 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:35:50.140749 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f42d072-f12b-409e-b0f7-5f76c1cc2630 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 19:35:50.146960 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application [None req-2f42d072-f12b-409e-b0f7-5f76c1cc2630 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 13 19:35:50.146960 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:35:50.146960 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:35:50.146960 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:35:50.146960 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:35:50.146960 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:35:50.146960 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:35:50.146960 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:35:50.146960 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:35:50.146960 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:35:50.146960 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:35:50.146960 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:35:50.146960 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 19:35:50.146960 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 19:35:50.146960 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 19:35:50.146960 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 19:35:50.148398 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 19:35:50.148398 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 19:35:50.148398 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 19:35:50.148398 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 19:35:50.148398 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:35:50.148398 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:35:50.148398 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:35:50.148398 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:35:50.148398 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:35:50.148398 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:35:50.148398 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:35:50.148398 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application with Lock( Sep 13 19:35:50.148398 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:35:50.148398 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:35:50.148398 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:35:50.148398 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:35:50.149678 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:35:50.149678 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:35:50.149678 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:35:50.149678 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:35:50.149678 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 19:35:50.149678 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 19:35:50.149678 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 19:35:50.149678 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 19:35:50.149678 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 19:35:50.149678 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 19:35:50.149678 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 13 19:35:50.149678 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application Sep 13 19:35:50.149678 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 208/420] 10.222.0.25 () {56 vars in 1114 bytes} [Tue Sep 13 19:35:49 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:35:50.157368 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34daf267-c210-4340-94a3-42e408f5c823 None None] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:35:50.264597 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG dbcounter [-] [87934] Writing DB stats keystone:SELECT=100 {{(pid=87934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:35:50.294418 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34daf267-c210-4340-94a3-42e408f5c823 None None] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:35:50.346478 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa05bf92-ceea-4ddd-868c-edc140433c0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:35:50.347413 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa05bf92-ceea-4ddd-868c-edc140433c0c None admin] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:35:50.347815 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa05bf92-ceea-4ddd-868c-edc140433c0c None admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:35:50.348234 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa05bf92-ceea-4ddd-868c-edc140433c0c None admin] PATH_INFO: `/v3/roles` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:35:50.349839 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa05bf92-ceea-4ddd-868c-edc140433c0c None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=87934) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:35:50.350428 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa05bf92-ceea-4ddd-868c-edc140433c0c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:35:50.352948 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa05bf92-ceea-4ddd-868c-edc140433c0c None admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:35:50.366136 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 213/421] 10.222.0.25 () {56 vars in 1111 bytes} [Tue Sep 13 19:35:50 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:35:50.373658 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f42d072-f12b-409e-b0f7-5f76c1cc2630 None admin] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:35:50.493801 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa05bf92-ceea-4ddd-868c-edc140433c0c None admin] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:35:50.517779 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG dbcounter [-] [87935] Writing DB stats keystone:SELECT=100 {{(pid=87935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:35:50.528665 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f42d072-f12b-409e-b0f7-5f76c1cc2630 None admin] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:35:50.606716 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592c83c1-345e-4444-aa67-6e7ef09807ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:35:50.607811 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592c83c1-345e-4444-aa67-6e7ef09807ae None admin] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:35:50.608313 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592c83c1-345e-4444-aa67-6e7ef09807ae None admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:35:50.608804 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592c83c1-345e-4444-aa67-6e7ef09807ae None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:35:50.716913 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa05bf92-ceea-4ddd-868c-edc140433c0c None admin] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:35:50.762220 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-592c83c1-345e-4444-aa67-6e7ef09807ae None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:35:50.764373 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-592c83c1-345e-4444-aa67-6e7ef09807ae None admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:35:50.777524 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93439c40-3528-4483-91a1-fbabd5ba1ed5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:35:50.778177 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93439c40-3528-4483-91a1-fbabd5ba1ed5 None admin] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:35:50.778457 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93439c40-3528-4483-91a1-fbabd5ba1ed5 None admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:35:50.778725 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93439c40-3528-4483-91a1-fbabd5ba1ed5 None admin] PATH_INFO: `/v3/roles/member` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:35:50.782209 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG dbcounter [-] [87934] Writing DB stats keystone:SELECT=100 {{(pid=87934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:35:50.792734 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93439c40-3528-4483-91a1-fbabd5ba1ed5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 19:35:50.802179 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application [None req-93439c40-3528-4483-91a1-fbabd5ba1ed5 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 13 19:35:50.802179 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:35:50.802179 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:35:50.802179 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:35:50.802179 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:35:50.802179 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:35:50.802179 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:35:50.802179 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:35:50.802179 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:35:50.802179 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:35:50.802179 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:35:50.802179 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:35:50.802179 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 19:35:50.802179 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 19:35:50.802179 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 19:35:50.802179 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 19:35:50.803701 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 19:35:50.803701 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 19:35:50.803701 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 19:35:50.803701 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 19:35:50.803701 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:35:50.803701 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:35:50.803701 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:35:50.803701 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:35:50.803701 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:35:50.803701 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:35:50.803701 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:35:50.803701 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application with Lock( Sep 13 19:35:50.803701 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:35:50.803701 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:35:50.803701 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:35:50.803701 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:35:50.804742 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:35:50.804742 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:35:50.804742 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:35:50.804742 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:35:50.804742 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 19:35:50.804742 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 19:35:50.804742 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 19:35:50.804742 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 19:35:50.804742 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 19:35:50.804742 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 19:35:50.804742 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 13 19:35:50.804742 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application Sep 13 19:35:50.804742 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 214/422] 10.222.0.25 () {56 vars in 1099 bytes} [Tue Sep 13 19:35:50 2022] GET /identity/v3/roles/member => generated 84 bytes in 306 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:35:50.806254 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50903d2-28e4-4023-a5c4-4e2f974a54a3 None None] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:35:50.806539 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50903d2-28e4-4023-a5c4-4e2f974a54a3 None None] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:35:50.806815 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50903d2-28e4-4023-a5c4-4e2f974a54a3 None None] PATH_INFO: `/` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:35:50.808578 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 215/423] 10.222.0.25 () {54 vars in 927 bytes} [Tue Sep 13 19:35:50 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:35:50.816107 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50903d2-28e4-4023-a5c4-4e2f974a54a3 None None] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:35:50.906982 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG dbcounter [-] [87935] Writing DB stats keystone:SELECT=100 {{(pid=87935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:35:50.924606 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 209/424] 10.222.0.25 () {58 vars in 1282 bytes} [Tue Sep 13 19:35:50 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 551 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 13 19:35:50.926169 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b121f4d-1e31-4285-916b-d356502704f6 None None] REQUEST_METHOD: `POST` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:35:50.926455 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b121f4d-1e31-4285-916b-d356502704f6 None None] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:35:50.926794 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b121f4d-1e31-4285-916b-d356502704f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:35:50.950216 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.auth.core [None req-2b121f4d-1e31-4285-916b-d356502704f6 None None] MFA Rules not processed for user `7b0aed92d02344acb92a0e4aa67c3068`. Rule list: `[]` (Enabled: `True`). {{(pid=87935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:35:50.952451 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.fernet_utils [None req-2b121f4d-1e31-4285-916b-d356502704f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:35:50.959961 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50903d2-28e4-4023-a5c4-4e2f974a54a3 None None] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:35:50.999184 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2af0ff-b504-4300-b0a4-7ef713a96907 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:35:51.000100 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2af0ff-b504-4300-b0a4-7ef713a96907 None admin] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:35:51.000780 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2af0ff-b504-4300-b0a4-7ef713a96907 None admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:35:51.001095 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2af0ff-b504-4300-b0a4-7ef713a96907 None admin] PATH_INFO: `/v3/roles` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:35:51.002319 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e2af0ff-b504-4300-b0a4-7ef713a96907 None admin] RBAC: Adding query filter params (name=member) {{(pid=87934) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:35:51.002875 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e2af0ff-b504-4300-b0a4-7ef713a96907 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:35:51.005514 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e2af0ff-b504-4300-b0a4-7ef713a96907 None admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:35:51.022708 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 216/425] 10.222.0.25 () {56 vars in 1101 bytes} [Tue Sep 13 19:35:50 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:35:51.023928 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2af0ff-b504-4300-b0a4-7ef713a96907 None admin] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:35:51.060594 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 210/426] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Sep 13 19:35:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 19:35:51.061598 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b121f4d-1e31-4285-916b-d356502704f6 None None] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:35:51.107592 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG dbcounter [-] [87934] Writing DB stats keystone:SELECT=100 {{(pid=87934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:35:51.163861 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2af0ff-b504-4300-b0a4-7ef713a96907 None admin] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:35:51.211653 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea17a99-28cc-4eca-86c4-2c50b0f600cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:35:51.212784 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea17a99-28cc-4eca-86c4-2c50b0f600cf None admin] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:35:51.213978 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea17a99-28cc-4eca-86c4-2c50b0f600cf None admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:35:51.214602 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea17a99-28cc-4eca-86c4-2c50b0f600cf None admin] PATH_INFO: `/v3/projects/8aefa5062b7b4e4390554359e5669a9b` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:35:51.216157 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea17a99-28cc-4eca-86c4-2c50b0f600cf None admin] RBAC: Authorizing `identity:get_project(project_id=8aefa5062b7b4e4390554359e5669a9b)` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:35:51.217897 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea17a99-28cc-4eca-86c4-2c50b0f600cf None admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:35:51.219824 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 217/427] 10.222.0.25 () {56 vars in 1186 bytes} [Tue Sep 13 19:35:51 2022] GET /identity/v3/projects/8aefa5062b7b4e4390554359e5669a9b => generated 298 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:35:51.230477 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea17a99-28cc-4eca-86c4-2c50b0f600cf None admin] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:35:51.305524 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b121f4d-1e31-4285-916b-d356502704f6 None None] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:35:51.364599 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG dbcounter [-] [87935] Writing DB stats keystone:SELECT=100 {{(pid=87935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:35:51.382014 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3a4d91-5716-419e-94cc-92e552c7261f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:35:51.382630 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3a4d91-5716-419e-94cc-92e552c7261f None admin] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:35:51.382910 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3a4d91-5716-419e-94cc-92e552c7261f None admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:35:51.383178 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3a4d91-5716-419e-94cc-92e552c7261f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:35:51.472805 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab3a4d91-5716-419e-94cc-92e552c7261f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:35:51.474351 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab3a4d91-5716-419e-94cc-92e552c7261f None admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:35:51.491898 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea17a99-28cc-4eca-86c4-2c50b0f600cf None admin] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:35:51.521684 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG dbcounter [-] [87934] Writing DB stats keystone:SELECT=100 {{(pid=87934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:35:51.532166 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9c705b-0e95-44d0-a9e9-2cf11b665f9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:35:51.532892 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9c705b-0e95-44d0-a9e9-2cf11b665f9c None admin] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:35:51.533202 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9c705b-0e95-44d0-a9e9-2cf11b665f9c None admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:35:51.533559 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9c705b-0e95-44d0-a9e9-2cf11b665f9c None admin] PATH_INFO: `/v3/groups/e392f0a270074d3ea54b38df964ba25f` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:35:51.534714 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e9c705b-0e95-44d0-a9e9-2cf11b665f9c None admin] RBAC: Authorizing `identity:get_group(group_id=e392f0a270074d3ea54b38df964ba25f)` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:35:51.536164 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e9c705b-0e95-44d0-a9e9-2cf11b665f9c None admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:35:51.540322 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 218/428] 10.222.0.25 () {56 vars in 1180 bytes} [Tue Sep 13 19:35:51 2022] GET /identity/v3/groups/e392f0a270074d3ea54b38df964ba25f => generated 226 bytes in 309 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:35:51.540322 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9c705b-0e95-44d0-a9e9-2cf11b665f9c None admin] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:35:51.603028 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 211/429] 10.222.0.25 () {58 vars in 1282 bytes} [Tue Sep 13 19:35:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 542 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 13 19:35:51.603812 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3a4d91-5716-419e-94cc-92e552c7261f None admin] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:35:51.634405 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG dbcounter [-] [87935] Writing DB stats keystone:SELECT=100 {{(pid=87935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:35:51.676760 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9c705b-0e95-44d0-a9e9-2cf11b665f9c None admin] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:35:51.717950 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c63565-a786-413a-99ad-596a13710a36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:35:51.719265 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c63565-a786-413a-99ad-596a13710a36 None admin] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:35:51.719693 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c63565-a786-413a-99ad-596a13710a36 None admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:35:51.720136 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c63565-a786-413a-99ad-596a13710a36 None admin] PATH_INFO: `/v3/roles/member` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:35:51.735353 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c63565-a786-413a-99ad-596a13710a36 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 19:35:51.743103 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application [None req-74c63565-a786-413a-99ad-596a13710a36 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 13 19:35:51.743103 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:35:51.743103 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:35:51.743103 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:35:51.743103 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:35:51.743103 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:35:51.743103 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:35:51.743103 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:35:51.743103 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:35:51.743103 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:35:51.743103 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:35:51.743103 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:35:51.743103 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 19:35:51.743103 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 19:35:51.743103 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 19:35:51.743103 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 19:35:51.744196 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 19:35:51.744196 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 19:35:51.744196 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 19:35:51.744196 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 19:35:51.744196 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:35:51.744196 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:35:51.744196 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:35:51.744196 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:35:51.744196 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:35:51.744196 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:35:51.744196 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:35:51.744196 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application with Lock( Sep 13 19:35:51.744196 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:35:51.744196 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:35:51.744196 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:35:51.744196 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:35:51.745104 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:35:51.745104 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:35:51.745104 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:35:51.745104 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:35:51.745104 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 19:35:51.745104 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 19:35:51.745104 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 19:35:51.745104 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 19:35:51.745104 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 19:35:51.745104 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 19:35:51.745104 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 13 19:35:51.745104 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application Sep 13 19:35:51.748292 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 219/430] 10.222.0.25 () {56 vars in 1099 bytes} [Tue Sep 13 19:35:51 2022] GET /identity/v3/roles/member => generated 84 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:35:51.749642 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c63565-a786-413a-99ad-596a13710a36 None admin] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:35:51.759969 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3a4d91-5716-419e-94cc-92e552c7261f None admin] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:35:51.803238 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172d0ac9-1953-475a-a02e-33c886d32aad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:35:51.804163 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172d0ac9-1953-475a-a02e-33c886d32aad None admin] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:35:51.804541 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172d0ac9-1953-475a-a02e-33c886d32aad None admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:35:51.804736 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172d0ac9-1953-475a-a02e-33c886d32aad None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:35:51.805528 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-172d0ac9-1953-475a-a02e-33c886d32aad None admin] RBAC: Adding query filter params (group.id=e392f0a270074d3ea54b38df964ba25f, role.id=8af3d83a03144ae8bacdb82d9a108110, scope.project.id=8aefa5062b7b4e4390554359e5669a9b) {{(pid=87935) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:35:51.805835 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-172d0ac9-1953-475a-a02e-33c886d32aad None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:35:51.807332 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-172d0ac9-1953-475a-a02e-33c886d32aad None admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:35:51.814501 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 212/431] 10.222.0.25 () {56 vars in 1376 bytes} [Tue Sep 13 19:35:51 2022] GET /identity/v3/role_assignments?group.id=e392f0a270074d3ea54b38df964ba25f&scope.project.id=8aefa5062b7b4e4390554359e5669a9b&role.id=8af3d83a03144ae8bacdb82d9a108110 => generated 611 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:35:51.815733 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172d0ac9-1953-475a-a02e-33c886d32aad None admin] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:35:51.840847 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG dbcounter [-] [87934] Writing DB stats keystone:SELECT=100 {{(pid=87934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:35:51.906743 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c63565-a786-413a-99ad-596a13710a36 None admin] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:35:51.955658 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG dbcounter [-] [87935] Writing DB stats keystone:SELECT=100 {{(pid=87935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:35:51.972582 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324cee8e-5f95-4a6f-910a-1c1b631f6245 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:35:51.973952 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324cee8e-5f95-4a6f-910a-1c1b631f6245 None admin] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:35:51.977840 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324cee8e-5f95-4a6f-910a-1c1b631f6245 None admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:35:51.978381 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324cee8e-5f95-4a6f-910a-1c1b631f6245 None admin] PATH_INFO: `/v3/projects/8aefa5062b7b4e4390554359e5669a9b` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:35:51.982159 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-324cee8e-5f95-4a6f-910a-1c1b631f6245 None admin] RBAC: Authorizing `identity:get_project(project_id=8aefa5062b7b4e4390554359e5669a9b)` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:35:51.984247 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-324cee8e-5f95-4a6f-910a-1c1b631f6245 None admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:35:51.986900 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 220/432] 10.222.0.25 () {56 vars in 1186 bytes} [Tue Sep 13 19:35:51 2022] GET /identity/v3/projects/8aefa5062b7b4e4390554359e5669a9b => generated 298 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:35:51.989948 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172d0ac9-1953-475a-a02e-33c886d32aad None admin] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:35:51.992735 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324cee8e-5f95-4a6f-910a-1c1b631f6245 None admin] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:35:52.056085 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6f90b6-c485-4733-b9a5-945803a4bc1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:35:52.056834 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6f90b6-c485-4733-b9a5-945803a4bc1a None admin] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:35:52.057114 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6f90b6-c485-4733-b9a5-945803a4bc1a None admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:35:52.057395 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6f90b6-c485-4733-b9a5-945803a4bc1a None admin] PATH_INFO: `/v3/roles` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:35:52.058084 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b6f90b6-c485-4733-b9a5-945803a4bc1a None admin] RBAC: Adding query filter params (name=member) {{(pid=87935) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:35:52.058389 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b6f90b6-c485-4733-b9a5-945803a4bc1a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:35:52.059838 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b6f90b6-c485-4733-b9a5-945803a4bc1a None admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:35:52.070664 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 213/433] 10.222.0.25 () {56 vars in 1101 bytes} [Tue Sep 13 19:35:51 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:35:52.076624 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c842c136-9b39-4f8d-8086-77bf22470f22 None None] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:35:52.076624 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c842c136-9b39-4f8d-8086-77bf22470f22 None None] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:35:52.076624 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c842c136-9b39-4f8d-8086-77bf22470f22 None None] PATH_INFO: `/` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:35:52.078554 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 214/434] 10.222.0.25 () {54 vars in 927 bytes} [Tue Sep 13 19:35:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:35:52.079490 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c842c136-9b39-4f8d-8086-77bf22470f22 None None] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:35:52.170627 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324cee8e-5f95-4a6f-910a-1c1b631f6245 None admin] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:35:52.202293 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG dbcounter [-] [87934] Writing DB stats keystone:SELECT=100 {{(pid=87934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:35:52.217499 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415f0c62-871e-41a8-9b8c-2f830f4bbca4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:35:52.218146 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415f0c62-871e-41a8-9b8c-2f830f4bbca4 None admin] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:35:52.218423 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415f0c62-871e-41a8-9b8c-2f830f4bbca4 None admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:35:52.218692 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415f0c62-871e-41a8-9b8c-2f830f4bbca4 None admin] PATH_INFO: `/v3/groups/e392f0a270074d3ea54b38df964ba25f` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:35:52.219804 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-415f0c62-871e-41a8-9b8c-2f830f4bbca4 None admin] RBAC: Authorizing `identity:get_group(group_id=e392f0a270074d3ea54b38df964ba25f)` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:35:52.221266 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-415f0c62-871e-41a8-9b8c-2f830f4bbca4 None admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:35:52.222933 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 221/435] 10.222.0.25 () {56 vars in 1180 bytes} [Tue Sep 13 19:35:51 2022] GET /identity/v3/groups/e392f0a270074d3ea54b38df964ba25f => generated 226 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:35:52.224062 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5db668e-a0bb-4260-a66b-a49cacf1c9ef None None] REQUEST_METHOD: `POST` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:35:52.224499 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5db668e-a0bb-4260-a66b-a49cacf1c9ef None None] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:35:52.224993 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5db668e-a0bb-4260-a66b-a49cacf1c9ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:35:52.229652 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c842c136-9b39-4f8d-8086-77bf22470f22 None None] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:35:52.247197 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.auth.core [None req-e5db668e-a0bb-4260-a66b-a49cacf1c9ef None None] MFA Rules not processed for user `7b0aed92d02344acb92a0e4aa67c3068`. Rule list: `[]` (Enabled: `True`). {{(pid=87934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:35:52.249629 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.fernet_utils [None req-e5db668e-a0bb-4260-a66b-a49cacf1c9ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:35:52.269551 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ad6894-5bcb-43f6-ac4e-f8018f6c7779 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:35:52.270143 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ad6894-5bcb-43f6-ac4e-f8018f6c7779 None admin] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:35:52.270423 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ad6894-5bcb-43f6-ac4e-f8018f6c7779 None admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:35:52.270689 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ad6894-5bcb-43f6-ac4e-f8018f6c7779 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:35:52.303483 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG dbcounter [-] [87935] Writing DB stats keystone:SELECT=100 {{(pid=87935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:35:52.344509 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 222/436] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Sep 13 19:35:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 19:35:52.345394 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5db668e-a0bb-4260-a66b-a49cacf1c9ef None None] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:35:52.376736 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ad6894-5bcb-43f6-ac4e-f8018f6c7779 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:35:52.378260 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ad6894-5bcb-43f6-ac4e-f8018f6c7779 None admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:35:52.482350 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5db668e-a0bb-4260-a66b-a49cacf1c9ef None None] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:35:52.505204 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG dbcounter [-] [87934] Writing DB stats keystone:SELECT=100 {{(pid=87934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:35:52.520089 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 215/437] 10.222.0.25 () {58 vars in 1282 bytes} [Tue Sep 13 19:35:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 441 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 13 19:35:52.521200 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e34581-9fcb-4ecd-923c-f7342c6dceca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:35:52.521472 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fbfc3d-f524-4880-897d-f6e26457c3c2 None None] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:35:52.521752 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fbfc3d-f524-4880-897d-f6e26457c3c2 None None] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:35:52.522030 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fbfc3d-f524-4880-897d-f6e26457c3c2 None None] PATH_INFO: `/` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:35:52.522180 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e34581-9fcb-4ecd-923c-f7342c6dceca None admin] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:35:52.522486 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e34581-9fcb-4ecd-923c-f7342c6dceca None admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:35:52.522763 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e34581-9fcb-4ecd-923c-f7342c6dceca None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:35:52.527654 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 216/438] 10.222.0.25 () {54 vars in 927 bytes} [Tue Sep 13 19:35:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:35:52.527824 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e34581-9fcb-4ecd-923c-f7342c6dceca None admin] RBAC: Adding query filter params (group.id=e392f0a270074d3ea54b38df964ba25f, role.id=a259191f6d0e46fabd9f34536bb28747, scope.project.id=8aefa5062b7b4e4390554359e5669a9b) {{(pid=87934) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:35:52.527824 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e34581-9fcb-4ecd-923c-f7342c6dceca None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:35:52.527824 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e34581-9fcb-4ecd-923c-f7342c6dceca None admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:35:52.528049 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10fbfc3d-f524-4880-897d-f6e26457c3c2 None None] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:35:52.532996 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 223/439] 10.222.0.25 () {56 vars in 1376 bytes} [Tue Sep 13 19:35:52 2022] GET /identity/v3/role_assignments?group.id=e392f0a270074d3ea54b38df964ba25f&scope.project.id=8aefa5062b7b4e4390554359e5669a9b&role.id=a259191f6d0e46fabd9f34536bb28747 => generated 611 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:35:52.534222 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff98401-d78f-4e79-a662-e4cd87a22db2 None None] REQUEST_METHOD: `POST` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:35:52.534498 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff98401-d78f-4e79-a662-e4cd87a22db2 None None] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:35:52.534771 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff98401-d78f-4e79-a662-e4cd87a22db2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:35:52.555612 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.auth.core [None req-5ff98401-d78f-4e79-a662-e4cd87a22db2 None None] MFA Rules not processed for user `7b0aed92d02344acb92a0e4aa67c3068`. Rule list: `[]` (Enabled: `True`). {{(pid=87934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:35:52.556859 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.fernet_utils [None req-5ff98401-d78f-4e79-a662-e4cd87a22db2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:35:52.603673 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG dbcounter [-] [87935] Writing DB stats keystone:SELECT=100 {{(pid=87935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:35:52.644880 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 224/440] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Sep 13 19:35:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 19:35:52.645997 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff98401-d78f-4e79-a662-e4cd87a22db2 None None] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:35:52.675785 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10fbfc3d-f524-4880-897d-f6e26457c3c2 None None] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:35:52.738286 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b63da1-b593-4dcb-8913-6d709a499db9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:35:52.738837 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b63da1-b593-4dcb-8913-6d709a499db9 None admin] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:35:52.739110 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b63da1-b593-4dcb-8913-6d709a499db9 None admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:35:52.739374 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b63da1-b593-4dcb-8913-6d709a499db9 None admin] PATH_INFO: `/v3/projects/93e1f3226d564df686b8ca37cfd3a42c` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:35:52.741998 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b63da1-b593-4dcb-8913-6d709a499db9 None admin] RBAC: Authorizing `identity:get_project(project_id=93e1f3226d564df686b8ca37cfd3a42c)` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:35:52.742269 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b63da1-b593-4dcb-8913-6d709a499db9 None admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:35:52.749124 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 217/441] 10.222.0.25 () {56 vars in 1186 bytes} [Tue Sep 13 19:35:52 2022] GET /identity/v3/projects/93e1f3226d564df686b8ca37cfd3a42c => generated 302 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:35:52.750104 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b63da1-b593-4dcb-8913-6d709a499db9 None admin] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:35:52.806485 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff98401-d78f-4e79-a662-e4cd87a22db2 None None] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:35:52.834775 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG dbcounter [-] [87934] Writing DB stats keystone:SELECT=100 {{(pid=87934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:35:52.871632 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c575c945-bd21-4028-9b13-037ca9a8aa69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:35:52.872424 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c575c945-bd21-4028-9b13-037ca9a8aa69 None admin] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:35:52.872628 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c575c945-bd21-4028-9b13-037ca9a8aa69 None admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:35:52.872930 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c575c945-bd21-4028-9b13-037ca9a8aa69 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:35:52.886812 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c575c945-bd21-4028-9b13-037ca9a8aa69 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 19:35:52.897629 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application [None req-c575c945-bd21-4028-9b13-037ca9a8aa69 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 13 19:35:52.897629 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:35:52.897629 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:35:52.897629 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:35:52.897629 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:35:52.897629 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:35:52.897629 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:35:52.897629 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:35:52.897629 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:35:52.897629 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:35:52.897629 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:35:52.897629 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:35:52.897629 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 19:35:52.897629 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 19:35:52.897629 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 19:35:52.897629 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 19:35:52.898874 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 19:35:52.898874 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 19:35:52.898874 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 19:35:52.898874 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 19:35:52.898874 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:35:52.898874 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:35:52.898874 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:35:52.898874 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:35:52.898874 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:35:52.898874 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:35:52.898874 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:35:52.898874 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application with Lock( Sep 13 19:35:52.898874 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:35:52.898874 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:35:52.898874 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:35:52.898874 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:35:52.899835 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:35:52.899835 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:35:52.899835 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:35:52.899835 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:35:52.899835 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 19:35:52.899835 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 19:35:52.899835 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 19:35:52.899835 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 19:35:52.899835 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 19:35:52.899835 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 19:35:52.899835 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 13 19:35:52.899835 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application Sep 13 19:35:52.899835 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 225/442] 10.222.0.25 () {56 vars in 1114 bytes} [Tue Sep 13 19:35:52 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:35:52.902241 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c575c945-bd21-4028-9b13-037ca9a8aa69 None admin] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:35:52.939159 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b63da1-b593-4dcb-8913-6d709a499db9 None admin] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:35:52.969949 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG dbcounter [-] [87935] Writing DB stats keystone:SELECT=100 {{(pid=87935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:35:52.995057 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d72500f-0ed3-46b1-baef-a361712eeab0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:35:52.995057 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d72500f-0ed3-46b1-baef-a361712eeab0 None admin] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:35:52.995355 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d72500f-0ed3-46b1-baef-a361712eeab0 None admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:35:52.995355 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d72500f-0ed3-46b1-baef-a361712eeab0 None admin] PATH_INFO: `/v3/groups/e392f0a270074d3ea54b38df964ba25f` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:35:52.996601 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d72500f-0ed3-46b1-baef-a361712eeab0 None admin] RBAC: Authorizing `identity:get_group(group_id=e392f0a270074d3ea54b38df964ba25f)` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:35:53.003709 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d72500f-0ed3-46b1-baef-a361712eeab0 None admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:35:53.003709 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 218/443] 10.222.0.25 () {56 vars in 1180 bytes} [Tue Sep 13 19:35:52 2022] GET /identity/v3/groups/e392f0a270074d3ea54b38df964ba25f => generated 226 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:35:53.003709 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d72500f-0ed3-46b1-baef-a361712eeab0 None admin] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:35:53.036386 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c575c945-bd21-4028-9b13-037ca9a8aa69 None admin] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:35:53.088936 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6346297-91bc-404e-ac94-4b0e076b7454 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:35:53.089947 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6346297-91bc-404e-ac94-4b0e076b7454 None admin] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:35:53.090833 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6346297-91bc-404e-ac94-4b0e076b7454 None admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:35:53.090833 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6346297-91bc-404e-ac94-4b0e076b7454 None admin] PATH_INFO: `/v3/roles` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:35:53.091134 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6346297-91bc-404e-ac94-4b0e076b7454 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=87934) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:35:53.091448 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6346297-91bc-404e-ac94-4b0e076b7454 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:35:53.092920 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6346297-91bc-404e-ac94-4b0e076b7454 None admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:35:53.113576 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 226/444] 10.222.0.25 () {56 vars in 1111 bytes} [Tue Sep 13 19:35:52 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 19:35:53.114277 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6346297-91bc-404e-ac94-4b0e076b7454 None admin] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:35:53.159328 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d72500f-0ed3-46b1-baef-a361712eeab0 None admin] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:35:53.165280 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG dbcounter [-] [87934] Writing DB stats keystone:SELECT=100 {{(pid=87934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:35:53.212793 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d9417a-6b76-44d7-bdbf-47e086be5f54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:35:53.214657 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d9417a-6b76-44d7-bdbf-47e086be5f54 None admin] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:35:53.214657 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d9417a-6b76-44d7-bdbf-47e086be5f54 None admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:35:53.214657 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d9417a-6b76-44d7-bdbf-47e086be5f54 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:35:53.230558 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d9417a-6b76-44d7-bdbf-47e086be5f54 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 19:35:53.235592 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application [None req-26d9417a-6b76-44d7-bdbf-47e086be5f54 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 19:35:53.235592 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:35:53.235592 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:35:53.235592 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:35:53.235592 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:35:53.235592 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:35:53.235592 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:35:53.235592 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:35:53.235592 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:35:53.235592 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:35:53.235592 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:35:53.235592 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:35:53.235592 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 19:35:53.235592 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 19:35:53.235592 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 19:35:53.235592 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 19:35:53.236669 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 19:35:53.236669 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 19:35:53.236669 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 19:35:53.236669 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 19:35:53.236669 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:35:53.236669 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:35:53.236669 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:35:53.236669 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:35:53.236669 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:35:53.236669 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:35:53.236669 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:35:53.236669 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application with Lock( Sep 13 19:35:53.236669 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:35:53.236669 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:35:53.236669 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:35:53.236669 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:35:53.237468 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:35:53.237468 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:35:53.237468 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:35:53.237468 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:35:53.237468 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 19:35:53.237468 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 19:35:53.237468 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 19:35:53.237468 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 19:35:53.237468 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 19:35:53.237468 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 19:35:53.237468 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 19:35:53.237468 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application Sep 13 19:35:53.237468 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 219/445] 10.222.0.25 () {56 vars in 1096 bytes} [Tue Sep 13 19:35:53 2022] GET /identity/v3/roles/admin => generated 83 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:35:53.238212 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d9417a-6b76-44d7-bdbf-47e086be5f54 None admin] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:35:53.278675 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6346297-91bc-404e-ac94-4b0e076b7454 None admin] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:35:53.316611 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG dbcounter [-] [87935] Writing DB stats keystone:SELECT=100 {{(pid=87935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:35:53.317143 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182288b7-3a54-462c-bbaf-1bd225e53151 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:35:53.317956 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182288b7-3a54-462c-bbaf-1bd225e53151 None admin] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:35:53.318163 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182288b7-3a54-462c-bbaf-1bd225e53151 None admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:35:53.318619 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182288b7-3a54-462c-bbaf-1bd225e53151 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:35:53.319623 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-182288b7-3a54-462c-bbaf-1bd225e53151 None admin] RBAC: Adding query filter params (group.id=e392f0a270074d3ea54b38df964ba25f, role.id=a259191f6d0e46fabd9f34536bb28747, scope.project.id=93e1f3226d564df686b8ca37cfd3a42c) {{(pid=87934) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:35:53.319934 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-182288b7-3a54-462c-bbaf-1bd225e53151 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:35:53.321439 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-182288b7-3a54-462c-bbaf-1bd225e53151 None admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:35:53.327643 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 227/446] 10.222.0.25 () {56 vars in 1376 bytes} [Tue Sep 13 19:35:53 2022] GET /identity/v3/role_assignments?group.id=e392f0a270074d3ea54b38df964ba25f&scope.project.id=93e1f3226d564df686b8ca37cfd3a42c&role.id=a259191f6d0e46fabd9f34536bb28747 => generated 611 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:35:53.328604 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182288b7-3a54-462c-bbaf-1bd225e53151 None admin] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:35:53.392304 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d9417a-6b76-44d7-bdbf-47e086be5f54 None admin] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:35:53.447295 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a371be-df60-4670-8804-db5817d2fb0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:35:53.447928 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a371be-df60-4670-8804-db5817d2fb0b None admin] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:35:53.448225 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a371be-df60-4670-8804-db5817d2fb0b None admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:35:53.448512 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a371be-df60-4670-8804-db5817d2fb0b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:35:53.465086 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG dbcounter [-] [87934] Writing DB stats keystone:SELECT=100 {{(pid=87934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:35:53.470843 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182288b7-3a54-462c-bbaf-1bd225e53151 None admin] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:35:53.516062 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2eb522-b301-41ec-b680-01c43e450202 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:35:53.517408 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2eb522-b301-41ec-b680-01c43e450202 None admin] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:35:53.517685 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2eb522-b301-41ec-b680-01c43e450202 None admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:35:53.517952 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2eb522-b301-41ec-b680-01c43e450202 None admin] PATH_INFO: `/v3/roles` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:35:53.518618 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d2eb522-b301-41ec-b680-01c43e450202 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87934) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:35:53.518918 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d2eb522-b301-41ec-b680-01c43e450202 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:35:53.520881 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d2eb522-b301-41ec-b680-01c43e450202 None admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:35:53.529567 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 228/447] 10.222.0.25 () {56 vars in 1099 bytes} [Tue Sep 13 19:35:53 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:35:53.534331 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a371be-df60-4670-8804-db5817d2fb0b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:35:53.535250 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2eb522-b301-41ec-b680-01c43e450202 None admin] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:35:53.535810 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a371be-df60-4670-8804-db5817d2fb0b None admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:35:53.607380 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG dbcounter [-] [87935] Writing DB stats keystone:SELECT=100 {{(pid=87935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:35:53.681699 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2eb522-b301-41ec-b680-01c43e450202 None admin] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:35:53.689645 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 220/448] 10.222.0.25 () {58 vars in 1282 bytes} [Tue Sep 13 19:35:53 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 452 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 13 19:35:53.695711 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a371be-df60-4670-8804-db5817d2fb0b None admin] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:35:53.735458 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5968eed-8fd0-4f1d-a62d-a5402f2b72ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:35:53.736198 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5968eed-8fd0-4f1d-a62d-a5402f2b72ba None admin] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:35:53.736498 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5968eed-8fd0-4f1d-a62d-a5402f2b72ba None admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:35:53.736781 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5968eed-8fd0-4f1d-a62d-a5402f2b72ba None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:35:53.787888 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG dbcounter [-] [87934] Writing DB stats keystone:SELECT=100 {{(pid=87934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:35:53.827250 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a371be-df60-4670-8804-db5817d2fb0b None admin] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:35:53.840457 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5968eed-8fd0-4f1d-a62d-a5402f2b72ba None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:35:53.841921 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5968eed-8fd0-4f1d-a62d-a5402f2b72ba None admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:35:53.884003 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67499a2e-217d-46c2-a8b5-fe45be25110e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:35:53.884676 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67499a2e-217d-46c2-a8b5-fe45be25110e None admin] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:35:53.884953 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67499a2e-217d-46c2-a8b5-fe45be25110e None admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:35:53.885224 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67499a2e-217d-46c2-a8b5-fe45be25110e None admin] PATH_INFO: `/v3/projects/93e1f3226d564df686b8ca37cfd3a42c` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:35:53.886383 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67499a2e-217d-46c2-a8b5-fe45be25110e None admin] RBAC: Authorizing `identity:get_project(project_id=93e1f3226d564df686b8ca37cfd3a42c)` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:35:53.887864 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67499a2e-217d-46c2-a8b5-fe45be25110e None admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:35:53.889768 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 221/449] 10.222.0.25 () {56 vars in 1186 bytes} [Tue Sep 13 19:35:53 2022] GET /identity/v3/projects/93e1f3226d564df686b8ca37cfd3a42c => generated 302 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 19:35:53.895399 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67499a2e-217d-46c2-a8b5-fe45be25110e None admin] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:35:53.918165 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG dbcounter [-] [87935] Writing DB stats keystone:SELECT=100 {{(pid=87935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:35:53.968326 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 229/450] 10.222.0.25 () {58 vars in 1282 bytes} [Tue Sep 13 19:35:53 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 433 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 13 19:35:53.975658 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5968eed-8fd0-4f1d-a62d-a5402f2b72ba None admin] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:35:54.026556 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67499a2e-217d-46c2-a8b5-fe45be25110e None admin] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:35:54.047340 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG dbcounter [-] [87934] Writing DB stats keystone:SELECT=100 {{(pid=87934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:35:54.067715 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8b5fe7-4c30-46ed-9a23-1616b4bf3685 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:35:54.068396 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8b5fe7-4c30-46ed-9a23-1616b4bf3685 None admin] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:35:54.068937 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8b5fe7-4c30-46ed-9a23-1616b4bf3685 None admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:35:54.068937 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8b5fe7-4c30-46ed-9a23-1616b4bf3685 None admin] PATH_INFO: `/v3/groups/e392f0a270074d3ea54b38df964ba25f` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:35:54.070264 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf8b5fe7-4c30-46ed-9a23-1616b4bf3685 None admin] RBAC: Authorizing `identity:get_group(group_id=e392f0a270074d3ea54b38df964ba25f)` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:35:54.071715 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf8b5fe7-4c30-46ed-9a23-1616b4bf3685 None admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:35:54.073364 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 222/451] 10.222.0.25 () {56 vars in 1180 bytes} [Tue Sep 13 19:35:53 2022] GET /identity/v3/groups/e392f0a270074d3ea54b38df964ba25f => generated 226 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 19:35:54.079283 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8b5fe7-4c30-46ed-9a23-1616b4bf3685 None admin] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:35:54.096526 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5968eed-8fd0-4f1d-a62d-a5402f2b72ba None admin] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:35:54.133667 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648ff1f1-5a18-4f2b-bacf-3e3e9f5e98ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:35:54.134310 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648ff1f1-5a18-4f2b-bacf-3e3e9f5e98ff None admin] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:35:54.134651 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648ff1f1-5a18-4f2b-bacf-3e3e9f5e98ff None admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:35:54.134918 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648ff1f1-5a18-4f2b-bacf-3e3e9f5e98ff None admin] PATH_INFO: `/v3/projects/455c35cf3f4241039d612c7710aac324` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:35:54.136102 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-648ff1f1-5a18-4f2b-bacf-3e3e9f5e98ff None admin] RBAC: Authorizing `identity:get_project(project_id=455c35cf3f4241039d612c7710aac324)` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:35:54.137592 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-648ff1f1-5a18-4f2b-bacf-3e3e9f5e98ff None admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:35:54.139225 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 230/452] 10.222.0.25 () {56 vars in 1186 bytes} [Tue Sep 13 19:35:53 2022] GET /identity/v3/projects/455c35cf3f4241039d612c7710aac324 => generated 344 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 19:35:54.145960 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648ff1f1-5a18-4f2b-bacf-3e3e9f5e98ff None admin] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:35:54.189633 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG dbcounter [-] [87935] Writing DB stats keystone:SELECT=100 {{(pid=87935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:35:54.219576 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8b5fe7-4c30-46ed-9a23-1616b4bf3685 None admin] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:35:54.260493 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648ff1f1-5a18-4f2b-bacf-3e3e9f5e98ff None admin] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:35:54.266629 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f536f1b-1882-4939-b2b2-a818ab761acc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:35:54.267229 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f536f1b-1882-4939-b2b2-a818ab761acc None admin] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:35:54.267503 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f536f1b-1882-4939-b2b2-a818ab761acc None admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:35:54.267766 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f536f1b-1882-4939-b2b2-a818ab761acc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:35:54.268519 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f536f1b-1882-4939-b2b2-a818ab761acc None admin] RBAC: Adding query filter params (group.id=e392f0a270074d3ea54b38df964ba25f, role.id=8af3d83a03144ae8bacdb82d9a108110, scope.project.id=93e1f3226d564df686b8ca37cfd3a42c) {{(pid=87935) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:35:54.268824 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f536f1b-1882-4939-b2b2-a818ab761acc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:35:54.270272 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f536f1b-1882-4939-b2b2-a818ab761acc None admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:35:54.280992 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 223/453] 10.222.0.25 () {56 vars in 1376 bytes} [Tue Sep 13 19:35:54 2022] GET /identity/v3/role_assignments?group.id=e392f0a270074d3ea54b38df964ba25f&scope.project.id=93e1f3226d564df686b8ca37cfd3a42c&role.id=8af3d83a03144ae8bacdb82d9a108110 => generated 611 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 19:35:54.301008 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG dbcounter [-] [87934] Writing DB stats keystone:SELECT=100 {{(pid=87934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:35:54.309009 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b956ba49-52b7-477d-964b-652b3a21cf0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:35:54.311242 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b956ba49-52b7-477d-964b-652b3a21cf0a None admin] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:35:54.311524 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b956ba49-52b7-477d-964b-652b3a21cf0a None admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:35:54.311798 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b956ba49-52b7-477d-964b-652b3a21cf0a None admin] PATH_INFO: `/v3/groups/62f5f12c6f674fd4b2b04fe72d64489d` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:35:54.313535 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b956ba49-52b7-477d-964b-652b3a21cf0a None admin] RBAC: Authorizing `identity:get_group(group_id=62f5f12c6f674fd4b2b04fe72d64489d)` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:35:54.315516 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b956ba49-52b7-477d-964b-652b3a21cf0a None admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:35:54.317378 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 231/454] 10.222.0.25 () {56 vars in 1180 bytes} [Tue Sep 13 19:35:54 2022] GET /identity/v3/groups/62f5f12c6f674fd4b2b04fe72d64489d => generated 229 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 19:35:54.326606 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f536f1b-1882-4939-b2b2-a818ab761acc None admin] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:35:54.463207 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f536f1b-1882-4939-b2b2-a818ab761acc None admin] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:35:54.512836 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79343ced-7113-4008-8a86-f1ef25f06e98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:35:54.513473 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79343ced-7113-4008-8a86-f1ef25f06e98 None admin] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:35:54.513753 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79343ced-7113-4008-8a86-f1ef25f06e98 None admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:35:54.514021 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79343ced-7113-4008-8a86-f1ef25f06e98 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:35:54.514809 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79343ced-7113-4008-8a86-f1ef25f06e98 None admin] RBAC: Adding query filter params (group.id=62f5f12c6f674fd4b2b04fe72d64489d, role.id=6ca1d4427ff64e0a9d25d96cfb1445f6, scope.project.id=455c35cf3f4241039d612c7710aac324) {{(pid=87935) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:35:54.515123 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79343ced-7113-4008-8a86-f1ef25f06e98 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:35:54.516681 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79343ced-7113-4008-8a86-f1ef25f06e98 None admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:35:54.525406 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 224/455] 10.222.0.25 () {56 vars in 1376 bytes} [Tue Sep 13 19:35:54 2022] GET /identity/v3/role_assignments?group.id=62f5f12c6f674fd4b2b04fe72d64489d&scope.project.id=455c35cf3f4241039d612c7710aac324&role.id=6ca1d4427ff64e0a9d25d96cfb1445f6 => generated 611 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:35:57.436170 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bde3cb-c712-484c-8bde-faa85be8e47e None None] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:35:57.437278 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bde3cb-c712-484c-8bde-faa85be8e47e None None] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:35:57.437770 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bde3cb-c712-484c-8bde-faa85be8e47e None None] PATH_INFO: `/` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:35:57.439646 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 232/456] 10.222.0.25 () {54 vars in 927 bytes} [Tue Sep 13 19:35:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:35:57.445810 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9784f0ee-1346-406d-a92f-8129f7059fea None None] REQUEST_METHOD: `POST` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:35:57.446752 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9784f0ee-1346-406d-a92f-8129f7059fea None None] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:35:57.447228 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9784f0ee-1346-406d-a92f-8129f7059fea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:35:57.475068 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b16a6f-eebb-41f9-813c-4def0f5ecc1c None None] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:35:57.475696 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b16a6f-eebb-41f9-813c-4def0f5ecc1c None None] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:35:57.476167 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b16a6f-eebb-41f9-813c-4def0f5ecc1c None None] PATH_INFO: `/` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:35:57.477793 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 233/457] 10.222.0.25 () {54 vars in 927 bytes} [Tue Sep 13 19:35:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 13 19:35:57.483383 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.auth.core [None req-9784f0ee-1346-406d-a92f-8129f7059fea None None] MFA Rules not processed for user `7b0aed92d02344acb92a0e4aa67c3068`. Rule list: `[]` (Enabled: `True`). {{(pid=87935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:35:57.484806 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460dbf6c-0564-4939-8c8a-379b8aa2c2d9 None None] REQUEST_METHOD: `POST` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:35:57.484958 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.fernet_utils [None req-9784f0ee-1346-406d-a92f-8129f7059fea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:35:57.485440 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460dbf6c-0564-4939-8c8a-379b8aa2c2d9 None None] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:35:57.485921 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460dbf6c-0564-4939-8c8a-379b8aa2c2d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:35:57.505930 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG dbcounter [-] [87935] Writing DB stats keystone:SELECT=100 {{(pid=87935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:35:57.514202 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.auth.core [None req-460dbf6c-0564-4939-8c8a-379b8aa2c2d9 None None] MFA Rules not processed for user `7b0aed92d02344acb92a0e4aa67c3068`. Rule list: `[]` (Enabled: `True`). {{(pid=87934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:35:57.515403 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.fernet_utils [None req-460dbf6c-0564-4939-8c8a-379b8aa2c2d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:35:57.655097 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 225/458] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Sep 13 19:35:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 19:35:57.670909 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 234/459] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Sep 13 19:35:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 19:35:58.081899 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa505f05-cc7e-4108-b4fc-d6178cc48fcd None None] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:35:58.082601 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa505f05-cc7e-4108-b4fc-d6178cc48fcd None None] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:35:58.083079 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa505f05-cc7e-4108-b4fc-d6178cc48fcd None None] PATH_INFO: `/` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:35:58.086636 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 226/460] 10.222.0.25 () {54 vars in 927 bytes} [Tue Sep 13 19:35:58 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:35:58.092984 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf185e6-c627-4fca-a4cb-726819e7b742 None None] REQUEST_METHOD: `POST` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:35:58.093426 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf185e6-c627-4fca-a4cb-726819e7b742 None None] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:35:58.093900 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf185e6-c627-4fca-a4cb-726819e7b742 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:35:58.120551 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa505f05-cc7e-4108-b4fc-d6178cc48fcd None None] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:35:58.135373 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.auth.core [None req-dcf185e6-c627-4fca-a4cb-726819e7b742 None None] MFA Rules not processed for user `7b0aed92d02344acb92a0e4aa67c3068`. Rule list: `[]` (Enabled: `True`). {{(pid=87934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:35:58.137356 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.fernet_utils [None req-dcf185e6-c627-4fca-a4cb-726819e7b742 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:35:58.258601 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 235/461] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Sep 13 19:35:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 13 19:35:58.260874 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76b56ce-37ca-4e33-96be-81eb863fa4b5 None None] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:35:58.261368 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76b56ce-37ca-4e33-96be-81eb863fa4b5 None None] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:35:58.261846 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76b56ce-37ca-4e33-96be-81eb863fa4b5 None None] PATH_INFO: `/` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:35:58.264748 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 236/462] 10.222.0.25 () {54 vars in 927 bytes} [Tue Sep 13 19:35:58 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:35:58.275779 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044f1cad-173c-4bc6-8166-1b8e478a601f None None] REQUEST_METHOD: `POST` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:35:58.276364 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044f1cad-173c-4bc6-8166-1b8e478a601f None None] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:35:58.277142 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044f1cad-173c-4bc6-8166-1b8e478a601f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:35:58.304335 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.auth.core [None req-044f1cad-173c-4bc6-8166-1b8e478a601f None None] MFA Rules not processed for user `7b0aed92d02344acb92a0e4aa67c3068`. Rule list: `[]` (Enabled: `True`). {{(pid=87934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:35:58.305763 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.fernet_utils [None req-044f1cad-173c-4bc6-8166-1b8e478a601f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:35:58.335762 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa505f05-cc7e-4108-b4fc-d6178cc48fcd None None] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:35:58.367247 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG dbcounter [-] [87934] Writing DB stats keystone:SELECT=100 {{(pid=87934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:35:58.373482 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29a193b-c73c-4f2f-900a-a0a3c1cc6b18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:35:58.374475 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29a193b-c73c-4f2f-900a-a0a3c1cc6b18 None admin] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:35:58.374899 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29a193b-c73c-4f2f-900a-a0a3c1cc6b18 None admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:35:58.375342 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29a193b-c73c-4f2f-900a-a0a3c1cc6b18 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:35:58.386198 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 237/463] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Sep 13 19:35:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 13 19:35:58.386923 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a29a193b-c73c-4f2f-900a-a0a3c1cc6b18 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:35:58.387599 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044f1cad-173c-4bc6-8166-1b8e478a601f None None] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:35:58.388493 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a29a193b-c73c-4f2f-900a-a0a3c1cc6b18 None admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:35:58.404427 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application [None req-a29a193b-c73c-4f2f-900a-a0a3c1cc6b18 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 19:35:58.404427 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:35:58.404427 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:35:58.404427 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:35:58.404427 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:35:58.404427 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:35:58.404427 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:35:58.404427 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:35:58.404427 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:35:58.404427 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:35:58.404427 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:35:58.404427 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:35:58.404427 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 19:35:58.404427 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 19:35:58.404427 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 19:35:58.404427 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 19:35:58.405485 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:35:58.405485 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:35:58.405485 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:35:58.405485 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:35:58.405485 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:35:58.405485 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:35:58.405485 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:35:58.405485 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application with Lock( Sep 13 19:35:58.405485 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:35:58.405485 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:35:58.405485 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:35:58.405485 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:35:58.405485 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:35:58.405485 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:35:58.405485 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:35:58.405485 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:35:58.405485 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 19:35:58.406378 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 19:35:58.406378 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 19:35:58.406378 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application Sep 13 19:35:58.408552 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 227/464] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Sep 13 19:35:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 289 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:35:58.413747 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG dbcounter [-] [87935] Writing DB stats keystone:SELECT=100 {{(pid=87935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:35:58.415333 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29a193b-c73c-4f2f-900a-a0a3c1cc6b18 None admin] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:35:58.514504 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044f1cad-173c-4bc6-8166-1b8e478a601f None None] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:35:58.524325 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29a193b-c73c-4f2f-900a-a0a3c1cc6b18 None admin] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:35:58.551937 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0b3a4a-91e6-4dd8-92e3-1b141c320692 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:35:58.553721 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0b3a4a-91e6-4dd8-92e3-1b141c320692 None admin] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:35:58.554265 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0b3a4a-91e6-4dd8-92e3-1b141c320692 None admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:35:58.554710 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0b3a4a-91e6-4dd8-92e3-1b141c320692 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:35:58.563106 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a8a2ae-f88b-4e87-ab01-03dbc9bc1f8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:35:58.564022 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a8a2ae-f88b-4e87-ab01-03dbc9bc1f8b None admin] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:35:58.564518 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a8a2ae-f88b-4e87-ab01-03dbc9bc1f8b None admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:35:58.564991 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a8a2ae-f88b-4e87-ab01-03dbc9bc1f8b None admin] PATH_INFO: `/v3/domains` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:35:58.565838 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a8a2ae-f88b-4e87-ab01-03dbc9bc1f8b None admin] RBAC: Adding query filter params (name=Default) {{(pid=87935) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:35:58.566335 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a8a2ae-f88b-4e87-ab01-03dbc9bc1f8b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:35:58.567327 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c0b3a4a-91e6-4dd8-92e3-1b141c320692 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:35:58.568167 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a8a2ae-f88b-4e87-ab01-03dbc9bc1f8b None admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:35:58.569305 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c0b3a4a-91e6-4dd8-92e3-1b141c320692 None admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:35:58.581956 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 228/465] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Sep 13 19:35:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 19:35:58.588492 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a8a2ae-f88b-4e87-ab01-03dbc9bc1f8b None admin] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:35:58.588631 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application [None req-9c0b3a4a-91e6-4dd8-92e3-1b141c320692 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 19:35:58.588631 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:35:58.588631 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:35:58.588631 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:35:58.588631 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:35:58.588631 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:35:58.588631 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:35:58.588631 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:35:58.588631 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:35:58.588631 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:35:58.588631 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:35:58.588631 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:35:58.588631 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 19:35:58.588631 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 19:35:58.588631 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 19:35:58.588631 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 19:35:58.589464 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:35:58.589464 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:35:58.589464 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:35:58.589464 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:35:58.589464 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:35:58.589464 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:35:58.589464 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:35:58.589464 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application with Lock( Sep 13 19:35:58.589464 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:35:58.589464 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:35:58.589464 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:35:58.589464 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:35:58.589464 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:35:58.589464 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:35:58.589464 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:35:58.589464 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:35:58.589464 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 19:35:58.590312 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 19:35:58.590312 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 19:35:58.590312 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application Sep 13 19:35:58.590312 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 238/466] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Sep 13 19:35:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:35:58.594852 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0b3a4a-91e6-4dd8-92e3-1b141c320692 None admin] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:35:58.658965 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG dbcounter [-] [87934] Writing DB stats keystone:SELECT=100 {{(pid=87934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:35:58.682370 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG dbcounter [-] [87935] Writing DB stats keystone:SELECT=100 {{(pid=87935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:35:58.727028 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0b3a4a-91e6-4dd8-92e3-1b141c320692 None admin] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:35:58.748559 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a8a2ae-f88b-4e87-ab01-03dbc9bc1f8b None admin] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:35:58.763949 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bed6369-3924-49b6-9699-fbd7c57ec024 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:35:58.764842 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bed6369-3924-49b6-9699-fbd7c57ec024 None admin] REQUEST_METHOD: `POST` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:35:58.765291 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bed6369-3924-49b6-9699-fbd7c57ec024 None admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:35:58.765703 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bed6369-3924-49b6-9699-fbd7c57ec024 None admin] PATH_INFO: `/v3/users` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:35:58.766511 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bed6369-3924-49b6-9699-fbd7c57ec024 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:35:58.768084 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bed6369-3924-49b6-9699-fbd7c57ec024 None admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:35:58.795083 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 239/467] 10.222.0.25 () {60 vars in 1132 bytes} [Tue Sep 13 19:35:58 2022] POST /identity/v3/users => generated 246 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 19:35:58.796246 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bed6369-3924-49b6-9699-fbd7c57ec024 None admin] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:35:58.804383 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ec3de3-8915-46c1-8d41-02d386306f7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:35:58.805335 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ec3de3-8915-46c1-8d41-02d386306f7e None admin] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:35:58.805747 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ec3de3-8915-46c1-8d41-02d386306f7e None admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:35:58.806162 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ec3de3-8915-46c1-8d41-02d386306f7e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:35:58.818816 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ec3de3-8915-46c1-8d41-02d386306f7e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:35:58.820981 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ec3de3-8915-46c1-8d41-02d386306f7e None admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:35:58.841930 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application [None req-18ec3de3-8915-46c1-8d41-02d386306f7e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 19:35:58.841930 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:35:58.841930 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:35:58.841930 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:35:58.841930 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:35:58.841930 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:35:58.841930 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:35:58.841930 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:35:58.841930 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:35:58.841930 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:35:58.841930 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:35:58.841930 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:35:58.841930 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 19:35:58.841930 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 19:35:58.841930 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 19:35:58.841930 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 19:35:58.842936 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:35:58.842936 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:35:58.842936 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:35:58.842936 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:35:58.842936 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:35:58.842936 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:35:58.842936 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:35:58.842936 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application with Lock( Sep 13 19:35:58.842936 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:35:58.842936 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:35:58.842936 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:35:58.842936 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:35:58.842936 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:35:58.842936 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:35:58.842936 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:35:58.842936 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:35:58.842936 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 19:35:58.843814 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 19:35:58.843814 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 19:35:58.843814 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application Sep 13 19:35:58.845883 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 229/468] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Sep 13 19:35:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 263 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:35:58.847003 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ec3de3-8915-46c1-8d41-02d386306f7e None admin] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:35:58.940567 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG dbcounter [-] [87934] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:35:58.951372 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bed6369-3924-49b6-9699-fbd7c57ec024 None admin] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:35:59.005194 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ec3de3-8915-46c1-8d41-02d386306f7e None admin] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:35:59.006047 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4be3ba2-b852-4941-9b59-bf1ec04c9696 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:35:59.006803 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4be3ba2-b852-4941-9b59-bf1ec04c9696 None admin] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:35:59.007088 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4be3ba2-b852-4941-9b59-bf1ec04c9696 None admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:35:59.007355 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4be3ba2-b852-4941-9b59-bf1ec04c9696 None admin] PATH_INFO: `/v3/domains` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:35:59.008011 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4be3ba2-b852-4941-9b59-bf1ec04c9696 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87934) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:35:59.009150 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4be3ba2-b852-4941-9b59-bf1ec04c9696 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:35:59.009895 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4be3ba2-b852-4941-9b59-bf1ec04c9696 None admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:35:59.015256 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG dbcounter [-] [87935] Writing DB stats keystone:SELECT=100 {{(pid=87935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:35:59.029205 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 240/469] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Sep 13 19:35:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:35:59.029205 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4be3ba2-b852-4941-9b59-bf1ec04c9696 None admin] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:35:59.053787 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b659ae15-087c-4ee2-9e5d-f5d5af29e18e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:35:59.054650 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b659ae15-087c-4ee2-9e5d-f5d5af29e18e None admin] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:35:59.055032 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b659ae15-087c-4ee2-9e5d-f5d5af29e18e None admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:35:59.055406 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b659ae15-087c-4ee2-9e5d-f5d5af29e18e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:35:59.070366 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b659ae15-087c-4ee2-9e5d-f5d5af29e18e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:35:59.071553 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b659ae15-087c-4ee2-9e5d-f5d5af29e18e None admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:35:59.091425 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application [None req-b659ae15-087c-4ee2-9e5d-f5d5af29e18e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 19:35:59.091425 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:35:59.091425 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:35:59.091425 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:35:59.091425 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:35:59.091425 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:35:59.091425 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:35:59.091425 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:35:59.091425 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:35:59.091425 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:35:59.091425 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:35:59.091425 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:35:59.091425 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 19:35:59.091425 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 19:35:59.091425 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 19:35:59.091425 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 19:35:59.093775 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:35:59.093775 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:35:59.093775 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:35:59.093775 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:35:59.093775 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:35:59.093775 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:35:59.093775 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:35:59.093775 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application with Lock( Sep 13 19:35:59.093775 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:35:59.093775 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:35:59.093775 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:35:59.093775 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:35:59.093775 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:35:59.093775 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:35:59.093775 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:35:59.093775 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:35:59.093775 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 19:35:59.095894 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 19:35:59.095894 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 19:35:59.095894 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application Sep 13 19:35:59.095894 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 230/470] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Sep 13 19:35:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:35:59.095894 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b659ae15-087c-4ee2-9e5d-f5d5af29e18e None admin] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:35:59.177679 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4be3ba2-b852-4941-9b59-bf1ec04c9696 None admin] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:35:59.218819 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d585d324-f446-48ab-b0ab-af06e2800198 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:35:59.219462 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d585d324-f446-48ab-b0ab-af06e2800198 None admin] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:35:59.219740 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d585d324-f446-48ab-b0ab-af06e2800198 None admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:35:59.220012 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d585d324-f446-48ab-b0ab-af06e2800198 None admin] PATH_INFO: `/v3/domains` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:35:59.220766 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d585d324-f446-48ab-b0ab-af06e2800198 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87934) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:35:59.221065 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d585d324-f446-48ab-b0ab-af06e2800198 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:35:59.222445 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d585d324-f446-48ab-b0ab-af06e2800198 None admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:35:59.238738 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 241/471] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Sep 13 19:35:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:35:59.239872 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d585d324-f446-48ab-b0ab-af06e2800198 None admin] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:35:59.255129 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b659ae15-087c-4ee2-9e5d-f5d5af29e18e None admin] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:35:59.263271 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG dbcounter [-] [87934] Writing DB stats keystone:SELECT=100 {{(pid=87934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:35:59.299962 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d8b1a8-1c10-4644-962b-84fa85def662 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:35:59.300726 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d8b1a8-1c10-4644-962b-84fa85def662 None admin] REQUEST_METHOD: `POST` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:35:59.301106 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d8b1a8-1c10-4644-962b-84fa85def662 None admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:35:59.301380 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d8b1a8-1c10-4644-962b-84fa85def662 None admin] PATH_INFO: `/v3/users` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:35:59.302005 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d8b1a8-1c10-4644-962b-84fa85def662 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:35:59.304545 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d8b1a8-1c10-4644-962b-84fa85def662 None admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:35:59.332470 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 231/472] 10.222.0.25 () {60 vars in 1132 bytes} [Tue Sep 13 19:35:59 2022] POST /identity/v3/users => generated 248 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 19:35:59.333308 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d8b1a8-1c10-4644-962b-84fa85def662 None admin] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:35:59.361065 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG dbcounter [-] [87935] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:35:59.391347 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d585d324-f446-48ab-b0ab-af06e2800198 None admin] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:35:59.436295 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33821bb5-095c-4658-8f25-98ed94c71f5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:35:59.437359 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33821bb5-095c-4658-8f25-98ed94c71f5e None admin] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:35:59.437851 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33821bb5-095c-4658-8f25-98ed94c71f5e None admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:35:59.438347 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33821bb5-095c-4658-8f25-98ed94c71f5e None admin] PATH_INFO: `/v3/domains` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:35:59.439231 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33821bb5-095c-4658-8f25-98ed94c71f5e None admin] RBAC: Adding query filter params (name=Default) {{(pid=87934) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:35:59.439747 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33821bb5-095c-4658-8f25-98ed94c71f5e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:35:59.441394 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33821bb5-095c-4658-8f25-98ed94c71f5e None admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:35:59.462918 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 242/473] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Sep 13 19:35:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:35:59.464810 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86764b42-6998-45f8-ae21-7093b159bcf0 None None] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:35:59.465443 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86764b42-6998-45f8-ae21-7093b159bcf0 None None] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:35:59.465936 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86764b42-6998-45f8-ae21-7093b159bcf0 None None] PATH_INFO: `/` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:35:59.468387 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 243/474] 10.222.0.25 () {54 vars in 927 bytes} [Tue Sep 13 19:35:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:35:59.469619 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86764b42-6998-45f8-ae21-7093b159bcf0 None None] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:35:59.481826 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d8b1a8-1c10-4644-962b-84fa85def662 None admin] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:35:59.526140 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b53b72e-645e-48cc-be0d-a86f58063872 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:35:59.527073 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b53b72e-645e-48cc-be0d-a86f58063872 None admin] REQUEST_METHOD: `POST` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:35:59.527073 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b53b72e-645e-48cc-be0d-a86f58063872 None admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:35:59.527291 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b53b72e-645e-48cc-be0d-a86f58063872 None admin] PATH_INFO: `/v3/users` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:35:59.527905 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b53b72e-645e-48cc-be0d-a86f58063872 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:35:59.530436 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b53b72e-645e-48cc-be0d-a86f58063872 None admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:35:59.572306 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 232/475] 10.222.0.25 () {60 vars in 1132 bytes} [Tue Sep 13 19:35:59 2022] POST /identity/v3/users => generated 248 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 19:35:59.573945 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973333b2-c688-41da-b317-29f23e898744 None None] REQUEST_METHOD: `POST` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:35:59.574633 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973333b2-c688-41da-b317-29f23e898744 None None] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:35:59.574808 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973333b2-c688-41da-b317-29f23e898744 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:35:59.591446 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG dbcounter [-] [87934] Writing DB stats keystone:SELECT=100 {{(pid=87934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:35:59.628656 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.auth.core [None req-973333b2-c688-41da-b317-29f23e898744 None None] MFA Rules not processed for user `7b0aed92d02344acb92a0e4aa67c3068`. Rule list: `[]` (Enabled: `True`). {{(pid=87935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:35:59.631279 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.fernet_utils [None req-973333b2-c688-41da-b317-29f23e898744 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:35:59.657114 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86764b42-6998-45f8-ae21-7093b159bcf0 None None] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:35:59.729033 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5eb26a5-940d-4535-bcc5-8f21465349e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:35:59.730449 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5eb26a5-940d-4535-bcc5-8f21465349e3 None admin] REQUEST_METHOD: `POST` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:35:59.731176 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5eb26a5-940d-4535-bcc5-8f21465349e3 None admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:35:59.731945 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5eb26a5-940d-4535-bcc5-8f21465349e3 None admin] PATH_INFO: `/v3/users` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:35:59.733441 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5eb26a5-940d-4535-bcc5-8f21465349e3 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:35:59.736304 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5eb26a5-940d-4535-bcc5-8f21465349e3 None admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:35:59.784432 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 244/476] 10.222.0.25 () {60 vars in 1132 bytes} [Tue Sep 13 19:35:59 2022] POST /identity/v3/users => generated 249 bytes in 312 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 19:35:59.787444 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG dbcounter [-] [87935] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:35:59.800179 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 233/477] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Sep 13 19:35:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 19:36:00.103247 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5eb26a5-940d-4535-bcc5-8f21465349e3 None admin] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:36:00.240990 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5eb26a5-940d-4535-bcc5-8f21465349e3 None admin] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:36:00.291413 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG dbcounter [-] [87934] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:36:00.297785 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8cfb3d-2db5-465d-aada-5159121efaec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:36:00.298487 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8cfb3d-2db5-465d-aada-5159121efaec None admin] REQUEST_METHOD: `POST` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:36:00.299306 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8cfb3d-2db5-465d-aada-5159121efaec None admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:36:00.299654 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8cfb3d-2db5-465d-aada-5159121efaec None admin] PATH_INFO: `/v3/roles` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:36:00.304249 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac8cfb3d-2db5-465d-aada-5159121efaec None admin] RBAC: Authorizing `identity:create_role()` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:36:00.304249 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac8cfb3d-2db5-465d-aada-5159121efaec None admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:36:00.313687 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.sql.core [None req-ac8cfb3d-2db5-465d-aada-5159121efaec None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Sep 13 19:36:00.313687 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Sep 13 19:36:00.313687 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [parameters: {'id': '8fa558fe4c1944dbb9a4d816ac472540', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Sep 13 19:36:00.313687 dv-cinder-828805-6-smb devstack@keystone.service[87934]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=87934) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Sep 13 19:36:00.335637 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application [None req-ac8cfb3d-2db5-465d-aada-5159121efaec None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Sep 13 19:36:00.335637 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:36:00.335637 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 13 19:36:00.335637 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 13 19:36:00.335637 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 13 19:36:00.335637 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 13 19:36:00.335637 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 13 19:36:00.335637 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application result = self._query(query) Sep 13 19:36:00.335637 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 13 19:36:00.335637 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application conn.query(q) Sep 13 19:36:00.335637 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 13 19:36:00.335637 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 13 19:36:00.335637 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 13 19:36:00.335637 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application result.read() Sep 13 19:36:00.335637 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 13 19:36:00.336636 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 13 19:36:00.336636 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 13 19:36:00.336636 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 13 19:36:00.336636 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 13 19:36:00.336636 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 13 19:36:00.336636 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 13 19:36:00.336636 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 13 19:36:00.336636 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Sep 13 19:36:00.336636 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application Sep 13 19:36:00.336636 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Sep 13 19:36:00.336636 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application Sep 13 19:36:00.336636 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:36:00.336636 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Sep 13 19:36:00.336636 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return method(*args, **kwargs) Sep 13 19:36:00.336636 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Sep 13 19:36:00.336636 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return ref.to_dict() Sep 13 19:36:00.336636 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 13 19:36:00.336636 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application next(self.gen) Sep 13 19:36:00.337534 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Sep 13 19:36:00.337534 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application yield resource Sep 13 19:36:00.337534 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 13 19:36:00.337534 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application next(self.gen) Sep 13 19:36:00.337534 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Sep 13 19:36:00.337534 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application self.session.rollback() Sep 13 19:36:00.337534 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 13 19:36:00.337534 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application self.force_reraise() Sep 13 19:36:00.337534 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 13 19:36:00.337534 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application raise self.value Sep 13 19:36:00.337534 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Sep 13 19:36:00.337534 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Sep 13 19:36:00.337534 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Sep 13 19:36:00.337534 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application session.commit() Sep 13 19:36:00.337534 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Sep 13 19:36:00.337534 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Sep 13 19:36:00.337534 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Sep 13 19:36:00.338397 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application self._prepare_impl() Sep 13 19:36:00.338397 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Sep 13 19:36:00.338397 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application self.session.flush() Sep 13 19:36:00.338397 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Sep 13 19:36:00.338397 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application self._flush(objects) Sep 13 19:36:00.338397 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Sep 13 19:36:00.338397 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Sep 13 19:36:00.338397 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Sep 13 19:36:00.338397 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application compat.raise_( Sep 13 19:36:00.338397 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 13 19:36:00.338397 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application raise exception Sep 13 19:36:00.338397 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Sep 13 19:36:00.338397 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application flush_context.execute() Sep 13 19:36:00.338397 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Sep 13 19:36:00.338397 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application rec.execute(self) Sep 13 19:36:00.338397 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Sep 13 19:36:00.338397 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Sep 13 19:36:00.339268 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Sep 13 19:36:00.339268 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application _emit_insert_statements( Sep 13 19:36:00.339268 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Sep 13 19:36:00.339268 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application c = connection._execute_20( Sep 13 19:36:00.339268 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Sep 13 19:36:00.339268 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Sep 13 19:36:00.339268 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Sep 13 19:36:00.339268 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Sep 13 19:36:00.339268 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Sep 13 19:36:00.339268 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application ret = self._execute_context( Sep 13 19:36:00.339268 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Sep 13 19:36:00.339268 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Sep 13 19:36:00.339268 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Sep 13 19:36:00.339268 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Sep 13 19:36:00.339268 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 13 19:36:00.339268 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application raise exception Sep 13 19:36:00.340074 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 13 19:36:00.340074 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 13 19:36:00.340074 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 13 19:36:00.340074 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 13 19:36:00.340074 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 13 19:36:00.340074 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application result = self._query(query) Sep 13 19:36:00.340074 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 13 19:36:00.340074 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application conn.query(q) Sep 13 19:36:00.340074 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 13 19:36:00.340074 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 13 19:36:00.340074 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 13 19:36:00.340074 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application result.read() Sep 13 19:36:00.340074 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 13 19:36:00.340074 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 13 19:36:00.340074 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 13 19:36:00.340074 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 13 19:36:00.340875 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 13 19:36:00.340875 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 13 19:36:00.340875 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 13 19:36:00.340875 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 13 19:36:00.340875 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Sep 13 19:36:00.340875 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Sep 13 19:36:00.340875 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application [parameters: {'id': '8fa558fe4c1944dbb9a4d816ac472540', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Sep 13 19:36:00.340875 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Sep 13 19:36:00.340875 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application Sep 13 19:36:00.340875 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 13 19:36:00.340875 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application Sep 13 19:36:00.340875 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:36:00.340875 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:36:00.340875 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:36:00.340875 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:36:00.340875 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:36:00.341663 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:36:00.341663 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:36:00.341663 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:36:00.341663 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:36:00.341663 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:36:00.341663 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:36:00.341663 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Sep 13 19:36:00.341663 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Sep 13 19:36:00.341663 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:36:00.341663 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:36:00.341663 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Sep 13 19:36:00.341663 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Sep 13 19:36:00.341663 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Sep 13 19:36:00.341663 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Sep 13 19:36:00.341663 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Sep 13 19:36:00.341663 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application Sep 13 19:36:00.342495 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 245/478] 10.222.0.25 () {60 vars in 1131 bytes} [Tue Sep 13 19:36:00 2022] POST /identity/v3/roles => generated 144 bytes in 234 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:36:00.349629 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973333b2-c688-41da-b317-29f23e898744 None None] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:36:00.526024 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973333b2-c688-41da-b317-29f23e898744 None None] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:36:00.580993 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e5fea0-8d52-4572-8794-767318101805 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:36:00.581646 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e5fea0-8d52-4572-8794-767318101805 None admin] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:36:00.581918 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e5fea0-8d52-4572-8794-767318101805 None admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:36:00.582454 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e5fea0-8d52-4572-8794-767318101805 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:36:00.597297 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e5fea0-8d52-4572-8794-767318101805 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 19:36:00.602266 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application [None req-08e5fea0-8d52-4572-8794-767318101805 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 13 19:36:00.602266 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:36:00.602266 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:36:00.602266 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:36:00.602266 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:36:00.602266 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:36:00.602266 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:36:00.602266 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:36:00.602266 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:36:00.602266 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:36:00.602266 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:36:00.602266 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:36:00.602266 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 19:36:00.602266 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 19:36:00.602266 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 19:36:00.602266 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 19:36:00.603161 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 19:36:00.603161 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 19:36:00.603161 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 19:36:00.603161 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 19:36:00.603161 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:36:00.603161 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:36:00.603161 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:36:00.603161 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:36:00.603161 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:36:00.603161 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:36:00.603161 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:36:00.603161 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application with Lock( Sep 13 19:36:00.603161 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:36:00.603161 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:36:00.603161 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:36:00.603161 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:36:00.603986 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:36:00.603986 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:36:00.603986 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:36:00.603986 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:36:00.603986 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 19:36:00.603986 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 19:36:00.603986 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 19:36:00.603986 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 19:36:00.603986 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 19:36:00.603986 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 19:36:00.603986 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 13 19:36:00.603986 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application Sep 13 19:36:00.603986 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 234/479] 10.222.0.25 () {56 vars in 1114 bytes} [Tue Sep 13 19:36:00 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 255 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:36:00.611395 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8cfb3d-2db5-465d-aada-5159121efaec None admin] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:36:00.758060 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8cfb3d-2db5-465d-aada-5159121efaec None admin] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:36:00.799480 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91557f05-7d14-4872-a856-0a97efa0d3f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:36:00.800025 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91557f05-7d14-4872-a856-0a97efa0d3f7 None admin] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:36:00.800336 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91557f05-7d14-4872-a856-0a97efa0d3f7 None admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:36:00.800611 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91557f05-7d14-4872-a856-0a97efa0d3f7 None admin] PATH_INFO: `/v3/roles` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:36:00.801290 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91557f05-7d14-4872-a856-0a97efa0d3f7 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=87934) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:36:00.801593 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91557f05-7d14-4872-a856-0a97efa0d3f7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:36:00.803115 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91557f05-7d14-4872-a856-0a97efa0d3f7 None admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:36:00.816170 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 246/480] 10.222.0.25 () {56 vars in 1111 bytes} [Tue Sep 13 19:36:00 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 19:36:01.657203 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099f9940-c3f6-48c6-bf87-b01221888dd5 None None] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:36:01.658193 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099f9940-c3f6-48c6-bf87-b01221888dd5 None None] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:36:01.658666 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099f9940-c3f6-48c6-bf87-b01221888dd5 None None] PATH_INFO: `/` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:36:01.660475 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 235/481] 10.222.0.25 () {54 vars in 927 bytes} [Tue Sep 13 19:36:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:36:01.673993 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16add001-183f-4c98-98d5-bf9a25283721 None None] REQUEST_METHOD: `POST` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:36:01.674539 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16add001-183f-4c98-98d5-bf9a25283721 None None] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:36:01.674539 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16add001-183f-4c98-98d5-bf9a25283721 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:36:01.697756 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.auth.core [None req-16add001-183f-4c98-98d5-bf9a25283721 None None] MFA Rules not processed for user `7b0aed92d02344acb92a0e4aa67c3068`. Rule list: `[]` (Enabled: `True`). {{(pid=87934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:36:01.698967 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.fernet_utils [None req-16add001-183f-4c98-98d5-bf9a25283721 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:36:01.788042 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG dbcounter [-] [87934] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:36:01.807956 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 247/482] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Sep 13 19:36:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 19:36:02.256485 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099f9940-c3f6-48c6-bf87-b01221888dd5 None None] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:36:02.322134 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d207c3b-a758-4a66-b8d3-76816346b955 None None] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:36:02.322388 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d207c3b-a758-4a66-b8d3-76816346b955 None None] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:36:02.322719 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d207c3b-a758-4a66-b8d3-76816346b955 None None] PATH_INFO: `/` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:36:02.325367 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 248/483] 10.222.0.25 () {54 vars in 927 bytes} [Tue Sep 13 19:36:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 13 19:36:02.331610 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b4165d-3074-4f54-ac25-bc50f8ff3d34 None None] REQUEST_METHOD: `POST` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:36:02.331893 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b4165d-3074-4f54-ac25-bc50f8ff3d34 None None] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:36:02.332468 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b4165d-3074-4f54-ac25-bc50f8ff3d34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:36:02.372645 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG dbcounter [-] [87935] Writing DB stats keystone:SELECT=100 {{(pid=87935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:36:02.373415 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.auth.core [None req-39b4165d-3074-4f54-ac25-bc50f8ff3d34 None None] MFA Rules not processed for user `7b0aed92d02344acb92a0e4aa67c3068`. Rule list: `[]` (Enabled: `True`). {{(pid=87934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:36:02.374648 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.fernet_utils [None req-39b4165d-3074-4f54-ac25-bc50f8ff3d34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:36:02.410970 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099f9940-c3f6-48c6-bf87-b01221888dd5 None None] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:36:02.454774 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8c2fc5-6714-4946-8a1d-8d15e6debbcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:36:02.455660 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8c2fc5-6714-4946-8a1d-8d15e6debbcb None admin] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:36:02.456006 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8c2fc5-6714-4946-8a1d-8d15e6debbcb None admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:36:02.456381 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8c2fc5-6714-4946-8a1d-8d15e6debbcb None admin] PATH_INFO: `/v3/roles/service` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:36:02.473480 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca8c2fc5-6714-4946-8a1d-8d15e6debbcb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 19:36:02.479691 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application [None req-ca8c2fc5-6714-4946-8a1d-8d15e6debbcb None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 13 19:36:02.479691 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:36:02.479691 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:36:02.479691 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:36:02.479691 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:36:02.479691 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:36:02.479691 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:36:02.479691 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:36:02.479691 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:36:02.479691 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:36:02.479691 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:36:02.479691 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:36:02.479691 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 19:36:02.479691 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 19:36:02.479691 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 19:36:02.479691 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 19:36:02.481325 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 19:36:02.481325 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 19:36:02.481325 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 19:36:02.481325 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 19:36:02.481325 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:36:02.481325 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:36:02.481325 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:36:02.481325 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:36:02.481325 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:36:02.481325 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:36:02.481325 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:36:02.481325 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application with Lock( Sep 13 19:36:02.481325 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:36:02.481325 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:36:02.481325 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:36:02.481325 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:36:02.482670 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:36:02.482670 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:36:02.482670 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:36:02.482670 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:36:02.482670 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 19:36:02.482670 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 19:36:02.482670 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 19:36:02.482670 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 19:36:02.482670 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 19:36:02.482670 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 19:36:02.482670 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 13 19:36:02.482670 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application Sep 13 19:36:02.482670 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 236/484] 10.222.0.25 () {56 vars in 1102 bytes} [Tue Sep 13 19:36:02 2022] GET /identity/v3/roles/service => generated 85 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:36:02.487129 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8c2fc5-6714-4946-8a1d-8d15e6debbcb None admin] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:36:02.539552 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 249/485] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Sep 13 19:36:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 13 19:36:02.613178 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546d837e-9041-4405-a465-8577b0fecdc4 None None] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:36:02.613518 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546d837e-9041-4405-a465-8577b0fecdc4 None None] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:36:02.613752 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546d837e-9041-4405-a465-8577b0fecdc4 None None] PATH_INFO: `/` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:36:02.616288 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 250/486] 10.222.0.25 () {54 vars in 927 bytes} [Tue Sep 13 19:36:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:36:02.624195 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3785509e-bbff-4ad6-ab07-c13f8335770c None None] REQUEST_METHOD: `POST` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:36:02.624539 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3785509e-bbff-4ad6-ab07-c13f8335770c None None] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:36:02.624785 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3785509e-bbff-4ad6-ab07-c13f8335770c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:36:02.627767 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8c2fc5-6714-4946-8a1d-8d15e6debbcb None admin] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:36:02.652621 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG dbcounter [-] [87935] Writing DB stats keystone:SELECT=100 {{(pid=87935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:36:02.662142 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.auth.core [None req-3785509e-bbff-4ad6-ab07-c13f8335770c None None] MFA Rules not processed for user `7b0aed92d02344acb92a0e4aa67c3068`. Rule list: `[]` (Enabled: `True`). {{(pid=87934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:36:02.663804 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.fernet_utils [None req-3785509e-bbff-4ad6-ab07-c13f8335770c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:36:02.680043 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f39b37-3dc2-40cc-b8cf-64063b82a852 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:36:02.681359 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f39b37-3dc2-40cc-b8cf-64063b82a852 None admin] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:36:02.681813 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f39b37-3dc2-40cc-b8cf-64063b82a852 None admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:36:02.682258 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f39b37-3dc2-40cc-b8cf-64063b82a852 None admin] PATH_INFO: `/v3/roles` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:36:02.683105 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f39b37-3dc2-40cc-b8cf-64063b82a852 None admin] RBAC: Adding query filter params (name=service) {{(pid=87935) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:36:02.683611 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f39b37-3dc2-40cc-b8cf-64063b82a852 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:36:02.685247 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f39b37-3dc2-40cc-b8cf-64063b82a852 None admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:36:02.706631 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 237/487] 10.222.0.25 () {56 vars in 1103 bytes} [Tue Sep 13 19:36:02 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:36:02.712330 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f39b37-3dc2-40cc-b8cf-64063b82a852 None admin] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:36:02.819699 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 251/488] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Sep 13 19:36:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 19:36:02.857171 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3785509e-bbff-4ad6-ab07-c13f8335770c None None] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:36:02.902506 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f39b37-3dc2-40cc-b8cf-64063b82a852 None admin] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:36:02.953746 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG dbcounter [-] [87934] Writing DB stats keystone:SELECT=100 {{(pid=87934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:36:02.965705 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8d660c-529e-4dc9-93d0-07974863c87b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:36:02.966628 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8d660c-529e-4dc9-93d0-07974863c87b None admin] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:36:02.967045 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8d660c-529e-4dc9-93d0-07974863c87b None admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:36:02.967507 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8d660c-529e-4dc9-93d0-07974863c87b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:36:02.981532 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba8d660c-529e-4dc9-93d0-07974863c87b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:36:02.983214 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba8d660c-529e-4dc9-93d0-07974863c87b None admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:36:02.999503 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application [None req-ba8d660c-529e-4dc9-93d0-07974863c87b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 19:36:02.999503 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:36:02.999503 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:36:02.999503 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:36:02.999503 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:36:02.999503 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:36:02.999503 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:36:02.999503 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:36:02.999503 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:36:02.999503 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:36:02.999503 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:36:02.999503 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:36:02.999503 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 19:36:02.999503 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 19:36:02.999503 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 19:36:02.999503 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 19:36:03.000518 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:36:03.000518 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:36:03.000518 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:36:03.000518 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:36:03.000518 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:36:03.000518 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:36:03.000518 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:36:03.000518 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application with Lock( Sep 13 19:36:03.000518 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:36:03.000518 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:36:03.000518 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:36:03.000518 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:36:03.000518 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:36:03.000518 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:36:03.000518 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:36:03.000518 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:36:03.000518 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 19:36:03.001354 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 19:36:03.001354 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 19:36:03.001354 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application Sep 13 19:36:03.001354 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 238/489] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Sep 13 19:36:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 289 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:36:03.006850 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4104800e-6f59-468f-a207-b66b441817a6 None None] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:36:03.006850 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4104800e-6f59-468f-a207-b66b441817a6 None None] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:36:03.006850 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4104800e-6f59-468f-a207-b66b441817a6 None None] PATH_INFO: `/` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:36:03.009024 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 239/490] 10.222.0.25 () {54 vars in 927 bytes} [Tue Sep 13 19:36:03 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:36:03.009990 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4104800e-6f59-468f-a207-b66b441817a6 None None] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:36:03.033986 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3785509e-bbff-4ad6-ab07-c13f8335770c None None] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:36:03.055713 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG dbcounter [-] [87935] Writing DB stats keystone:SELECT=100 {{(pid=87935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:36:03.086599 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acad24f3-f8bd-45c1-af7a-f23db520a88b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:36:03.087607 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acad24f3-f8bd-45c1-af7a-f23db520a88b None admin] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:36:03.088676 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acad24f3-f8bd-45c1-af7a-f23db520a88b None admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:36:03.089121 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acad24f3-f8bd-45c1-af7a-f23db520a88b None admin] PATH_INFO: `/v3/roles/service` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:36:03.105140 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acad24f3-f8bd-45c1-af7a-f23db520a88b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 19:36:03.112231 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application [None req-acad24f3-f8bd-45c1-af7a-f23db520a88b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 13 19:36:03.112231 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:36:03.112231 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:36:03.112231 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:36:03.112231 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:36:03.112231 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:36:03.112231 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:36:03.112231 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:36:03.112231 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:36:03.112231 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:36:03.112231 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:36:03.112231 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:36:03.112231 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 19:36:03.112231 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 19:36:03.112231 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 19:36:03.112231 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 19:36:03.113168 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 19:36:03.113168 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 19:36:03.113168 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 19:36:03.113168 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 19:36:03.113168 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:36:03.113168 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:36:03.113168 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:36:03.113168 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:36:03.113168 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:36:03.113168 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:36:03.113168 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:36:03.113168 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application with Lock( Sep 13 19:36:03.113168 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:36:03.113168 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:36:03.113168 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:36:03.113168 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:36:03.113961 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:36:03.113961 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:36:03.113961 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:36:03.113961 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:36:03.113961 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 19:36:03.113961 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 19:36:03.113961 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 19:36:03.113961 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 19:36:03.113961 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 19:36:03.113961 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 19:36:03.113961 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 13 19:36:03.113961 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application Sep 13 19:36:03.117029 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 252/491] 10.222.0.25 () {56 vars in 1102 bytes} [Tue Sep 13 19:36:02 2022] GET /identity/v3/roles/service => generated 85 bytes in 260 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:36:03.118438 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3813fa42-569b-4cb7-8d75-3e44ccd083dd None None] REQUEST_METHOD: `POST` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:36:03.119022 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3813fa42-569b-4cb7-8d75-3e44ccd083dd None None] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:36:03.119425 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3813fa42-569b-4cb7-8d75-3e44ccd083dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:36:03.144749 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.auth.core [None req-3813fa42-569b-4cb7-8d75-3e44ccd083dd None None] MFA Rules not processed for user `7b0aed92d02344acb92a0e4aa67c3068`. Rule list: `[]` (Enabled: `True`). {{(pid=87934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:36:03.147630 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.fernet_utils [None req-3813fa42-569b-4cb7-8d75-3e44ccd083dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:36:03.150275 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4104800e-6f59-468f-a207-b66b441817a6 None None] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:36:03.189243 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61617a02-bd7b-4f28-b7c6-5d69fe28e7b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:36:03.189841 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61617a02-bd7b-4f28-b7c6-5d69fe28e7b6 None admin] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:36:03.190116 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61617a02-bd7b-4f28-b7c6-5d69fe28e7b6 None admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:36:03.191047 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61617a02-bd7b-4f28-b7c6-5d69fe28e7b6 None admin] PATH_INFO: `/v3/domains` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:36:03.191047 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61617a02-bd7b-4f28-b7c6-5d69fe28e7b6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87935) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:36:03.191298 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61617a02-bd7b-4f28-b7c6-5d69fe28e7b6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:36:03.193220 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61617a02-bd7b-4f28-b7c6-5d69fe28e7b6 None admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:36:03.206304 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 240/492] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Sep 13 19:36:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:36:03.210026 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61617a02-bd7b-4f28-b7c6-5d69fe28e7b6 None admin] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:36:03.226757 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 253/493] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Sep 13 19:36:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 19:36:03.227736 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3813fa42-569b-4cb7-8d75-3e44ccd083dd None None] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:36:03.294238 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG dbcounter [-] [87934] Writing DB stats keystone:SELECT=100 {{(pid=87934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:36:03.373887 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG dbcounter [-] [87935] Writing DB stats keystone:SELECT=100 {{(pid=87935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:36:03.384750 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61617a02-bd7b-4f28-b7c6-5d69fe28e7b6 None admin] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:36:03.392630 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3813fa42-569b-4cb7-8d75-3e44ccd083dd None None] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:36:03.428464 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f906b578-45df-4980-9743-22ebc8da2797 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:36:03.429454 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f906b578-45df-4980-9743-22ebc8da2797 None admin] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:36:03.429951 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f906b578-45df-4980-9743-22ebc8da2797 None admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:36:03.430413 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f906b578-45df-4980-9743-22ebc8da2797 None admin] PATH_INFO: `/v3/roles` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:36:03.431295 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f906b578-45df-4980-9743-22ebc8da2797 None admin] RBAC: Adding query filter params (name=service) {{(pid=87935) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:36:03.431803 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f906b578-45df-4980-9743-22ebc8da2797 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:36:03.434062 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f906b578-45df-4980-9743-22ebc8da2797 None admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:36:03.446145 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 241/494] 10.222.0.25 () {56 vars in 1103 bytes} [Tue Sep 13 19:36:03 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:36:03.447372 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f906b578-45df-4980-9743-22ebc8da2797 None admin] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:36:03.458024 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42e93d4-adf5-4483-b337-b7e737662f2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:36:03.459206 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42e93d4-adf5-4483-b337-b7e737662f2b None admin] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:36:03.460064 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42e93d4-adf5-4483-b337-b7e737662f2b None admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:36:03.460064 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42e93d4-adf5-4483-b337-b7e737662f2b None admin] PATH_INFO: `/v3/roles/service` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:36:03.472708 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b42e93d4-adf5-4483-b337-b7e737662f2b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 19:36:03.480866 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application [None req-b42e93d4-adf5-4483-b337-b7e737662f2b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 13 19:36:03.480866 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:36:03.480866 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:36:03.480866 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:36:03.480866 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:36:03.480866 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:36:03.480866 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:36:03.480866 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:36:03.480866 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:36:03.480866 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:36:03.480866 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:36:03.480866 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:36:03.480866 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 19:36:03.480866 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 19:36:03.480866 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 19:36:03.480866 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 19:36:03.481864 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 19:36:03.481864 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 19:36:03.481864 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 19:36:03.481864 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 19:36:03.481864 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:36:03.481864 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:36:03.481864 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:36:03.481864 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:36:03.481864 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:36:03.481864 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:36:03.481864 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:36:03.481864 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application with Lock( Sep 13 19:36:03.481864 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:36:03.481864 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:36:03.481864 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:36:03.481864 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:36:03.482667 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:36:03.482667 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:36:03.482667 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:36:03.482667 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:36:03.482667 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 19:36:03.482667 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 19:36:03.482667 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 19:36:03.482667 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 19:36:03.482667 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 19:36:03.482667 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 19:36:03.482667 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 13 19:36:03.482667 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application Sep 13 19:36:03.486827 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 254/495] 10.222.0.25 () {56 vars in 1102 bytes} [Tue Sep 13 19:36:03 2022] GET /identity/v3/roles/service => generated 85 bytes in 256 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:36:03.487884 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42e93d4-adf5-4483-b337-b7e737662f2b None admin] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:36:03.581871 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f906b578-45df-4980-9743-22ebc8da2797 None admin] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:36:03.605818 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG dbcounter [-] [87934] Writing DB stats keystone:SELECT=100 {{(pid=87934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:36:03.609890 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42e93d4-adf5-4483-b337-b7e737662f2b None admin] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:36:03.626746 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55b772e-963c-408c-a447-2b466121e706 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:36:03.627287 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55b772e-963c-408c-a447-2b466121e706 None admin] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:36:03.627567 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55b772e-963c-408c-a447-2b466121e706 None admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:36:03.627836 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55b772e-963c-408c-a447-2b466121e706 None admin] PATH_INFO: `/v3/users/nova` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:36:03.637583 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c55b772e-963c-408c-a447-2b466121e706 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:36:03.640070 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c55b772e-963c-408c-a447-2b466121e706 None admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:36:03.657637 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application [None req-c55b772e-963c-408c-a447-2b466121e706 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 13 19:36:03.657637 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:36:03.657637 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:36:03.657637 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:36:03.657637 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:36:03.657637 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:36:03.657637 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:36:03.657637 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:36:03.657637 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:36:03.657637 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:36:03.657637 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:36:03.657637 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:36:03.657637 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 13 19:36:03.657637 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 13 19:36:03.657637 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 13 19:36:03.657637 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 13 19:36:03.659417 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:36:03.659417 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:36:03.659417 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 13 19:36:03.659417 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 19:36:03.659417 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 13 19:36:03.659417 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 19:36:03.659417 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:36:03.659417 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:36:03.659417 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:36:03.659417 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:36:03.659417 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:36:03.659417 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application with Lock( Sep 13 19:36:03.659417 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:36:03.659417 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:36:03.659417 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:36:03.659417 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:36:03.659417 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:36:03.659417 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:36:03.663720 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:36:03.663720 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:36:03.663720 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 13 19:36:03.663720 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 13 19:36:03.663720 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 13 19:36:03.663720 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 13 19:36:03.663720 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 13 19:36:03.663720 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 13 19:36:03.663720 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 13 19:36:03.663720 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application Sep 13 19:36:03.663720 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 242/496] 10.222.0.25 () {56 vars in 1093 bytes} [Tue Sep 13 19:36:03 2022] GET /identity/v3/users/nova => generated 82 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:36:03.663720 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55b772e-963c-408c-a447-2b466121e706 None admin] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:36:03.666696 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea486555-a605-4144-8294-093b6335581b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:36:03.667286 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea486555-a605-4144-8294-093b6335581b None admin] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:36:03.667562 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea486555-a605-4144-8294-093b6335581b None admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:36:03.668872 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea486555-a605-4144-8294-093b6335581b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:36:03.680525 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea486555-a605-4144-8294-093b6335581b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:36:03.682259 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea486555-a605-4144-8294-093b6335581b None admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:36:03.685727 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG dbcounter [-] [87935] Writing DB stats keystone:SELECT=100 {{(pid=87935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:36:03.702816 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application [None req-ea486555-a605-4144-8294-093b6335581b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 19:36:03.702816 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:36:03.702816 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:36:03.702816 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:36:03.702816 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:36:03.702816 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:36:03.702816 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:36:03.702816 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:36:03.702816 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:36:03.702816 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:36:03.702816 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:36:03.702816 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:36:03.702816 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 19:36:03.702816 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 19:36:03.702816 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 19:36:03.702816 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 19:36:03.703825 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:36:03.703825 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:36:03.703825 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:36:03.703825 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:36:03.703825 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:36:03.703825 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:36:03.703825 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:36:03.703825 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application with Lock( Sep 13 19:36:03.703825 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:36:03.703825 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:36:03.703825 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:36:03.703825 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:36:03.703825 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:36:03.703825 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:36:03.703825 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:36:03.703825 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:36:03.703825 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 19:36:03.704715 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 19:36:03.704715 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 19:36:03.704715 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application Sep 13 19:36:03.704715 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 255/497] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Sep 13 19:36:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:36:03.704931 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea486555-a605-4144-8294-093b6335581b None admin] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:36:03.795096 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55b772e-963c-408c-a447-2b466121e706 None admin] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:36:03.827349 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea486555-a605-4144-8294-093b6335581b None admin] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:36:03.841983 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d3dc0b-b3e4-4046-9148-254b0ec7f2a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:36:03.842810 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d3dc0b-b3e4-4046-9148-254b0ec7f2a0 None admin] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:36:03.843249 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d3dc0b-b3e4-4046-9148-254b0ec7f2a0 None admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:36:03.843555 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d3dc0b-b3e4-4046-9148-254b0ec7f2a0 None admin] PATH_INFO: `/v3/roles` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:36:03.844252 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d3dc0b-b3e4-4046-9148-254b0ec7f2a0 None admin] RBAC: Adding query filter params (name=service) {{(pid=87935) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:36:03.844576 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d3dc0b-b3e4-4046-9148-254b0ec7f2a0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:36:03.845959 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d3dc0b-b3e4-4046-9148-254b0ec7f2a0 None admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:36:03.855729 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 243/498] 10.222.0.25 () {56 vars in 1103 bytes} [Tue Sep 13 19:36:03 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:36:03.856712 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d3dc0b-b3e4-4046-9148-254b0ec7f2a0 None admin] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:36:03.874384 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1515a273-08a9-45c9-9d90-d460796d9371 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:36:03.875019 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1515a273-08a9-45c9-9d90-d460796d9371 None admin] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:36:03.875291 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1515a273-08a9-45c9-9d90-d460796d9371 None admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:36:03.875568 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1515a273-08a9-45c9-9d90-d460796d9371 None admin] PATH_INFO: `/v3/roles/service` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:36:03.887669 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1515a273-08a9-45c9-9d90-d460796d9371 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 19:36:03.892978 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application [None req-1515a273-08a9-45c9-9d90-d460796d9371 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 13 19:36:03.892978 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:36:03.892978 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:36:03.892978 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:36:03.892978 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:36:03.892978 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:36:03.892978 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:36:03.892978 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:36:03.892978 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:36:03.892978 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:36:03.892978 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:36:03.892978 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:36:03.892978 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 19:36:03.892978 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 19:36:03.892978 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 19:36:03.892978 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 19:36:03.893976 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 19:36:03.893976 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 19:36:03.893976 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 19:36:03.893976 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 19:36:03.893976 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:36:03.893976 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:36:03.893976 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:36:03.893976 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:36:03.893976 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:36:03.893976 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:36:03.893976 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:36:03.893976 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application with Lock( Sep 13 19:36:03.893976 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:36:03.893976 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:36:03.893976 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:36:03.893976 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:36:03.894839 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:36:03.894839 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:36:03.894839 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:36:03.894839 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:36:03.894839 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 19:36:03.894839 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 19:36:03.894839 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 19:36:03.894839 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 19:36:03.894839 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 19:36:03.894839 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 19:36:03.894839 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 13 19:36:03.894839 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application Sep 13 19:36:03.894839 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 256/499] 10.222.0.25 () {56 vars in 1102 bytes} [Tue Sep 13 19:36:03 2022] GET /identity/v3/roles/service => generated 85 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:36:03.895500 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1515a273-08a9-45c9-9d90-d460796d9371 None admin] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:36:03.914236 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG dbcounter [-] [87934] Writing DB stats keystone:SELECT=100 {{(pid=87934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:36:03.956710 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG dbcounter [-] [87935] Writing DB stats keystone:SELECT=100 {{(pid=87935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:36:03.984013 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d3dc0b-b3e4-4046-9148-254b0ec7f2a0 None admin] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:36:04.009510 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1515a273-08a9-45c9-9d90-d460796d9371 None admin] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:36:04.019784 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1b0579-596e-4785-b7a2-efe859c7c779 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:36:04.020444 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1b0579-596e-4785-b7a2-efe859c7c779 None admin] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:36:04.020737 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1b0579-596e-4785-b7a2-efe859c7c779 None admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:36:04.021687 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1b0579-596e-4785-b7a2-efe859c7c779 None admin] PATH_INFO: `/v3/users` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:36:04.022640 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b1b0579-596e-4785-b7a2-efe859c7c779 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=87935) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:36:04.022944 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b1b0579-596e-4785-b7a2-efe859c7c779 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:36:04.024527 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b1b0579-596e-4785-b7a2-efe859c7c779 None admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:36:04.054830 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e5240f-52ef-4b00-b63c-0236f2b1e107 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:36:04.055437 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e5240f-52ef-4b00-b63c-0236f2b1e107 None admin] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:36:04.055716 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e5240f-52ef-4b00-b63c-0236f2b1e107 None admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:36:04.055985 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e5240f-52ef-4b00-b63c-0236f2b1e107 None admin] PATH_INFO: `/v3/domains` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:36:04.056654 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e5240f-52ef-4b00-b63c-0236f2b1e107 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87934) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:36:04.056982 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e5240f-52ef-4b00-b63c-0236f2b1e107 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:36:04.058324 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e5240f-52ef-4b00-b63c-0236f2b1e107 None admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:36:04.070905 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 244/500] 10.222.0.25 () {56 vars in 1133 bytes} [Tue Sep 13 19:36:03 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:36:04.070905 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1b0579-596e-4785-b7a2-efe859c7c779 None admin] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:36:04.071216 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 257/501] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Sep 13 19:36:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:36:04.072091 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e5240f-52ef-4b00-b63c-0236f2b1e107 None admin] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:36:04.163514 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG dbcounter [-] [87934] Writing DB stats keystone:SELECT=100 {{(pid=87934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:36:04.181050 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1b0579-596e-4785-b7a2-efe859c7c779 None admin] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:36:04.199019 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e5240f-52ef-4b00-b63c-0236f2b1e107 None admin] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:36:04.219705 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41aff2df-dee6-402d-9cfd-4b1e74002fb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:36:04.220390 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41aff2df-dee6-402d-9cfd-4b1e74002fb3 None admin] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:36:04.220673 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41aff2df-dee6-402d-9cfd-4b1e74002fb3 None admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:36:04.220943 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41aff2df-dee6-402d-9cfd-4b1e74002fb3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:36:04.223731 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG dbcounter [-] [87935] Writing DB stats keystone:SELECT=100 {{(pid=87935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:36:04.233584 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41aff2df-dee6-402d-9cfd-4b1e74002fb3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:36:04.235059 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41aff2df-dee6-402d-9cfd-4b1e74002fb3 None admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:36:04.242804 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b38f17-c8ec-45f2-a48e-0a74eb612a8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:36:04.243405 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b38f17-c8ec-45f2-a48e-0a74eb612a8b None admin] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:36:04.243682 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b38f17-c8ec-45f2-a48e-0a74eb612a8b None admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:36:04.243958 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b38f17-c8ec-45f2-a48e-0a74eb612a8b None admin] PATH_INFO: `/v3/roles` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:36:04.244648 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b38f17-c8ec-45f2-a48e-0a74eb612a8b None admin] RBAC: Adding query filter params (name=service) {{(pid=87934) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:36:04.244951 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b38f17-c8ec-45f2-a48e-0a74eb612a8b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:36:04.246315 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b38f17-c8ec-45f2-a48e-0a74eb612a8b None admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:36:04.250621 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application [None req-41aff2df-dee6-402d-9cfd-4b1e74002fb3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 19:36:04.250621 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:36:04.250621 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:36:04.250621 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:36:04.250621 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:36:04.250621 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:36:04.250621 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:36:04.250621 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:36:04.250621 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:36:04.250621 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:36:04.250621 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:36:04.250621 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:36:04.250621 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 19:36:04.250621 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 19:36:04.250621 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 19:36:04.250621 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 19:36:04.253025 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:36:04.253025 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:36:04.253025 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:36:04.253025 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:36:04.253025 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:36:04.253025 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:36:04.253025 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:36:04.253025 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application with Lock( Sep 13 19:36:04.253025 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:36:04.253025 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:36:04.253025 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:36:04.253025 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:36:04.253025 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:36:04.253025 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:36:04.253025 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:36:04.253025 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:36:04.253025 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 19:36:04.255237 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 19:36:04.255237 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 19:36:04.255237 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application Sep 13 19:36:04.255237 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 245/502] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Sep 13 19:36:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:36:04.255237 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a042ab-00b9-41be-b02e-ab59c4fd5e3a None None] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:36:04.255237 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a042ab-00b9-41be-b02e-ab59c4fd5e3a None None] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:36:04.255237 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a042ab-00b9-41be-b02e-ab59c4fd5e3a None None] PATH_INFO: `/` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:36:04.260865 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 246/503] 10.222.0.25 () {54 vars in 927 bytes} [Tue Sep 13 19:36:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:36:04.260865 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a042ab-00b9-41be-b02e-ab59c4fd5e3a None None] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:36:04.266216 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 258/504] 10.222.0.25 () {56 vars in 1103 bytes} [Tue Sep 13 19:36:04 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:36:04.266216 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b38f17-c8ec-45f2-a48e-0a74eb612a8b None admin] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:36:04.366584 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a042ab-00b9-41be-b02e-ab59c4fd5e3a None None] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:36:04.373075 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b38f17-c8ec-45f2-a48e-0a74eb612a8b None admin] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:36:04.402794 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d81b18-0276-407c-aa80-1a247c2bb341 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:36:04.403392 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d81b18-0276-407c-aa80-1a247c2bb341 None admin] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:36:04.403668 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d81b18-0276-407c-aa80-1a247c2bb341 None admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:36:04.403934 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d81b18-0276-407c-aa80-1a247c2bb341 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:36:04.405310 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG dbcounter [-] [87934] Writing DB stats keystone:SELECT=100 {{(pid=87934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:36:04.411427 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9c6c07-e1a5-4670-8a5b-9a5b0eaab696 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:36:04.412423 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9c6c07-e1a5-4670-8a5b-9a5b0eaab696 None admin] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:36:04.412711 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9c6c07-e1a5-4670-8a5b-9a5b0eaab696 None admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:36:04.413004 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9c6c07-e1a5-4670-8a5b-9a5b0eaab696 None admin] PATH_INFO: `/v3/users/glance` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:36:04.420968 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce9c6c07-e1a5-4670-8a5b-9a5b0eaab696 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:36:04.422350 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce9c6c07-e1a5-4670-8a5b-9a5b0eaab696 None admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:36:04.435873 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application [None req-ce9c6c07-e1a5-4670-8a5b-9a5b0eaab696 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Sep 13 19:36:04.435873 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:36:04.435873 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:36:04.435873 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:36:04.435873 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:36:04.435873 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:36:04.435873 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:36:04.435873 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:36:04.435873 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:36:04.435873 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:36:04.435873 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:36:04.435873 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:36:04.435873 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 13 19:36:04.435873 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 13 19:36:04.435873 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 13 19:36:04.435873 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 13 19:36:04.436904 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:36:04.436904 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:36:04.436904 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 13 19:36:04.436904 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 19:36:04.436904 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 13 19:36:04.436904 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 19:36:04.436904 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:36:04.436904 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:36:04.436904 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:36:04.436904 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:36:04.436904 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:36:04.436904 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application with Lock( Sep 13 19:36:04.436904 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:36:04.436904 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:36:04.436904 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:36:04.436904 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:36:04.436904 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:36:04.436904 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:36:04.437929 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:36:04.437929 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:36:04.437929 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 13 19:36:04.437929 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 13 19:36:04.437929 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 13 19:36:04.437929 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 13 19:36:04.437929 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 13 19:36:04.437929 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 13 19:36:04.437929 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Sep 13 19:36:04.437929 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application Sep 13 19:36:04.437929 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 259/505] 10.222.0.25 () {56 vars in 1099 bytes} [Tue Sep 13 19:36:04 2022] GET /identity/v3/users/glance => generated 84 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:36:04.437929 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9c6c07-e1a5-4670-8a5b-9a5b0eaab696 None admin] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:36:04.465049 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG dbcounter [-] [87935] Writing DB stats keystone:SELECT=100 {{(pid=87935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:36:04.479218 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d81b18-0276-407c-aa80-1a247c2bb341 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:36:04.480778 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d81b18-0276-407c-aa80-1a247c2bb341 None admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:36:04.544860 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9c6c07-e1a5-4670-8a5b-9a5b0eaab696 None admin] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:36:04.579885 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8598681a-479c-4dcd-a095-afcbb516f965 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:36:04.580520 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8598681a-479c-4dcd-a095-afcbb516f965 None admin] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:36:04.580803 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8598681a-479c-4dcd-a095-afcbb516f965 None admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:36:04.581078 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8598681a-479c-4dcd-a095-afcbb516f965 None admin] PATH_INFO: `/v3/domains` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:36:04.581714 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8598681a-479c-4dcd-a095-afcbb516f965 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87934) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:36:04.582020 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8598681a-479c-4dcd-a095-afcbb516f965 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:36:04.583655 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8598681a-479c-4dcd-a095-afcbb516f965 None admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:36:04.585617 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 247/506] 10.222.0.25 () {58 vars in 1282 bytes} [Tue Sep 13 19:36:04 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 13 19:36:04.586460 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d81b18-0276-407c-aa80-1a247c2bb341 None admin] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:36:04.601031 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 260/507] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Sep 13 19:36:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:36:04.601031 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd6fdd8-edbd-42bd-9e72-684f5c21ae5b None None] REQUEST_METHOD: `POST` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:36:04.601031 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd6fdd8-edbd-42bd-9e72-684f5c21ae5b None None] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:36:04.601031 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd6fdd8-edbd-42bd-9e72-684f5c21ae5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:36:04.618546 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.auth.core [None req-3dd6fdd8-edbd-42bd-9e72-684f5c21ae5b None None] MFA Rules not processed for user `7b0aed92d02344acb92a0e4aa67c3068`. Rule list: `[]` (Enabled: `True`). {{(pid=87934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:36:04.619772 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.fernet_utils [None req-3dd6fdd8-edbd-42bd-9e72-684f5c21ae5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:36:04.669550 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG dbcounter [-] [87934] Writing DB stats keystone:SELECT=100 {{(pid=87934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:36:04.684756 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG dbcounter [-] [87935] Writing DB stats keystone:SELECT=100 {{(pid=87935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:36:04.693181 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 261/508] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Sep 13 19:36:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 19:36:04.704563 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd6fdd8-edbd-42bd-9e72-684f5c21ae5b None None] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:36:04.711506 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d81b18-0276-407c-aa80-1a247c2bb341 None admin] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:36:04.751678 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae2a8a1-14c3-492d-bbbf-d5fcbf166cdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:36:04.752636 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae2a8a1-14c3-492d-bbbf-d5fcbf166cdb None admin] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:36:04.752918 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae2a8a1-14c3-492d-bbbf-d5fcbf166cdb None admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:36:04.753394 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae2a8a1-14c3-492d-bbbf-d5fcbf166cdb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:36:04.765288 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae2a8a1-14c3-492d-bbbf-d5fcbf166cdb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:36:04.768028 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae2a8a1-14c3-492d-bbbf-d5fcbf166cdb None admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:36:04.785425 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application [None req-dae2a8a1-14c3-492d-bbbf-d5fcbf166cdb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 19:36:04.785425 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:36:04.785425 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:36:04.785425 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:36:04.785425 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:36:04.785425 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:36:04.785425 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:36:04.785425 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:36:04.785425 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:36:04.785425 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:36:04.785425 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:36:04.785425 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:36:04.785425 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 19:36:04.785425 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 19:36:04.785425 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 19:36:04.785425 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 19:36:04.786921 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:36:04.786921 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:36:04.786921 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:36:04.786921 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:36:04.786921 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:36:04.786921 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:36:04.786921 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:36:04.786921 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application with Lock( Sep 13 19:36:04.786921 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:36:04.786921 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:36:04.786921 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:36:04.786921 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:36:04.786921 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:36:04.786921 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:36:04.786921 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:36:04.786921 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:36:04.786921 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 19:36:04.787916 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 19:36:04.787916 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 19:36:04.787916 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application Sep 13 19:36:04.787916 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 248/509] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Sep 13 19:36:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:36:04.787916 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae2a8a1-14c3-492d-bbbf-d5fcbf166cdb None admin] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:36:04.813153 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd6fdd8-edbd-42bd-9e72-684f5c21ae5b None None] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:36:04.857008 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f8a7d9-9ddc-44cb-96b6-d03074855f80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:36:04.857687 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f8a7d9-9ddc-44cb-96b6-d03074855f80 None admin] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:36:04.857893 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f8a7d9-9ddc-44cb-96b6-d03074855f80 None admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:36:04.858159 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f8a7d9-9ddc-44cb-96b6-d03074855f80 None admin] PATH_INFO: `/v3/users` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:36:04.858914 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f8a7d9-9ddc-44cb-96b6-d03074855f80 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=87934) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:36:04.859196 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f8a7d9-9ddc-44cb-96b6-d03074855f80 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:36:04.860675 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f8a7d9-9ddc-44cb-96b6-d03074855f80 None admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:36:04.899553 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 262/510] 10.222.0.25 () {56 vars in 1137 bytes} [Tue Sep 13 19:36:04 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:36:04.900524 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f8a7d9-9ddc-44cb-96b6-d03074855f80 None admin] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:36:04.911425 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae2a8a1-14c3-492d-bbbf-d5fcbf166cdb None admin] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:36:04.957744 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG dbcounter [-] [87934] Writing DB stats keystone:SELECT=100 {{(pid=87934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:36:04.961028 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12cc8cb4-67a4-45da-98e6-b18b090c5192 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:36:04.961887 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12cc8cb4-67a4-45da-98e6-b18b090c5192 None admin] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:36:04.962126 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12cc8cb4-67a4-45da-98e6-b18b090c5192 None admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:36:04.962401 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12cc8cb4-67a4-45da-98e6-b18b090c5192 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:36:04.972138 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG dbcounter [-] [87935] Writing DB stats keystone:SELECT=100 {{(pid=87935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:36:04.975046 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12cc8cb4-67a4-45da-98e6-b18b090c5192 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:36:04.977739 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12cc8cb4-67a4-45da-98e6-b18b090c5192 None admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:36:04.996179 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application [None req-12cc8cb4-67a4-45da-98e6-b18b090c5192 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 19:36:04.996179 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:36:04.996179 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:36:04.996179 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:36:04.996179 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:36:04.996179 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:36:04.996179 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:36:04.996179 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:36:04.996179 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:36:04.996179 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:36:04.996179 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:36:04.996179 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:36:04.996179 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 19:36:04.996179 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 19:36:04.996179 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 19:36:04.996179 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 19:36:04.997895 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:36:04.997895 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:36:04.997895 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:36:04.997895 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:36:04.997895 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:36:04.997895 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:36:04.997895 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:36:04.997895 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application with Lock( Sep 13 19:36:04.997895 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:36:04.997895 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:36:04.997895 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:36:04.997895 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:36:04.997895 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:36:04.997895 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:36:04.997895 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:36:04.997895 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:36:04.997895 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 19:36:04.999282 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 19:36:04.999282 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 19:36:04.999282 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application Sep 13 19:36:04.999282 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 249/511] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Sep 13 19:36:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:36:04.999282 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12cc8cb4-67a4-45da-98e6-b18b090c5192 None admin] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:36:05.034290 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f8a7d9-9ddc-44cb-96b6-d03074855f80 None admin] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:36:05.074156 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0553d0c0-6331-418c-98e8-494c12a1f572 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:36:05.074790 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0553d0c0-6331-418c-98e8-494c12a1f572 None admin] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:36:05.075204 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0553d0c0-6331-418c-98e8-494c12a1f572 None admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:36:05.075473 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0553d0c0-6331-418c-98e8-494c12a1f572 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:36:05.084158 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0553d0c0-6331-418c-98e8-494c12a1f572 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:36:05.085974 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0553d0c0-6331-418c-98e8-494c12a1f572 None admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:36:05.102822 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application [None req-0553d0c0-6331-418c-98e8-494c12a1f572 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Sep 13 19:36:05.102822 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:36:05.102822 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:36:05.102822 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:36:05.102822 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:36:05.102822 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:36:05.102822 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:36:05.102822 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:36:05.102822 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:36:05.102822 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:36:05.102822 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:36:05.102822 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:36:05.102822 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 13 19:36:05.102822 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 13 19:36:05.102822 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 13 19:36:05.102822 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 13 19:36:05.104616 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:36:05.104616 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:36:05.104616 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 13 19:36:05.104616 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 19:36:05.104616 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 13 19:36:05.104616 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 19:36:05.104616 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:36:05.104616 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:36:05.104616 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:36:05.104616 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:36:05.104616 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:36:05.104616 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application with Lock( Sep 13 19:36:05.104616 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:36:05.104616 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:36:05.104616 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:36:05.104616 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:36:05.104616 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:36:05.104616 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:36:05.106418 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:36:05.106418 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:36:05.106418 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 13 19:36:05.106418 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 13 19:36:05.106418 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 13 19:36:05.106418 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 13 19:36:05.106418 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 13 19:36:05.106418 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 13 19:36:05.106418 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Sep 13 19:36:05.106418 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application Sep 13 19:36:05.106418 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 263/512] 10.222.0.25 () {56 vars in 1099 bytes} [Tue Sep 13 19:36:04 2022] GET /identity/v3/users/cinder => generated 84 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:36:05.106418 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0553d0c0-6331-418c-98e8-494c12a1f572 None admin] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:36:05.120123 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12cc8cb4-67a4-45da-98e6-b18b090c5192 None admin] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:36:05.157444 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a949744a-01dc-42fe-9468-49d5754b0c05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:36:05.158047 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a949744a-01dc-42fe-9468-49d5754b0c05 None admin] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:36:05.158326 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a949744a-01dc-42fe-9468-49d5754b0c05 None admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:36:05.158596 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a949744a-01dc-42fe-9468-49d5754b0c05 None admin] PATH_INFO: `/v3/domains` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:36:05.159246 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a949744a-01dc-42fe-9468-49d5754b0c05 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87935) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:36:05.159562 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a949744a-01dc-42fe-9468-49d5754b0c05 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:36:05.160931 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a949744a-01dc-42fe-9468-49d5754b0c05 None admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:36:05.174399 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 250/513] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Sep 13 19:36:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:36:05.174399 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a949744a-01dc-42fe-9468-49d5754b0c05 None admin] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:36:05.210456 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG dbcounter [-] [87934] Writing DB stats keystone:SELECT=100 {{(pid=87934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:36:05.214567 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0553d0c0-6331-418c-98e8-494c12a1f572 None admin] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:36:05.233967 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG dbcounter [-] [87935] Writing DB stats keystone:SELECT=100 {{(pid=87935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:36:05.249777 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9c7116-bfdf-4130-b292-56a7d2224504 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:36:05.250401 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9c7116-bfdf-4130-b292-56a7d2224504 None admin] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:36:05.250680 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9c7116-bfdf-4130-b292-56a7d2224504 None admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:36:05.250958 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9c7116-bfdf-4130-b292-56a7d2224504 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:36:05.291045 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a949744a-01dc-42fe-9468-49d5754b0c05 None admin] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:36:05.327750 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296772be-5fad-4eff-b85a-963a08634c43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:36:05.328176 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a9c7116-bfdf-4130-b292-56a7d2224504 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:36:05.328389 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296772be-5fad-4eff-b85a-963a08634c43 None admin] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:36:05.328673 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296772be-5fad-4eff-b85a-963a08634c43 None admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:36:05.328946 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296772be-5fad-4eff-b85a-963a08634c43 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:36:05.329675 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a9c7116-bfdf-4130-b292-56a7d2224504 None admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:36:05.341347 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-296772be-5fad-4eff-b85a-963a08634c43 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:36:05.343627 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-296772be-5fad-4eff-b85a-963a08634c43 None admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:36:05.363770 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application [None req-296772be-5fad-4eff-b85a-963a08634c43 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 19:36:05.363770 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:36:05.363770 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:36:05.363770 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:36:05.363770 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:36:05.363770 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:36:05.363770 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:36:05.363770 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:36:05.363770 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:36:05.363770 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:36:05.363770 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:36:05.363770 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:36:05.363770 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 19:36:05.363770 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 19:36:05.363770 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 19:36:05.363770 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 19:36:05.364962 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:36:05.364962 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:36:05.364962 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:36:05.364962 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:36:05.364962 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:36:05.364962 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:36:05.364962 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:36:05.364962 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application with Lock( Sep 13 19:36:05.364962 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:36:05.364962 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:36:05.364962 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:36:05.364962 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:36:05.364962 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:36:05.364962 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:36:05.364962 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:36:05.364962 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:36:05.364962 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 19:36:05.366038 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 19:36:05.366038 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 19:36:05.366038 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application Sep 13 19:36:05.366038 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 251/514] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Sep 13 19:36:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:36:05.366264 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296772be-5fad-4eff-b85a-963a08634c43 None admin] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:36:05.438955 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG dbcounter [-] [87934] Writing DB stats keystone:SELECT=100 {{(pid=87934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:36:05.448476 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 264/515] 10.222.0.25 () {58 vars in 1282 bytes} [Tue Sep 13 19:36:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 13 19:36:05.449413 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9c7116-bfdf-4130-b292-56a7d2224504 None admin] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:36:05.477055 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296772be-5fad-4eff-b85a-963a08634c43 None admin] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:36:05.479522 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG dbcounter [-] [87935] Writing DB stats keystone:SELECT=100 {{(pid=87935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:36:05.518113 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850aeb2e-2a96-4bb1-ae05-73c64901c501 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:36:05.518728 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850aeb2e-2a96-4bb1-ae05-73c64901c501 None admin] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:36:05.519005 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850aeb2e-2a96-4bb1-ae05-73c64901c501 None admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:36:05.519280 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850aeb2e-2a96-4bb1-ae05-73c64901c501 None admin] PATH_INFO: `/v3/domains` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:36:05.519935 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-850aeb2e-2a96-4bb1-ae05-73c64901c501 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87935) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:36:05.520300 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-850aeb2e-2a96-4bb1-ae05-73c64901c501 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:36:05.522251 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-850aeb2e-2a96-4bb1-ae05-73c64901c501 None admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:36:05.538447 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 252/516] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Sep 13 19:36:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:36:05.540080 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850aeb2e-2a96-4bb1-ae05-73c64901c501 None admin] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:36:05.585106 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9c7116-bfdf-4130-b292-56a7d2224504 None admin] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:36:05.626907 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03251c90-49d6-4726-a02a-7c0de54ecd49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:36:05.627600 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03251c90-49d6-4726-a02a-7c0de54ecd49 None admin] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:36:05.627886 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03251c90-49d6-4726-a02a-7c0de54ecd49 None admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:36:05.628201 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03251c90-49d6-4726-a02a-7c0de54ecd49 None admin] PATH_INFO: `/v3/users` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:36:05.629028 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03251c90-49d6-4726-a02a-7c0de54ecd49 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=87934) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:36:05.629380 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03251c90-49d6-4726-a02a-7c0de54ecd49 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:36:05.631719 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03251c90-49d6-4726-a02a-7c0de54ecd49 None admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:36:05.652598 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 265/517] 10.222.0.25 () {56 vars in 1137 bytes} [Tue Sep 13 19:36:05 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:36:05.653966 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03251c90-49d6-4726-a02a-7c0de54ecd49 None admin] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:36:05.679396 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850aeb2e-2a96-4bb1-ae05-73c64901c501 None admin] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:36:05.716285 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206a61b5-70d3-4611-a431-23d36be3fc8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:36:05.716937 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206a61b5-70d3-4611-a431-23d36be3fc8f None admin] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:36:05.717177 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206a61b5-70d3-4611-a431-23d36be3fc8f None admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:36:05.717445 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206a61b5-70d3-4611-a431-23d36be3fc8f None admin] PATH_INFO: `/v3/users/neutron` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:36:05.718903 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG dbcounter [-] [87934] Writing DB stats keystone:SELECT=100 {{(pid=87934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:36:05.725198 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-206a61b5-70d3-4611-a431-23d36be3fc8f None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:36:05.726651 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-206a61b5-70d3-4611-a431-23d36be3fc8f None admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:36:05.739230 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application [None req-206a61b5-70d3-4611-a431-23d36be3fc8f None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Sep 13 19:36:05.739230 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:36:05.739230 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:36:05.739230 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:36:05.739230 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:36:05.739230 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:36:05.739230 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:36:05.739230 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:36:05.739230 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:36:05.739230 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:36:05.739230 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:36:05.739230 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:36:05.739230 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 13 19:36:05.739230 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 13 19:36:05.739230 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 13 19:36:05.739230 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 13 19:36:05.741325 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:36:05.741325 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:36:05.741325 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 13 19:36:05.741325 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 19:36:05.741325 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 13 19:36:05.741325 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 19:36:05.741325 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:36:05.741325 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:36:05.741325 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:36:05.741325 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:36:05.741325 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:36:05.741325 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application with Lock( Sep 13 19:36:05.741325 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:36:05.741325 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:36:05.741325 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:36:05.741325 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:36:05.741325 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:36:05.741325 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:36:05.742300 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:36:05.742300 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:36:05.742300 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 13 19:36:05.742300 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 13 19:36:05.742300 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 13 19:36:05.742300 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 13 19:36:05.742300 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 13 19:36:05.742300 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 13 19:36:05.742300 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Sep 13 19:36:05.742300 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application Sep 13 19:36:05.742300 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 253/518] 10.222.0.25 () {56 vars in 1102 bytes} [Tue Sep 13 19:36:05 2022] GET /identity/v3/users/neutron => generated 85 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:36:05.742300 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206a61b5-70d3-4611-a431-23d36be3fc8f None admin] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:36:05.768892 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG dbcounter [-] [87935] Writing DB stats keystone:SELECT=100 {{(pid=87935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:36:05.772397 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03251c90-49d6-4726-a02a-7c0de54ecd49 None admin] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:36:05.822972 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241a65ca-9105-4ab9-bc6e-c1927d079f73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:36:05.823931 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241a65ca-9105-4ab9-bc6e-c1927d079f73 None admin] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:36:05.824354 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241a65ca-9105-4ab9-bc6e-c1927d079f73 None admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:36:05.824709 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241a65ca-9105-4ab9-bc6e-c1927d079f73 None admin] PATH_INFO: `/v3/domains` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:36:05.825823 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241a65ca-9105-4ab9-bc6e-c1927d079f73 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87934) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:36:05.826324 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241a65ca-9105-4ab9-bc6e-c1927d079f73 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:36:05.828729 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241a65ca-9105-4ab9-bc6e-c1927d079f73 None admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:36:05.852125 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 266/519] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Sep 13 19:36:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:36:05.852125 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241a65ca-9105-4ab9-bc6e-c1927d079f73 None admin] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:36:05.886359 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206a61b5-70d3-4611-a431-23d36be3fc8f None admin] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:36:05.926622 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd70122-8112-4ae7-8ee5-f8c968133197 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:36:05.927775 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd70122-8112-4ae7-8ee5-f8c968133197 None admin] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:36:05.928049 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd70122-8112-4ae7-8ee5-f8c968133197 None admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:36:05.928347 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd70122-8112-4ae7-8ee5-f8c968133197 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:36:05.943862 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd70122-8112-4ae7-8ee5-f8c968133197 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:36:05.945648 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd70122-8112-4ae7-8ee5-f8c968133197 None admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:36:05.960890 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application [None req-0cd70122-8112-4ae7-8ee5-f8c968133197 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 19:36:05.960890 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:36:05.960890 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:36:05.960890 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:36:05.960890 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:36:05.960890 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:36:05.960890 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:36:05.960890 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:36:05.960890 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:36:05.960890 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:36:05.960890 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:36:05.960890 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:36:05.960890 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 19:36:05.960890 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 19:36:05.960890 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 19:36:05.960890 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 19:36:05.962022 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:36:05.962022 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:36:05.962022 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:36:05.962022 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:36:05.962022 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:36:05.962022 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:36:05.962022 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:36:05.962022 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application with Lock( Sep 13 19:36:05.962022 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:36:05.962022 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:36:05.962022 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:36:05.962022 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:36:05.962022 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:36:05.962022 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:36:05.962022 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:36:05.962022 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:36:05.962022 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 19:36:05.963067 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 19:36:05.963067 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 19:36:05.963067 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application Sep 13 19:36:05.963067 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 254/520] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Sep 13 19:36:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:36:05.963338 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd70122-8112-4ae7-8ee5-f8c968133197 None admin] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:36:05.964229 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241a65ca-9105-4ab9-bc6e-c1927d079f73 None admin] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:36:05.993842 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG dbcounter [-] [87934] Writing DB stats keystone:SELECT=100 {{(pid=87934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:36:06.011921 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb5422b-617a-4df4-a469-cd91441c08ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:36:06.012575 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb5422b-617a-4df4-a469-cd91441c08ea None admin] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:36:06.012842 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb5422b-617a-4df4-a469-cd91441c08ea None admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:36:06.013108 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb5422b-617a-4df4-a469-cd91441c08ea None admin] PATH_INFO: `/v3/projects/service` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:36:06.020105 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb5422b-617a-4df4-a469-cd91441c08ea None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:36:06.021882 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb5422b-617a-4df4-a469-cd91441c08ea None admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:36:06.034011 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application [None req-8eb5422b-617a-4df4-a469-cd91441c08ea None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 19:36:06.034011 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:36:06.034011 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:36:06.034011 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:36:06.034011 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:36:06.034011 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:36:06.034011 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:36:06.034011 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:36:06.034011 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:36:06.034011 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:36:06.034011 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:36:06.034011 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:36:06.034011 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 13 19:36:06.034011 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 13 19:36:06.034011 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 13 19:36:06.034935 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 13 19:36:06.034935 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:36:06.034935 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:36:06.034935 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:36:06.034935 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:36:06.034935 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:36:06.034935 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:36:06.034935 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:36:06.034935 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application with Lock( Sep 13 19:36:06.034935 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:36:06.034935 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:36:06.034935 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:36:06.034935 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:36:06.034935 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:36:06.034935 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:36:06.034935 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:36:06.034935 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:36:06.035963 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 13 19:36:06.035963 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 13 19:36:06.035963 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 13 19:36:06.035963 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 13 19:36:06.035963 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 13 19:36:06.035963 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 13 19:36:06.035963 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 19:36:06.035963 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application Sep 13 19:36:06.035963 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 267/521] 10.222.0.25 () {56 vars in 1111 bytes} [Tue Sep 13 19:36:05 2022] GET /identity/v3/projects/service => generated 88 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:36:06.037052 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb5422b-617a-4df4-a469-cd91441c08ea None admin] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:36:06.053093 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG dbcounter [-] [87935] Writing DB stats keystone:SELECT=100 {{(pid=87935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:36:06.077876 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd70122-8112-4ae7-8ee5-f8c968133197 None admin] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:36:06.113025 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd67773-5279-4586-a9d2-49f6910d0218 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:36:06.113627 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd67773-5279-4586-a9d2-49f6910d0218 None admin] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:36:06.113908 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd67773-5279-4586-a9d2-49f6910d0218 None admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:36:06.114173 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd67773-5279-4586-a9d2-49f6910d0218 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:36:06.163991 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb5422b-617a-4df4-a469-cd91441c08ea None admin] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:36:06.192510 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd67773-5279-4586-a9d2-49f6910d0218 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:36:06.194199 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd67773-5279-4586-a9d2-49f6910d0218 None admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:36:06.204258 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27eff73e-5f1d-4892-9ed3-8fd50274cadf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:36:06.204872 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27eff73e-5f1d-4892-9ed3-8fd50274cadf None admin] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:36:06.205152 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27eff73e-5f1d-4892-9ed3-8fd50274cadf None admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:36:06.205421 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27eff73e-5f1d-4892-9ed3-8fd50274cadf None admin] PATH_INFO: `/v3/users` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:36:06.206140 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27eff73e-5f1d-4892-9ed3-8fd50274cadf None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=87934) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:36:06.206440 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27eff73e-5f1d-4892-9ed3-8fd50274cadf None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:36:06.208185 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27eff73e-5f1d-4892-9ed3-8fd50274cadf None admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:36:06.232991 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 268/522] 10.222.0.25 () {56 vars in 1139 bytes} [Tue Sep 13 19:36:06 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:36:06.233923 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27eff73e-5f1d-4892-9ed3-8fd50274cadf None admin] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:36:06.282234 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG dbcounter [-] [87934] Writing DB stats keystone:SELECT=100 {{(pid=87934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:36:06.291835 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG dbcounter [-] [87935] Writing DB stats keystone:SELECT=100 {{(pid=87935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:36:06.319327 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 255/523] 10.222.0.25 () {58 vars in 1282 bytes} [Tue Sep 13 19:36:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 356 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 13 19:36:06.320189 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd67773-5279-4586-a9d2-49f6910d0218 None admin] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:36:06.348555 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27eff73e-5f1d-4892-9ed3-8fd50274cadf None admin] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:36:06.385016 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6993006-53c3-405f-920d-649efa31e9c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:36:06.385916 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6993006-53c3-405f-920d-649efa31e9c9 None admin] REQUEST_METHOD: `POST` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:36:06.386193 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6993006-53c3-405f-920d-649efa31e9c9 None admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:36:06.386462 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6993006-53c3-405f-920d-649efa31e9c9 None admin] PATH_INFO: `/v3/users` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:36:06.387137 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6993006-53c3-405f-920d-649efa31e9c9 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:36:06.388616 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6993006-53c3-405f-920d-649efa31e9c9 None admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:36:06.411341 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 269/524] 10.222.0.25 () {60 vars in 1132 bytes} [Tue Sep 13 19:36:06 2022] POST /identity/v3/users => generated 247 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 19:36:06.413151 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6993006-53c3-405f-920d-649efa31e9c9 None admin] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:36:06.448422 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd67773-5279-4586-a9d2-49f6910d0218 None admin] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:36:06.500312 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9490cfc8-8cb2-4c15-a8b8-106440adf47d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:36:06.500947 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9490cfc8-8cb2-4c15-a8b8-106440adf47d None admin] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:36:06.501230 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9490cfc8-8cb2-4c15-a8b8-106440adf47d None admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:36:06.501502 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9490cfc8-8cb2-4c15-a8b8-106440adf47d None admin] PATH_INFO: `/v3/domains` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:36:06.502155 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9490cfc8-8cb2-4c15-a8b8-106440adf47d None admin] RBAC: Adding query filter params (name=Default) {{(pid=87935) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:36:06.502464 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9490cfc8-8cb2-4c15-a8b8-106440adf47d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:36:06.503888 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9490cfc8-8cb2-4c15-a8b8-106440adf47d None admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:36:06.518563 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 256/525] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Sep 13 19:36:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:36:06.521898 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9490cfc8-8cb2-4c15-a8b8-106440adf47d None admin] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:36:06.567460 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG dbcounter [-] [87934] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:36:06.569016 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG dbcounter [-] [87935] Writing DB stats keystone:SELECT=100 {{(pid=87935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:36:06.582920 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6993006-53c3-405f-920d-649efa31e9c9 None admin] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:36:06.628462 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d66943-342f-47d2-a01a-282856fbca9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:36:06.629085 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d66943-342f-47d2-a01a-282856fbca9b None admin] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:36:06.629423 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d66943-342f-47d2-a01a-282856fbca9b None admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:36:06.630425 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d66943-342f-47d2-a01a-282856fbca9b None admin] PATH_INFO: `/v3/projects` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:36:06.630622 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d66943-342f-47d2-a01a-282856fbca9b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87934) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:36:06.630909 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d66943-342f-47d2-a01a-282856fbca9b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:36:06.632381 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d66943-342f-47d2-a01a-282856fbca9b None admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:36:06.653003 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 270/526] 10.222.0.25 () {56 vars in 1148 bytes} [Tue Sep 13 19:36:06 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:36:06.653684 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d66943-342f-47d2-a01a-282856fbca9b None admin] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:36:06.656245 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9490cfc8-8cb2-4c15-a8b8-106440adf47d None admin] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:36:06.697518 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518ed15b-7c95-4cfd-ae58-e7c0fed4f2c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:36:06.698958 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518ed15b-7c95-4cfd-ae58-e7c0fed4f2c8 None admin] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:36:06.699447 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518ed15b-7c95-4cfd-ae58-e7c0fed4f2c8 None admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:36:06.700325 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518ed15b-7c95-4cfd-ae58-e7c0fed4f2c8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:36:06.770560 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d66943-342f-47d2-a01a-282856fbca9b None admin] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:36:06.798576 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-518ed15b-7c95-4cfd-ae58-e7c0fed4f2c8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:36:06.800718 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-518ed15b-7c95-4cfd-ae58-e7c0fed4f2c8 None admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:36:06.823419 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0c09e4-e19d-42d8-9377-95261854c67f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:36:06.824449 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0c09e4-e19d-42d8-9377-95261854c67f None admin] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:36:06.824938 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0c09e4-e19d-42d8-9377-95261854c67f None admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:36:06.825423 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0c09e4-e19d-42d8-9377-95261854c67f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:36:06.839771 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG dbcounter [-] [87935] Writing DB stats keystone:SELECT=100 {{(pid=87935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:36:06.840955 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0c09e4-e19d-42d8-9377-95261854c67f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:36:06.842460 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0c09e4-e19d-42d8-9377-95261854c67f None admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:36:06.860220 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application [None req-ab0c09e4-e19d-42d8-9377-95261854c67f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 19:36:06.860220 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:36:06.860220 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:36:06.860220 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:36:06.860220 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:36:06.860220 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:36:06.860220 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:36:06.860220 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:36:06.860220 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:36:06.860220 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:36:06.860220 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:36:06.860220 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:36:06.860220 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 19:36:06.860220 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 19:36:06.860220 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 19:36:06.860220 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 19:36:06.861318 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:36:06.861318 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:36:06.861318 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:36:06.861318 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:36:06.861318 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:36:06.861318 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:36:06.861318 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:36:06.861318 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application with Lock( Sep 13 19:36:06.861318 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:36:06.861318 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:36:06.861318 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:36:06.861318 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:36:06.861318 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:36:06.861318 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:36:06.861318 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:36:06.861318 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:36:06.861318 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 19:36:06.862244 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 19:36:06.862244 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 19:36:06.862244 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application Sep 13 19:36:06.862244 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 271/527] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Sep 13 19:36:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:36:06.862244 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0c09e4-e19d-42d8-9377-95261854c67f None admin] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:36:06.872646 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG dbcounter [-] [87934] Writing DB stats keystone:SELECT=100 {{(pid=87934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:36:06.940616 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 257/528] 10.222.0.25 () {58 vars in 1282 bytes} [Tue Sep 13 19:36:06 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 422 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 13 19:36:06.941766 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518ed15b-7c95-4cfd-ae58-e7c0fed4f2c8 None admin] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:36:07.027945 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0c09e4-e19d-42d8-9377-95261854c67f None admin] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:36:07.069425 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa071da-45cc-43aa-8d3f-ff6142e8a215 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:36:07.070069 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa071da-45cc-43aa-8d3f-ff6142e8a215 None admin] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:36:07.070352 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa071da-45cc-43aa-8d3f-ff6142e8a215 None admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:36:07.070626 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa071da-45cc-43aa-8d3f-ff6142e8a215 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:36:07.076689 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518ed15b-7c95-4cfd-ae58-e7c0fed4f2c8 None admin] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:36:07.078416 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa071da-45cc-43aa-8d3f-ff6142e8a215 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:36:07.079874 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa071da-45cc-43aa-8d3f-ff6142e8a215 None admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:36:07.093047 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application [None req-6aa071da-45cc-43aa-8d3f-ff6142e8a215 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 19:36:07.093047 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:36:07.093047 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:36:07.093047 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:36:07.093047 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:36:07.093047 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:36:07.093047 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:36:07.093047 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:36:07.093047 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:36:07.093047 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:36:07.093047 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:36:07.093047 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:36:07.093047 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 13 19:36:07.093047 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 13 19:36:07.093047 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 13 19:36:07.094002 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 13 19:36:07.094002 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:36:07.094002 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:36:07.094002 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:36:07.094002 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:36:07.094002 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:36:07.094002 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:36:07.094002 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:36:07.094002 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application with Lock( Sep 13 19:36:07.094002 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:36:07.094002 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:36:07.094002 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:36:07.094002 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:36:07.094002 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:36:07.094002 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:36:07.094002 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:36:07.094002 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:36:07.094859 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 13 19:36:07.094859 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 13 19:36:07.094859 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 13 19:36:07.094859 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 13 19:36:07.094859 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 13 19:36:07.094859 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 13 19:36:07.094859 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 19:36:07.094859 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application Sep 13 19:36:07.094859 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 272/529] 10.222.0.25 () {56 vars in 1111 bytes} [Tue Sep 13 19:36:06 2022] GET /identity/v3/projects/service => generated 88 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:36:07.095355 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa071da-45cc-43aa-8d3f-ff6142e8a215 None admin] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:36:07.131204 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe69839c-7590-4340-8b2e-245e28f4928c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:36:07.131995 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe69839c-7590-4340-8b2e-245e28f4928c None admin] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:36:07.132301 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe69839c-7590-4340-8b2e-245e28f4928c None admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:36:07.132572 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe69839c-7590-4340-8b2e-245e28f4928c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:36:07.133323 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe69839c-7590-4340-8b2e-245e28f4928c None admin] RBAC: Adding query filter params (role.id=60f5ecbf9ce84814968607f126a85a5a, scope.project.id=9a10a4268f3c4cb29f4e00c292e2df62, user.id=d71fe5a8275f4ea98555afdcefc902a0) {{(pid=87935) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:36:07.133614 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe69839c-7590-4340-8b2e-245e28f4928c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:36:07.135065 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe69839c-7590-4340-8b2e-245e28f4928c None admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:36:07.138997 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG dbcounter [-] [87935] Writing DB stats keystone:SELECT=100 {{(pid=87935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:36:07.143047 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 258/530] 10.222.0.25 () {56 vars in 1374 bytes} [Tue Sep 13 19:36:06 2022] GET /identity/v3/role_assignments?user.id=d71fe5a8275f4ea98555afdcefc902a0&scope.project.id=9a10a4268f3c4cb29f4e00c292e2df62&role.id=60f5ecbf9ce84814968607f126a85a5a => generated 259 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:36:07.143707 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe69839c-7590-4340-8b2e-245e28f4928c None admin] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:36:07.216114 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG dbcounter [-] [87934] Writing DB stats keystone:SELECT=100 {{(pid=87934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:36:07.290792 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa071da-45cc-43aa-8d3f-ff6142e8a215 None admin] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:36:07.314171 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe69839c-7590-4340-8b2e-245e28f4928c None admin] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:36:07.353805 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca48249-90ac-452d-9221-2d7f4af1f530 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:36:07.354372 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca48249-90ac-452d-9221-2d7f4af1f530 None admin] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:36:07.354678 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca48249-90ac-452d-9221-2d7f4af1f530 None admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:36:07.354952 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca48249-90ac-452d-9221-2d7f4af1f530 None admin] PATH_INFO: `/v3/domains` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:36:07.355604 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca48249-90ac-452d-9221-2d7f4af1f530 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87934) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:36:07.355908 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca48249-90ac-452d-9221-2d7f4af1f530 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:36:07.357351 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca48249-90ac-452d-9221-2d7f4af1f530 None admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:36:07.359371 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224d2a32-4664-41e7-a927-660a088550a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:36:07.360241 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224d2a32-4664-41e7-a927-660a088550a8 None admin] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:36:07.360524 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224d2a32-4664-41e7-a927-660a088550a8 None admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:36:07.360789 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224d2a32-4664-41e7-a927-660a088550a8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:36:07.373299 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-224d2a32-4664-41e7-a927-660a088550a8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:36:07.373507 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 273/531] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Sep 13 19:36:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:36:07.374011 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca48249-90ac-452d-9221-2d7f4af1f530 None admin] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:36:07.374520 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-224d2a32-4664-41e7-a927-660a088550a8 None admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:36:07.403143 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application [None req-224d2a32-4664-41e7-a927-660a088550a8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 19:36:07.403143 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:36:07.403143 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:36:07.403143 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:36:07.403143 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:36:07.403143 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:36:07.403143 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:36:07.403143 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:36:07.403143 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:36:07.403143 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:36:07.403143 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:36:07.403143 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:36:07.403143 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 19:36:07.403143 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 19:36:07.403143 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 19:36:07.403143 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 19:36:07.404147 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:36:07.404147 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:36:07.404147 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:36:07.404147 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:36:07.404147 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:36:07.404147 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:36:07.404147 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:36:07.404147 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application with Lock( Sep 13 19:36:07.404147 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:36:07.404147 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:36:07.404147 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:36:07.404147 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:36:07.404147 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:36:07.404147 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:36:07.404147 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:36:07.404147 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:36:07.404147 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 19:36:07.405355 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 19:36:07.405355 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 19:36:07.405355 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application Sep 13 19:36:07.407524 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 259/532] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Sep 13 19:36:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 264 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:36:07.408865 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224d2a32-4664-41e7-a927-660a088550a8 None admin] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:36:07.471964 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG dbcounter [-] [87935] Writing DB stats keystone:SELECT=100 {{(pid=87935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:36:07.531699 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224d2a32-4664-41e7-a927-660a088550a8 None admin] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:36:07.545299 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca48249-90ac-452d-9221-2d7f4af1f530 None admin] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:36:07.573985 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76e7262-3983-4509-a00f-69fa0c814127 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:36:07.575070 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76e7262-3983-4509-a00f-69fa0c814127 None admin] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:36:07.575617 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76e7262-3983-4509-a00f-69fa0c814127 None admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:36:07.576099 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76e7262-3983-4509-a00f-69fa0c814127 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:36:07.585083 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d76e7262-3983-4509-a00f-69fa0c814127 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:36:07.586944 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d76e7262-3983-4509-a00f-69fa0c814127 None admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:36:07.592162 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG dbcounter [-] [87934] Writing DB stats keystone:SELECT=100 {{(pid=87934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:36:07.603694 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application [None req-d76e7262-3983-4509-a00f-69fa0c814127 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 19:36:07.603694 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:36:07.603694 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:36:07.603694 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:36:07.603694 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:36:07.603694 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:36:07.603694 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:36:07.603694 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:36:07.603694 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:36:07.603694 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:36:07.603694 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:36:07.603694 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:36:07.603694 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 13 19:36:07.603694 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 13 19:36:07.603694 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 13 19:36:07.604750 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 13 19:36:07.604750 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:36:07.604750 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:36:07.604750 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:36:07.604750 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:36:07.604750 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:36:07.604750 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:36:07.604750 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:36:07.604750 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application with Lock( Sep 13 19:36:07.604750 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:36:07.604750 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:36:07.604750 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:36:07.604750 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:36:07.604750 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:36:07.604750 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:36:07.604750 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:36:07.604750 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:36:07.605607 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 13 19:36:07.605607 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 13 19:36:07.605607 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 13 19:36:07.605607 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 13 19:36:07.605607 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 13 19:36:07.605607 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 13 19:36:07.605607 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 19:36:07.605607 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application Sep 13 19:36:07.611256 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 260/533] 10.222.0.25 () {56 vars in 1111 bytes} [Tue Sep 13 19:36:07 2022] GET /identity/v3/projects/service => generated 88 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:36:07.611256 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76e7262-3983-4509-a00f-69fa0c814127 None admin] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:36:07.617976 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc375c1c-e1a4-4ce7-baac-203d08778ffb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:36:07.618975 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc375c1c-e1a4-4ce7-baac-203d08778ffb None admin] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:36:07.619458 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc375c1c-e1a4-4ce7-baac-203d08778ffb None admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:36:07.619938 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc375c1c-e1a4-4ce7-baac-203d08778ffb None admin] PATH_INFO: `/v3/projects` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:36:07.620874 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc375c1c-e1a4-4ce7-baac-203d08778ffb None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87934) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:36:07.621414 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc375c1c-e1a4-4ce7-baac-203d08778ffb None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:36:07.623299 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc375c1c-e1a4-4ce7-baac-203d08778ffb None admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:36:07.642936 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 274/534] 10.222.0.25 () {56 vars in 1148 bytes} [Tue Sep 13 19:36:07 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:36:07.644434 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc375c1c-e1a4-4ce7-baac-203d08778ffb None admin] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:36:07.743003 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76e7262-3983-4509-a00f-69fa0c814127 None admin] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:36:07.760667 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG dbcounter [-] [87935] Writing DB stats keystone:SELECT=100 {{(pid=87935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:36:07.770234 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc375c1c-e1a4-4ce7-baac-203d08778ffb None admin] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:36:07.783187 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa83864-e73c-4c02-af54-9cb26b2628bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:36:07.783898 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa83864-e73c-4c02-af54-9cb26b2628bf None admin] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:36:07.784182 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa83864-e73c-4c02-af54-9cb26b2628bf None admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:36:07.784509 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa83864-e73c-4c02-af54-9cb26b2628bf None admin] PATH_INFO: `/v3/domains` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:36:07.785343 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa83864-e73c-4c02-af54-9cb26b2628bf None admin] RBAC: Adding query filter params (name=Default) {{(pid=87935) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:36:07.785459 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa83864-e73c-4c02-af54-9cb26b2628bf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:36:07.787765 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa83864-e73c-4c02-af54-9cb26b2628bf None admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:36:07.806175 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 261/535] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Sep 13 19:36:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:36:07.807805 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa83864-e73c-4c02-af54-9cb26b2628bf None admin] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:36:07.827845 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5079807c-32af-42fe-8f46-f34d7327be63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:36:07.828488 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5079807c-32af-42fe-8f46-f34d7327be63 None admin] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:36:07.828764 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5079807c-32af-42fe-8f46-f34d7327be63 None admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:36:07.829033 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5079807c-32af-42fe-8f46-f34d7327be63 None admin] PATH_INFO: `/v3/projects` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:36:07.830000 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5079807c-32af-42fe-8f46-f34d7327be63 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87934) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:36:07.830000 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5079807c-32af-42fe-8f46-f34d7327be63 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:36:07.831434 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5079807c-32af-42fe-8f46-f34d7327be63 None admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:36:07.852986 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 275/536] 10.222.0.25 () {56 vars in 1148 bytes} [Tue Sep 13 19:36:07 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:36:07.852986 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5079807c-32af-42fe-8f46-f34d7327be63 None admin] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:36:07.921658 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG dbcounter [-] [87934] Writing DB stats keystone:SELECT=100 {{(pid=87934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:36:07.939860 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa83864-e73c-4c02-af54-9cb26b2628bf None admin] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:36:07.987283 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5079807c-32af-42fe-8f46-f34d7327be63 None admin] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:36:07.988955 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4be3019-1a3e-4b53-8491-faa805575ee6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:36:07.990369 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4be3019-1a3e-4b53-8491-faa805575ee6 None admin] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:36:07.990743 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4be3019-1a3e-4b53-8491-faa805575ee6 None admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:36:07.991173 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4be3019-1a3e-4b53-8491-faa805575ee6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:36:07.992558 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4be3019-1a3e-4b53-8491-faa805575ee6 None admin] RBAC: Adding query filter params (role.id=60f5ecbf9ce84814968607f126a85a5a, scope.project.id=9a10a4268f3c4cb29f4e00c292e2df62, user.id=907d44d3b6944ccb83999d8e489871d4) {{(pid=87935) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:36:07.993073 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4be3019-1a3e-4b53-8491-faa805575ee6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:36:07.995587 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4be3019-1a3e-4b53-8491-faa805575ee6 None admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:36:08.005736 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 262/537] 10.222.0.25 () {56 vars in 1374 bytes} [Tue Sep 13 19:36:07 2022] GET /identity/v3/role_assignments?user.id=907d44d3b6944ccb83999d8e489871d4&scope.project.id=9a10a4268f3c4cb29f4e00c292e2df62&role.id=60f5ecbf9ce84814968607f126a85a5a => generated 259 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:36:08.007426 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4be3019-1a3e-4b53-8491-faa805575ee6 None admin] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:36:08.035630 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ff8a4e-75af-46f6-b533-8fba9349cf8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:36:08.037893 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ff8a4e-75af-46f6-b533-8fba9349cf8a None admin] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:36:08.038127 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ff8a4e-75af-46f6-b533-8fba9349cf8a None admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:36:08.038398 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ff8a4e-75af-46f6-b533-8fba9349cf8a None admin] PATH_INFO: `/v3/projects/service` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:36:08.052831 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ff8a4e-75af-46f6-b533-8fba9349cf8a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:36:08.055379 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ff8a4e-75af-46f6-b533-8fba9349cf8a None admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:36:08.071137 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application [None req-d3ff8a4e-75af-46f6-b533-8fba9349cf8a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 19:36:08.071137 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:36:08.071137 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:36:08.071137 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:36:08.071137 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:36:08.071137 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:36:08.071137 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:36:08.071137 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:36:08.071137 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:36:08.071137 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:36:08.071137 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:36:08.071137 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:36:08.071137 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 13 19:36:08.071137 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 13 19:36:08.071137 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 13 19:36:08.072632 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 13 19:36:08.072632 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:36:08.072632 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:36:08.072632 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:36:08.072632 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:36:08.072632 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:36:08.072632 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:36:08.072632 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:36:08.072632 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application with Lock( Sep 13 19:36:08.072632 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:36:08.072632 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:36:08.072632 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:36:08.072632 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:36:08.072632 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:36:08.072632 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:36:08.072632 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:36:08.072632 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:36:08.074002 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 13 19:36:08.074002 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 13 19:36:08.074002 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 13 19:36:08.074002 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 13 19:36:08.074002 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 13 19:36:08.074002 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 13 19:36:08.074002 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 19:36:08.074002 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application Sep 13 19:36:08.077700 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 276/538] 10.222.0.25 () {56 vars in 1111 bytes} [Tue Sep 13 19:36:07 2022] GET /identity/v3/projects/service => generated 88 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:36:08.087459 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG dbcounter [-] [87935] Writing DB stats keystone:SELECT=100 {{(pid=87935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:36:08.087664 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ff8a4e-75af-46f6-b533-8fba9349cf8a None admin] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:36:08.247342 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4be3019-1a3e-4b53-8491-faa805575ee6 None admin] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:36:08.277947 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ff8a4e-75af-46f6-b533-8fba9349cf8a None admin] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:36:08.280653 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG dbcounter [-] [87934] Writing DB stats keystone:SELECT=100 {{(pid=87934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:36:08.307578 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9148411-ae84-4f79-9dcd-1fc8a5f20d1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:36:08.308447 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9148411-ae84-4f79-9dcd-1fc8a5f20d1c None admin] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:36:08.308894 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9148411-ae84-4f79-9dcd-1fc8a5f20d1c None admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:36:08.309317 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9148411-ae84-4f79-9dcd-1fc8a5f20d1c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:36:08.310200 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9148411-ae84-4f79-9dcd-1fc8a5f20d1c None admin] RBAC: Adding query filter params (role.id=60f5ecbf9ce84814968607f126a85a5a, scope.project.id=9a10a4268f3c4cb29f4e00c292e2df62, user.id=4cbb50c88b794a7f9f26844effde7d63) {{(pid=87935) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:36:08.310657 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9148411-ae84-4f79-9dcd-1fc8a5f20d1c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:36:08.312380 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9148411-ae84-4f79-9dcd-1fc8a5f20d1c None admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:36:08.317224 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49617a31-0c9d-4f1e-b242-5043670fb2a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:36:08.318604 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49617a31-0c9d-4f1e-b242-5043670fb2a9 None admin] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:36:08.320371 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49617a31-0c9d-4f1e-b242-5043670fb2a9 None admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:36:08.320371 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49617a31-0c9d-4f1e-b242-5043670fb2a9 None admin] PATH_INFO: `/v3/projects` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:36:08.320371 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49617a31-0c9d-4f1e-b242-5043670fb2a9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87934) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:36:08.320371 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49617a31-0c9d-4f1e-b242-5043670fb2a9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:36:08.321806 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49617a31-0c9d-4f1e-b242-5043670fb2a9 None admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:36:08.321962 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 263/539] 10.222.0.25 () {56 vars in 1374 bytes} [Tue Sep 13 19:36:08 2022] GET /identity/v3/role_assignments?user.id=4cbb50c88b794a7f9f26844effde7d63&scope.project.id=9a10a4268f3c4cb29f4e00c292e2df62&role.id=60f5ecbf9ce84814968607f126a85a5a => generated 259 bytes in 315 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:36:08.338223 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 277/540] 10.222.0.25 () {56 vars in 1148 bytes} [Tue Sep 13 19:36:08 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 19:36:08.344158 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9148411-ae84-4f79-9dcd-1fc8a5f20d1c None admin] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:36:08.516322 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG dbcounter [-] [87935] Writing DB stats keystone:SELECT=100 {{(pid=87935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:36:08.519206 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9148411-ae84-4f79-9dcd-1fc8a5f20d1c None admin] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:36:08.558438 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7c48f3-e305-4697-a917-ee0ff1fc933d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:36:08.559043 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7c48f3-e305-4697-a917-ee0ff1fc933d None admin] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:36:08.559320 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7c48f3-e305-4697-a917-ee0ff1fc933d None admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:36:08.559587 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7c48f3-e305-4697-a917-ee0ff1fc933d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:36:08.560349 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a7c48f3-e305-4697-a917-ee0ff1fc933d None admin] RBAC: Adding query filter params (role.id=60f5ecbf9ce84814968607f126a85a5a, scope.project.id=9a10a4268f3c4cb29f4e00c292e2df62, user.id=1196a96e4a404f559600b69f929ea9da) {{(pid=87935) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:36:08.560664 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a7c48f3-e305-4697-a917-ee0ff1fc933d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:36:08.562164 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a7c48f3-e305-4697-a917-ee0ff1fc933d None admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:36:08.576380 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 264/541] 10.222.0.25 () {56 vars in 1374 bytes} [Tue Sep 13 19:36:08 2022] GET /identity/v3/role_assignments?user.id=1196a96e4a404f559600b69f929ea9da&scope.project.id=9a10a4268f3c4cb29f4e00c292e2df62&role.id=60f5ecbf9ce84814968607f126a85a5a => generated 259 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:36:08.880318 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6890fed3-e4d8-454c-b137-9a540616b2dd None None] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:36:08.880961 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6890fed3-e4d8-454c-b137-9a540616b2dd None None] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:36:08.881615 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6890fed3-e4d8-454c-b137-9a540616b2dd None None] PATH_INFO: `/` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:36:08.883155 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 278/542] 10.222.0.25 () {54 vars in 927 bytes} [Tue Sep 13 19:36:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:36:08.889215 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7188ff23-1975-4287-8c64-97c4f8a66da3 None None] REQUEST_METHOD: `POST` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:36:08.889755 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7188ff23-1975-4287-8c64-97c4f8a66da3 None None] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:36:08.889755 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7188ff23-1975-4287-8c64-97c4f8a66da3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:36:08.910817 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.auth.core [None req-7188ff23-1975-4287-8c64-97c4f8a66da3 None None] MFA Rules not processed for user `7b0aed92d02344acb92a0e4aa67c3068`. Rule list: `[]` (Enabled: `True`). {{(pid=87935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:36:08.912485 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.fernet_utils [None req-7188ff23-1975-4287-8c64-97c4f8a66da3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:36:09.000512 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 265/543] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Sep 13 19:36:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 19:36:09.455472 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6890fed3-e4d8-454c-b137-9a540616b2dd None None] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:36:09.610253 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6890fed3-e4d8-454c-b137-9a540616b2dd None None] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:36:09.667721 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2fac3c-fa8f-41c6-9817-2fe11e22030e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:36:09.668797 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2fac3c-fa8f-41c6-9817-2fe11e22030e None admin] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:36:09.669327 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2fac3c-fa8f-41c6-9817-2fe11e22030e None admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:36:09.669799 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2fac3c-fa8f-41c6-9817-2fe11e22030e None admin] PATH_INFO: `/v3/roles/service` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:36:09.683914 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd2fac3c-fa8f-41c6-9817-2fe11e22030e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 19:36:09.689342 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application [None req-fd2fac3c-fa8f-41c6-9817-2fe11e22030e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 13 19:36:09.689342 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:36:09.689342 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:36:09.689342 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:36:09.689342 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:36:09.689342 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:36:09.689342 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:36:09.689342 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:36:09.689342 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:36:09.689342 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:36:09.689342 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:36:09.689342 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:36:09.689342 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 19:36:09.689342 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 19:36:09.689342 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 19:36:09.689342 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 19:36:09.690315 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 19:36:09.690315 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 19:36:09.690315 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 19:36:09.690315 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 19:36:09.690315 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:36:09.690315 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:36:09.690315 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:36:09.690315 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:36:09.690315 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:36:09.690315 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:36:09.690315 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:36:09.690315 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application with Lock( Sep 13 19:36:09.690315 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:36:09.690315 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:36:09.690315 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:36:09.690315 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:36:09.691120 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:36:09.691120 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:36:09.691120 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:36:09.691120 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:36:09.691120 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 19:36:09.691120 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 19:36:09.691120 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 19:36:09.691120 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 19:36:09.691120 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 19:36:09.691120 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 19:36:09.691120 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 13 19:36:09.691120 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application Sep 13 19:36:09.693934 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 279/544] 10.222.0.25 () {56 vars in 1102 bytes} [Tue Sep 13 19:36:09 2022] GET /identity/v3/roles/service => generated 85 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:36:09.704264 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7188ff23-1975-4287-8c64-97c4f8a66da3 None None] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:36:09.790484 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97af88f6-4c32-4bce-ad81-574e40ad8e72 None None] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:36:09.791116 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97af88f6-4c32-4bce-ad81-574e40ad8e72 None None] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:36:09.791587 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97af88f6-4c32-4bce-ad81-574e40ad8e72 None None] PATH_INFO: `/` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:36:09.793206 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 280/545] 10.222.0.25 () {54 vars in 927 bytes} [Tue Sep 13 19:36:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:36:09.799012 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d35ee73-418f-4d85-8bbd-3a8c9d31cc6d None None] REQUEST_METHOD: `POST` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:36:09.799605 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d35ee73-418f-4d85-8bbd-3a8c9d31cc6d None None] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:36:09.800078 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d35ee73-418f-4d85-8bbd-3a8c9d31cc6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:36:09.823634 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.auth.core [None req-4d35ee73-418f-4d85-8bbd-3a8c9d31cc6d None None] MFA Rules not processed for user `7b0aed92d02344acb92a0e4aa67c3068`. Rule list: `[]` (Enabled: `True`). {{(pid=87934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:36:09.825280 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.fernet_utils [None req-4d35ee73-418f-4d85-8bbd-3a8c9d31cc6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:36:09.902069 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG dbcounter [-] [87934] Writing DB stats keystone:SELECT=100 {{(pid=87934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:36:09.930901 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 281/546] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Sep 13 19:36:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 13 19:36:09.936767 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG dbcounter [-] [87935] Writing DB stats keystone:SELECT=100 {{(pid=87935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:36:09.958800 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7188ff23-1975-4287-8c64-97c4f8a66da3 None None] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:36:10.021076 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7840607-6fdb-4fc9-89e4-958d290d9ea2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:36:10.021759 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7840607-6fdb-4fc9-89e4-958d290d9ea2 None admin] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:36:10.022040 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7840607-6fdb-4fc9-89e4-958d290d9ea2 None admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:36:10.022305 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7840607-6fdb-4fc9-89e4-958d290d9ea2 None admin] PATH_INFO: `/v3/roles` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:36:10.022980 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7840607-6fdb-4fc9-89e4-958d290d9ea2 None admin] RBAC: Adding query filter params (name=service) {{(pid=87935) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:36:10.023277 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7840607-6fdb-4fc9-89e4-958d290d9ea2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:36:10.024710 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7840607-6fdb-4fc9-89e4-958d290d9ea2 None admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:36:10.034149 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 266/547] 10.222.0.25 () {56 vars in 1103 bytes} [Tue Sep 13 19:36:09 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 334 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:36:10.040740 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d35ee73-418f-4d85-8bbd-3a8c9d31cc6d None None] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:36:10.171222 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d35ee73-418f-4d85-8bbd-3a8c9d31cc6d None None] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:36:10.208839 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a610f14c-aa62-432d-bf88-4a56e41198b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:36:10.210209 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a610f14c-aa62-432d-bf88-4a56e41198b6 None admin] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:36:10.210785 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a610f14c-aa62-432d-bf88-4a56e41198b6 None admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:36:10.211252 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a610f14c-aa62-432d-bf88-4a56e41198b6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:36:10.223281 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a610f14c-aa62-432d-bf88-4a56e41198b6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:36:10.225187 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a610f14c-aa62-432d-bf88-4a56e41198b6 None admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:36:10.242132 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application [None req-a610f14c-aa62-432d-bf88-4a56e41198b6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 19:36:10.242132 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:36:10.242132 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:36:10.242132 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:36:10.242132 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:36:10.242132 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:36:10.242132 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:36:10.242132 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:36:10.242132 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:36:10.242132 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:36:10.242132 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:36:10.242132 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:36:10.242132 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 19:36:10.242132 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 19:36:10.242132 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 19:36:10.242132 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 19:36:10.243104 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:36:10.243104 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:36:10.243104 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:36:10.243104 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:36:10.243104 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:36:10.243104 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:36:10.243104 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:36:10.243104 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application with Lock( Sep 13 19:36:10.243104 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:36:10.243104 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:36:10.243104 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:36:10.243104 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:36:10.243104 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:36:10.243104 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:36:10.243104 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:36:10.243104 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:36:10.243104 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 19:36:10.244044 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 19:36:10.244044 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 19:36:10.244044 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application Sep 13 19:36:10.246234 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 282/548] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Sep 13 19:36:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:36:10.257425 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7840607-6fdb-4fc9-89e4-958d290d9ea2 None admin] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:36:10.323705 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a610f14c-aa62-432d-bf88-4a56e41198b6 None admin] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:36:10.344587 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG dbcounter [-] [87934] Writing DB stats keystone:SELECT=100 {{(pid=87934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:36:10.398612 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7840607-6fdb-4fc9-89e4-958d290d9ea2 None admin] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:36:10.441291 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475351dd-e1b0-4c72-85ec-4b676366788a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:36:10.441871 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475351dd-e1b0-4c72-85ec-4b676366788a None admin] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:36:10.442296 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475351dd-e1b0-4c72-85ec-4b676366788a None admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:36:10.442933 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475351dd-e1b0-4c72-85ec-4b676366788a None admin] PATH_INFO: `/v3/domains` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:36:10.443646 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-475351dd-e1b0-4c72-85ec-4b676366788a None admin] RBAC: Adding query filter params (name=Default) {{(pid=87935) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:36:10.443948 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-475351dd-e1b0-4c72-85ec-4b676366788a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:36:10.445985 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-475351dd-e1b0-4c72-85ec-4b676366788a None admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:36:10.465837 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 267/549] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Sep 13 19:36:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:36:10.467613 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475351dd-e1b0-4c72-85ec-4b676366788a None admin] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:36:10.500611 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG dbcounter [-] [87935] Writing DB stats keystone:SELECT=100 {{(pid=87935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:36:10.508601 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a610f14c-aa62-432d-bf88-4a56e41198b6 None admin] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:36:10.545649 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94bd36e-6d1b-4704-957e-ba95effc5c6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:36:10.546329 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94bd36e-6d1b-4704-957e-ba95effc5c6c None admin] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:36:10.546610 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94bd36e-6d1b-4704-957e-ba95effc5c6c None admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:36:10.546875 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94bd36e-6d1b-4704-957e-ba95effc5c6c None admin] PATH_INFO: `/v3/roles/service` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:36:10.558864 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d94bd36e-6d1b-4704-957e-ba95effc5c6c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 19:36:10.564382 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application [None req-d94bd36e-6d1b-4704-957e-ba95effc5c6c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 13 19:36:10.564382 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:36:10.564382 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:36:10.564382 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:36:10.564382 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:36:10.564382 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:36:10.564382 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:36:10.564382 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:36:10.564382 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:36:10.564382 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:36:10.564382 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:36:10.564382 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:36:10.564382 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 19:36:10.564382 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 19:36:10.564382 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 19:36:10.564382 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 19:36:10.565478 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 19:36:10.565478 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 19:36:10.565478 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 19:36:10.565478 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 19:36:10.565478 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:36:10.565478 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:36:10.565478 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:36:10.565478 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:36:10.565478 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:36:10.565478 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:36:10.565478 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:36:10.565478 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application with Lock( Sep 13 19:36:10.565478 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:36:10.565478 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:36:10.565478 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:36:10.565478 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:36:10.566314 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:36:10.566314 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:36:10.566314 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:36:10.566314 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:36:10.566314 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 19:36:10.566314 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 19:36:10.566314 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 19:36:10.566314 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 19:36:10.566314 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 19:36:10.566314 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 19:36:10.566314 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 13 19:36:10.566314 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application Sep 13 19:36:10.566314 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 283/550] 10.222.0.25 () {56 vars in 1102 bytes} [Tue Sep 13 19:36:10 2022] GET /identity/v3/roles/service => generated 85 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:36:10.573160 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94bd36e-6d1b-4704-957e-ba95effc5c6c None admin] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:36:10.696067 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475351dd-e1b0-4c72-85ec-4b676366788a None admin] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:36:10.715512 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG dbcounter [-] [87934] Writing DB stats keystone:SELECT=100 {{(pid=87934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:36:10.750412 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b825cd5-2dff-4434-a09f-0da7af16b2bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:36:10.751121 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b825cd5-2dff-4434-a09f-0da7af16b2bb None admin] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:36:10.751407 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b825cd5-2dff-4434-a09f-0da7af16b2bb None admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:36:10.751680 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b825cd5-2dff-4434-a09f-0da7af16b2bb None admin] PATH_INFO: `/v3/users/swift` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:36:10.756715 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94bd36e-6d1b-4704-957e-ba95effc5c6c None admin] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:36:10.764367 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b825cd5-2dff-4434-a09f-0da7af16b2bb None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:36:10.765855 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b825cd5-2dff-4434-a09f-0da7af16b2bb None admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:36:10.793139 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff17adb-51c7-4515-87a8-e8250d329120 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:36:10.793867 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff17adb-51c7-4515-87a8-e8250d329120 None admin] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:36:10.794202 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff17adb-51c7-4515-87a8-e8250d329120 None admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:36:10.794539 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff17adb-51c7-4515-87a8-e8250d329120 None admin] PATH_INFO: `/v3/roles` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:36:10.795275 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff17adb-51c7-4515-87a8-e8250d329120 None admin] RBAC: Adding query filter params (name=service) {{(pid=87934) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:36:10.795642 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff17adb-51c7-4515-87a8-e8250d329120 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:36:10.795796 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application [None req-3b825cd5-2dff-4434-a09f-0da7af16b2bb None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 13 19:36:10.795796 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:36:10.795796 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:36:10.795796 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:36:10.795796 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:36:10.795796 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:36:10.795796 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:36:10.795796 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:36:10.795796 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:36:10.795796 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:36:10.795796 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:36:10.795796 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:36:10.795796 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 13 19:36:10.795796 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 13 19:36:10.795796 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 13 19:36:10.795796 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 13 19:36:10.797586 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:36:10.797586 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:36:10.797586 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 13 19:36:10.797586 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 19:36:10.797586 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 13 19:36:10.797586 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 19:36:10.797586 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:36:10.797586 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:36:10.797586 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:36:10.797586 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:36:10.797586 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:36:10.797586 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application with Lock( Sep 13 19:36:10.797586 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:36:10.797586 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:36:10.797586 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:36:10.797586 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:36:10.797586 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:36:10.797586 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:36:10.799233 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:36:10.799233 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:36:10.799233 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 13 19:36:10.799233 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 13 19:36:10.799233 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 13 19:36:10.799233 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 13 19:36:10.799233 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 13 19:36:10.799233 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 13 19:36:10.799233 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 13 19:36:10.799233 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application Sep 13 19:36:10.799233 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 268/551] 10.222.0.25 () {56 vars in 1096 bytes} [Tue Sep 13 19:36:10 2022] GET /identity/v3/users/swift => generated 83 bytes in 330 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 13 19:36:10.801181 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff17adb-51c7-4515-87a8-e8250d329120 None admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:36:10.809619 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b825cd5-2dff-4434-a09f-0da7af16b2bb None admin] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:36:10.811269 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 284/552] 10.222.0.25 () {56 vars in 1103 bytes} [Tue Sep 13 19:36:10 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:36:10.823940 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff17adb-51c7-4515-87a8-e8250d329120 None admin] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:36:10.992187 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG dbcounter [-] [87935] Writing DB stats keystone:SELECT=100 {{(pid=87935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:36:10.999506 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff17adb-51c7-4515-87a8-e8250d329120 None admin] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:36:11.031324 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG dbcounter [-] [87934] Writing DB stats keystone:SELECT=100 {{(pid=87934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:36:11.040366 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e03c353-7d43-419b-8673-0d1b344aa6db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:36:11.041102 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e03c353-7d43-419b-8673-0d1b344aa6db None admin] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:36:11.041453 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e03c353-7d43-419b-8673-0d1b344aa6db None admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:36:11.041804 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e03c353-7d43-419b-8673-0d1b344aa6db None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:36:11.054889 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e03c353-7d43-419b-8673-0d1b344aa6db None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:36:11.056404 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e03c353-7d43-419b-8673-0d1b344aa6db None admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:36:11.069078 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b825cd5-2dff-4434-a09f-0da7af16b2bb None admin] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:36:11.089692 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application [None req-7e03c353-7d43-419b-8673-0d1b344aa6db None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 19:36:11.089692 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:36:11.089692 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:36:11.089692 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:36:11.089692 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:36:11.089692 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:36:11.089692 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:36:11.089692 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:36:11.089692 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:36:11.089692 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:36:11.089692 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:36:11.089692 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:36:11.089692 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 19:36:11.089692 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 19:36:11.089692 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 19:36:11.089692 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 19:36:11.092047 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:36:11.092047 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:36:11.092047 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:36:11.092047 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:36:11.092047 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:36:11.092047 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:36:11.092047 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:36:11.092047 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application with Lock( Sep 13 19:36:11.092047 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:36:11.092047 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:36:11.092047 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:36:11.092047 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:36:11.092047 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:36:11.092047 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:36:11.092047 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:36:11.092047 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:36:11.092047 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 19:36:11.093400 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 19:36:11.093400 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 19:36:11.093400 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application Sep 13 19:36:11.093400 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 285/553] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Sep 13 19:36:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 268 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:36:11.094070 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a5e343-f47a-42bd-b178-0e8139630691 None None] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:36:11.094358 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a5e343-f47a-42bd-b178-0e8139630691 None None] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:36:11.094627 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a5e343-f47a-42bd-b178-0e8139630691 None None] PATH_INFO: `/` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:36:11.096111 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 286/554] 10.222.0.25 () {54 vars in 927 bytes} [Tue Sep 13 19:36:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:36:11.108428 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a5e343-f47a-42bd-b178-0e8139630691 None None] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:36:11.121210 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3bba6a-915d-48fe-a7c2-b23885416537 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:36:11.121831 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3bba6a-915d-48fe-a7c2-b23885416537 None admin] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:36:11.122114 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3bba6a-915d-48fe-a7c2-b23885416537 None admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:36:11.122389 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3bba6a-915d-48fe-a7c2-b23885416537 None admin] PATH_INFO: `/v3/users` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:36:11.123142 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f3bba6a-915d-48fe-a7c2-b23885416537 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=87935) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:36:11.123454 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f3bba6a-915d-48fe-a7c2-b23885416537 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:36:11.125006 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f3bba6a-915d-48fe-a7c2-b23885416537 None admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:36:11.145584 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 269/555] 10.222.0.25 () {56 vars in 1135 bytes} [Tue Sep 13 19:36:10 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 336 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 19:36:11.147173 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d604b1-4b65-4352-8a9a-510a552c2bba None None] REQUEST_METHOD: `POST` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:36:11.147467 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d604b1-4b65-4352-8a9a-510a552c2bba None None] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:36:11.147741 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d604b1-4b65-4352-8a9a-510a552c2bba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:36:11.167333 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.auth.core [None req-a9d604b1-4b65-4352-8a9a-510a552c2bba None None] MFA Rules not processed for user `7b0aed92d02344acb92a0e4aa67c3068`. Rule list: `[]` (Enabled: `True`). {{(pid=87935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:36:11.168587 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.fernet_utils [None req-a9d604b1-4b65-4352-8a9a-510a552c2bba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:36:11.256728 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a5e343-f47a-42bd-b178-0e8139630691 None None] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:36:11.269381 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 270/556] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Sep 13 19:36:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 19:36:11.270282 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d604b1-4b65-4352-8a9a-510a552c2bba None None] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:36:11.326534 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b97613-6ffe-4e83-bab2-33cfaced3da4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:36:11.327583 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b97613-6ffe-4e83-bab2-33cfaced3da4 None admin] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:36:11.328059 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b97613-6ffe-4e83-bab2-33cfaced3da4 None admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:36:11.328653 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b97613-6ffe-4e83-bab2-33cfaced3da4 None admin] PATH_INFO: `/v3/domains` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:36:11.329593 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b97613-6ffe-4e83-bab2-33cfaced3da4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87934) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:36:11.330094 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b97613-6ffe-4e83-bab2-33cfaced3da4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:36:11.332624 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b97613-6ffe-4e83-bab2-33cfaced3da4 None admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:36:11.350618 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 287/557] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Sep 13 19:36:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:36:11.352531 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5977bc-5947-43c8-883e-6d42c3a2c559 None None] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:36:11.353047 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5977bc-5947-43c8-883e-6d42c3a2c559 None None] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:36:11.353518 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5977bc-5947-43c8-883e-6d42c3a2c559 None None] PATH_INFO: `/` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:36:11.355000 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 288/558] 10.222.0.25 () {54 vars in 927 bytes} [Tue Sep 13 19:36:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:36:11.367284 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565cbace-967c-4392-af0e-7a14fa889042 None None] REQUEST_METHOD: `POST` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:36:11.367845 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565cbace-967c-4392-af0e-7a14fa889042 None None] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:36:11.368126 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565cbace-967c-4392-af0e-7a14fa889042 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:36:11.372709 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG dbcounter [-] [87935] Writing DB stats keystone:SELECT=100 {{(pid=87935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:36:11.402610 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.auth.core [None req-565cbace-967c-4392-af0e-7a14fa889042 None None] MFA Rules not processed for user `7b0aed92d02344acb92a0e4aa67c3068`. Rule list: `[]` (Enabled: `True`). {{(pid=87934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:36:11.405077 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.fernet_utils [None req-565cbace-967c-4392-af0e-7a14fa889042 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:36:11.429605 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d604b1-4b65-4352-8a9a-510a552c2bba None None] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:36:11.476022 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c017905-fd84-40a4-b8a8-a41ac5bf9dcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:36:11.476702 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c017905-fd84-40a4-b8a8-a41ac5bf9dcc None admin] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:36:11.477188 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c017905-fd84-40a4-b8a8-a41ac5bf9dcc None admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:36:11.477341 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c017905-fd84-40a4-b8a8-a41ac5bf9dcc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:36:11.492699 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG dbcounter [-] [87934] Writing DB stats keystone:SELECT=100 {{(pid=87934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:36:11.498097 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 289/559] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Sep 13 19:36:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 19:36:11.499303 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565cbace-967c-4392-af0e-7a14fa889042 None None] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:36:11.571039 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c017905-fd84-40a4-b8a8-a41ac5bf9dcc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:36:11.572490 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c017905-fd84-40a4-b8a8-a41ac5bf9dcc None admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:36:11.640648 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565cbace-967c-4392-af0e-7a14fa889042 None None] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:36:11.663482 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG dbcounter [-] [87935] Writing DB stats keystone:SELECT=100 {{(pid=87935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:36:11.691098 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056c6435-5abc-4273-8be3-aa3d420409fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:36:11.691757 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056c6435-5abc-4273-8be3-aa3d420409fb None admin] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:36:11.692006 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056c6435-5abc-4273-8be3-aa3d420409fb None admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:36:11.692300 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056c6435-5abc-4273-8be3-aa3d420409fb None admin] PATH_INFO: `/v3/users/nova` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:36:11.700142 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-056c6435-5abc-4273-8be3-aa3d420409fb None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:36:11.701668 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-056c6435-5abc-4273-8be3-aa3d420409fb None admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:36:11.717478 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 271/560] 10.222.0.25 () {58 vars in 1282 bytes} [Tue Sep 13 19:36:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 443 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 13 19:36:11.717674 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application [None req-056c6435-5abc-4273-8be3-aa3d420409fb None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 13 19:36:11.717674 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:36:11.717674 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:36:11.717674 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:36:11.717674 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:36:11.717674 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:36:11.717674 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:36:11.717674 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:36:11.717674 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:36:11.717674 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:36:11.717674 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:36:11.717674 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:36:11.717674 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 13 19:36:11.717674 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 13 19:36:11.717674 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 13 19:36:11.717674 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 13 19:36:11.718614 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:36:11.718614 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:36:11.718614 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 13 19:36:11.718614 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 19:36:11.718614 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 13 19:36:11.718614 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 19:36:11.718614 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:36:11.718614 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:36:11.718614 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:36:11.718614 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:36:11.718614 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:36:11.718614 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application with Lock( Sep 13 19:36:11.718614 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:36:11.718614 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:36:11.718614 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:36:11.718614 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:36:11.718614 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:36:11.718614 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:36:11.719616 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:36:11.719616 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:36:11.719616 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 13 19:36:11.719616 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 13 19:36:11.719616 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 13 19:36:11.719616 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 13 19:36:11.719616 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 13 19:36:11.719616 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 13 19:36:11.719616 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 13 19:36:11.719616 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application Sep 13 19:36:11.720264 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5886c5-719e-47c5-b74c-8eebe52a52d0 None None] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:36:11.720264 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5886c5-719e-47c5-b74c-8eebe52a52d0 None None] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:36:11.720410 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 290/561] 10.222.0.25 () {56 vars in 1093 bytes} [Tue Sep 13 19:36:11 2022] GET /identity/v3/users/nova => generated 82 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:36:11.720410 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056c6435-5abc-4273-8be3-aa3d420409fb None admin] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:36:11.720534 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5886c5-719e-47c5-b74c-8eebe52a52d0 None None] PATH_INFO: `/` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:36:11.722604 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 272/562] 10.222.0.25 () {54 vars in 927 bytes} [Tue Sep 13 19:36:11 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:36:11.724452 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5886c5-719e-47c5-b74c-8eebe52a52d0 None None] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:36:11.758502 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG dbcounter [-] [87934] Writing DB stats keystone:SELECT=100 {{(pid=87934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:36:11.837488 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056c6435-5abc-4273-8be3-aa3d420409fb None admin] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:36:11.850851 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5886c5-719e-47c5-b74c-8eebe52a52d0 None None] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:36:11.873981 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f58a0a-86ef-418d-8a53-1086ef3ece11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:36:11.874618 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f58a0a-86ef-418d-8a53-1086ef3ece11 None admin] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:36:11.874889 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f58a0a-86ef-418d-8a53-1086ef3ece11 None admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:36:11.875159 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f58a0a-86ef-418d-8a53-1086ef3ece11 None admin] PATH_INFO: `/v3/roles/service` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:36:11.887073 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f876aef-2ae2-4878-b90d-ba41cee0eb12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:36:11.887700 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f876aef-2ae2-4878-b90d-ba41cee0eb12 None admin] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:36:11.887976 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f876aef-2ae2-4878-b90d-ba41cee0eb12 None admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:36:11.888266 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f876aef-2ae2-4878-b90d-ba41cee0eb12 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:36:11.888641 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f58a0a-86ef-418d-8a53-1086ef3ece11 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 19:36:11.893892 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application [None req-20f58a0a-86ef-418d-8a53-1086ef3ece11 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 13 19:36:11.893892 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:36:11.893892 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:36:11.893892 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:36:11.893892 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:36:11.893892 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:36:11.893892 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:36:11.893892 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:36:11.893892 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:36:11.893892 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:36:11.893892 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:36:11.893892 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:36:11.893892 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 19:36:11.893892 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 19:36:11.893892 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 19:36:11.893892 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 19:36:11.894846 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 19:36:11.894846 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 19:36:11.894846 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 19:36:11.894846 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 19:36:11.894846 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:36:11.894846 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:36:11.894846 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:36:11.894846 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:36:11.894846 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:36:11.894846 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:36:11.894846 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:36:11.894846 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application with Lock( Sep 13 19:36:11.894846 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:36:11.894846 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:36:11.894846 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:36:11.894846 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:36:11.896181 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:36:11.896181 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:36:11.896181 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:36:11.896181 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:36:11.896181 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 19:36:11.896181 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 19:36:11.896181 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 19:36:11.896181 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 19:36:11.896181 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 19:36:11.896181 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 19:36:11.896181 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 13 19:36:11.896181 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application Sep 13 19:36:11.900421 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 291/563] 10.222.0.25 () {56 vars in 1102 bytes} [Tue Sep 13 19:36:11 2022] GET /identity/v3/roles/service => generated 85 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:36:11.900666 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f876aef-2ae2-4878-b90d-ba41cee0eb12 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:36:11.901803 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f58a0a-86ef-418d-8a53-1086ef3ece11 None admin] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:36:11.903073 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f876aef-2ae2-4878-b90d-ba41cee0eb12 None admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:36:11.921978 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application [None req-4f876aef-2ae2-4878-b90d-ba41cee0eb12 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 19:36:11.921978 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:36:11.921978 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:36:11.921978 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:36:11.921978 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:36:11.921978 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:36:11.921978 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:36:11.921978 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:36:11.921978 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:36:11.921978 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:36:11.921978 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:36:11.921978 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:36:11.921978 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 19:36:11.921978 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 19:36:11.921978 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 19:36:11.921978 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 19:36:11.923007 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:36:11.923007 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:36:11.923007 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:36:11.923007 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:36:11.923007 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:36:11.923007 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:36:11.923007 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:36:11.923007 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application with Lock( Sep 13 19:36:11.923007 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:36:11.923007 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:36:11.923007 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:36:11.923007 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:36:11.923007 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:36:11.923007 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:36:11.923007 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:36:11.923007 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:36:11.923007 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 19:36:11.923902 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 19:36:11.923902 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 19:36:11.923902 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application Sep 13 19:36:11.923902 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 273/564] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Sep 13 19:36:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:36:11.924415 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcce82a-2af2-4e02-9677-727b2428ecbb None None] REQUEST_METHOD: `POST` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:36:11.924611 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcce82a-2af2-4e02-9677-727b2428ecbb None None] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:36:11.924864 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcce82a-2af2-4e02-9677-727b2428ecbb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:36:11.943806 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.auth.core [None req-4bcce82a-2af2-4e02-9677-727b2428ecbb None None] MFA Rules not processed for user `7b0aed92d02344acb92a0e4aa67c3068`. Rule list: `[]` (Enabled: `True`). {{(pid=87935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:36:11.945043 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.fernet_utils [None req-4bcce82a-2af2-4e02-9677-727b2428ecbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:36:11.956530 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG dbcounter [-] [87935] Writing DB stats keystone:SELECT=100 {{(pid=87935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:36:12.010329 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG dbcounter [-] [87934] Writing DB stats keystone:SELECT=100 {{(pid=87934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:36:12.018446 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 274/565] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Sep 13 19:36:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 19:36:12.019309 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bcce82a-2af2-4e02-9677-727b2428ecbb None None] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:36:12.019747 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f58a0a-86ef-418d-8a53-1086ef3ece11 None admin] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:36:12.057040 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72a1000-93e4-4667-82a7-d4b8d240a335 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:36:12.057650 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72a1000-93e4-4667-82a7-d4b8d240a335 None admin] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:36:12.057928 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72a1000-93e4-4667-82a7-d4b8d240a335 None admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:36:12.058195 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72a1000-93e4-4667-82a7-d4b8d240a335 None admin] PATH_INFO: `/v3/users` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:36:12.058921 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f72a1000-93e4-4667-82a7-d4b8d240a335 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=87934) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:36:12.059249 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f72a1000-93e4-4667-82a7-d4b8d240a335 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:36:12.060727 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f72a1000-93e4-4667-82a7-d4b8d240a335 None admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:36:12.081101 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 292/566] 10.222.0.25 () {56 vars in 1133 bytes} [Tue Sep 13 19:36:11 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:36:12.081997 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72a1000-93e4-4667-82a7-d4b8d240a335 None admin] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:36:12.149839 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bcce82a-2af2-4e02-9677-727b2428ecbb None None] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:36:12.190313 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194a832c-6045-4f6b-8a12-23955ba2f3b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:36:12.191010 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194a832c-6045-4f6b-8a12-23955ba2f3b4 None admin] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:36:12.191502 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194a832c-6045-4f6b-8a12-23955ba2f3b4 None admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:36:12.191502 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194a832c-6045-4f6b-8a12-23955ba2f3b4 None admin] PATH_INFO: `/v3/roles/service` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:36:12.200844 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72a1000-93e4-4667-82a7-d4b8d240a335 None admin] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:36:12.204582 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-194a832c-6045-4f6b-8a12-23955ba2f3b4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 19:36:12.210543 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application [None req-194a832c-6045-4f6b-8a12-23955ba2f3b4 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 13 19:36:12.210543 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:36:12.210543 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:36:12.210543 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:36:12.210543 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:36:12.210543 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:36:12.210543 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:36:12.210543 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:36:12.210543 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:36:12.210543 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:36:12.210543 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:36:12.210543 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:36:12.210543 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 19:36:12.210543 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 19:36:12.210543 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 19:36:12.210543 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 19:36:12.211512 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 19:36:12.211512 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 19:36:12.211512 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 19:36:12.211512 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 19:36:12.211512 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:36:12.211512 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:36:12.211512 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:36:12.211512 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:36:12.211512 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:36:12.211512 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:36:12.211512 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:36:12.211512 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application with Lock( Sep 13 19:36:12.211512 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:36:12.211512 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:36:12.211512 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:36:12.211512 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:36:12.212404 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:36:12.212404 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:36:12.212404 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:36:12.212404 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:36:12.212404 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 19:36:12.212404 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 19:36:12.212404 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 19:36:12.212404 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 19:36:12.212404 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 19:36:12.212404 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 19:36:12.212404 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 13 19:36:12.212404 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application Sep 13 19:36:12.212404 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 275/567] 10.222.0.25 () {56 vars in 1102 bytes} [Tue Sep 13 19:36:12 2022] GET /identity/v3/roles/service => generated 85 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:36:12.213711 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194a832c-6045-4f6b-8a12-23955ba2f3b4 None admin] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:36:12.224084 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG dbcounter [-] [87935] Writing DB stats keystone:SELECT=100 {{(pid=87935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:36:12.245190 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1547fc5c-6bd9-4884-ab36-929204b9703f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:36:12.245917 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1547fc5c-6bd9-4884-ab36-929204b9703f None admin] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:36:12.246192 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1547fc5c-6bd9-4884-ab36-929204b9703f None admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:36:12.246487 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1547fc5c-6bd9-4884-ab36-929204b9703f None admin] PATH_INFO: `/v3/roles` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:36:12.247162 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1547fc5c-6bd9-4884-ab36-929204b9703f None admin] RBAC: Adding query filter params (name=service) {{(pid=87934) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:36:12.247473 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1547fc5c-6bd9-4884-ab36-929204b9703f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:36:12.251001 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1547fc5c-6bd9-4884-ab36-929204b9703f None admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:36:12.264274 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 293/568] 10.222.0.25 () {56 vars in 1103 bytes} [Tue Sep 13 19:36:12 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:36:12.264274 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1547fc5c-6bd9-4884-ab36-929204b9703f None admin] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:36:12.277141 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG dbcounter [-] [87934] Writing DB stats keystone:SELECT=100 {{(pid=87934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:36:12.355610 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194a832c-6045-4f6b-8a12-23955ba2f3b4 None admin] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:36:12.382761 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1547fc5c-6bd9-4884-ab36-929204b9703f None admin] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:36:12.397124 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed63f141-9157-42cb-981d-88b7de5a6500 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:36:12.398059 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed63f141-9157-42cb-981d-88b7de5a6500 None admin] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:36:12.398498 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed63f141-9157-42cb-981d-88b7de5a6500 None admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:36:12.398957 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed63f141-9157-42cb-981d-88b7de5a6500 None admin] PATH_INFO: `/v3/domains` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:36:12.400129 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed63f141-9157-42cb-981d-88b7de5a6500 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87935) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:36:12.400626 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed63f141-9157-42cb-981d-88b7de5a6500 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:36:12.403086 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed63f141-9157-42cb-981d-88b7de5a6500 None admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:36:12.417084 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 276/569] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Sep 13 19:36:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:36:12.417938 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed63f141-9157-42cb-981d-88b7de5a6500 None admin] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:36:12.422777 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769b7dc1-8947-43c1-917b-b61ceecdebed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:36:12.423435 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769b7dc1-8947-43c1-917b-b61ceecdebed None admin] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:36:12.424564 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769b7dc1-8947-43c1-917b-b61ceecdebed None admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:36:12.424564 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769b7dc1-8947-43c1-917b-b61ceecdebed None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:36:12.435796 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-769b7dc1-8947-43c1-917b-b61ceecdebed None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:36:12.437295 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-769b7dc1-8947-43c1-917b-b61ceecdebed None admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:36:12.452607 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application [None req-769b7dc1-8947-43c1-917b-b61ceecdebed None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 19:36:12.452607 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:36:12.452607 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:36:12.452607 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:36:12.452607 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:36:12.452607 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:36:12.452607 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:36:12.452607 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:36:12.452607 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:36:12.452607 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:36:12.452607 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:36:12.452607 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:36:12.452607 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 19:36:12.452607 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 19:36:12.452607 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 19:36:12.452607 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 19:36:12.453717 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:36:12.453717 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:36:12.453717 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:36:12.453717 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:36:12.453717 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:36:12.453717 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:36:12.453717 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:36:12.453717 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application with Lock( Sep 13 19:36:12.453717 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:36:12.453717 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:36:12.453717 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:36:12.453717 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:36:12.453717 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:36:12.453717 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:36:12.453717 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:36:12.453717 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:36:12.453717 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 19:36:12.454638 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 19:36:12.454638 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 19:36:12.454638 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application Sep 13 19:36:12.454638 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 294/570] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Sep 13 19:36:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:36:12.454638 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769b7dc1-8947-43c1-917b-b61ceecdebed None admin] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:36:12.498621 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG dbcounter [-] [87935] Writing DB stats keystone:SELECT=100 {{(pid=87935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:36:12.524046 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG dbcounter [-] [87934] Writing DB stats keystone:SELECT=100 {{(pid=87934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:36:12.537416 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed63f141-9157-42cb-981d-88b7de5a6500 None admin] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:36:12.576633 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769b7dc1-8947-43c1-917b-b61ceecdebed None admin] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:36:12.581724 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83597962-22da-4bfe-a969-37bb6913d5cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:36:12.582605 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83597962-22da-4bfe-a969-37bb6913d5cb None admin] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:36:12.582880 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83597962-22da-4bfe-a969-37bb6913d5cb None admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:36:12.583545 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83597962-22da-4bfe-a969-37bb6913d5cb None admin] PATH_INFO: `/v3/roles` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:36:12.584240 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83597962-22da-4bfe-a969-37bb6913d5cb None admin] RBAC: Adding query filter params (name=service) {{(pid=87935) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:36:12.584548 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83597962-22da-4bfe-a969-37bb6913d5cb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:36:12.585936 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83597962-22da-4bfe-a969-37bb6913d5cb None admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:36:12.594317 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 277/571] 10.222.0.25 () {56 vars in 1103 bytes} [Tue Sep 13 19:36:12 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:36:12.595134 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83597962-22da-4bfe-a969-37bb6913d5cb None admin] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:36:12.617118 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6528706a-fb87-4d63-b868-194a0ab2133c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:36:12.617758 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6528706a-fb87-4d63-b868-194a0ab2133c None admin] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:36:12.618038 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6528706a-fb87-4d63-b868-194a0ab2133c None admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:36:12.618308 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6528706a-fb87-4d63-b868-194a0ab2133c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:36:12.629729 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6528706a-fb87-4d63-b868-194a0ab2133c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:36:12.631816 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6528706a-fb87-4d63-b868-194a0ab2133c None admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:36:12.646847 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application [None req-6528706a-fb87-4d63-b868-194a0ab2133c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 19:36:12.646847 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:36:12.646847 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:36:12.646847 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:36:12.646847 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:36:12.646847 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:36:12.646847 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:36:12.646847 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:36:12.646847 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:36:12.646847 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:36:12.646847 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:36:12.646847 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:36:12.646847 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 19:36:12.646847 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 19:36:12.646847 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 19:36:12.646847 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 19:36:12.648453 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:36:12.648453 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:36:12.648453 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:36:12.648453 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:36:12.648453 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:36:12.648453 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:36:12.648453 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:36:12.648453 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application with Lock( Sep 13 19:36:12.648453 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:36:12.648453 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:36:12.648453 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:36:12.648453 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:36:12.648453 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:36:12.648453 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:36:12.648453 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:36:12.648453 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:36:12.648453 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 19:36:12.649380 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 19:36:12.649380 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 19:36:12.649380 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application Sep 13 19:36:12.649380 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 295/572] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Sep 13 19:36:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:36:12.649380 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6528706a-fb87-4d63-b868-194a0ab2133c None admin] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:36:12.710146 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83597962-22da-4bfe-a969-37bb6913d5cb None admin] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:36:12.740156 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG dbcounter [-] [87935] Writing DB stats keystone:SELECT=100 {{(pid=87935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:36:12.748568 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081ab237-a845-4150-9ee2-57d8a7b4a2c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:36:12.749195 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081ab237-a845-4150-9ee2-57d8a7b4a2c1 None admin] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:36:12.749491 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081ab237-a845-4150-9ee2-57d8a7b4a2c1 None admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:36:12.749746 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081ab237-a845-4150-9ee2-57d8a7b4a2c1 None admin] PATH_INFO: `/v3/roles/service` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:36:12.758550 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6528706a-fb87-4d63-b868-194a0ab2133c None admin] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:36:12.760826 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-081ab237-a845-4150-9ee2-57d8a7b4a2c1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 19:36:12.766832 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application [None req-081ab237-a845-4150-9ee2-57d8a7b4a2c1 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 13 19:36:12.766832 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:36:12.766832 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:36:12.766832 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:36:12.766832 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:36:12.766832 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:36:12.766832 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:36:12.766832 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:36:12.766832 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:36:12.766832 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:36:12.766832 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:36:12.766832 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:36:12.766832 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 19:36:12.766832 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 19:36:12.766832 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 19:36:12.766832 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 19:36:12.767963 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 19:36:12.767963 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 19:36:12.767963 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 19:36:12.767963 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 19:36:12.767963 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:36:12.767963 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:36:12.767963 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:36:12.767963 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:36:12.767963 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:36:12.767963 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:36:12.767963 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:36:12.767963 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application with Lock( Sep 13 19:36:12.767963 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:36:12.767963 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:36:12.767963 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:36:12.767963 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:36:12.769926 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:36:12.769926 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:36:12.769926 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:36:12.769926 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:36:12.769926 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 19:36:12.769926 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 19:36:12.769926 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 19:36:12.769926 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 19:36:12.769926 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 19:36:12.769926 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 19:36:12.769926 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 13 19:36:12.769926 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application Sep 13 19:36:12.769926 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 278/573] 10.222.0.25 () {56 vars in 1102 bytes} [Tue Sep 13 19:36:12 2022] GET /identity/v3/roles/service => generated 85 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:36:12.769926 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081ab237-a845-4150-9ee2-57d8a7b4a2c1 None admin] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:36:12.776462 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG dbcounter [-] [87934] Writing DB stats keystone:SELECT=100 {{(pid=87934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:36:12.798089 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae661a1-4595-4c26-bc3f-2a740400a876 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:36:12.798717 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae661a1-4595-4c26-bc3f-2a740400a876 None admin] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:36:12.798999 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae661a1-4595-4c26-bc3f-2a740400a876 None admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:36:12.799262 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae661a1-4595-4c26-bc3f-2a740400a876 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:36:12.807165 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae661a1-4595-4c26-bc3f-2a740400a876 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:36:12.808630 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae661a1-4595-4c26-bc3f-2a740400a876 None admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:36:12.820336 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application [None req-4ae661a1-4595-4c26-bc3f-2a740400a876 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 19:36:12.820336 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:36:12.820336 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:36:12.820336 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:36:12.820336 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:36:12.820336 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:36:12.820336 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:36:12.820336 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:36:12.820336 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:36:12.820336 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:36:12.820336 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:36:12.820336 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:36:12.820336 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 13 19:36:12.820336 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 13 19:36:12.820336 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 13 19:36:12.821896 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 13 19:36:12.821896 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:36:12.821896 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:36:12.821896 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:36:12.821896 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:36:12.821896 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:36:12.821896 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:36:12.821896 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:36:12.821896 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application with Lock( Sep 13 19:36:12.821896 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:36:12.821896 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:36:12.821896 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:36:12.821896 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:36:12.821896 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:36:12.821896 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:36:12.821896 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:36:12.821896 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:36:12.822874 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 13 19:36:12.822874 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 13 19:36:12.822874 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 13 19:36:12.822874 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 13 19:36:12.822874 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 13 19:36:12.822874 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 13 19:36:12.822874 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 19:36:12.822874 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application Sep 13 19:36:12.822874 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 296/574] 10.222.0.25 () {56 vars in 1111 bytes} [Tue Sep 13 19:36:12 2022] GET /identity/v3/projects/service => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:36:12.822874 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae661a1-4595-4c26-bc3f-2a740400a876 None admin] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:36:12.886224 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081ab237-a845-4150-9ee2-57d8a7b4a2c1 None admin] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:36:12.922721 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c02f7ba-d08d-4d34-a399-2047e433bb19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:36:12.923426 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c02f7ba-d08d-4d34-a399-2047e433bb19 None admin] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:36:12.923711 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c02f7ba-d08d-4d34-a399-2047e433bb19 None admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:36:12.923986 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c02f7ba-d08d-4d34-a399-2047e433bb19 None admin] PATH_INFO: `/v3/domains` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:36:12.924673 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c02f7ba-d08d-4d34-a399-2047e433bb19 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87935) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:36:12.924985 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c02f7ba-d08d-4d34-a399-2047e433bb19 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:36:12.926359 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c02f7ba-d08d-4d34-a399-2047e433bb19 None admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:36:12.928459 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae661a1-4595-4c26-bc3f-2a740400a876 None admin] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:36:12.940024 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 279/575] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Sep 13 19:36:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:36:12.940929 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c02f7ba-d08d-4d34-a399-2047e433bb19 None admin] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:36:12.968878 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b49b1d-71d0-4e1a-8dc4-74c326f40f8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:36:12.969536 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b49b1d-71d0-4e1a-8dc4-74c326f40f8e None admin] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:36:12.969807 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b49b1d-71d0-4e1a-8dc4-74c326f40f8e None admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:36:12.970068 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b49b1d-71d0-4e1a-8dc4-74c326f40f8e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:36:12.982607 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b49b1d-71d0-4e1a-8dc4-74c326f40f8e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:36:12.984087 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b49b1d-71d0-4e1a-8dc4-74c326f40f8e None admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:36:12.998404 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG dbcounter [-] [87935] Writing DB stats keystone:SELECT=100 {{(pid=87935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:36:12.999767 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application [None req-e1b49b1d-71d0-4e1a-8dc4-74c326f40f8e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 19:36:12.999767 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:36:12.999767 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:36:12.999767 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:36:12.999767 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:36:12.999767 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:36:12.999767 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:36:12.999767 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:36:12.999767 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:36:12.999767 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:36:12.999767 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:36:12.999767 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:36:12.999767 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 19:36:12.999767 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 19:36:12.999767 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 19:36:12.999767 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 19:36:13.000863 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:36:13.000863 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:36:13.000863 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:36:13.000863 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:36:13.000863 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:36:13.000863 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:36:13.000863 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:36:13.000863 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application with Lock( Sep 13 19:36:13.000863 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:36:13.000863 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:36:13.000863 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:36:13.000863 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:36:13.000863 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:36:13.000863 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:36:13.000863 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:36:13.000863 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:36:13.000863 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 19:36:13.001763 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 19:36:13.001763 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 19:36:13.001763 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application Sep 13 19:36:13.001763 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 297/576] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Sep 13 19:36:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:36:13.002531 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b49b1d-71d0-4e1a-8dc4-74c326f40f8e None admin] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:36:13.033495 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG dbcounter [-] [87934] Writing DB stats keystone:SELECT=100 {{(pid=87934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:36:13.057913 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c02f7ba-d08d-4d34-a399-2047e433bb19 None admin] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:36:13.094436 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733f7d8e-238c-49f1-b95b-066c324524db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:36:13.095064 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733f7d8e-238c-49f1-b95b-066c324524db None admin] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:36:13.095347 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733f7d8e-238c-49f1-b95b-066c324524db None admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:36:13.095627 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733f7d8e-238c-49f1-b95b-066c324524db None admin] PATH_INFO: `/v3/domains` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:36:13.096315 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-733f7d8e-238c-49f1-b95b-066c324524db None admin] RBAC: Adding query filter params (name=Default) {{(pid=87935) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:36:13.096631 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-733f7d8e-238c-49f1-b95b-066c324524db None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:36:13.098031 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-733f7d8e-238c-49f1-b95b-066c324524db None admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:36:13.111382 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 280/577] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Sep 13 19:36:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:36:13.112257 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733f7d8e-238c-49f1-b95b-066c324524db None admin] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:36:13.112348 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b49b1d-71d0-4e1a-8dc4-74c326f40f8e None admin] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:36:13.156443 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3a75de-c13b-4fa1-8c9b-e5c87cc4ae30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:36:13.157049 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3a75de-c13b-4fa1-8c9b-e5c87cc4ae30 None admin] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:36:13.157323 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3a75de-c13b-4fa1-8c9b-e5c87cc4ae30 None admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:36:13.157587 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3a75de-c13b-4fa1-8c9b-e5c87cc4ae30 None admin] PATH_INFO: `/v3/roles` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:36:13.158251 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db3a75de-c13b-4fa1-8c9b-e5c87cc4ae30 None admin] RBAC: Adding query filter params (name=service) {{(pid=87934) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:36:13.158564 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db3a75de-c13b-4fa1-8c9b-e5c87cc4ae30 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:36:13.159945 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db3a75de-c13b-4fa1-8c9b-e5c87cc4ae30 None admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:36:13.168810 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 298/578] 10.222.0.25 () {56 vars in 1103 bytes} [Tue Sep 13 19:36:13 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:36:13.169623 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3a75de-c13b-4fa1-8c9b-e5c87cc4ae30 None admin] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:36:13.219902 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733f7d8e-238c-49f1-b95b-066c324524db None admin] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:36:13.229786 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG dbcounter [-] [87935] Writing DB stats keystone:SELECT=100 {{(pid=87935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:36:13.264107 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG dbcounter [-] [87934] Writing DB stats keystone:SELECT=100 {{(pid=87934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:36:13.269043 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-effafa7d-a539-4a09-8ff6-043d65fc795f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:36:13.269651 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effafa7d-a539-4a09-8ff6-043d65fc795f None admin] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:36:13.269925 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effafa7d-a539-4a09-8ff6-043d65fc795f None admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:36:13.270411 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effafa7d-a539-4a09-8ff6-043d65fc795f None admin] PATH_INFO: `/v3/projects` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:36:13.271811 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-effafa7d-a539-4a09-8ff6-043d65fc795f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87935) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:36:13.272160 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-effafa7d-a539-4a09-8ff6-043d65fc795f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:36:13.273644 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-effafa7d-a539-4a09-8ff6-043d65fc795f None admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:36:13.284295 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3a75de-c13b-4fa1-8c9b-e5c87cc4ae30 None admin] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:36:13.292848 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 281/579] 10.222.0.25 () {56 vars in 1148 bytes} [Tue Sep 13 19:36:13 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:36:13.293520 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-effafa7d-a539-4a09-8ff6-043d65fc795f None admin] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:36:13.321983 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5aabc9-97c9-41ec-8b16-fb7d3775e647 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:36:13.322613 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5aabc9-97c9-41ec-8b16-fb7d3775e647 None admin] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:36:13.322885 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5aabc9-97c9-41ec-8b16-fb7d3775e647 None admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:36:13.323153 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5aabc9-97c9-41ec-8b16-fb7d3775e647 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:36:13.330250 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c5aabc9-97c9-41ec-8b16-fb7d3775e647 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:36:13.331729 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c5aabc9-97c9-41ec-8b16-fb7d3775e647 None admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:36:13.346385 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application [None req-4c5aabc9-97c9-41ec-8b16-fb7d3775e647 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 19:36:13.346385 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:36:13.346385 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:36:13.346385 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:36:13.346385 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:36:13.346385 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:36:13.346385 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:36:13.346385 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:36:13.346385 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:36:13.346385 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:36:13.346385 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:36:13.346385 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:36:13.346385 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 13 19:36:13.346385 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 13 19:36:13.346385 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 13 19:36:13.347528 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 13 19:36:13.347528 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:36:13.347528 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:36:13.347528 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:36:13.347528 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:36:13.347528 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:36:13.347528 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:36:13.347528 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:36:13.347528 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application with Lock( Sep 13 19:36:13.347528 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:36:13.347528 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:36:13.347528 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:36:13.347528 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:36:13.347528 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:36:13.347528 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:36:13.347528 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:36:13.347528 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:36:13.349315 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 13 19:36:13.349315 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 13 19:36:13.349315 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 13 19:36:13.349315 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 13 19:36:13.349315 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 13 19:36:13.349315 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 13 19:36:13.349315 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 19:36:13.349315 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application Sep 13 19:36:13.349315 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 299/580] 10.222.0.25 () {56 vars in 1111 bytes} [Tue Sep 13 19:36:13 2022] GET /identity/v3/projects/service => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:36:13.350127 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5aabc9-97c9-41ec-8b16-fb7d3775e647 None admin] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:36:13.409656 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-effafa7d-a539-4a09-8ff6-043d65fc795f None admin] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:36:13.454897 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b07105-c4a3-4f9c-b107-1578b83a3ddf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:36:13.455608 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b07105-c4a3-4f9c-b107-1578b83a3ddf None admin] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:36:13.455881 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b07105-c4a3-4f9c-b107-1578b83a3ddf None admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:36:13.456154 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b07105-c4a3-4f9c-b107-1578b83a3ddf None admin] PATH_INFO: `/v3/domains` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:36:13.456839 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b07105-c4a3-4f9c-b107-1578b83a3ddf None admin] RBAC: Adding query filter params (name=Default) {{(pid=87935) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:36:13.457396 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b07105-c4a3-4f9c-b107-1578b83a3ddf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:36:13.458961 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b07105-c4a3-4f9c-b107-1578b83a3ddf None admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:36:13.472270 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 282/581] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Sep 13 19:36:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:36:13.472894 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b07105-c4a3-4f9c-b107-1578b83a3ddf None admin] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:36:13.494132 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5aabc9-97c9-41ec-8b16-fb7d3775e647 None admin] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:36:13.501699 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG dbcounter [-] [87935] Writing DB stats keystone:SELECT=100 {{(pid=87935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:36:13.529929 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2fd6cee-2b19-403a-b851-400fa8dbd806 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:36:13.530558 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fd6cee-2b19-403a-b851-400fa8dbd806 None admin] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:36:13.530834 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fd6cee-2b19-403a-b851-400fa8dbd806 None admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:36:13.531103 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fd6cee-2b19-403a-b851-400fa8dbd806 None admin] PATH_INFO: `/v3/users/glance` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:36:13.538956 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2fd6cee-2b19-403a-b851-400fa8dbd806 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:36:13.540439 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2fd6cee-2b19-403a-b851-400fa8dbd806 None admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:36:13.551769 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application [None req-c2fd6cee-2b19-403a-b851-400fa8dbd806 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Sep 13 19:36:13.551769 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:36:13.551769 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:36:13.551769 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:36:13.551769 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:36:13.551769 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:36:13.551769 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:36:13.551769 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:36:13.551769 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:36:13.551769 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:36:13.551769 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:36:13.551769 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:36:13.551769 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 13 19:36:13.551769 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 13 19:36:13.551769 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 13 19:36:13.551769 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 13 19:36:13.553200 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:36:13.553200 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:36:13.553200 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 13 19:36:13.553200 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 19:36:13.553200 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 13 19:36:13.553200 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 19:36:13.553200 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:36:13.553200 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:36:13.553200 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:36:13.553200 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:36:13.553200 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:36:13.553200 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application with Lock( Sep 13 19:36:13.553200 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:36:13.553200 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:36:13.553200 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:36:13.553200 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:36:13.553200 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:36:13.553200 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:36:13.554519 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:36:13.554519 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:36:13.554519 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 13 19:36:13.554519 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 13 19:36:13.554519 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 13 19:36:13.554519 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 13 19:36:13.554519 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 13 19:36:13.554519 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 13 19:36:13.554519 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Sep 13 19:36:13.554519 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application Sep 13 19:36:13.556668 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 300/582] 10.222.0.25 () {56 vars in 1099 bytes} [Tue Sep 13 19:36:13 2022] GET /identity/v3/users/glance => generated 84 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:36:13.556668 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2fd6cee-2b19-403a-b851-400fa8dbd806 None admin] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:36:13.569774 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG dbcounter [-] [87934] Writing DB stats keystone:SELECT=100 {{(pid=87934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:36:13.596792 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b07105-c4a3-4f9c-b107-1578b83a3ddf None admin] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:36:13.632380 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456cfd70-7401-4424-b39d-6d428d247a4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:36:13.633021 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456cfd70-7401-4424-b39d-6d428d247a4a None admin] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:36:13.633300 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456cfd70-7401-4424-b39d-6d428d247a4a None admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:36:13.633571 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456cfd70-7401-4424-b39d-6d428d247a4a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:36:13.644618 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-456cfd70-7401-4424-b39d-6d428d247a4a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:36:13.647114 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-456cfd70-7401-4424-b39d-6d428d247a4a None admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:36:13.663138 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application [None req-456cfd70-7401-4424-b39d-6d428d247a4a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 19:36:13.663138 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:36:13.663138 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:36:13.663138 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:36:13.663138 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:36:13.663138 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:36:13.663138 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:36:13.663138 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:36:13.663138 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:36:13.663138 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:36:13.663138 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:36:13.663138 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:36:13.663138 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 19:36:13.663138 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 19:36:13.663138 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 19:36:13.663138 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 19:36:13.664591 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:36:13.664591 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:36:13.664591 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:36:13.664591 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:36:13.664591 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:36:13.664591 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:36:13.664591 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:36:13.664591 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application with Lock( Sep 13 19:36:13.664591 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:36:13.664591 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:36:13.664591 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:36:13.664591 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:36:13.664591 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:36:13.664591 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:36:13.664591 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:36:13.664591 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:36:13.664591 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 19:36:13.665550 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 19:36:13.665550 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 19:36:13.665550 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application Sep 13 19:36:13.665550 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 283/583] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Sep 13 19:36:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:36:13.665550 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456cfd70-7401-4424-b39d-6d428d247a4a None admin] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:36:13.677313 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2fd6cee-2b19-403a-b851-400fa8dbd806 None admin] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:36:13.721818 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5d4168-18ab-472a-acfd-5616daa88cea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:36:13.722475 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5d4168-18ab-472a-acfd-5616daa88cea None admin] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:36:13.722702 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5d4168-18ab-472a-acfd-5616daa88cea None admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:36:13.722979 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5d4168-18ab-472a-acfd-5616daa88cea None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:36:13.723745 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce5d4168-18ab-472a-acfd-5616daa88cea None admin] RBAC: Adding query filter params (role.id=60f5ecbf9ce84814968607f126a85a5a, scope.project.id=9a10a4268f3c4cb29f4e00c292e2df62, user.id=fb42d6ac6cdd4d97a80c3ee0c6f8e3f5) {{(pid=87934) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:36:13.724050 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce5d4168-18ab-472a-acfd-5616daa88cea None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:36:13.725572 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce5d4168-18ab-472a-acfd-5616daa88cea None admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:36:13.731250 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 301/584] 10.222.0.25 () {56 vars in 1374 bytes} [Tue Sep 13 19:36:13 2022] GET /identity/v3/role_assignments?user.id=fb42d6ac6cdd4d97a80c3ee0c6f8e3f5&scope.project.id=9a10a4268f3c4cb29f4e00c292e2df62&role.id=60f5ecbf9ce84814968607f126a85a5a => generated 259 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:36:13.732068 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5d4168-18ab-472a-acfd-5616daa88cea None admin] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:36:13.767985 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG dbcounter [-] [87935] Writing DB stats keystone:SELECT=100 {{(pid=87935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:36:13.794734 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456cfd70-7401-4424-b39d-6d428d247a4a None admin] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:36:13.837012 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG dbcounter [-] [87934] Writing DB stats keystone:SELECT=100 {{(pid=87934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:36:13.839471 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6856d644-08c5-45c1-bff8-020b624654fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:36:13.840003 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6856d644-08c5-45c1-bff8-020b624654fb None admin] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:36:13.840305 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6856d644-08c5-45c1-bff8-020b624654fb None admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:36:13.840583 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6856d644-08c5-45c1-bff8-020b624654fb None admin] PATH_INFO: `/v3/projects` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:36:13.841333 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6856d644-08c5-45c1-bff8-020b624654fb None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87935) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:36:13.841642 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6856d644-08c5-45c1-bff8-020b624654fb None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:36:13.843135 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6856d644-08c5-45c1-bff8-020b624654fb None admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:36:13.863143 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 284/585] 10.222.0.25 () {56 vars in 1148 bytes} [Tue Sep 13 19:36:13 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:36:13.863143 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6856d644-08c5-45c1-bff8-020b624654fb None admin] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:36:13.882779 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5d4168-18ab-472a-acfd-5616daa88cea None admin] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:36:13.923999 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c65376c-c9b9-4d12-93c8-c174d67c8f4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:36:13.924668 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c65376c-c9b9-4d12-93c8-c174d67c8f4d None admin] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:36:13.924978 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c65376c-c9b9-4d12-93c8-c174d67c8f4d None admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:36:13.925249 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c65376c-c9b9-4d12-93c8-c174d67c8f4d None admin] PATH_INFO: `/v3/users/cinder` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:36:13.933735 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c65376c-c9b9-4d12-93c8-c174d67c8f4d None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:36:13.935188 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c65376c-c9b9-4d12-93c8-c174d67c8f4d None admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:36:13.947775 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application [None req-3c65376c-c9b9-4d12-93c8-c174d67c8f4d None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Sep 13 19:36:13.947775 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:36:13.947775 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:36:13.947775 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:36:13.947775 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:36:13.947775 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:36:13.947775 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:36:13.947775 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:36:13.947775 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:36:13.947775 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:36:13.947775 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:36:13.947775 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:36:13.947775 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 13 19:36:13.947775 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 13 19:36:13.947775 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 13 19:36:13.947775 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 13 19:36:13.948995 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:36:13.948995 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:36:13.948995 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 13 19:36:13.948995 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 19:36:13.948995 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 13 19:36:13.948995 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 19:36:13.948995 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:36:13.948995 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:36:13.948995 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:36:13.948995 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:36:13.948995 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:36:13.948995 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application with Lock( Sep 13 19:36:13.948995 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:36:13.948995 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:36:13.948995 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:36:13.948995 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:36:13.948995 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:36:13.948995 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:36:13.950172 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:36:13.950172 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:36:13.950172 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 13 19:36:13.950172 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 13 19:36:13.950172 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 13 19:36:13.950172 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 13 19:36:13.950172 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 13 19:36:13.950172 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 13 19:36:13.950172 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Sep 13 19:36:13.950172 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application Sep 13 19:36:13.950840 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 302/586] 10.222.0.25 () {56 vars in 1099 bytes} [Tue Sep 13 19:36:13 2022] GET /identity/v3/users/cinder => generated 84 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:36:13.956228 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c65376c-c9b9-4d12-93c8-c174d67c8f4d None admin] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:36:13.982379 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6856d644-08c5-45c1-bff8-020b624654fb None admin] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:36:14.021520 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0ca121-b2fb-4160-80bc-c014bbe1089f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:36:14.022487 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0ca121-b2fb-4160-80bc-c014bbe1089f None admin] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:36:14.022933 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0ca121-b2fb-4160-80bc-c014bbe1089f None admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:36:14.023363 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0ca121-b2fb-4160-80bc-c014bbe1089f None admin] PATH_INFO: `/v3/users` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:36:14.024260 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd0ca121-b2fb-4160-80bc-c014bbe1089f None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=87935) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:36:14.024726 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd0ca121-b2fb-4160-80bc-c014bbe1089f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:36:14.026573 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd0ca121-b2fb-4160-80bc-c014bbe1089f None admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:36:14.038346 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG dbcounter [-] [87935] Writing DB stats keystone:SELECT=100 {{(pid=87935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:36:14.059982 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 285/587] 10.222.0.25 () {56 vars in 1137 bytes} [Tue Sep 13 19:36:13 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:36:14.060829 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0ca121-b2fb-4160-80bc-c014bbe1089f None admin] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:36:14.068643 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c65376c-c9b9-4d12-93c8-c174d67c8f4d None admin] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:36:14.104520 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG dbcounter [-] [87934] Writing DB stats keystone:SELECT=100 {{(pid=87934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:36:14.109962 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859e15f6-49e9-49c8-ae38-caf059bb9db2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:36:14.110581 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859e15f6-49e9-49c8-ae38-caf059bb9db2 None admin] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:36:14.110858 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859e15f6-49e9-49c8-ae38-caf059bb9db2 None admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:36:14.111129 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859e15f6-49e9-49c8-ae38-caf059bb9db2 None admin] PATH_INFO: `/v3/domains` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:36:14.111780 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-859e15f6-49e9-49c8-ae38-caf059bb9db2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87934) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:36:14.112081 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-859e15f6-49e9-49c8-ae38-caf059bb9db2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:36:14.113522 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-859e15f6-49e9-49c8-ae38-caf059bb9db2 None admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:36:14.134537 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 303/588] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Sep 13 19:36:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:36:14.135392 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859e15f6-49e9-49c8-ae38-caf059bb9db2 None admin] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:36:14.183557 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0ca121-b2fb-4160-80bc-c014bbe1089f None admin] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:36:14.221907 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f45cb66-dc2e-4f38-811f-64edaf43eb6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:36:14.222565 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f45cb66-dc2e-4f38-811f-64edaf43eb6e None admin] REQUEST_METHOD: `PUT` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:36:14.222841 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f45cb66-dc2e-4f38-811f-64edaf43eb6e None admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:36:14.223108 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f45cb66-dc2e-4f38-811f-64edaf43eb6e None admin] PATH_INFO: `/v3/projects/9a10a4268f3c4cb29f4e00c292e2df62/users/d71fe5a8275f4ea98555afdcefc902a0/roles/60f5ecbf9ce84814968607f126a85a5a` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:36:14.246131 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f45cb66-dc2e-4f38-811f-64edaf43eb6e None admin] RBAC: Authorizing `identity:create_grant(project_id=9a10a4268f3c4cb29f4e00c292e2df62, user_id=d71fe5a8275f4ea98555afdcefc902a0, role_id=60f5ecbf9ce84814968607f126a85a5a)` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:36:14.247837 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f45cb66-dc2e-4f38-811f-64edaf43eb6e None admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:36:14.269982 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 286/589] 10.222.0.25 () {58 vars in 1439 bytes} [Tue Sep 13 19:36:14 2022] PUT /identity/v3/projects/9a10a4268f3c4cb29f4e00c292e2df62/users/d71fe5a8275f4ea98555afdcefc902a0/roles/60f5ecbf9ce84814968607f126a85a5a => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 19:36:14.269982 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f45cb66-dc2e-4f38-811f-64edaf43eb6e None admin] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:36:14.270278 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859e15f6-49e9-49c8-ae38-caf059bb9db2 None admin] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:36:14.327091 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a43c77-6ca7-491c-9920-10099af96130 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:36:14.328877 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a43c77-6ca7-491c-9920-10099af96130 None admin] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:36:14.329360 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a43c77-6ca7-491c-9920-10099af96130 None admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:36:14.329814 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a43c77-6ca7-491c-9920-10099af96130 None admin] PATH_INFO: `/v3/users` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:36:14.331466 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a43c77-6ca7-491c-9920-10099af96130 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=87934) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:36:14.332746 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a43c77-6ca7-491c-9920-10099af96130 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:36:14.335659 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a43c77-6ca7-491c-9920-10099af96130 None admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:36:14.341402 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG dbcounter [-] [87935] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:36:14.376400 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 304/590] 10.222.0.25 () {56 vars in 1137 bytes} [Tue Sep 13 19:36:14 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:36:14.378721 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a43c77-6ca7-491c-9920-10099af96130 None admin] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:36:14.417026 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f45cb66-dc2e-4f38-811f-64edaf43eb6e None admin] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:36:14.459396 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG dbcounter [-] [87934] Writing DB stats keystone:SELECT=100 {{(pid=87934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:36:14.470153 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf64df11-3159-4fed-85b4-8fde36cd0848 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:36:14.471111 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf64df11-3159-4fed-85b4-8fde36cd0848 None admin] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:36:14.471702 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf64df11-3159-4fed-85b4-8fde36cd0848 None admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:36:14.472153 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf64df11-3159-4fed-85b4-8fde36cd0848 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:36:14.486575 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf64df11-3159-4fed-85b4-8fde36cd0848 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:36:14.489501 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf64df11-3159-4fed-85b4-8fde36cd0848 None admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:36:14.516568 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application [None req-bf64df11-3159-4fed-85b4-8fde36cd0848 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 19:36:14.516568 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:36:14.516568 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:36:14.516568 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:36:14.516568 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:36:14.516568 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:36:14.516568 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:36:14.516568 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:36:14.516568 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:36:14.516568 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:36:14.516568 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:36:14.516568 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:36:14.516568 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 19:36:14.516568 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 19:36:14.516568 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 19:36:14.516568 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 19:36:14.517718 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:36:14.517718 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:36:14.517718 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:36:14.517718 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:36:14.517718 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:36:14.517718 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:36:14.517718 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:36:14.517718 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application with Lock( Sep 13 19:36:14.517718 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:36:14.517718 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:36:14.517718 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:36:14.517718 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:36:14.517718 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:36:14.517718 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:36:14.517718 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:36:14.517718 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:36:14.517718 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 19:36:14.518823 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 19:36:14.518823 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 19:36:14.518823 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application Sep 13 19:36:14.521163 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 287/591] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Sep 13 19:36:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 259 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:36:14.522532 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf64df11-3159-4fed-85b4-8fde36cd0848 None admin] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:36:14.534563 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a43c77-6ca7-491c-9920-10099af96130 None admin] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:36:14.592649 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4c1b4d-16af-4881-bcd2-3ebea2d4efee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:36:14.593812 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4c1b4d-16af-4881-bcd2-3ebea2d4efee None admin] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:36:14.594095 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4c1b4d-16af-4881-bcd2-3ebea2d4efee None admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:36:14.594368 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4c1b4d-16af-4881-bcd2-3ebea2d4efee None admin] PATH_INFO: `/v3/users/neutron` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:36:14.606559 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf4c1b4d-16af-4881-bcd2-3ebea2d4efee None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:36:14.608010 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf4c1b4d-16af-4881-bcd2-3ebea2d4efee None admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:36:14.631828 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application [None req-cf4c1b4d-16af-4881-bcd2-3ebea2d4efee None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Sep 13 19:36:14.631828 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:36:14.631828 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:36:14.631828 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:36:14.631828 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:36:14.631828 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:36:14.631828 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:36:14.631828 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:36:14.631828 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:36:14.631828 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:36:14.631828 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:36:14.631828 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:36:14.631828 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 13 19:36:14.631828 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 13 19:36:14.631828 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 13 19:36:14.631828 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 13 19:36:14.632912 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:36:14.632912 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:36:14.632912 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 13 19:36:14.632912 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 19:36:14.632912 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 13 19:36:14.632912 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 19:36:14.632912 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:36:14.632912 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:36:14.632912 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:36:14.632912 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:36:14.632912 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:36:14.632912 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application with Lock( Sep 13 19:36:14.632912 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:36:14.632912 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:36:14.632912 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:36:14.632912 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:36:14.632912 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:36:14.632912 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:36:14.633907 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:36:14.633907 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:36:14.633907 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 13 19:36:14.633907 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 13 19:36:14.633907 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 13 19:36:14.633907 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 13 19:36:14.633907 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 13 19:36:14.633907 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 13 19:36:14.633907 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Sep 13 19:36:14.633907 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application Sep 13 19:36:14.637218 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 305/592] 10.222.0.25 () {56 vars in 1102 bytes} [Tue Sep 13 19:36:14 2022] GET /identity/v3/users/neutron => generated 85 bytes in 260 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:36:14.638380 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4c1b4d-16af-4881-bcd2-3ebea2d4efee None admin] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:36:14.666864 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG dbcounter [-] [87935] Writing DB stats keystone:SELECT=100 {{(pid=87935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:36:14.671014 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf64df11-3159-4fed-85b4-8fde36cd0848 None admin] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:36:14.722795 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4edfcb6-331c-4b3a-a833-bd6991f7ac8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:36:14.723618 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4edfcb6-331c-4b3a-a833-bd6991f7ac8b None admin] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:36:14.723994 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4edfcb6-331c-4b3a-a833-bd6991f7ac8b None admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:36:14.724465 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4edfcb6-331c-4b3a-a833-bd6991f7ac8b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:36:14.741899 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4edfcb6-331c-4b3a-a833-bd6991f7ac8b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:36:14.743624 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4edfcb6-331c-4b3a-a833-bd6991f7ac8b None admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:36:14.760512 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application [None req-c4edfcb6-331c-4b3a-a833-bd6991f7ac8b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 19:36:14.760512 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:36:14.760512 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:36:14.760512 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:36:14.760512 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:36:14.760512 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:36:14.760512 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:36:14.760512 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:36:14.760512 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:36:14.760512 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:36:14.760512 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:36:14.760512 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:36:14.760512 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 19:36:14.760512 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 19:36:14.760512 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 19:36:14.760512 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 19:36:14.761742 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:36:14.761742 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:36:14.761742 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:36:14.761742 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:36:14.761742 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:36:14.761742 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:36:14.761742 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:36:14.761742 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application with Lock( Sep 13 19:36:14.761742 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:36:14.761742 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:36:14.761742 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:36:14.761742 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:36:14.761742 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:36:14.761742 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:36:14.761742 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:36:14.761742 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:36:14.761742 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 19:36:14.762875 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 19:36:14.762875 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 19:36:14.762875 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application Sep 13 19:36:14.764301 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 288/593] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Sep 13 19:36:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:36:14.765202 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4edfcb6-331c-4b3a-a833-bd6991f7ac8b None admin] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:36:14.790689 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4c1b4d-16af-4881-bcd2-3ebea2d4efee None admin] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:36:14.808716 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG dbcounter [-] [87934] Writing DB stats keystone:SELECT=100 {{(pid=87934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:36:14.850341 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56313d97-0186-40af-838e-0c0a521c7062 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:36:14.850964 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56313d97-0186-40af-838e-0c0a521c7062 None admin] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:36:14.851238 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56313d97-0186-40af-838e-0c0a521c7062 None admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:36:14.851507 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56313d97-0186-40af-838e-0c0a521c7062 None admin] PATH_INFO: `/v3/domains` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:36:14.852168 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56313d97-0186-40af-838e-0c0a521c7062 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87934) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:36:14.852508 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56313d97-0186-40af-838e-0c0a521c7062 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:36:14.853879 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56313d97-0186-40af-838e-0c0a521c7062 None admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:36:14.872028 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 306/594] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Sep 13 19:36:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:36:14.873007 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56313d97-0186-40af-838e-0c0a521c7062 None admin] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:36:14.907474 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4edfcb6-331c-4b3a-a833-bd6991f7ac8b None admin] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:36:14.946530 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61fcbb99-5f09-4ecd-bbaa-4f654d39d67b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:36:14.947144 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fcbb99-5f09-4ecd-bbaa-4f654d39d67b None admin] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:36:14.947494 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fcbb99-5f09-4ecd-bbaa-4f654d39d67b None admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:36:14.947683 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fcbb99-5f09-4ecd-bbaa-4f654d39d67b None admin] PATH_INFO: `/v3/users` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:36:14.948466 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61fcbb99-5f09-4ecd-bbaa-4f654d39d67b None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=87935) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:36:14.948772 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61fcbb99-5f09-4ecd-bbaa-4f654d39d67b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:36:14.950210 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61fcbb99-5f09-4ecd-bbaa-4f654d39d67b None admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:36:14.975740 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 289/595] 10.222.0.25 () {56 vars in 1139 bytes} [Tue Sep 13 19:36:14 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:36:14.976811 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61fcbb99-5f09-4ecd-bbaa-4f654d39d67b None admin] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:36:14.990536 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG dbcounter [-] [87935] Writing DB stats keystone:SELECT=100 {{(pid=87935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:36:15.012107 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56313d97-0186-40af-838e-0c0a521c7062 None admin] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:36:15.057881 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43dc5568-f4ca-452d-a736-bf61a39d67d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:36:15.059753 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43dc5568-f4ca-452d-a736-bf61a39d67d5 None admin] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:36:15.060307 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43dc5568-f4ca-452d-a736-bf61a39d67d5 None admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:36:15.060804 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43dc5568-f4ca-452d-a736-bf61a39d67d5 None admin] PATH_INFO: `/v3/domains` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:36:15.061659 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43dc5568-f4ca-452d-a736-bf61a39d67d5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87934) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:36:15.062196 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43dc5568-f4ca-452d-a736-bf61a39d67d5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:36:15.063995 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43dc5568-f4ca-452d-a736-bf61a39d67d5 None admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:36:15.080257 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 307/596] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Sep 13 19:36:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:36:15.081459 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43dc5568-f4ca-452d-a736-bf61a39d67d5 None admin] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:36:15.101311 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61fcbb99-5f09-4ecd-bbaa-4f654d39d67b None admin] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:36:15.120622 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG dbcounter [-] [87934] Writing DB stats keystone:SELECT=100 {{(pid=87934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:36:15.142300 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95e5159-20ac-4df1-820f-914de1391ac7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:36:15.142978 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95e5159-20ac-4df1-820f-914de1391ac7 None admin] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:36:15.143257 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95e5159-20ac-4df1-820f-914de1391ac7 None admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:36:15.143579 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95e5159-20ac-4df1-820f-914de1391ac7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:36:15.151722 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f95e5159-20ac-4df1-820f-914de1391ac7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:36:15.153450 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f95e5159-20ac-4df1-820f-914de1391ac7 None admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:36:15.166948 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application [None req-f95e5159-20ac-4df1-820f-914de1391ac7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 19:36:15.166948 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:36:15.166948 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:36:15.166948 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:36:15.166948 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:36:15.166948 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:36:15.166948 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:36:15.166948 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:36:15.166948 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:36:15.166948 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:36:15.166948 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:36:15.166948 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:36:15.166948 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 13 19:36:15.166948 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 13 19:36:15.166948 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 13 19:36:15.167907 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 13 19:36:15.167907 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:36:15.167907 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:36:15.167907 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:36:15.167907 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:36:15.167907 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:36:15.167907 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:36:15.167907 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:36:15.167907 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application with Lock( Sep 13 19:36:15.167907 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:36:15.167907 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:36:15.167907 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:36:15.167907 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:36:15.167907 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:36:15.167907 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:36:15.167907 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:36:15.167907 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:36:15.168830 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 13 19:36:15.168830 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 13 19:36:15.168830 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 13 19:36:15.168830 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 13 19:36:15.168830 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 13 19:36:15.168830 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 13 19:36:15.168830 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 19:36:15.168830 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application Sep 13 19:36:15.172612 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 290/597] 10.222.0.25 () {56 vars in 1111 bytes} [Tue Sep 13 19:36:14 2022] GET /identity/v3/projects/service => generated 88 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:36:15.173505 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95e5159-20ac-4df1-820f-914de1391ac7 None admin] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:36:15.206078 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43dc5568-f4ca-452d-a736-bf61a39d67d5 None admin] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:36:15.243548 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3045dfb5-ea2d-412a-9047-da85aaeaf841 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:36:15.244670 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3045dfb5-ea2d-412a-9047-da85aaeaf841 None admin] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:36:15.245257 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3045dfb5-ea2d-412a-9047-da85aaeaf841 None admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:36:15.245855 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3045dfb5-ea2d-412a-9047-da85aaeaf841 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:36:15.256771 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG dbcounter [-] [87935] Writing DB stats keystone:SELECT=100 {{(pid=87935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:36:15.268013 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3045dfb5-ea2d-412a-9047-da85aaeaf841 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:36:15.271248 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3045dfb5-ea2d-412a-9047-da85aaeaf841 None admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:36:15.294296 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application [None req-3045dfb5-ea2d-412a-9047-da85aaeaf841 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 19:36:15.294296 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:36:15.294296 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:36:15.294296 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:36:15.294296 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:36:15.294296 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:36:15.294296 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:36:15.294296 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:36:15.294296 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:36:15.294296 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:36:15.294296 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:36:15.294296 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:36:15.294296 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 19:36:15.294296 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 19:36:15.294296 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 19:36:15.294296 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 19:36:15.295416 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:36:15.295416 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:36:15.295416 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:36:15.295416 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:36:15.295416 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:36:15.295416 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:36:15.295416 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:36:15.295416 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application with Lock( Sep 13 19:36:15.295416 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:36:15.295416 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:36:15.295416 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:36:15.295416 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:36:15.295416 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:36:15.295416 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:36:15.295416 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:36:15.295416 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:36:15.295416 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 19:36:15.296347 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 19:36:15.296347 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 19:36:15.296347 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application Sep 13 19:36:15.298677 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 308/598] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Sep 13 19:36:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:36:15.299882 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3045dfb5-ea2d-412a-9047-da85aaeaf841 None admin] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:36:15.306109 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95e5159-20ac-4df1-820f-914de1391ac7 None admin] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:36:15.347739 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a03a537-9c8c-4ecc-b4bc-bf1f73d8fcf1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:36:15.348776 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a03a537-9c8c-4ecc-b4bc-bf1f73d8fcf1 None admin] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:36:15.349246 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a03a537-9c8c-4ecc-b4bc-bf1f73d8fcf1 None admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:36:15.349661 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a03a537-9c8c-4ecc-b4bc-bf1f73d8fcf1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:36:15.360150 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a03a537-9c8c-4ecc-b4bc-bf1f73d8fcf1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:36:15.363414 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a03a537-9c8c-4ecc-b4bc-bf1f73d8fcf1 None admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:36:15.378189 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application [None req-0a03a537-9c8c-4ecc-b4bc-bf1f73d8fcf1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 19:36:15.378189 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:36:15.378189 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:36:15.378189 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:36:15.378189 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:36:15.378189 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:36:15.378189 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:36:15.378189 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:36:15.378189 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:36:15.378189 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:36:15.378189 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:36:15.378189 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:36:15.378189 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 13 19:36:15.378189 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 13 19:36:15.378189 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 13 19:36:15.379346 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 13 19:36:15.379346 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:36:15.379346 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:36:15.379346 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:36:15.379346 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:36:15.379346 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:36:15.379346 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:36:15.379346 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:36:15.379346 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application with Lock( Sep 13 19:36:15.379346 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:36:15.379346 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:36:15.379346 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:36:15.379346 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:36:15.379346 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:36:15.379346 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:36:15.379346 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:36:15.379346 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:36:15.381126 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 13 19:36:15.381126 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 13 19:36:15.381126 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 13 19:36:15.381126 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 13 19:36:15.381126 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 13 19:36:15.381126 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 13 19:36:15.381126 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 19:36:15.381126 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application Sep 13 19:36:15.382873 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 291/599] 10.222.0.25 () {56 vars in 1111 bytes} [Tue Sep 13 19:36:15 2022] GET /identity/v3/projects/service => generated 88 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:36:15.388587 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a03a537-9c8c-4ecc-b4bc-bf1f73d8fcf1 None admin] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:36:15.400201 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG dbcounter [-] [87934] Writing DB stats keystone:SELECT=100 {{(pid=87934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:36:15.423405 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3045dfb5-ea2d-412a-9047-da85aaeaf841 None admin] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:36:15.460792 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ed17cd-4e4c-4b16-96ce-46bab459e12a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:36:15.461528 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ed17cd-4e4c-4b16-96ce-46bab459e12a None admin] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:36:15.461866 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ed17cd-4e4c-4b16-96ce-46bab459e12a None admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:36:15.462205 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ed17cd-4e4c-4b16-96ce-46bab459e12a None admin] PATH_INFO: `/v3/projects` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:36:15.462975 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ed17cd-4e4c-4b16-96ce-46bab459e12a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87934) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:36:15.463376 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ed17cd-4e4c-4b16-96ce-46bab459e12a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:36:15.464937 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ed17cd-4e4c-4b16-96ce-46bab459e12a None admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:36:15.486252 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 309/600] 10.222.0.25 () {56 vars in 1148 bytes} [Tue Sep 13 19:36:15 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:36:15.486252 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ed17cd-4e4c-4b16-96ce-46bab459e12a None admin] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:36:15.525319 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a03a537-9c8c-4ecc-b4bc-bf1f73d8fcf1 None admin] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:36:15.558901 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG dbcounter [-] [87935] Writing DB stats keystone:SELECT=100 {{(pid=87935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:36:15.567349 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11dcb2e-547c-4c3d-a06c-ffef03f7cab1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:36:15.568301 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11dcb2e-547c-4c3d-a06c-ffef03f7cab1 None admin] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:36:15.568822 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11dcb2e-547c-4c3d-a06c-ffef03f7cab1 None admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:36:15.569438 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11dcb2e-547c-4c3d-a06c-ffef03f7cab1 None admin] PATH_INFO: `/v3/domains` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:36:15.570298 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d11dcb2e-547c-4c3d-a06c-ffef03f7cab1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87935) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:36:15.570795 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d11dcb2e-547c-4c3d-a06c-ffef03f7cab1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:36:15.572511 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d11dcb2e-547c-4c3d-a06c-ffef03f7cab1 None admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:36:15.592620 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 292/601] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Sep 13 19:36:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:36:15.593925 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11dcb2e-547c-4c3d-a06c-ffef03f7cab1 None admin] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:36:15.597950 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ed17cd-4e4c-4b16-96ce-46bab459e12a None admin] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:36:15.641012 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aace0a9-6dfe-4818-84f0-080252a29fa7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:36:15.641748 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aace0a9-6dfe-4818-84f0-080252a29fa7 None admin] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:36:15.642093 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aace0a9-6dfe-4818-84f0-080252a29fa7 None admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:36:15.642451 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aace0a9-6dfe-4818-84f0-080252a29fa7 None admin] PATH_INFO: `/v3/projects` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:36:15.643218 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aace0a9-6dfe-4818-84f0-080252a29fa7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87934) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:36:15.644014 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aace0a9-6dfe-4818-84f0-080252a29fa7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:36:15.645109 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aace0a9-6dfe-4818-84f0-080252a29fa7 None admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:36:15.663319 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 310/602] 10.222.0.25 () {56 vars in 1148 bytes} [Tue Sep 13 19:36:15 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:36:15.663319 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aace0a9-6dfe-4818-84f0-080252a29fa7 None admin] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:36:15.664153 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG dbcounter [-] [87934] Writing DB stats keystone:SELECT=100 {{(pid=87934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:36:15.727245 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11dcb2e-547c-4c3d-a06c-ffef03f7cab1 None admin] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:36:15.768692 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aace0a9-6dfe-4818-84f0-080252a29fa7 None admin] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:36:15.772653 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a8368b-4128-4141-b4a2-41d6e13164c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:36:15.773630 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a8368b-4128-4141-b4a2-41d6e13164c7 None admin] REQUEST_METHOD: `PUT` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:36:15.774111 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a8368b-4128-4141-b4a2-41d6e13164c7 None admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:36:15.774606 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a8368b-4128-4141-b4a2-41d6e13164c7 None admin] PATH_INFO: `/v3/projects/9a10a4268f3c4cb29f4e00c292e2df62/users/907d44d3b6944ccb83999d8e489871d4/roles/60f5ecbf9ce84814968607f126a85a5a` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:36:15.792111 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a8368b-4128-4141-b4a2-41d6e13164c7 None admin] RBAC: Authorizing `identity:create_grant(project_id=9a10a4268f3c4cb29f4e00c292e2df62, user_id=907d44d3b6944ccb83999d8e489871d4, role_id=60f5ecbf9ce84814968607f126a85a5a)` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:36:15.794113 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a8368b-4128-4141-b4a2-41d6e13164c7 None admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:36:15.809743 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 293/603] 10.222.0.25 () {58 vars in 1439 bytes} [Tue Sep 13 19:36:15 2022] PUT /identity/v3/projects/9a10a4268f3c4cb29f4e00c292e2df62/users/907d44d3b6944ccb83999d8e489871d4/roles/60f5ecbf9ce84814968607f126a85a5a => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 19:36:15.811029 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a8368b-4128-4141-b4a2-41d6e13164c7 None admin] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:36:15.825095 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddaa8e27-196a-4c0b-a9c4-524843f64f83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:36:15.825855 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddaa8e27-196a-4c0b-a9c4-524843f64f83 None admin] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:36:15.826056 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddaa8e27-196a-4c0b-a9c4-524843f64f83 None admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:36:15.826328 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddaa8e27-196a-4c0b-a9c4-524843f64f83 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:36:15.853756 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddaa8e27-196a-4c0b-a9c4-524843f64f83 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:36:15.855238 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddaa8e27-196a-4c0b-a9c4-524843f64f83 None admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:36:15.882764 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG dbcounter [-] [87935] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:36:15.883208 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application [None req-ddaa8e27-196a-4c0b-a9c4-524843f64f83 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 19:36:15.883208 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:36:15.883208 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:36:15.883208 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:36:15.883208 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:36:15.883208 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:36:15.883208 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:36:15.883208 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:36:15.883208 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:36:15.883208 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:36:15.883208 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:36:15.883208 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:36:15.883208 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 13 19:36:15.883208 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 13 19:36:15.883208 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 13 19:36:15.884095 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 13 19:36:15.884095 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:36:15.884095 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:36:15.884095 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:36:15.884095 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:36:15.884095 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:36:15.884095 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:36:15.884095 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:36:15.884095 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application with Lock( Sep 13 19:36:15.884095 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:36:15.884095 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:36:15.884095 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:36:15.884095 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:36:15.884095 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:36:15.884095 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:36:15.884095 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:36:15.884095 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:36:15.885040 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 13 19:36:15.885040 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 13 19:36:15.885040 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 13 19:36:15.885040 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 13 19:36:15.885040 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 13 19:36:15.885040 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 13 19:36:15.885040 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 19:36:15.885040 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application Sep 13 19:36:15.892923 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 311/604] 10.222.0.25 () {56 vars in 1111 bytes} [Tue Sep 13 19:36:15 2022] GET /identity/v3/projects/service => generated 88 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:36:15.913463 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddaa8e27-196a-4c0b-a9c4-524843f64f83 None admin] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:36:15.966115 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a8368b-4128-4141-b4a2-41d6e13164c7 None admin] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:36:16.010794 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da120a7a-5ace-48e3-92c2-ec68096c3d19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:36:16.012536 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da120a7a-5ace-48e3-92c2-ec68096c3d19 None admin] REQUEST_METHOD: `PUT` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:36:16.013175 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da120a7a-5ace-48e3-92c2-ec68096c3d19 None admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:36:16.013897 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da120a7a-5ace-48e3-92c2-ec68096c3d19 None admin] PATH_INFO: `/v3/projects/9a10a4268f3c4cb29f4e00c292e2df62/users/4cbb50c88b794a7f9f26844effde7d63/roles/60f5ecbf9ce84814968607f126a85a5a` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:36:16.034524 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da120a7a-5ace-48e3-92c2-ec68096c3d19 None admin] RBAC: Authorizing `identity:create_grant(project_id=9a10a4268f3c4cb29f4e00c292e2df62, user_id=4cbb50c88b794a7f9f26844effde7d63, role_id=60f5ecbf9ce84814968607f126a85a5a)` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:36:16.037281 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da120a7a-5ace-48e3-92c2-ec68096c3d19 None admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:36:16.051120 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG dbcounter [-] [87934] Writing DB stats keystone:SELECT=100 {{(pid=87934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:36:16.062234 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 294/605] 10.222.0.25 () {58 vars in 1439 bytes} [Tue Sep 13 19:36:15 2022] PUT /identity/v3/projects/9a10a4268f3c4cb29f4e00c292e2df62/users/4cbb50c88b794a7f9f26844effde7d63/roles/60f5ecbf9ce84814968607f126a85a5a => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 19:36:16.063523 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc0a894-b5f6-4f82-bc29-4370f1d10cc5 None None] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:36:16.063834 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc0a894-b5f6-4f82-bc29-4370f1d10cc5 None None] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:36:16.064098 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc0a894-b5f6-4f82-bc29-4370f1d10cc5 None None] PATH_INFO: `/` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:36:16.073937 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 295/606] 10.222.0.25 () {54 vars in 927 bytes} [Tue Sep 13 19:36:16 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:36:16.081824 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16610f8d-3d6d-4c40-831e-a6d16141feee None None] REQUEST_METHOD: `POST` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:36:16.082015 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16610f8d-3d6d-4c40-831e-a6d16141feee None None] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:36:16.083384 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16610f8d-3d6d-4c40-831e-a6d16141feee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:36:16.109420 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddaa8e27-196a-4c0b-a9c4-524843f64f83 None admin] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:36:16.125061 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.auth.core [None req-16610f8d-3d6d-4c40-831e-a6d16141feee None None] MFA Rules not processed for user `7b0aed92d02344acb92a0e4aa67c3068`. Rule list: `[]` (Enabled: `True`). {{(pid=87935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:36:16.126279 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.fernet_utils [None req-16610f8d-3d6d-4c40-831e-a6d16141feee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:36:16.182496 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b33863-5172-4566-b662-ba9c5b63eab1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:36:16.183126 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b33863-5172-4566-b662-ba9c5b63eab1 None admin] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:36:16.183620 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b33863-5172-4566-b662-ba9c5b63eab1 None admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:36:16.185530 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b33863-5172-4566-b662-ba9c5b63eab1 None admin] PATH_INFO: `/v3/projects` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:36:16.187165 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b33863-5172-4566-b662-ba9c5b63eab1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87934) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:36:16.187475 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b33863-5172-4566-b662-ba9c5b63eab1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:36:16.188987 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b33863-5172-4566-b662-ba9c5b63eab1 None admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:36:16.226541 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 312/607] 10.222.0.25 () {56 vars in 1148 bytes} [Tue Sep 13 19:36:15 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 314 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:36:16.253762 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b33863-5172-4566-b662-ba9c5b63eab1 None admin] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:36:16.267186 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 296/608] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Sep 13 19:36:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 19:36:16.382061 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b33863-5172-4566-b662-ba9c5b63eab1 None admin] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:36:16.408839 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG dbcounter [-] [87934] Writing DB stats keystone:SELECT=100 {{(pid=87934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:36:16.427578 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3c58cb-5312-465a-b7e4-8de2b82fa4cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:36:16.428603 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3c58cb-5312-465a-b7e4-8de2b82fa4cf None admin] REQUEST_METHOD: `PUT` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:36:16.428985 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3c58cb-5312-465a-b7e4-8de2b82fa4cf None admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:36:16.429359 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3c58cb-5312-465a-b7e4-8de2b82fa4cf None admin] PATH_INFO: `/v3/projects/9a10a4268f3c4cb29f4e00c292e2df62/users/1196a96e4a404f559600b69f929ea9da/roles/60f5ecbf9ce84814968607f126a85a5a` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:36:16.446403 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c3c58cb-5312-465a-b7e4-8de2b82fa4cf None admin] RBAC: Authorizing `identity:create_grant(project_id=9a10a4268f3c4cb29f4e00c292e2df62, user_id=1196a96e4a404f559600b69f929ea9da, role_id=60f5ecbf9ce84814968607f126a85a5a)` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:36:16.448049 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c3c58cb-5312-465a-b7e4-8de2b82fa4cf None admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:36:16.467307 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 313/609] 10.222.0.25 () {58 vars in 1439 bytes} [Tue Sep 13 19:36:16 2022] PUT /identity/v3/projects/9a10a4268f3c4cb29f4e00c292e2df62/users/1196a96e4a404f559600b69f929ea9da/roles/60f5ecbf9ce84814968607f126a85a5a => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 19:36:16.607553 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16610f8d-3d6d-4c40-831e-a6d16141feee None None] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:36:16.635751 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG dbcounter [-] [87935] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:36:16.764594 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16610f8d-3d6d-4c40-831e-a6d16141feee None None] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:36:16.811036 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc3db94-d96e-46a5-a997-6c0fa98cde92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:36:16.812718 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc3db94-d96e-46a5-a997-6c0fa98cde92 None admin] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:36:16.813517 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc3db94-d96e-46a5-a997-6c0fa98cde92 None admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:36:16.814251 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc3db94-d96e-46a5-a997-6c0fa98cde92 None admin] PATH_INFO: `/v3/roles/service` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:36:16.828413 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc3db94-d96e-46a5-a997-6c0fa98cde92 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 19:36:16.835043 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application [None req-6cc3db94-d96e-46a5-a997-6c0fa98cde92 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 13 19:36:16.835043 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:36:16.835043 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:36:16.835043 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:36:16.835043 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:36:16.835043 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:36:16.835043 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:36:16.835043 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:36:16.835043 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:36:16.835043 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:36:16.835043 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:36:16.835043 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:36:16.835043 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 19:36:16.835043 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 19:36:16.835043 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 19:36:16.835043 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 19:36:16.836010 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 19:36:16.836010 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 19:36:16.836010 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 19:36:16.836010 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 19:36:16.836010 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:36:16.836010 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:36:16.836010 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:36:16.836010 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:36:16.836010 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:36:16.836010 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:36:16.836010 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:36:16.836010 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application with Lock( Sep 13 19:36:16.836010 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:36:16.836010 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:36:16.836010 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:36:16.836010 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:36:16.836910 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:36:16.836910 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:36:16.836910 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:36:16.836910 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:36:16.836910 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 19:36:16.836910 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 19:36:16.836910 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 19:36:16.836910 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 19:36:16.836910 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 19:36:16.836910 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 19:36:16.836910 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 13 19:36:16.836910 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application Sep 13 19:36:16.839618 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 297/610] 10.222.0.25 () {56 vars in 1102 bytes} [Tue Sep 13 19:36:16 2022] GET /identity/v3/roles/service => generated 85 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:36:16.845716 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3c58cb-5312-465a-b7e4-8de2b82fa4cf None admin] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:36:16.959237 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74c8eef-c854-44ab-92c2-a36faa3496c1 None None] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:36:16.959821 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74c8eef-c854-44ab-92c2-a36faa3496c1 None None] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:36:16.960299 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74c8eef-c854-44ab-92c2-a36faa3496c1 None None] PATH_INFO: `/` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:36:16.962165 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 298/611] 10.222.0.25 () {54 vars in 927 bytes} [Tue Sep 13 19:36:16 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:36:16.968094 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9116e12b-5173-422e-84de-a9a7b0795f58 None None] REQUEST_METHOD: `POST` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:36:16.968693 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9116e12b-5173-422e-84de-a9a7b0795f58 None None] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:36:16.969164 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9116e12b-5173-422e-84de-a9a7b0795f58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:36:17.017501 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.auth.core [None req-9116e12b-5173-422e-84de-a9a7b0795f58 None None] MFA Rules not processed for user `7b0aed92d02344acb92a0e4aa67c3068`. Rule list: `[]` (Enabled: `True`). {{(pid=87935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:36:17.018820 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.fernet_utils [None req-9116e12b-5173-422e-84de-a9a7b0795f58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:36:17.089559 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3c58cb-5312-465a-b7e4-8de2b82fa4cf None admin] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:36:17.109707 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 299/612] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Sep 13 19:36:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 13 19:36:17.173287 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505fcf25-8bf9-4567-94bf-b77d4fc87d2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:36:17.174194 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505fcf25-8bf9-4567-94bf-b77d4fc87d2a None admin] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:36:17.174635 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505fcf25-8bf9-4567-94bf-b77d4fc87d2a None admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:36:17.175056 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505fcf25-8bf9-4567-94bf-b77d4fc87d2a None admin] PATH_INFO: `/v3/roles` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:36:17.175940 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-505fcf25-8bf9-4567-94bf-b77d4fc87d2a None admin] RBAC: Adding query filter params (name=service) {{(pid=87934) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:36:17.176424 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-505fcf25-8bf9-4567-94bf-b77d4fc87d2a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:36:17.178572 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-505fcf25-8bf9-4567-94bf-b77d4fc87d2a None admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:36:17.188066 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 314/613] 10.222.0.25 () {56 vars in 1103 bytes} [Tue Sep 13 19:36:16 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 343 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:36:17.194136 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9116e12b-5173-422e-84de-a9a7b0795f58 None None] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:36:17.212080 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG dbcounter [-] [87935] Writing DB stats keystone:SELECT=100 {{(pid=87935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:36:17.318737 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9116e12b-5173-422e-84de-a9a7b0795f58 None None] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:36:17.361576 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c28460-6e77-42a2-aee3-4f6c3c052e2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:36:17.362220 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c28460-6e77-42a2-aee3-4f6c3c052e2c None admin] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:36:17.362495 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c28460-6e77-42a2-aee3-4f6c3c052e2c None admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:36:17.362761 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c28460-6e77-42a2-aee3-4f6c3c052e2c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:36:17.380750 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c28460-6e77-42a2-aee3-4f6c3c052e2c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:36:17.382909 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c28460-6e77-42a2-aee3-4f6c3c052e2c None admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:36:17.407584 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application [None req-43c28460-6e77-42a2-aee3-4f6c3c052e2c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 19:36:17.407584 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:36:17.407584 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:36:17.407584 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:36:17.407584 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:36:17.407584 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:36:17.407584 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:36:17.407584 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:36:17.407584 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:36:17.407584 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:36:17.407584 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:36:17.407584 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:36:17.407584 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 19:36:17.407584 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 19:36:17.407584 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 19:36:17.407584 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 19:36:17.408800 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:36:17.408800 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:36:17.408800 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:36:17.408800 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:36:17.408800 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:36:17.408800 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:36:17.408800 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:36:17.408800 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application with Lock( Sep 13 19:36:17.408800 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:36:17.408800 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:36:17.408800 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:36:17.408800 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:36:17.408800 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:36:17.408800 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:36:17.408800 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:36:17.408800 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:36:17.408800 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 19:36:17.409843 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 19:36:17.409843 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 19:36:17.409843 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application Sep 13 19:36:17.409843 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 300/614] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Sep 13 19:36:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:36:17.414340 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505fcf25-8bf9-4567-94bf-b77d4fc87d2a None admin] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:36:17.490645 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG dbcounter [-] [87934] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:36:17.595277 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505fcf25-8bf9-4567-94bf-b77d4fc87d2a None admin] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:36:17.609739 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c28460-6e77-42a2-aee3-4f6c3c052e2c None admin] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:36:17.670330 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95fd20fe-63a5-4a6a-b873-260d855df9ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:36:17.670955 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fd20fe-63a5-4a6a-b873-260d855df9ad None admin] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:36:17.671235 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fd20fe-63a5-4a6a-b873-260d855df9ad None admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:36:17.671504 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fd20fe-63a5-4a6a-b873-260d855df9ad None admin] PATH_INFO: `/v3/domains` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:36:17.672156 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95fd20fe-63a5-4a6a-b873-260d855df9ad None admin] RBAC: Adding query filter params (name=Default) {{(pid=87934) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:36:17.672490 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95fd20fe-63a5-4a6a-b873-260d855df9ad None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:36:17.673845 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95fd20fe-63a5-4a6a-b873-260d855df9ad None admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:36:17.703551 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 315/615] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Sep 13 19:36:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:36:17.711116 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95fd20fe-63a5-4a6a-b873-260d855df9ad None admin] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:36:17.717214 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG dbcounter [-] [87935] Writing DB stats keystone:SELECT=100 {{(pid=87935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:36:17.789467 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c28460-6e77-42a2-aee3-4f6c3c052e2c None admin] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:36:17.855374 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG dbcounter [-] [87934] Writing DB stats keystone:SELECT=100 {{(pid=87934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:36:17.866420 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95fd20fe-63a5-4a6a-b873-260d855df9ad None admin] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:36:17.897004 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73dd6a1d-363b-46ed-bbeb-b01560a10357 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:36:17.897835 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73dd6a1d-363b-46ed-bbeb-b01560a10357 None admin] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:36:17.898228 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73dd6a1d-363b-46ed-bbeb-b01560a10357 None admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:36:17.898608 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73dd6a1d-363b-46ed-bbeb-b01560a10357 None admin] PATH_INFO: `/v3/roles/service` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:36:17.906388 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf277c5c-9571-4cb1-8c52-dbd4827ee8eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:36:17.907436 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf277c5c-9571-4cb1-8c52-dbd4827ee8eb None admin] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:36:17.907927 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf277c5c-9571-4cb1-8c52-dbd4827ee8eb None admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:36:17.908480 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf277c5c-9571-4cb1-8c52-dbd4827ee8eb None admin] PATH_INFO: `/v3/users/swift` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:36:17.925456 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73dd6a1d-363b-46ed-bbeb-b01560a10357 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 19:36:17.929060 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf277c5c-9571-4cb1-8c52-dbd4827ee8eb None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:36:17.930554 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf277c5c-9571-4cb1-8c52-dbd4827ee8eb None admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:36:17.931890 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application [None req-73dd6a1d-363b-46ed-bbeb-b01560a10357 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 13 19:36:17.931890 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:36:17.931890 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:36:17.931890 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:36:17.931890 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:36:17.931890 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:36:17.931890 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:36:17.931890 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:36:17.931890 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:36:17.931890 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:36:17.931890 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:36:17.931890 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:36:17.931890 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 19:36:17.931890 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 19:36:17.931890 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 19:36:17.931890 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 19:36:17.933012 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 19:36:17.933012 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 19:36:17.933012 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 19:36:17.933012 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 19:36:17.933012 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:36:17.933012 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:36:17.933012 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:36:17.933012 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:36:17.933012 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:36:17.933012 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:36:17.933012 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:36:17.933012 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application with Lock( Sep 13 19:36:17.933012 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:36:17.933012 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:36:17.933012 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:36:17.933012 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:36:17.934066 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:36:17.934066 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:36:17.934066 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:36:17.934066 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:36:17.934066 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 19:36:17.934066 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 19:36:17.934066 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 19:36:17.934066 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 19:36:17.934066 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 19:36:17.934066 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 19:36:17.934066 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 13 19:36:17.934066 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application Sep 13 19:36:17.934066 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 301/616] 10.222.0.25 () {56 vars in 1102 bytes} [Tue Sep 13 19:36:17 2022] GET /identity/v3/roles/service => generated 85 bytes in 324 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 13 19:36:17.940424 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73dd6a1d-363b-46ed-bbeb-b01560a10357 None admin] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:36:17.961008 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application [None req-bf277c5c-9571-4cb1-8c52-dbd4827ee8eb None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 13 19:36:17.961008 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:36:17.961008 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:36:17.961008 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:36:17.961008 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:36:17.961008 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:36:17.961008 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:36:17.961008 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:36:17.961008 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:36:17.961008 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:36:17.961008 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:36:17.961008 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:36:17.961008 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 13 19:36:17.961008 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 13 19:36:17.961008 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 13 19:36:17.961008 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 13 19:36:17.962223 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:36:17.962223 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:36:17.962223 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 13 19:36:17.962223 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 19:36:17.962223 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 13 19:36:17.962223 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 19:36:17.962223 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:36:17.962223 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:36:17.962223 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:36:17.962223 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:36:17.962223 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:36:17.962223 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application with Lock( Sep 13 19:36:17.962223 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:36:17.962223 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:36:17.962223 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:36:17.962223 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:36:17.962223 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:36:17.962223 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:36:17.963375 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:36:17.963375 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:36:17.963375 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 13 19:36:17.963375 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 13 19:36:17.963375 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 13 19:36:17.963375 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 13 19:36:17.963375 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 13 19:36:17.963375 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 13 19:36:17.963375 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 13 19:36:17.963375 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application Sep 13 19:36:17.963375 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 316/617] 10.222.0.25 () {56 vars in 1096 bytes} [Tue Sep 13 19:36:17 2022] GET /identity/v3/users/swift => generated 83 bytes in 252 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 13 19:36:17.970073 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf277c5c-9571-4cb1-8c52-dbd4827ee8eb None admin] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:36:18.065283 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73dd6a1d-363b-46ed-bbeb-b01560a10357 None admin] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:36:18.103758 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG dbcounter [-] [87935] Writing DB stats keystone:SELECT=100 {{(pid=87935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:36:18.124772 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80e6a6a-9d0f-4e39-8a04-e22ee264c407 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:36:18.125493 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80e6a6a-9d0f-4e39-8a04-e22ee264c407 None admin] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:36:18.125778 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80e6a6a-9d0f-4e39-8a04-e22ee264c407 None admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:36:18.126047 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80e6a6a-9d0f-4e39-8a04-e22ee264c407 None admin] PATH_INFO: `/v3/roles` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:36:18.126720 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a80e6a6a-9d0f-4e39-8a04-e22ee264c407 None admin] RBAC: Adding query filter params (name=service) {{(pid=87935) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:36:18.127021 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a80e6a6a-9d0f-4e39-8a04-e22ee264c407 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:36:18.128507 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a80e6a6a-9d0f-4e39-8a04-e22ee264c407 None admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:36:18.143886 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 302/618] 10.222.0.25 () {56 vars in 1103 bytes} [Tue Sep 13 19:36:17 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 19:36:18.150634 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80e6a6a-9d0f-4e39-8a04-e22ee264c407 None admin] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:36:18.180644 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf277c5c-9571-4cb1-8c52-dbd4827ee8eb None admin] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:36:18.244959 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00dd39d-bf7d-4c43-944f-cff01990fc86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:36:18.245597 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00dd39d-bf7d-4c43-944f-cff01990fc86 None admin] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:36:18.245886 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00dd39d-bf7d-4c43-944f-cff01990fc86 None admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:36:18.246242 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00dd39d-bf7d-4c43-944f-cff01990fc86 None admin] PATH_INFO: `/v3/users` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:36:18.249626 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d00dd39d-bf7d-4c43-944f-cff01990fc86 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=87934) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:36:18.249626 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d00dd39d-bf7d-4c43-944f-cff01990fc86 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:36:18.249626 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d00dd39d-bf7d-4c43-944f-cff01990fc86 None admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:36:18.290441 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 317/619] 10.222.0.25 () {56 vars in 1135 bytes} [Tue Sep 13 19:36:17 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 320 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:36:18.298025 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80e6a6a-9d0f-4e39-8a04-e22ee264c407 None admin] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:36:18.301250 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00dd39d-bf7d-4c43-944f-cff01990fc86 None admin] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:36:18.338855 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG dbcounter [-] [87934] Writing DB stats keystone:SELECT=100 {{(pid=87934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:36:18.367845 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c8d868-865e-43ce-b4d5-ec14af610c51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:36:18.368501 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c8d868-865e-43ce-b4d5-ec14af610c51 None admin] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:36:18.368781 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c8d868-865e-43ce-b4d5-ec14af610c51 None admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:36:18.369054 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c8d868-865e-43ce-b4d5-ec14af610c51 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:36:18.399766 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c8d868-865e-43ce-b4d5-ec14af610c51 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:36:18.401258 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c8d868-865e-43ce-b4d5-ec14af610c51 None admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:36:18.430187 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application [None req-79c8d868-865e-43ce-b4d5-ec14af610c51 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 19:36:18.430187 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:36:18.430187 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:36:18.430187 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:36:18.430187 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:36:18.430187 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:36:18.430187 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:36:18.430187 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:36:18.430187 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:36:18.430187 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:36:18.430187 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:36:18.430187 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:36:18.430187 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 19:36:18.430187 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 19:36:18.430187 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 19:36:18.430187 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 19:36:18.431223 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:36:18.431223 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:36:18.431223 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:36:18.431223 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:36:18.431223 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:36:18.431223 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:36:18.431223 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:36:18.431223 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application with Lock( Sep 13 19:36:18.431223 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:36:18.431223 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:36:18.431223 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:36:18.431223 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:36:18.431223 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:36:18.431223 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:36:18.431223 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:36:18.431223 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:36:18.431223 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 19:36:18.432129 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 19:36:18.432129 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 19:36:18.432129 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application Sep 13 19:36:18.432129 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 303/620] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Sep 13 19:36:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 281 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 13 19:36:18.437233 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c8d868-865e-43ce-b4d5-ec14af610c51 None admin] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:36:18.473732 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00dd39d-bf7d-4c43-944f-cff01990fc86 None admin] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:36:18.517918 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG dbcounter [-] [87935] Writing DB stats keystone:SELECT=100 {{(pid=87935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:36:18.538106 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c832c1-d84d-4fc0-b86d-e579da89c7e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:36:18.538757 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c832c1-d84d-4fc0-b86d-e579da89c7e5 None admin] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:36:18.539023 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c832c1-d84d-4fc0-b86d-e579da89c7e5 None admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:36:18.539294 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c832c1-d84d-4fc0-b86d-e579da89c7e5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:36:18.561548 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c832c1-d84d-4fc0-b86d-e579da89c7e5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:36:18.563053 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c832c1-d84d-4fc0-b86d-e579da89c7e5 None admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:36:18.593578 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application [None req-93c832c1-d84d-4fc0-b86d-e579da89c7e5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 19:36:18.593578 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:36:18.593578 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:36:18.593578 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:36:18.593578 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:36:18.593578 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:36:18.593578 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:36:18.593578 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:36:18.593578 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:36:18.593578 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:36:18.593578 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:36:18.593578 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:36:18.593578 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 19:36:18.593578 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 19:36:18.593578 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 19:36:18.593578 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 19:36:18.595755 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:36:18.595755 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:36:18.595755 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:36:18.595755 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:36:18.595755 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:36:18.595755 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:36:18.595755 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:36:18.595755 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application with Lock( Sep 13 19:36:18.595755 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:36:18.595755 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:36:18.595755 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:36:18.595755 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:36:18.595755 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:36:18.595755 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:36:18.595755 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:36:18.595755 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:36:18.595755 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 19:36:18.597846 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 19:36:18.597846 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 19:36:18.597846 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application Sep 13 19:36:18.597846 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 318/621] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Sep 13 19:36:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 296 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:36:18.604704 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c832c1-d84d-4fc0-b86d-e579da89c7e5 None admin] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:36:18.640730 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c8d868-865e-43ce-b4d5-ec14af610c51 None admin] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:36:18.680458 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582096a0-3d72-4627-8675-8ae7d342ea15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:36:18.681077 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582096a0-3d72-4627-8675-8ae7d342ea15 None admin] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:36:18.681475 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582096a0-3d72-4627-8675-8ae7d342ea15 None admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:36:18.681748 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582096a0-3d72-4627-8675-8ae7d342ea15 None admin] PATH_INFO: `/v3/domains` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:36:18.682399 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-582096a0-3d72-4627-8675-8ae7d342ea15 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87935) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:36:18.682703 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-582096a0-3d72-4627-8675-8ae7d342ea15 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:36:18.684298 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-582096a0-3d72-4627-8675-8ae7d342ea15 None admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:36:18.697959 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 304/622] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Sep 13 19:36:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:36:18.709698 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582096a0-3d72-4627-8675-8ae7d342ea15 None admin] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:36:18.728719 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG dbcounter [-] [87934] Writing DB stats keystone:SELECT=100 {{(pid=87934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:36:18.768347 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c832c1-d84d-4fc0-b86d-e579da89c7e5 None admin] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:36:18.805143 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0616b29f-fb89-46b3-8f43-faa1266e7606 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:36:18.805758 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0616b29f-fb89-46b3-8f43-faa1266e7606 None admin] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:36:18.806038 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0616b29f-fb89-46b3-8f43-faa1266e7606 None admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:36:18.806309 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0616b29f-fb89-46b3-8f43-faa1266e7606 None admin] PATH_INFO: `/v3/domains` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:36:18.806963 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0616b29f-fb89-46b3-8f43-faa1266e7606 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87934) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:36:18.807270 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0616b29f-fb89-46b3-8f43-faa1266e7606 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:36:18.808693 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0616b29f-fb89-46b3-8f43-faa1266e7606 None admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:36:18.822520 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 319/623] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Sep 13 19:36:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:36:18.823892 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18510e1-ee74-40c1-81b2-123a96ae64e4 None None] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:36:18.824183 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18510e1-ee74-40c1-81b2-123a96ae64e4 None None] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:36:18.824485 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18510e1-ee74-40c1-81b2-123a96ae64e4 None None] PATH_INFO: `/` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:36:18.826069 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 320/624] 10.222.0.25 () {54 vars in 927 bytes} [Tue Sep 13 19:36:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:36:18.831883 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb33c99-4b84-42ea-b731-8a2b62827c5a None None] REQUEST_METHOD: `POST` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:36:18.832479 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb33c99-4b84-42ea-b731-8a2b62827c5a None None] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:36:18.832724 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb33c99-4b84-42ea-b731-8a2b62827c5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:36:18.838976 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG dbcounter [-] [87935] Writing DB stats keystone:SELECT=100 {{(pid=87935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:36:18.847626 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582096a0-3d72-4627-8675-8ae7d342ea15 None admin] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:36:18.852031 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.auth.core [None req-abb33c99-4b84-42ea-b731-8a2b62827c5a None None] MFA Rules not processed for user `7b0aed92d02344acb92a0e4aa67c3068`. Rule list: `[]` (Enabled: `True`). {{(pid=87934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:36:18.853279 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.fernet_utils [None req-abb33c99-4b84-42ea-b731-8a2b62827c5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:36:18.896290 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd778d7-5fa5-4490-8d3d-389d6b4e4e86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:36:18.897562 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd778d7-5fa5-4490-8d3d-389d6b4e4e86 None admin] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:36:18.898044 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd778d7-5fa5-4490-8d3d-389d6b4e4e86 None admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:36:18.898538 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd778d7-5fa5-4490-8d3d-389d6b4e4e86 None admin] PATH_INFO: `/v3/users/nova` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:36:18.907815 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd778d7-5fa5-4490-8d3d-389d6b4e4e86 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:36:18.909890 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd778d7-5fa5-4490-8d3d-389d6b4e4e86 None admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:36:18.925157 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application [None req-bcd778d7-5fa5-4490-8d3d-389d6b4e4e86 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 13 19:36:18.925157 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:36:18.925157 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:36:18.925157 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:36:18.925157 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:36:18.925157 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:36:18.925157 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:36:18.925157 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:36:18.925157 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:36:18.925157 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:36:18.925157 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:36:18.925157 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:36:18.925157 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 13 19:36:18.925157 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 13 19:36:18.925157 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 13 19:36:18.925157 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 13 19:36:18.926180 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:36:18.926180 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:36:18.926180 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 13 19:36:18.926180 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 19:36:18.926180 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 13 19:36:18.926180 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 19:36:18.926180 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:36:18.926180 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:36:18.926180 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:36:18.926180 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:36:18.926180 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:36:18.926180 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application with Lock( Sep 13 19:36:18.926180 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:36:18.926180 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:36:18.926180 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:36:18.926180 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:36:18.926180 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:36:18.926180 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:36:18.927224 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:36:18.927224 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:36:18.927224 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 13 19:36:18.927224 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 13 19:36:18.927224 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 13 19:36:18.927224 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 13 19:36:18.927224 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 13 19:36:18.927224 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 13 19:36:18.927224 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 13 19:36:18.927224 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application Sep 13 19:36:18.930204 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 305/626] 10.222.0.25 () {56 vars in 1093 bytes} [Tue Sep 13 19:36:18 2022] GET /identity/v3/users/nova => generated 82 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:36:18.930322 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 321/626] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Sep 13 19:36:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 13 19:36:18.931300 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb33c99-4b84-42ea-b731-8a2b62827c5a None None] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:36:18.937089 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd778d7-5fa5-4490-8d3d-389d6b4e4e86 None admin] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:36:19.064619 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG dbcounter [-] [87934] Writing DB stats keystone:SELECT=100 {{(pid=87934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:36:19.075420 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd778d7-5fa5-4490-8d3d-389d6b4e4e86 None admin] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:36:19.127894 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c22cb70-e325-4e72-bf8b-f48215cb77b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:36:19.128462 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c22cb70-e325-4e72-bf8b-f48215cb77b6 None admin] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:36:19.128742 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c22cb70-e325-4e72-bf8b-f48215cb77b6 None admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:36:19.129009 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c22cb70-e325-4e72-bf8b-f48215cb77b6 None admin] PATH_INFO: `/v3/users` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:36:19.129816 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c22cb70-e325-4e72-bf8b-f48215cb77b6 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=87935) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:36:19.130118 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c22cb70-e325-4e72-bf8b-f48215cb77b6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:36:19.133022 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c22cb70-e325-4e72-bf8b-f48215cb77b6 None admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:36:19.158249 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb33c99-4b84-42ea-b731-8a2b62827c5a None None] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:36:19.160348 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 306/627] 10.222.0.25 () {56 vars in 1133 bytes} [Tue Sep 13 19:36:18 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:36:19.161686 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d264c4-07ef-450a-b835-ca38909b729f None None] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:36:19.166393 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d264c4-07ef-450a-b835-ca38909b729f None None] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:36:19.166719 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d264c4-07ef-450a-b835-ca38909b729f None None] PATH_INFO: `/` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:36:19.168372 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 307/628] 10.222.0.25 () {54 vars in 927 bytes} [Tue Sep 13 19:36:19 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:36:19.169135 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d264c4-07ef-450a-b835-ca38909b729f None None] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:36:19.194351 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG dbcounter [-] [87935] Writing DB stats keystone:SELECT=100 {{(pid=87935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:36:19.221929 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c85c25-ff67-4d1c-8ec0-147929e855ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:36:19.222633 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c85c25-ff67-4d1c-8ec0-147929e855ab None admin] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:36:19.222915 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c85c25-ff67-4d1c-8ec0-147929e855ab None admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:36:19.223184 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c85c25-ff67-4d1c-8ec0-147929e855ab None admin] PATH_INFO: `/v3/projects/service` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:36:19.233082 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c85c25-ff67-4d1c-8ec0-147929e855ab None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:36:19.235247 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c85c25-ff67-4d1c-8ec0-147929e855ab None admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:36:19.254849 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application [None req-a5c85c25-ff67-4d1c-8ec0-147929e855ab None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 19:36:19.254849 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:36:19.254849 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:36:19.254849 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:36:19.254849 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:36:19.254849 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:36:19.254849 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:36:19.254849 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:36:19.254849 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:36:19.254849 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:36:19.254849 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:36:19.254849 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:36:19.254849 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 13 19:36:19.254849 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 13 19:36:19.254849 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 13 19:36:19.255896 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 13 19:36:19.255896 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:36:19.255896 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:36:19.255896 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:36:19.255896 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:36:19.255896 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:36:19.255896 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:36:19.255896 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:36:19.255896 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application with Lock( Sep 13 19:36:19.255896 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:36:19.255896 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:36:19.255896 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:36:19.255896 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:36:19.255896 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:36:19.255896 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:36:19.255896 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:36:19.255896 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:36:19.257530 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 13 19:36:19.257530 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 13 19:36:19.257530 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 13 19:36:19.257530 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 13 19:36:19.257530 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 13 19:36:19.257530 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 13 19:36:19.257530 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 19:36:19.257530 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application Sep 13 19:36:19.257530 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 322/629] 10.222.0.25 () {56 vars in 1111 bytes} [Tue Sep 13 19:36:18 2022] GET /identity/v3/projects/service => generated 88 bytes in 326 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:36:19.259219 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83449c2b-3a94-4655-a066-b767df45df48 None None] REQUEST_METHOD: `POST` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:36:19.259412 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83449c2b-3a94-4655-a066-b767df45df48 None None] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:36:19.263171 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83449c2b-3a94-4655-a066-b767df45df48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:36:19.283368 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.auth.core [None req-83449c2b-3a94-4655-a066-b767df45df48 None None] MFA Rules not processed for user `7b0aed92d02344acb92a0e4aa67c3068`. Rule list: `[]` (Enabled: `True`). {{(pid=87934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:36:19.289303 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.fernet_utils [None req-83449c2b-3a94-4655-a066-b767df45df48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:36:19.341642 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d264c4-07ef-450a-b835-ca38909b729f None None] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:36:19.377769 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 323/630] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Sep 13 19:36:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 19:36:19.378405 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34204210-7cf0-478f-b130-a96d7910f985 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:36:19.378624 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83449c2b-3a94-4655-a066-b767df45df48 None None] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:36:19.379034 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34204210-7cf0-478f-b130-a96d7910f985 None admin] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:36:19.379229 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34204210-7cf0-478f-b130-a96d7910f985 None admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:36:19.379493 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34204210-7cf0-478f-b130-a96d7910f985 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:36:19.448787 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG dbcounter [-] [87934] Writing DB stats keystone:SELECT=100 {{(pid=87934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:36:19.487420 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34204210-7cf0-478f-b130-a96d7910f985 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:36:19.490211 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34204210-7cf0-478f-b130-a96d7910f985 None admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:36:19.507423 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG dbcounter [-] [87935] Writing DB stats keystone:SELECT=100 {{(pid=87935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:36:19.527856 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83449c2b-3a94-4655-a066-b767df45df48 None None] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:36:19.572862 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76a79bf-5f5c-4018-bda3-11e46cc43d66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:36:19.573943 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76a79bf-5f5c-4018-bda3-11e46cc43d66 None admin] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:36:19.574222 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76a79bf-5f5c-4018-bda3-11e46cc43d66 None admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:36:19.574487 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76a79bf-5f5c-4018-bda3-11e46cc43d66 None admin] PATH_INFO: `/v3/projects` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:36:19.575175 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d76a79bf-5f5c-4018-bda3-11e46cc43d66 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87934) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:36:19.575475 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d76a79bf-5f5c-4018-bda3-11e46cc43d66 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:36:19.576921 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d76a79bf-5f5c-4018-bda3-11e46cc43d66 None admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:36:19.591107 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 324/631] 10.222.0.25 () {56 vars in 1148 bytes} [Tue Sep 13 19:36:19 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:36:19.591952 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76a79bf-5f5c-4018-bda3-11e46cc43d66 None admin] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:36:19.622849 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 308/632] 10.222.0.25 () {58 vars in 1282 bytes} [Tue Sep 13 19:36:19 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 454 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 13 19:36:19.624014 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b901e6a-2314-4a3a-af49-81f52d4b336d None None] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:36:19.624323 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b901e6a-2314-4a3a-af49-81f52d4b336d None None] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:36:19.624591 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b901e6a-2314-4a3a-af49-81f52d4b336d None None] PATH_INFO: `/` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:36:19.625986 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 309/633] 10.222.0.25 () {54 vars in 927 bytes} [Tue Sep 13 19:36:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:36:19.629070 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b901e6a-2314-4a3a-af49-81f52d4b336d None None] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:36:19.717018 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76a79bf-5f5c-4018-bda3-11e46cc43d66 None admin] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:36:19.719342 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG dbcounter [-] [87934] Writing DB stats keystone:SELECT=100 {{(pid=87934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:36:19.752952 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345c7db4-f182-4737-88a9-6f0ffcc8b779 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:36:19.753344 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b901e6a-2314-4a3a-af49-81f52d4b336d None None] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:36:19.753587 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345c7db4-f182-4737-88a9-6f0ffcc8b779 None admin] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:36:19.753865 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345c7db4-f182-4737-88a9-6f0ffcc8b779 None admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:36:19.754133 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345c7db4-f182-4737-88a9-6f0ffcc8b779 None admin] PATH_INFO: `/v3/roles/service` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:36:19.765741 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-345c7db4-f182-4737-88a9-6f0ffcc8b779 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 19:36:19.769683 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG dbcounter [-] [87935] Writing DB stats keystone:SELECT=100 {{(pid=87935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:36:19.771812 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application [None req-345c7db4-f182-4737-88a9-6f0ffcc8b779 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 13 19:36:19.771812 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:36:19.771812 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:36:19.771812 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:36:19.771812 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:36:19.771812 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:36:19.771812 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:36:19.771812 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:36:19.771812 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:36:19.771812 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:36:19.771812 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:36:19.771812 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:36:19.771812 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 19:36:19.771812 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 19:36:19.771812 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 19:36:19.771812 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 19:36:19.772882 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 19:36:19.772882 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 19:36:19.772882 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 19:36:19.772882 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 19:36:19.772882 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:36:19.772882 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:36:19.772882 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:36:19.772882 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:36:19.772882 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:36:19.772882 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:36:19.772882 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:36:19.772882 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application with Lock( Sep 13 19:36:19.772882 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:36:19.772882 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:36:19.772882 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:36:19.772882 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:36:19.773841 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:36:19.773841 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:36:19.773841 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:36:19.773841 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:36:19.773841 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 19:36:19.773841 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 19:36:19.773841 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 19:36:19.773841 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 19:36:19.773841 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 19:36:19.773841 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 19:36:19.773841 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 13 19:36:19.773841 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application Sep 13 19:36:19.773841 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 325/634] 10.222.0.25 () {56 vars in 1102 bytes} [Tue Sep 13 19:36:19 2022] GET /identity/v3/roles/service => generated 85 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:36:19.774563 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345c7db4-f182-4737-88a9-6f0ffcc8b779 None admin] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:36:19.797607 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba540921-2bba-4ebf-8383-fdcbb6424d1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:36:19.798269 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba540921-2bba-4ebf-8383-fdcbb6424d1f None admin] REQUEST_METHOD: `PUT` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:36:19.798543 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba540921-2bba-4ebf-8383-fdcbb6424d1f None admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:36:19.798812 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba540921-2bba-4ebf-8383-fdcbb6424d1f None admin] PATH_INFO: `/v3/projects/9a10a4268f3c4cb29f4e00c292e2df62/users/fb42d6ac6cdd4d97a80c3ee0c6f8e3f5/roles/60f5ecbf9ce84814968607f126a85a5a` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:36:19.814315 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba540921-2bba-4ebf-8383-fdcbb6424d1f None admin] RBAC: Authorizing `identity:create_grant(project_id=9a10a4268f3c4cb29f4e00c292e2df62, user_id=fb42d6ac6cdd4d97a80c3ee0c6f8e3f5, role_id=60f5ecbf9ce84814968607f126a85a5a)` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:36:19.815759 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba540921-2bba-4ebf-8383-fdcbb6424d1f None admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:36:19.829773 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 310/635] 10.222.0.25 () {58 vars in 1439 bytes} [Tue Sep 13 19:36:19 2022] PUT /identity/v3/projects/9a10a4268f3c4cb29f4e00c292e2df62/users/fb42d6ac6cdd4d97a80c3ee0c6f8e3f5/roles/60f5ecbf9ce84814968607f126a85a5a => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 19:36:19.831054 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7847cd72-8cdf-4ade-8353-b36a4e6bf9fe None None] REQUEST_METHOD: `POST` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:36:19.831339 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7847cd72-8cdf-4ade-8353-b36a4e6bf9fe None None] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:36:19.831609 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7847cd72-8cdf-4ade-8353-b36a4e6bf9fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:36:19.852350 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.auth.core [None req-7847cd72-8cdf-4ade-8353-b36a4e6bf9fe None None] MFA Rules not processed for user `7b0aed92d02344acb92a0e4aa67c3068`. Rule list: `[]` (Enabled: `True`). {{(pid=87935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:36:19.853602 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.fernet_utils [None req-7847cd72-8cdf-4ade-8353-b36a4e6bf9fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:36:19.915389 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345c7db4-f182-4737-88a9-6f0ffcc8b779 None admin] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:36:19.947532 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 311/636] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Sep 13 19:36:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 19:36:19.948968 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7847cd72-8cdf-4ade-8353-b36a4e6bf9fe None None] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:36:19.981921 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72e70ff-6a2f-42d7-9209-d71e03b49bdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:36:19.983446 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72e70ff-6a2f-42d7-9209-d71e03b49bdb None admin] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:36:19.983937 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72e70ff-6a2f-42d7-9209-d71e03b49bdb None admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:36:19.984554 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72e70ff-6a2f-42d7-9209-d71e03b49bdb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:36:20.001431 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b72e70ff-6a2f-42d7-9209-d71e03b49bdb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:36:20.003220 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b72e70ff-6a2f-42d7-9209-d71e03b49bdb None admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:36:20.022933 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application [None req-b72e70ff-6a2f-42d7-9209-d71e03b49bdb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 19:36:20.022933 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:36:20.022933 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:36:20.022933 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:36:20.022933 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:36:20.022933 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:36:20.022933 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:36:20.022933 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:36:20.022933 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:36:20.022933 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:36:20.022933 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:36:20.022933 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:36:20.022933 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 19:36:20.022933 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 19:36:20.022933 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 19:36:20.022933 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 19:36:20.024237 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:36:20.024237 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:36:20.024237 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:36:20.024237 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:36:20.024237 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:36:20.024237 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:36:20.024237 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:36:20.024237 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application with Lock( Sep 13 19:36:20.024237 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:36:20.024237 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:36:20.024237 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:36:20.024237 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:36:20.024237 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:36:20.024237 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:36:20.024237 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:36:20.024237 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:36:20.024237 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 19:36:20.025385 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 19:36:20.025385 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 19:36:20.025385 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application Sep 13 19:36:20.031738 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 326/637] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Sep 13 19:36:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 254 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:36:20.031738 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72e70ff-6a2f-42d7-9209-d71e03b49bdb None admin] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:36:20.054650 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG dbcounter [-] [87934] Writing DB stats keystone:SELECT=100 {{(pid=87934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:36:20.119321 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG dbcounter [-] [87935] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:36:20.133195 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7847cd72-8cdf-4ade-8353-b36a4e6bf9fe None None] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:36:20.161775 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72e70ff-6a2f-42d7-9209-d71e03b49bdb None admin] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:36:20.180282 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643d7b6d-cf1f-4705-ab2f-a78924c12beb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:36:20.181089 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643d7b6d-cf1f-4705-ab2f-a78924c12beb None admin] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:36:20.181484 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643d7b6d-cf1f-4705-ab2f-a78924c12beb None admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:36:20.182224 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643d7b6d-cf1f-4705-ab2f-a78924c12beb None admin] PATH_INFO: `/v3/roles/service` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:36:20.197836 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-643d7b6d-cf1f-4705-ab2f-a78924c12beb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 19:36:20.203849 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application [None req-643d7b6d-cf1f-4705-ab2f-a78924c12beb None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 13 19:36:20.203849 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:36:20.203849 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:36:20.203849 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:36:20.203849 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:36:20.203849 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:36:20.203849 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:36:20.203849 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:36:20.203849 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:36:20.203849 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:36:20.203849 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:36:20.203849 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:36:20.203849 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 19:36:20.203849 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 19:36:20.203849 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 19:36:20.203849 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 19:36:20.205972 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 19:36:20.205972 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 19:36:20.205972 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 19:36:20.205972 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 19:36:20.205972 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:36:20.205972 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:36:20.205972 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:36:20.205972 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:36:20.205972 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:36:20.205972 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:36:20.205972 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:36:20.205972 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application with Lock( Sep 13 19:36:20.205972 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:36:20.205972 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:36:20.205972 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:36:20.205972 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:36:20.208281 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:36:20.208281 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:36:20.208281 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:36:20.208281 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:36:20.208281 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 19:36:20.208281 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 19:36:20.208281 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 19:36:20.208281 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 19:36:20.208281 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 19:36:20.208281 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 19:36:20.208281 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 13 19:36:20.208281 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application Sep 13 19:36:20.209786 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 312/638] 10.222.0.25 () {56 vars in 1102 bytes} [Tue Sep 13 19:36:19 2022] GET /identity/v3/roles/service => generated 85 bytes in 259 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:36:20.209786 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643d7b6d-cf1f-4705-ab2f-a78924c12beb None admin] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:36:20.230124 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7098b7a9-c7e0-47fc-9c27-d920ef484d82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:36:20.231089 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7098b7a9-c7e0-47fc-9c27-d920ef484d82 None admin] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:36:20.231571 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7098b7a9-c7e0-47fc-9c27-d920ef484d82 None admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:36:20.232619 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7098b7a9-c7e0-47fc-9c27-d920ef484d82 None admin] PATH_INFO: `/v3/roles` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:36:20.233311 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7098b7a9-c7e0-47fc-9c27-d920ef484d82 None admin] RBAC: Adding query filter params (name=service) {{(pid=87934) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:36:20.233626 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7098b7a9-c7e0-47fc-9c27-d920ef484d82 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:36:20.235416 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7098b7a9-c7e0-47fc-9c27-d920ef484d82 None admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:36:20.247489 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 327/639] 10.222.0.25 () {56 vars in 1103 bytes} [Tue Sep 13 19:36:20 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:36:20.251023 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7098b7a9-c7e0-47fc-9c27-d920ef484d82 None admin] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:36:20.347938 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG dbcounter [-] [87934] Writing DB stats keystone:SELECT=100 {{(pid=87934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:36:20.369641 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643d7b6d-cf1f-4705-ab2f-a78924c12beb None admin] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:36:20.374133 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7098b7a9-c7e0-47fc-9c27-d920ef484d82 None admin] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:36:20.414165 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac74d4a-615a-4ad5-aa78-5de2f052fde5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:36:20.414783 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac74d4a-615a-4ad5-aa78-5de2f052fde5 None admin] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:36:20.415059 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac74d4a-615a-4ad5-aa78-5de2f052fde5 None admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:36:20.415332 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac74d4a-615a-4ad5-aa78-5de2f052fde5 None admin] PATH_INFO: `/v3/domains` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:36:20.415984 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac74d4a-615a-4ad5-aa78-5de2f052fde5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87935) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:36:20.416315 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac74d4a-615a-4ad5-aa78-5de2f052fde5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:36:20.417706 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac74d4a-615a-4ad5-aa78-5de2f052fde5 None admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:36:20.422557 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5899a8-7605-4d71-b1dc-f8809216d046 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:36:20.423164 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5899a8-7605-4d71-b1dc-f8809216d046 None admin] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:36:20.423439 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5899a8-7605-4d71-b1dc-f8809216d046 None admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:36:20.423704 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5899a8-7605-4d71-b1dc-f8809216d046 None admin] PATH_INFO: `/v3/roles` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:36:20.424392 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af5899a8-7605-4d71-b1dc-f8809216d046 None admin] RBAC: Adding query filter params (name=service) {{(pid=87934) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:36:20.424690 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af5899a8-7605-4d71-b1dc-f8809216d046 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:36:20.426039 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af5899a8-7605-4d71-b1dc-f8809216d046 None admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:36:20.436036 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 313/640] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Sep 13 19:36:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:36:20.436036 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac74d4a-615a-4ad5-aa78-5de2f052fde5 None admin] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:36:20.436329 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 328/641] 10.222.0.25 () {56 vars in 1103 bytes} [Tue Sep 13 19:36:20 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:36:20.436846 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5899a8-7605-4d71-b1dc-f8809216d046 None admin] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:36:20.458232 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG dbcounter [-] [87935] Writing DB stats keystone:SELECT=100 {{(pid=87935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:36:20.565595 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5899a8-7605-4d71-b1dc-f8809216d046 None admin] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:36:20.566902 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac74d4a-615a-4ad5-aa78-5de2f052fde5 None admin] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:36:20.610298 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657725da-d8fa-41e4-93be-a7b649ee9b8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:36:20.610939 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657725da-d8fa-41e4-93be-a7b649ee9b8b None admin] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:36:20.611218 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657725da-d8fa-41e4-93be-a7b649ee9b8b None admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:36:20.611495 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657725da-d8fa-41e4-93be-a7b649ee9b8b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:36:20.613346 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121aa724-07ff-4fa9-9419-85b7a146a427 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:36:20.614057 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121aa724-07ff-4fa9-9419-85b7a146a427 None admin] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:36:20.614286 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121aa724-07ff-4fa9-9419-85b7a146a427 None admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:36:20.614562 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121aa724-07ff-4fa9-9419-85b7a146a427 None admin] PATH_INFO: `/v3/roles/service` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:36:20.623856 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG dbcounter [-] [87934] Writing DB stats keystone:SELECT=100 {{(pid=87934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:36:20.625258 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-657725da-d8fa-41e4-93be-a7b649ee9b8b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:36:20.627072 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-121aa724-07ff-4fa9-9419-85b7a146a427 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 19:36:20.627503 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-657725da-d8fa-41e4-93be-a7b649ee9b8b None admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:36:20.633666 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application [None req-121aa724-07ff-4fa9-9419-85b7a146a427 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 13 19:36:20.633666 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:36:20.633666 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:36:20.633666 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:36:20.633666 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:36:20.633666 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:36:20.633666 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:36:20.633666 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:36:20.633666 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:36:20.633666 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:36:20.633666 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:36:20.633666 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:36:20.633666 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 19:36:20.633666 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 19:36:20.633666 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 19:36:20.633666 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 19:36:20.634790 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 19:36:20.634790 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 19:36:20.634790 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 19:36:20.634790 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 19:36:20.634790 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:36:20.634790 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:36:20.634790 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:36:20.634790 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:36:20.634790 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:36:20.634790 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:36:20.634790 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:36:20.634790 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application with Lock( Sep 13 19:36:20.634790 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:36:20.634790 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:36:20.634790 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:36:20.634790 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:36:20.635807 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:36:20.635807 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:36:20.635807 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:36:20.635807 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:36:20.635807 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 19:36:20.635807 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 19:36:20.635807 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 19:36:20.635807 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 19:36:20.635807 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 19:36:20.635807 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 19:36:20.635807 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 13 19:36:20.635807 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application Sep 13 19:36:20.639349 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 329/642] 10.222.0.25 () {56 vars in 1102 bytes} [Tue Sep 13 19:36:20 2022] GET /identity/v3/roles/service => generated 85 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:36:20.640411 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121aa724-07ff-4fa9-9419-85b7a146a427 None admin] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:36:20.651681 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application [None req-657725da-d8fa-41e4-93be-a7b649ee9b8b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 19:36:20.651681 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:36:20.651681 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:36:20.651681 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:36:20.651681 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:36:20.651681 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:36:20.651681 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:36:20.651681 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:36:20.651681 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:36:20.651681 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:36:20.651681 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:36:20.651681 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:36:20.651681 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 19:36:20.651681 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 19:36:20.651681 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 19:36:20.651681 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 19:36:20.652779 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:36:20.652779 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:36:20.652779 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:36:20.652779 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:36:20.652779 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:36:20.652779 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:36:20.652779 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:36:20.652779 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application with Lock( Sep 13 19:36:20.652779 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:36:20.652779 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:36:20.652779 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:36:20.652779 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:36:20.652779 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:36:20.652779 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:36:20.652779 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:36:20.652779 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:36:20.652779 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 19:36:20.653679 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 19:36:20.653679 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 19:36:20.653679 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application Sep 13 19:36:20.653679 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 314/643] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Sep 13 19:36:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:36:20.654409 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657725da-d8fa-41e4-93be-a7b649ee9b8b None admin] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:36:20.745999 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG dbcounter [-] [87935] Writing DB stats keystone:SELECT=100 {{(pid=87935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:36:20.761055 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121aa724-07ff-4fa9-9419-85b7a146a427 None admin] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:36:20.786740 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657725da-d8fa-41e4-93be-a7b649ee9b8b None admin] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:36:20.800104 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a43365-a175-4b8a-940b-a0c4a99a9727 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:36:20.800791 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a43365-a175-4b8a-940b-a0c4a99a9727 None admin] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:36:20.801068 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a43365-a175-4b8a-940b-a0c4a99a9727 None admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:36:20.801336 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a43365-a175-4b8a-940b-a0c4a99a9727 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:36:20.809122 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a43365-a175-4b8a-940b-a0c4a99a9727 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:36:20.810583 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a43365-a175-4b8a-940b-a0c4a99a9727 None admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:36:20.826662 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application [None req-92a43365-a175-4b8a-940b-a0c4a99a9727 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 19:36:20.826662 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:36:20.826662 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:36:20.826662 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:36:20.826662 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:36:20.826662 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:36:20.826662 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:36:20.826662 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:36:20.826662 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:36:20.826662 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:36:20.826662 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:36:20.826662 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:36:20.826662 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 13 19:36:20.826662 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 13 19:36:20.826662 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 13 19:36:20.827660 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 13 19:36:20.827660 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:36:20.827660 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:36:20.827660 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:36:20.827660 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:36:20.827660 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:36:20.827660 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:36:20.827660 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:36:20.827660 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application with Lock( Sep 13 19:36:20.827660 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:36:20.827660 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:36:20.827660 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:36:20.827660 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:36:20.827660 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:36:20.827660 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:36:20.827660 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:36:20.827660 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:36:20.828794 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 13 19:36:20.828794 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 13 19:36:20.828794 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 13 19:36:20.828794 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 13 19:36:20.828794 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 13 19:36:20.828794 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 13 19:36:20.828794 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 19:36:20.828794 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application Sep 13 19:36:20.828794 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 330/644] 10.222.0.25 () {56 vars in 1111 bytes} [Tue Sep 13 19:36:20 2022] GET /identity/v3/projects/service => generated 88 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:36:20.828794 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a43365-a175-4b8a-940b-a0c4a99a9727 None admin] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:36:20.833470 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d38910-e075-47d1-8232-7b33a418bd2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:36:20.834301 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d38910-e075-47d1-8232-7b33a418bd2d None admin] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:36:20.834586 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d38910-e075-47d1-8232-7b33a418bd2d None admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:36:20.834859 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d38910-e075-47d1-8232-7b33a418bd2d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:36:20.847988 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d38910-e075-47d1-8232-7b33a418bd2d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:36:20.849841 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d38910-e075-47d1-8232-7b33a418bd2d None admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:36:20.866262 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application [None req-32d38910-e075-47d1-8232-7b33a418bd2d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 19:36:20.866262 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:36:20.866262 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:36:20.866262 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:36:20.866262 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:36:20.866262 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:36:20.866262 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:36:20.866262 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:36:20.866262 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:36:20.866262 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:36:20.866262 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:36:20.866262 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:36:20.866262 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 19:36:20.866262 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 19:36:20.866262 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 19:36:20.866262 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 19:36:20.867295 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:36:20.867295 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:36:20.867295 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:36:20.867295 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:36:20.867295 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:36:20.867295 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:36:20.867295 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:36:20.867295 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application with Lock( Sep 13 19:36:20.867295 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:36:20.867295 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:36:20.867295 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:36:20.867295 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:36:20.867295 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:36:20.867295 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:36:20.867295 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:36:20.867295 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:36:20.867295 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 19:36:20.868248 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 19:36:20.868248 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 19:36:20.868248 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application Sep 13 19:36:20.872351 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 315/645] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Sep 13 19:36:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:36:20.873336 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d38910-e075-47d1-8232-7b33a418bd2d None admin] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:36:20.910037 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG dbcounter [-] [87934] Writing DB stats keystone:SELECT=100 {{(pid=87934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:36:20.968360 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a43365-a175-4b8a-940b-a0c4a99a9727 None admin] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:36:21.006816 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d38910-e075-47d1-8232-7b33a418bd2d None admin] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:36:21.013513 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60315b80-6d50-49e7-9f0a-0e27109bc52a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:36:21.014153 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60315b80-6d50-49e7-9f0a-0e27109bc52a None admin] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:36:21.014405 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60315b80-6d50-49e7-9f0a-0e27109bc52a None admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:36:21.015149 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60315b80-6d50-49e7-9f0a-0e27109bc52a None admin] PATH_INFO: `/v3/roles` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:36:21.015825 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60315b80-6d50-49e7-9f0a-0e27109bc52a None admin] RBAC: Adding query filter params (name=service) {{(pid=87934) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:36:21.016125 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60315b80-6d50-49e7-9f0a-0e27109bc52a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:36:21.017973 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60315b80-6d50-49e7-9f0a-0e27109bc52a None admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:36:21.026387 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG dbcounter [-] [87935] Writing DB stats keystone:SELECT=100 {{(pid=87935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:36:21.028249 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 331/646] 10.222.0.25 () {56 vars in 1103 bytes} [Tue Sep 13 19:36:20 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:36:21.034864 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60315b80-6d50-49e7-9f0a-0e27109bc52a None admin] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:36:21.054792 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2464fc-9479-4b3f-a0ec-0ca845f34d6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:36:21.055411 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2464fc-9479-4b3f-a0ec-0ca845f34d6d None admin] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:36:21.055740 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2464fc-9479-4b3f-a0ec-0ca845f34d6d None admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:36:21.056017 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2464fc-9479-4b3f-a0ec-0ca845f34d6d None admin] PATH_INFO: `/v3/domains` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:36:21.056689 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab2464fc-9479-4b3f-a0ec-0ca845f34d6d None admin] RBAC: Adding query filter params (name=Default) {{(pid=87935) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:36:21.056995 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab2464fc-9479-4b3f-a0ec-0ca845f34d6d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:36:21.058388 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab2464fc-9479-4b3f-a0ec-0ca845f34d6d None admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:36:21.084436 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 316/647] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Sep 13 19:36:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:36:21.085693 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2464fc-9479-4b3f-a0ec-0ca845f34d6d None admin] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:36:21.154940 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60315b80-6d50-49e7-9f0a-0e27109bc52a None admin] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:36:21.188256 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG dbcounter [-] [87934] Writing DB stats keystone:SELECT=100 {{(pid=87934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:36:21.197022 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b222c096-cbc5-4602-aeca-7b4fc472064a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:36:21.197638 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b222c096-cbc5-4602-aeca-7b4fc472064a None admin] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:36:21.198112 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b222c096-cbc5-4602-aeca-7b4fc472064a None admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:36:21.198234 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b222c096-cbc5-4602-aeca-7b4fc472064a None admin] PATH_INFO: `/v3/projects` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:36:21.198874 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b222c096-cbc5-4602-aeca-7b4fc472064a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87934) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:36:21.199217 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b222c096-cbc5-4602-aeca-7b4fc472064a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:36:21.200833 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b222c096-cbc5-4602-aeca-7b4fc472064a None admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:36:21.208135 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2464fc-9479-4b3f-a0ec-0ca845f34d6d None admin] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:36:21.214723 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 332/648] 10.222.0.25 () {56 vars in 1148 bytes} [Tue Sep 13 19:36:21 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:36:21.220441 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b222c096-cbc5-4602-aeca-7b4fc472064a None admin] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:36:21.268876 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e6c46f-0b84-453e-9bf3-ec7394dce76d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:36:21.269406 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e6c46f-0b84-453e-9bf3-ec7394dce76d None admin] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:36:21.269684 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e6c46f-0b84-453e-9bf3-ec7394dce76d None admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:36:21.269956 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e6c46f-0b84-453e-9bf3-ec7394dce76d None admin] PATH_INFO: `/v3/domains` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:36:21.270669 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e6c46f-0b84-453e-9bf3-ec7394dce76d None admin] RBAC: Adding query filter params (name=Default) {{(pid=87935) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:36:21.271021 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e6c46f-0b84-453e-9bf3-ec7394dce76d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:36:21.272443 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e6c46f-0b84-453e-9bf3-ec7394dce76d None admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:36:21.291201 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 317/649] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Sep 13 19:36:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:36:21.291201 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e6c46f-0b84-453e-9bf3-ec7394dce76d None admin] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:36:21.335381 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG dbcounter [-] [87935] Writing DB stats keystone:SELECT=100 {{(pid=87935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:36:21.361753 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b222c096-cbc5-4602-aeca-7b4fc472064a None admin] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:36:21.412985 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c949f45-0a8c-4368-850f-1e6a3d69646f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:36:21.414163 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c949f45-0a8c-4368-850f-1e6a3d69646f None admin] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:36:21.414625 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c949f45-0a8c-4368-850f-1e6a3d69646f None admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:36:21.414734 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e6c46f-0b84-453e-9bf3-ec7394dce76d None admin] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:36:21.415147 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c949f45-0a8c-4368-850f-1e6a3d69646f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:36:21.432614 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c949f45-0a8c-4368-850f-1e6a3d69646f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:36:21.435382 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c949f45-0a8c-4368-850f-1e6a3d69646f None admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:36:21.454432 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7525db-4abc-4270-9c02-c4a19b2550fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:36:21.455222 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application [None req-4c949f45-0a8c-4368-850f-1e6a3d69646f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 19:36:21.455222 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:36:21.455222 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:36:21.455222 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:36:21.455222 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:36:21.455222 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:36:21.455222 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:36:21.455222 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:36:21.455222 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:36:21.455222 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:36:21.455222 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:36:21.455222 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:36:21.455222 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 19:36:21.455222 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 19:36:21.455222 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 19:36:21.455222 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 19:36:21.456154 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:36:21.456154 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:36:21.456154 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:36:21.456154 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:36:21.456154 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:36:21.456154 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:36:21.456154 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:36:21.456154 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application with Lock( Sep 13 19:36:21.456154 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:36:21.456154 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:36:21.456154 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:36:21.456154 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:36:21.456154 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:36:21.456154 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:36:21.456154 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:36:21.456154 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:36:21.456154 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 19:36:21.462849 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 19:36:21.462849 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 19:36:21.462849 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application Sep 13 19:36:21.463045 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7525db-4abc-4270-9c02-c4a19b2550fa None admin] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:36:21.463045 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7525db-4abc-4270-9c02-c4a19b2550fa None admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:36:21.463045 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7525db-4abc-4270-9c02-c4a19b2550fa None admin] PATH_INFO: `/v3/users/glance` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:36:21.463229 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 333/650] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Sep 13 19:36:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:36:21.463229 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c949f45-0a8c-4368-850f-1e6a3d69646f None admin] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:36:21.472022 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d7525db-4abc-4270-9c02-c4a19b2550fa None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:36:21.474068 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d7525db-4abc-4270-9c02-c4a19b2550fa None admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:36:21.486375 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application [None req-7d7525db-4abc-4270-9c02-c4a19b2550fa None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Sep 13 19:36:21.486375 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:36:21.486375 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:36:21.486375 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:36:21.486375 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:36:21.486375 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:36:21.486375 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:36:21.486375 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:36:21.486375 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:36:21.486375 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:36:21.486375 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:36:21.486375 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:36:21.486375 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 13 19:36:21.486375 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 13 19:36:21.486375 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 13 19:36:21.486375 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 13 19:36:21.487367 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:36:21.487367 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:36:21.487367 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 13 19:36:21.487367 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 19:36:21.487367 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 13 19:36:21.487367 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 19:36:21.487367 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:36:21.487367 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:36:21.487367 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:36:21.487367 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:36:21.487367 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:36:21.487367 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application with Lock( Sep 13 19:36:21.487367 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:36:21.487367 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:36:21.487367 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:36:21.487367 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:36:21.487367 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:36:21.487367 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:36:21.488389 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:36:21.488389 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:36:21.488389 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 13 19:36:21.488389 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 13 19:36:21.488389 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 13 19:36:21.488389 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 13 19:36:21.488389 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 13 19:36:21.488389 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 13 19:36:21.488389 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Sep 13 19:36:21.488389 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application Sep 13 19:36:21.488389 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 318/651] 10.222.0.25 () {56 vars in 1099 bytes} [Tue Sep 13 19:36:21 2022] GET /identity/v3/users/glance => generated 84 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:36:21.488389 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7525db-4abc-4270-9c02-c4a19b2550fa None admin] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:36:21.506321 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG dbcounter [-] [87934] Writing DB stats keystone:SELECT=100 {{(pid=87934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:36:21.593389 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c949f45-0a8c-4368-850f-1e6a3d69646f None admin] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:36:21.611879 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG dbcounter [-] [87935] Writing DB stats keystone:SELECT=100 {{(pid=87935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:36:21.617346 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7525db-4abc-4270-9c02-c4a19b2550fa None admin] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:36:21.638114 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c23189-d39e-481a-ad35-879521518b6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:36:21.639004 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c23189-d39e-481a-ad35-879521518b6b None admin] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:36:21.639429 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c23189-d39e-481a-ad35-879521518b6b None admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:36:21.639841 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c23189-d39e-481a-ad35-879521518b6b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:36:21.640748 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c23189-d39e-481a-ad35-879521518b6b None admin] RBAC: Adding query filter params (role.id=60f5ecbf9ce84814968607f126a85a5a, scope.project.id=9a10a4268f3c4cb29f4e00c292e2df62, user.id=d71fe5a8275f4ea98555afdcefc902a0) {{(pid=87934) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:36:21.641209 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c23189-d39e-481a-ad35-879521518b6b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:36:21.642949 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c23189-d39e-481a-ad35-879521518b6b None admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:36:21.650400 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 334/652] 10.222.0.25 () {56 vars in 1374 bytes} [Tue Sep 13 19:36:21 2022] GET /identity/v3/role_assignments?user.id=d71fe5a8275f4ea98555afdcefc902a0&scope.project.id=9a10a4268f3c4cb29f4e00c292e2df62&role.id=60f5ecbf9ce84814968607f126a85a5a => generated 608 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:36:21.651451 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c23189-d39e-481a-ad35-879521518b6b None admin] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:36:21.702006 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6414dae2-4f93-4b01-b9de-7433307a9cb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:36:21.703265 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6414dae2-4f93-4b01-b9de-7433307a9cb2 None admin] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:36:21.703808 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6414dae2-4f93-4b01-b9de-7433307a9cb2 None admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:36:21.704403 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6414dae2-4f93-4b01-b9de-7433307a9cb2 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:36:21.718115 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6414dae2-4f93-4b01-b9de-7433307a9cb2 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:36:21.720455 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6414dae2-4f93-4b01-b9de-7433307a9cb2 None admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:36:21.740175 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application [None req-6414dae2-4f93-4b01-b9de-7433307a9cb2 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Sep 13 19:36:21.740175 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:36:21.740175 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:36:21.740175 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:36:21.740175 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:36:21.740175 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:36:21.740175 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:36:21.740175 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:36:21.740175 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:36:21.740175 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:36:21.740175 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:36:21.740175 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:36:21.740175 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 13 19:36:21.740175 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 13 19:36:21.740175 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 13 19:36:21.740175 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 13 19:36:21.741323 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:36:21.741323 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:36:21.741323 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 13 19:36:21.741323 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 19:36:21.741323 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 13 19:36:21.741323 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 19:36:21.741323 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:36:21.741323 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:36:21.741323 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:36:21.741323 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:36:21.741323 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:36:21.741323 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application with Lock( Sep 13 19:36:21.741323 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:36:21.741323 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:36:21.741323 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:36:21.741323 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:36:21.741323 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:36:21.741323 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:36:21.742284 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:36:21.742284 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:36:21.742284 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 13 19:36:21.742284 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 13 19:36:21.742284 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 13 19:36:21.742284 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 13 19:36:21.742284 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 13 19:36:21.742284 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 13 19:36:21.742284 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Sep 13 19:36:21.742284 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application Sep 13 19:36:21.746536 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 319/653] 10.222.0.25 () {56 vars in 1099 bytes} [Tue Sep 13 19:36:21 2022] GET /identity/v3/users/cinder => generated 84 bytes in 257 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:36:21.746536 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6414dae2-4f93-4b01-b9de-7433307a9cb2 None admin] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:36:21.801369 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG dbcounter [-] [87934] Writing DB stats keystone:SELECT=100 {{(pid=87934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:36:21.807155 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c23189-d39e-481a-ad35-879521518b6b None admin] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:36:21.849141 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af137353-f5d2-48a2-a497-4345d29aff4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:36:21.850256 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af137353-f5d2-48a2-a497-4345d29aff4a None admin] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:36:21.850690 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af137353-f5d2-48a2-a497-4345d29aff4a None admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:36:21.851105 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af137353-f5d2-48a2-a497-4345d29aff4a None admin] PATH_INFO: `/v3/domains` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:36:21.851915 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af137353-f5d2-48a2-a497-4345d29aff4a None admin] RBAC: Adding query filter params (name=Default) {{(pid=87934) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:36:21.852392 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af137353-f5d2-48a2-a497-4345d29aff4a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:36:21.853981 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af137353-f5d2-48a2-a497-4345d29aff4a None admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:36:21.869051 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 335/654] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Sep 13 19:36:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:36:21.870231 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af137353-f5d2-48a2-a497-4345d29aff4a None admin] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:36:21.882033 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6414dae2-4f93-4b01-b9de-7433307a9cb2 None admin] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:36:21.934700 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea819842-2779-48e6-a868-284a0172178f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:36:21.935318 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea819842-2779-48e6-a868-284a0172178f None admin] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:36:21.935602 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea819842-2779-48e6-a868-284a0172178f None admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:36:21.935879 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea819842-2779-48e6-a868-284a0172178f None admin] PATH_INFO: `/v3/users` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:36:21.936683 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea819842-2779-48e6-a868-284a0172178f None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=87935) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:36:21.937092 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea819842-2779-48e6-a868-284a0172178f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:36:21.938556 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea819842-2779-48e6-a868-284a0172178f None admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:36:21.963031 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 320/655] 10.222.0.25 () {56 vars in 1137 bytes} [Tue Sep 13 19:36:21 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:36:21.964235 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea819842-2779-48e6-a868-284a0172178f None admin] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:36:21.990435 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG dbcounter [-] [87935] Writing DB stats keystone:SELECT=100 {{(pid=87935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:36:22.026455 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af137353-f5d2-48a2-a497-4345d29aff4a None admin] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:36:22.087749 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744443ec-8aa7-41f3-86d1-13b113bda7ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:36:22.088415 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744443ec-8aa7-41f3-86d1-13b113bda7ed None admin] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:36:22.088697 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744443ec-8aa7-41f3-86d1-13b113bda7ed None admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:36:22.088973 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744443ec-8aa7-41f3-86d1-13b113bda7ed None admin] PATH_INFO: `/v3/users` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:36:22.089732 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-744443ec-8aa7-41f3-86d1-13b113bda7ed None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=87934) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:36:22.090099 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-744443ec-8aa7-41f3-86d1-13b113bda7ed None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:36:22.092299 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-744443ec-8aa7-41f3-86d1-13b113bda7ed None admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:36:22.109789 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea819842-2779-48e6-a868-284a0172178f None admin] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:36:22.117347 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 336/656] 10.222.0.25 () {56 vars in 1137 bytes} [Tue Sep 13 19:36:21 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:36:22.118230 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744443ec-8aa7-41f3-86d1-13b113bda7ed None admin] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:36:22.147325 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG dbcounter [-] [87934] Writing DB stats keystone:SELECT=100 {{(pid=87934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:36:22.166317 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5f3df7-8e67-4c80-bf52-ed27f4118db2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:36:22.167211 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5f3df7-8e67-4c80-bf52-ed27f4118db2 None admin] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:36:22.167591 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5f3df7-8e67-4c80-bf52-ed27f4118db2 None admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:36:22.167964 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5f3df7-8e67-4c80-bf52-ed27f4118db2 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:36:22.179406 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e5f3df7-8e67-4c80-bf52-ed27f4118db2 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:36:22.180923 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e5f3df7-8e67-4c80-bf52-ed27f4118db2 None admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:36:22.193696 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application [None req-3e5f3df7-8e67-4c80-bf52-ed27f4118db2 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Sep 13 19:36:22.193696 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:36:22.193696 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:36:22.193696 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:36:22.193696 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:36:22.193696 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:36:22.193696 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:36:22.193696 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:36:22.193696 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:36:22.193696 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:36:22.193696 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:36:22.193696 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:36:22.193696 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 13 19:36:22.193696 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 13 19:36:22.193696 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 13 19:36:22.193696 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 13 19:36:22.194731 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:36:22.194731 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:36:22.194731 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 13 19:36:22.194731 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 19:36:22.194731 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 13 19:36:22.194731 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 19:36:22.194731 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:36:22.194731 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:36:22.194731 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:36:22.194731 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:36:22.194731 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:36:22.194731 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application with Lock( Sep 13 19:36:22.194731 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:36:22.194731 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:36:22.194731 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:36:22.194731 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:36:22.194731 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:36:22.194731 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:36:22.195775 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:36:22.195775 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:36:22.195775 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 13 19:36:22.195775 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 13 19:36:22.195775 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 13 19:36:22.195775 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 13 19:36:22.195775 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 13 19:36:22.195775 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 13 19:36:22.195775 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Sep 13 19:36:22.195775 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application Sep 13 19:36:22.195775 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 321/657] 10.222.0.25 () {56 vars in 1102 bytes} [Tue Sep 13 19:36:21 2022] GET /identity/v3/users/neutron => generated 85 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:36:22.195775 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5f3df7-8e67-4c80-bf52-ed27f4118db2 None admin] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:36:22.256956 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744443ec-8aa7-41f3-86d1-13b113bda7ed None admin] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:36:22.301102 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG dbcounter [-] [87935] Writing DB stats keystone:SELECT=100 {{(pid=87935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:36:22.302046 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a07d2a0-501e-4f20-ae61-c5a742a3c873 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:36:22.303151 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a07d2a0-501e-4f20-ae61-c5a742a3c873 None admin] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:36:22.303524 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a07d2a0-501e-4f20-ae61-c5a742a3c873 None admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:36:22.304102 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a07d2a0-501e-4f20-ae61-c5a742a3c873 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:36:22.339792 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5f3df7-8e67-4c80-bf52-ed27f4118db2 None admin] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:36:22.377801 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d83c82-ed8e-4c33-907f-556ca2bf53c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:36:22.378427 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d83c82-ed8e-4c33-907f-556ca2bf53c5 None admin] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:36:22.378704 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d83c82-ed8e-4c33-907f-556ca2bf53c5 None admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:36:22.378968 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d83c82-ed8e-4c33-907f-556ca2bf53c5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:36:22.380643 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a07d2a0-501e-4f20-ae61-c5a742a3c873 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:36:22.382114 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a07d2a0-501e-4f20-ae61-c5a742a3c873 None admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:36:22.400959 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG dbcounter [-] [87934] Writing DB stats keystone:SELECT=100 {{(pid=87934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:36:22.461611 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d83c82-ed8e-4c33-907f-556ca2bf53c5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:36:22.463076 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d83c82-ed8e-4c33-907f-556ca2bf53c5 None admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:36:22.496704 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 337/658] 10.222.0.25 () {58 vars in 1282 bytes} [Tue Sep 13 19:36:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 379 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 13 19:36:22.496704 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb0c81a-647b-4e69-b966-317d020310aa None None] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:36:22.496704 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb0c81a-647b-4e69-b966-317d020310aa None None] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:36:22.496704 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb0c81a-647b-4e69-b966-317d020310aa None None] PATH_INFO: `/` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:36:22.496704 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 338/659] 10.222.0.25 () {54 vars in 927 bytes} [Tue Sep 13 19:36:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:36:22.496704 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb0c81a-647b-4e69-b966-317d020310aa None None] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:36:22.571720 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG dbcounter [-] [87935] Writing DB stats keystone:SELECT=100 {{(pid=87935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:36:22.605433 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 322/660] 10.222.0.25 () {58 vars in 1282 bytes} [Tue Sep 13 19:36:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 410 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 13 19:36:22.610723 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d83c82-ed8e-4c33-907f-556ca2bf53c5 None admin] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:36:22.617923 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb0c81a-647b-4e69-b966-317d020310aa None None] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:36:22.638818 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG dbcounter [-] [87934] Writing DB stats keystone:SELECT=100 {{(pid=87934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:36:22.664876 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6cf1b7c-45f9-44f8-8af6-3bc219d9c37e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:36:22.665650 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cf1b7c-45f9-44f8-8af6-3bc219d9c37e None admin] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:36:22.666097 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cf1b7c-45f9-44f8-8af6-3bc219d9c37e None admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:36:22.666575 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cf1b7c-45f9-44f8-8af6-3bc219d9c37e None admin] PATH_INFO: `/v3/users` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:36:22.667849 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6cf1b7c-45f9-44f8-8af6-3bc219d9c37e None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=87934) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:36:22.668386 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6cf1b7c-45f9-44f8-8af6-3bc219d9c37e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:36:22.670515 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6cf1b7c-45f9-44f8-8af6-3bc219d9c37e None admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:36:22.695428 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 339/661] 10.222.0.25 () {56 vars in 1139 bytes} [Tue Sep 13 19:36:22 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:36:22.695428 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c094ab66-f564-49a3-9930-b7ec5e4c4521 None None] REQUEST_METHOD: `POST` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:36:22.695428 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c094ab66-f564-49a3-9930-b7ec5e4c4521 None None] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:36:22.695428 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c094ab66-f564-49a3-9930-b7ec5e4c4521 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:36:22.712226 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.auth.core [None req-c094ab66-f564-49a3-9930-b7ec5e4c4521 None None] MFA Rules not processed for user `7b0aed92d02344acb92a0e4aa67c3068`. Rule list: `[]` (Enabled: `True`). {{(pid=87934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:36:22.713846 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.fernet_utils [None req-c094ab66-f564-49a3-9930-b7ec5e4c4521 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:36:22.760590 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d83c82-ed8e-4c33-907f-556ca2bf53c5 None admin] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:36:22.796160 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 340/662] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Sep 13 19:36:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 19:36:22.800447 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c094ab66-f564-49a3-9930-b7ec5e4c4521 None None] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:36:22.822532 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d680d969-c1c1-491d-92da-b10fc7df30e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:36:22.823169 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d680d969-c1c1-491d-92da-b10fc7df30e6 None admin] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:36:22.823445 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d680d969-c1c1-491d-92da-b10fc7df30e6 None admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:36:22.823711 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d680d969-c1c1-491d-92da-b10fc7df30e6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:36:22.836420 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d680d969-c1c1-491d-92da-b10fc7df30e6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:36:22.837824 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d680d969-c1c1-491d-92da-b10fc7df30e6 None admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:36:22.854618 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application [None req-d680d969-c1c1-491d-92da-b10fc7df30e6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 19:36:22.854618 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:36:22.854618 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:36:22.854618 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:36:22.854618 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:36:22.854618 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:36:22.854618 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:36:22.854618 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:36:22.854618 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:36:22.854618 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:36:22.854618 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:36:22.854618 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:36:22.854618 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 19:36:22.854618 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 19:36:22.854618 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 19:36:22.854618 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 19:36:22.855691 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:36:22.855691 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:36:22.855691 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:36:22.855691 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:36:22.855691 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:36:22.855691 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:36:22.855691 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:36:22.855691 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application with Lock( Sep 13 19:36:22.855691 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:36:22.855691 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:36:22.855691 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:36:22.855691 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:36:22.855691 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:36:22.855691 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:36:22.855691 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:36:22.855691 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:36:22.855691 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 19:36:22.856637 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 19:36:22.856637 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 19:36:22.856637 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application Sep 13 19:36:22.860460 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 323/663] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Sep 13 19:36:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 254 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:36:22.861388 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d680d969-c1c1-491d-92da-b10fc7df30e6 None admin] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:36:22.892060 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG dbcounter [-] [87935] Writing DB stats keystone:SELECT=100 {{(pid=87935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:36:22.947977 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c094ab66-f564-49a3-9930-b7ec5e4c4521 None None] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:36:22.951463 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG dbcounter [-] [87934] Writing DB stats keystone:SELECT=100 {{(pid=87934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:36:22.987996 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d680d969-c1c1-491d-92da-b10fc7df30e6 None admin] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:36:22.993333 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17befb2c-db98-436f-a8ce-ae448bb56ea8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:36:22.993974 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17befb2c-db98-436f-a8ce-ae448bb56ea8 None admin] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:36:22.994247 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17befb2c-db98-436f-a8ce-ae448bb56ea8 None admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:36:22.994574 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17befb2c-db98-436f-a8ce-ae448bb56ea8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:36:23.005858 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17befb2c-db98-436f-a8ce-ae448bb56ea8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:36:23.007331 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17befb2c-db98-436f-a8ce-ae448bb56ea8 None admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:36:23.023965 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application [None req-17befb2c-db98-436f-a8ce-ae448bb56ea8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 19:36:23.023965 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:36:23.023965 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:36:23.023965 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:36:23.023965 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:36:23.023965 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:36:23.023965 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:36:23.023965 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:36:23.023965 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:36:23.023965 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:36:23.023965 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:36:23.023965 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:36:23.023965 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 19:36:23.023965 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 19:36:23.023965 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 19:36:23.023965 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 19:36:23.025205 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:36:23.025205 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:36:23.025205 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:36:23.025205 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:36:23.025205 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:36:23.025205 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:36:23.025205 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:36:23.025205 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application with Lock( Sep 13 19:36:23.025205 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:36:23.025205 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:36:23.025205 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:36:23.025205 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:36:23.025205 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:36:23.025205 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:36:23.025205 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:36:23.025205 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:36:23.025205 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 19:36:23.026233 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 19:36:23.026233 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 19:36:23.026233 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application Sep 13 19:36:23.029890 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 341/664] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Sep 13 19:36:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:36:23.030833 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17befb2c-db98-436f-a8ce-ae448bb56ea8 None admin] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:36:23.038189 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ef4c85-c97d-43b5-9cb7-38b5d93d72d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:36:23.039034 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ef4c85-c97d-43b5-9cb7-38b5d93d72d8 None admin] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:36:23.039464 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ef4c85-c97d-43b5-9cb7-38b5d93d72d8 None admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:36:23.039877 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ef4c85-c97d-43b5-9cb7-38b5d93d72d8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:36:23.130361 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ef4c85-c97d-43b5-9cb7-38b5d93d72d8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:36:23.131943 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ef4c85-c97d-43b5-9cb7-38b5d93d72d8 None admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:36:23.157556 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17befb2c-db98-436f-a8ce-ae448bb56ea8 None admin] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:36:23.163989 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG dbcounter [-] [87935] Writing DB stats keystone:SELECT=100 {{(pid=87935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:36:23.196434 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab0e82b-21ad-4512-883a-9d48a31027a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:36:23.197055 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab0e82b-21ad-4512-883a-9d48a31027a5 None admin] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:36:23.197333 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab0e82b-21ad-4512-883a-9d48a31027a5 None admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:36:23.197601 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab0e82b-21ad-4512-883a-9d48a31027a5 None admin] PATH_INFO: `/v3/domains` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:36:23.198253 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab0e82b-21ad-4512-883a-9d48a31027a5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87934) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:36:23.198554 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab0e82b-21ad-4512-883a-9d48a31027a5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:36:23.200031 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab0e82b-21ad-4512-883a-9d48a31027a5 None admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:36:23.214622 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 342/665] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Sep 13 19:36:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:36:23.215395 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab0e82b-21ad-4512-883a-9d48a31027a5 None admin] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:36:23.239938 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG dbcounter [-] [87934] Writing DB stats keystone:SELECT=100 {{(pid=87934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:36:23.248700 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 324/666] 10.222.0.25 () {58 vars in 1282 bytes} [Tue Sep 13 19:36:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 388 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 13 19:36:23.249897 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ef4c85-c97d-43b5-9cb7-38b5d93d72d8 None admin] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:36:23.363190 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab0e82b-21ad-4512-883a-9d48a31027a5 None admin] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:36:23.365874 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ef4c85-c97d-43b5-9cb7-38b5d93d72d8 None admin] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:36:23.399897 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG dbcounter [-] [87935] Writing DB stats keystone:SELECT=100 {{(pid=87935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:36:23.408946 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7852289e-ee7a-4684-8e99-b80d5cdf92b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:36:23.409368 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88500dcb-2f51-4205-893e-f511bae46113 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:36:23.409508 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7852289e-ee7a-4684-8e99-b80d5cdf92b7 None admin] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:36:23.409757 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7852289e-ee7a-4684-8e99-b80d5cdf92b7 None admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:36:23.409973 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88500dcb-2f51-4205-893e-f511bae46113 None admin] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:36:23.410069 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7852289e-ee7a-4684-8e99-b80d5cdf92b7 None admin] PATH_INFO: `/v3/roles/service` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:36:23.410249 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88500dcb-2f51-4205-893e-f511bae46113 None admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:36:23.410517 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88500dcb-2f51-4205-893e-f511bae46113 None admin] PATH_INFO: `/v3/domains` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:36:23.411379 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88500dcb-2f51-4205-893e-f511bae46113 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87934) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:36:23.411758 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88500dcb-2f51-4205-893e-f511bae46113 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:36:23.413753 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88500dcb-2f51-4205-893e-f511bae46113 None admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:36:23.421829 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7852289e-ee7a-4684-8e99-b80d5cdf92b7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 19:36:23.426030 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 343/667] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Sep 13 19:36:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:36:23.426717 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88500dcb-2f51-4205-893e-f511bae46113 None admin] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:36:23.431264 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application [None req-7852289e-ee7a-4684-8e99-b80d5cdf92b7 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 13 19:36:23.431264 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:36:23.431264 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:36:23.431264 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:36:23.431264 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:36:23.431264 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:36:23.431264 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:36:23.431264 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:36:23.431264 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:36:23.431264 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:36:23.431264 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:36:23.431264 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:36:23.431264 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 19:36:23.431264 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 19:36:23.431264 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 19:36:23.431264 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 19:36:23.433163 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 19:36:23.433163 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 19:36:23.433163 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 19:36:23.433163 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 19:36:23.433163 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:36:23.433163 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:36:23.433163 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:36:23.433163 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:36:23.433163 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:36:23.433163 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:36:23.433163 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:36:23.433163 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application with Lock( Sep 13 19:36:23.433163 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:36:23.433163 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:36:23.433163 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:36:23.433163 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:36:23.435196 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:36:23.435196 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:36:23.435196 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:36:23.435196 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:36:23.435196 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 19:36:23.435196 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 19:36:23.435196 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 19:36:23.435196 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 19:36:23.435196 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 19:36:23.435196 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 19:36:23.435196 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 13 19:36:23.435196 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application Sep 13 19:36:23.435196 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 325/668] 10.222.0.25 () {56 vars in 1102 bytes} [Tue Sep 13 19:36:23 2022] GET /identity/v3/roles/service => generated 85 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:36:23.435196 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7852289e-ee7a-4684-8e99-b80d5cdf92b7 None admin] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:36:23.516305 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG dbcounter [-] [87934] Writing DB stats keystone:SELECT=100 {{(pid=87934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:36:23.542634 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88500dcb-2f51-4205-893e-f511bae46113 None admin] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:36:23.546410 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7852289e-ee7a-4684-8e99-b80d5cdf92b7 None admin] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:36:23.590151 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6c5a66-281e-4fae-9f3b-37fa04ec7748 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:36:23.590784 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6c5a66-281e-4fae-9f3b-37fa04ec7748 None admin] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:36:23.591065 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6c5a66-281e-4fae-9f3b-37fa04ec7748 None admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:36:23.591338 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6c5a66-281e-4fae-9f3b-37fa04ec7748 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:36:23.595697 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846c656a-015c-460a-8476-7ac1e3f68de9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:36:23.596251 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846c656a-015c-460a-8476-7ac1e3f68de9 None admin] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:36:23.596532 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846c656a-015c-460a-8476-7ac1e3f68de9 None admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:36:23.596785 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846c656a-015c-460a-8476-7ac1e3f68de9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:36:23.599320 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c6c5a66-281e-4fae-9f3b-37fa04ec7748 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:36:23.601179 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c6c5a66-281e-4fae-9f3b-37fa04ec7748 None admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:36:23.608183 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-846c656a-015c-460a-8476-7ac1e3f68de9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:36:23.609781 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-846c656a-015c-460a-8476-7ac1e3f68de9 None admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:36:23.613136 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application [None req-3c6c5a66-281e-4fae-9f3b-37fa04ec7748 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 19:36:23.613136 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:36:23.613136 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:36:23.613136 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:36:23.613136 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:36:23.613136 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:36:23.613136 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:36:23.613136 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:36:23.613136 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:36:23.613136 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:36:23.613136 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:36:23.613136 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:36:23.613136 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 13 19:36:23.613136 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 13 19:36:23.613136 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 13 19:36:23.614534 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 13 19:36:23.614534 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:36:23.614534 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:36:23.614534 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:36:23.614534 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:36:23.614534 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:36:23.614534 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:36:23.614534 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:36:23.614534 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application with Lock( Sep 13 19:36:23.614534 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:36:23.614534 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:36:23.614534 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:36:23.614534 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:36:23.614534 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:36:23.614534 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:36:23.614534 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:36:23.614534 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:36:23.620420 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 13 19:36:23.620420 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 13 19:36:23.620420 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 13 19:36:23.620420 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 13 19:36:23.620420 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 13 19:36:23.620420 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 13 19:36:23.620420 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 19:36:23.620420 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application Sep 13 19:36:23.620420 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 344/669] 10.222.0.25 () {56 vars in 1111 bytes} [Tue Sep 13 19:36:23 2022] GET /identity/v3/projects/service => generated 88 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:36:23.620420 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6c5a66-281e-4fae-9f3b-37fa04ec7748 None admin] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:36:23.635959 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application [None req-846c656a-015c-460a-8476-7ac1e3f68de9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 19:36:23.635959 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:36:23.635959 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:36:23.635959 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:36:23.635959 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:36:23.635959 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:36:23.635959 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:36:23.635959 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:36:23.635959 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:36:23.635959 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:36:23.635959 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:36:23.635959 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:36:23.635959 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 19:36:23.635959 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 19:36:23.635959 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 19:36:23.635959 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 19:36:23.637389 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:36:23.637389 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:36:23.637389 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:36:23.637389 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:36:23.637389 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:36:23.637389 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:36:23.637389 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:36:23.637389 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application with Lock( Sep 13 19:36:23.637389 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:36:23.637389 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:36:23.637389 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:36:23.637389 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:36:23.637389 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:36:23.637389 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:36:23.637389 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:36:23.637389 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:36:23.637389 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 19:36:23.638516 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 19:36:23.638516 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 19:36:23.638516 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application Sep 13 19:36:23.643851 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 326/670] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Sep 13 19:36:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:36:23.644752 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846c656a-015c-460a-8476-7ac1e3f68de9 None admin] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:36:23.711080 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG dbcounter [-] [87935] Writing DB stats keystone:SELECT=100 {{(pid=87935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:36:23.747877 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6c5a66-281e-4fae-9f3b-37fa04ec7748 None admin] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:36:23.790042 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846c656a-015c-460a-8476-7ac1e3f68de9 None admin] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:36:23.790280 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205c1a96-859a-4ea2-9d6d-59679c3064b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:36:23.790893 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205c1a96-859a-4ea2-9d6d-59679c3064b0 None admin] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:36:23.791173 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205c1a96-859a-4ea2-9d6d-59679c3064b0 None admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:36:23.791453 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205c1a96-859a-4ea2-9d6d-59679c3064b0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:36:23.794788 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG dbcounter [-] [87934] Writing DB stats keystone:SELECT=100 {{(pid=87934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:36:23.800412 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-205c1a96-859a-4ea2-9d6d-59679c3064b0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:36:23.802809 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-205c1a96-859a-4ea2-9d6d-59679c3064b0 None admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:36:23.815197 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application [None req-205c1a96-859a-4ea2-9d6d-59679c3064b0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 19:36:23.815197 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:36:23.815197 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:36:23.815197 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:36:23.815197 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:36:23.815197 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:36:23.815197 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:36:23.815197 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:36:23.815197 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:36:23.815197 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:36:23.815197 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:36:23.815197 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:36:23.815197 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 13 19:36:23.815197 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 13 19:36:23.815197 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 13 19:36:23.816388 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 13 19:36:23.816388 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:36:23.816388 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:36:23.816388 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:36:23.816388 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:36:23.816388 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:36:23.816388 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:36:23.816388 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:36:23.816388 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application with Lock( Sep 13 19:36:23.816388 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:36:23.816388 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:36:23.816388 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:36:23.816388 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:36:23.816388 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:36:23.816388 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:36:23.816388 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:36:23.816388 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:36:23.818069 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 13 19:36:23.818069 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 13 19:36:23.818069 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 13 19:36:23.818069 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 13 19:36:23.818069 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 13 19:36:23.818069 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 13 19:36:23.818069 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 19:36:23.818069 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application Sep 13 19:36:23.818069 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 345/671] 10.222.0.25 () {56 vars in 1111 bytes} [Tue Sep 13 19:36:23 2022] GET /identity/v3/projects/service => generated 88 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:36:23.818069 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205c1a96-859a-4ea2-9d6d-59679c3064b0 None admin] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:36:23.833925 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e525ce-34ed-471f-9ceb-7726d3c3fc2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:36:23.834530 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e525ce-34ed-471f-9ceb-7726d3c3fc2b None admin] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:36:23.834802 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e525ce-34ed-471f-9ceb-7726d3c3fc2b None admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:36:23.835064 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e525ce-34ed-471f-9ceb-7726d3c3fc2b None admin] PATH_INFO: `/v3/roles` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:36:23.835721 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e525ce-34ed-471f-9ceb-7726d3c3fc2b None admin] RBAC: Adding query filter params (name=service) {{(pid=87935) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:36:23.836014 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e525ce-34ed-471f-9ceb-7726d3c3fc2b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:36:23.837425 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e525ce-34ed-471f-9ceb-7726d3c3fc2b None admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:36:23.846045 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 327/672] 10.222.0.25 () {56 vars in 1103 bytes} [Tue Sep 13 19:36:23 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:36:23.846875 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e525ce-34ed-471f-9ceb-7726d3c3fc2b None admin] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:36:23.947055 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205c1a96-859a-4ea2-9d6d-59679c3064b0 None admin] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:36:23.978690 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e525ce-34ed-471f-9ceb-7726d3c3fc2b None admin] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:36:23.980506 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG dbcounter [-] [87935] Writing DB stats keystone:SELECT=100 {{(pid=87935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:36:23.986727 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fee3188-4c30-49e4-9cb2-98f750dd0d48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:36:23.987354 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fee3188-4c30-49e4-9cb2-98f750dd0d48 None admin] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:36:23.987634 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fee3188-4c30-49e4-9cb2-98f750dd0d48 None admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:36:23.987906 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fee3188-4c30-49e4-9cb2-98f750dd0d48 None admin] PATH_INFO: `/v3/projects` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:36:23.988731 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fee3188-4c30-49e4-9cb2-98f750dd0d48 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87934) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:36:23.989659 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fee3188-4c30-49e4-9cb2-98f750dd0d48 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:36:23.991157 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fee3188-4c30-49e4-9cb2-98f750dd0d48 None admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:36:24.011684 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 346/673] 10.222.0.25 () {56 vars in 1148 bytes} [Tue Sep 13 19:36:23 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:36:24.011684 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fee3188-4c30-49e4-9cb2-98f750dd0d48 None admin] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:36:24.024132 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe48f6f-8b25-4d7d-955c-43f424e6b488 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:36:24.024823 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe48f6f-8b25-4d7d-955c-43f424e6b488 None admin] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:36:24.025107 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe48f6f-8b25-4d7d-955c-43f424e6b488 None admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:36:24.025377 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe48f6f-8b25-4d7d-955c-43f424e6b488 None admin] PATH_INFO: `/v3/domains` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:36:24.026039 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe48f6f-8b25-4d7d-955c-43f424e6b488 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87935) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:36:24.026343 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe48f6f-8b25-4d7d-955c-43f424e6b488 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:36:24.027759 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe48f6f-8b25-4d7d-955c-43f424e6b488 None admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:36:24.040984 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 328/674] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Sep 13 19:36:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:36:24.041836 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe48f6f-8b25-4d7d-955c-43f424e6b488 None admin] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:36:24.081145 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG dbcounter [-] [87934] Writing DB stats keystone:SELECT=100 {{(pid=87934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:36:24.133439 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fee3188-4c30-49e4-9cb2-98f750dd0d48 None admin] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:36:24.167358 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe48f6f-8b25-4d7d-955c-43f424e6b488 None admin] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:36:24.173786 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88873c97-3198-4f95-bec7-1ecdbd88c778 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:36:24.174398 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88873c97-3198-4f95-bec7-1ecdbd88c778 None admin] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:36:24.174677 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88873c97-3198-4f95-bec7-1ecdbd88c778 None admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:36:24.174954 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88873c97-3198-4f95-bec7-1ecdbd88c778 None admin] PATH_INFO: `/v3/projects` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:36:24.175712 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88873c97-3198-4f95-bec7-1ecdbd88c778 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87934) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:36:24.175955 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88873c97-3198-4f95-bec7-1ecdbd88c778 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:36:24.177668 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88873c97-3198-4f95-bec7-1ecdbd88c778 None admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:36:24.190095 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 347/675] 10.222.0.25 () {56 vars in 1148 bytes} [Tue Sep 13 19:36:24 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:36:24.191129 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88873c97-3198-4f95-bec7-1ecdbd88c778 None admin] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:36:24.210423 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2afd19-a23c-484f-b43d-b9988719fba1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:36:24.211056 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2afd19-a23c-484f-b43d-b9988719fba1 None admin] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:36:24.211338 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2afd19-a23c-484f-b43d-b9988719fba1 None admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:36:24.211604 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2afd19-a23c-484f-b43d-b9988719fba1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:36:24.221948 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb2afd19-a23c-484f-b43d-b9988719fba1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:36:24.223458 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb2afd19-a23c-484f-b43d-b9988719fba1 None admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:36:24.240174 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application [None req-fb2afd19-a23c-484f-b43d-b9988719fba1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 19:36:24.240174 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:36:24.240174 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:36:24.240174 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:36:24.240174 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:36:24.240174 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:36:24.240174 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:36:24.240174 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:36:24.240174 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:36:24.240174 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:36:24.240174 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:36:24.240174 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:36:24.240174 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 19:36:24.240174 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 19:36:24.240174 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 19:36:24.240174 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 19:36:24.241397 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:36:24.241397 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:36:24.241397 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:36:24.241397 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:36:24.241397 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:36:24.241397 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:36:24.241397 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:36:24.241397 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application with Lock( Sep 13 19:36:24.241397 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:36:24.241397 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:36:24.241397 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:36:24.241397 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:36:24.241397 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:36:24.241397 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:36:24.241397 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:36:24.241397 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:36:24.241397 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 19:36:24.242344 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 19:36:24.242344 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 19:36:24.242344 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application Sep 13 19:36:24.242344 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 329/676] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Sep 13 19:36:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:36:24.242344 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2afd19-a23c-484f-b43d-b9988719fba1 None admin] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:36:24.260881 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG dbcounter [-] [87935] Writing DB stats keystone:SELECT=100 {{(pid=87935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:36:24.313166 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88873c97-3198-4f95-bec7-1ecdbd88c778 None admin] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:36:24.330811 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG dbcounter [-] [87934] Writing DB stats keystone:SELECT=100 {{(pid=87934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:36:24.354162 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab2f3d6-c199-4984-8399-293152b29390 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:36:24.354772 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab2f3d6-c199-4984-8399-293152b29390 None admin] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:36:24.355050 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab2f3d6-c199-4984-8399-293152b29390 None admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:36:24.355317 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab2f3d6-c199-4984-8399-293152b29390 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:36:24.356042 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab2f3d6-c199-4984-8399-293152b29390 None admin] RBAC: Adding query filter params (role.id=60f5ecbf9ce84814968607f126a85a5a, scope.project.id=9a10a4268f3c4cb29f4e00c292e2df62, user.id=907d44d3b6944ccb83999d8e489871d4) {{(pid=87934) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:36:24.356381 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab2f3d6-c199-4984-8399-293152b29390 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:36:24.357804 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab2f3d6-c199-4984-8399-293152b29390 None admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:36:24.363750 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 348/677] 10.222.0.25 () {56 vars in 1374 bytes} [Tue Sep 13 19:36:24 2022] GET /identity/v3/role_assignments?user.id=907d44d3b6944ccb83999d8e489871d4&scope.project.id=9a10a4268f3c4cb29f4e00c292e2df62&role.id=60f5ecbf9ce84814968607f126a85a5a => generated 608 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:36:24.365611 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643cb603-a4d1-43ed-8b7c-c8e52e483643 None None] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:36:24.365901 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643cb603-a4d1-43ed-8b7c-c8e52e483643 None None] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:36:24.366171 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643cb603-a4d1-43ed-8b7c-c8e52e483643 None None] PATH_INFO: `/` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:36:24.367753 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 349/678] 10.222.0.25 () {54 vars in 927 bytes} [Tue Sep 13 19:36:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:36:24.368548 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643cb603-a4d1-43ed-8b7c-c8e52e483643 None None] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:36:24.377769 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2afd19-a23c-484f-b43d-b9988719fba1 None admin] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:36:24.431540 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a946ed37-bcc1-4c73-a599-5533db84b348 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:36:24.432329 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a946ed37-bcc1-4c73-a599-5533db84b348 None admin] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:36:24.432608 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a946ed37-bcc1-4c73-a599-5533db84b348 None admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:36:24.432873 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a946ed37-bcc1-4c73-a599-5533db84b348 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:36:24.440612 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a946ed37-bcc1-4c73-a599-5533db84b348 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:36:24.442660 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a946ed37-bcc1-4c73-a599-5533db84b348 None admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:36:24.455240 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application [None req-a946ed37-bcc1-4c73-a599-5533db84b348 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 19:36:24.455240 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:36:24.455240 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:36:24.455240 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:36:24.455240 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:36:24.455240 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:36:24.455240 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:36:24.455240 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:36:24.455240 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:36:24.455240 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:36:24.455240 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:36:24.455240 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:36:24.455240 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 13 19:36:24.455240 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 13 19:36:24.455240 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 13 19:36:24.456260 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 13 19:36:24.456260 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:36:24.456260 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:36:24.456260 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:36:24.456260 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:36:24.456260 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:36:24.456260 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:36:24.456260 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:36:24.456260 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application with Lock( Sep 13 19:36:24.456260 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:36:24.456260 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:36:24.456260 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:36:24.456260 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:36:24.456260 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:36:24.456260 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:36:24.456260 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:36:24.456260 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:36:24.457460 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 13 19:36:24.457460 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 13 19:36:24.457460 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 13 19:36:24.457460 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 13 19:36:24.457460 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 13 19:36:24.457460 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 13 19:36:24.457460 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 19:36:24.457460 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application Sep 13 19:36:24.457460 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 330/679] 10.222.0.25 () {56 vars in 1111 bytes} [Tue Sep 13 19:36:24 2022] GET /identity/v3/projects/service => generated 88 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:36:24.457460 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a946ed37-bcc1-4c73-a599-5533db84b348 None admin] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:36:24.537785 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643cb603-a4d1-43ed-8b7c-c8e52e483643 None None] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:36:24.563053 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG dbcounter [-] [87935] Writing DB stats keystone:SELECT=100 {{(pid=87935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:36:24.587829 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ec0e8e-907c-4c20-b3b2-88caf88f26bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:36:24.588895 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ec0e8e-907c-4c20-b3b2-88caf88f26bd None admin] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:36:24.589529 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ec0e8e-907c-4c20-b3b2-88caf88f26bd None admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:36:24.589529 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ec0e8e-907c-4c20-b3b2-88caf88f26bd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:36:24.590176 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ec0e8e-907c-4c20-b3b2-88caf88f26bd None admin] RBAC: Adding query filter params (role.id=60f5ecbf9ce84814968607f126a85a5a, scope.project.id=9a10a4268f3c4cb29f4e00c292e2df62, user.id=4cbb50c88b794a7f9f26844effde7d63) {{(pid=87934) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:36:24.590488 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ec0e8e-907c-4c20-b3b2-88caf88f26bd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:36:24.591973 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ec0e8e-907c-4c20-b3b2-88caf88f26bd None admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:36:24.598771 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 350/680] 10.222.0.25 () {56 vars in 1374 bytes} [Tue Sep 13 19:36:24 2022] GET /identity/v3/role_assignments?user.id=4cbb50c88b794a7f9f26844effde7d63&scope.project.id=9a10a4268f3c4cb29f4e00c292e2df62&role.id=60f5ecbf9ce84814968607f126a85a5a => generated 608 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:36:24.599013 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a946ed37-bcc1-4c73-a599-5533db84b348 None admin] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:36:24.599765 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299a84fc-9618-47ad-9079-4810806fcf6a None None] REQUEST_METHOD: `POST` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:36:24.600055 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299a84fc-9618-47ad-9079-4810806fcf6a None None] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:36:24.600367 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299a84fc-9618-47ad-9079-4810806fcf6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:36:24.621535 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.auth.core [None req-299a84fc-9618-47ad-9079-4810806fcf6a None None] MFA Rules not processed for user `7b0aed92d02344acb92a0e4aa67c3068`. Rule list: `[]` (Enabled: `True`). {{(pid=87934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:36:24.623029 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.fernet_utils [None req-299a84fc-9618-47ad-9079-4810806fcf6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:36:24.670082 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d74747-b829-4f64-992c-8326a5961dff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:36:24.670721 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d74747-b829-4f64-992c-8326a5961dff None admin] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:36:24.671063 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d74747-b829-4f64-992c-8326a5961dff None admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:36:24.671347 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d74747-b829-4f64-992c-8326a5961dff None admin] PATH_INFO: `/v3/domains` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:36:24.672015 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d74747-b829-4f64-992c-8326a5961dff None admin] RBAC: Adding query filter params (name=Default) {{(pid=87935) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:36:24.673275 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d74747-b829-4f64-992c-8326a5961dff None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:36:24.675489 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d74747-b829-4f64-992c-8326a5961dff None admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:36:24.682598 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG dbcounter [-] [87934] Writing DB stats keystone:SELECT=100 {{(pid=87934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:36:24.691366 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 331/681] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Sep 13 19:36:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:36:24.697602 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d74747-b829-4f64-992c-8326a5961dff None admin] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:36:24.743318 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 351/682] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Sep 13 19:36:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 19:36:24.743318 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299a84fc-9618-47ad-9079-4810806fcf6a None None] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:36:24.867849 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d74747-b829-4f64-992c-8326a5961dff None admin] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:36:24.904501 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299a84fc-9618-47ad-9079-4810806fcf6a None None] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:36:24.918510 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9ce9fd-9020-4a5a-babd-f418749530b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:36:24.919126 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9ce9fd-9020-4a5a-babd-f418749530b2 None admin] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:36:24.919728 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9ce9fd-9020-4a5a-babd-f418749530b2 None admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:36:24.920066 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9ce9fd-9020-4a5a-babd-f418749530b2 None admin] PATH_INFO: `/v3/projects` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:36:24.921150 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b9ce9fd-9020-4a5a-babd-f418749530b2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87935) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:36:24.921455 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b9ce9fd-9020-4a5a-babd-f418749530b2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:36:24.923577 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b9ce9fd-9020-4a5a-babd-f418749530b2 None admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:36:24.925890 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG dbcounter [-] [87935] Writing DB stats keystone:SELECT=100 {{(pid=87935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:36:24.947081 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 332/683] 10.222.0.25 () {56 vars in 1148 bytes} [Tue Sep 13 19:36:24 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:36:24.953458 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9ce9fd-9020-4a5a-babd-f418749530b2 None admin] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:36:24.966003 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7465cb4a-e203-4a84-ae2e-eb0719cbc992 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:36:24.967230 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7465cb4a-e203-4a84-ae2e-eb0719cbc992 None admin] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:36:24.967732 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7465cb4a-e203-4a84-ae2e-eb0719cbc992 None admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:36:24.968202 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7465cb4a-e203-4a84-ae2e-eb0719cbc992 None admin] PATH_INFO: `/v3/users/swift` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:36:24.978775 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7465cb4a-e203-4a84-ae2e-eb0719cbc992 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:36:24.980857 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7465cb4a-e203-4a84-ae2e-eb0719cbc992 None admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:36:24.995279 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application [None req-7465cb4a-e203-4a84-ae2e-eb0719cbc992 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 13 19:36:24.995279 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:36:24.995279 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:36:24.995279 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:36:24.995279 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:36:24.995279 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:36:24.995279 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:36:24.995279 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:36:24.995279 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:36:24.995279 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:36:24.995279 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:36:24.995279 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:36:24.995279 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 13 19:36:24.995279 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 13 19:36:24.995279 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 13 19:36:24.995279 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 13 19:36:24.996643 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:36:24.996643 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:36:24.996643 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 13 19:36:24.996643 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 19:36:24.996643 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 13 19:36:24.996643 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 19:36:24.996643 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:36:24.996643 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:36:24.996643 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:36:24.996643 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:36:24.996643 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:36:24.996643 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application with Lock( Sep 13 19:36:24.996643 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:36:24.996643 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:36:24.996643 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:36:24.996643 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:36:24.996643 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:36:24.996643 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:36:24.997676 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:36:24.997676 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:36:24.997676 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 13 19:36:24.997676 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 13 19:36:24.997676 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 13 19:36:24.997676 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 13 19:36:24.997676 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 13 19:36:24.997676 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 13 19:36:24.997676 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 13 19:36:24.997676 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application Sep 13 19:36:25.000328 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 352/684] 10.222.0.25 () {56 vars in 1096 bytes} [Tue Sep 13 19:36:24 2022] GET /identity/v3/users/swift => generated 83 bytes in 262 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:36:25.006969 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7465cb4a-e203-4a84-ae2e-eb0719cbc992 None admin] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:36:25.084832 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG dbcounter [-] [87934] Writing DB stats keystone:SELECT=100 {{(pid=87934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:36:25.115891 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9ce9fd-9020-4a5a-babd-f418749530b2 None admin] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:36:25.159602 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7465cb4a-e203-4a84-ae2e-eb0719cbc992 None admin] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:36:25.160649 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99dacb13-e4f5-464f-b917-12ea63a16410 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:36:25.161733 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99dacb13-e4f5-464f-b917-12ea63a16410 None admin] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:36:25.162007 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99dacb13-e4f5-464f-b917-12ea63a16410 None admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:36:25.162279 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99dacb13-e4f5-464f-b917-12ea63a16410 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:36:25.163228 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99dacb13-e4f5-464f-b917-12ea63a16410 None admin] RBAC: Adding query filter params (role.id=60f5ecbf9ce84814968607f126a85a5a, scope.project.id=9a10a4268f3c4cb29f4e00c292e2df62, user.id=1196a96e4a404f559600b69f929ea9da) {{(pid=87935) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:36:25.163539 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99dacb13-e4f5-464f-b917-12ea63a16410 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:36:25.165937 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99dacb13-e4f5-464f-b917-12ea63a16410 None admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:36:25.173962 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 333/685] 10.222.0.25 () {56 vars in 1374 bytes} [Tue Sep 13 19:36:24 2022] GET /identity/v3/role_assignments?user.id=1196a96e4a404f559600b69f929ea9da&scope.project.id=9a10a4268f3c4cb29f4e00c292e2df62&role.id=60f5ecbf9ce84814968607f126a85a5a => generated 608 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:36:25.175170 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99dacb13-e4f5-464f-b917-12ea63a16410 None admin] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:36:25.205040 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d470fadb-4f51-4978-9ab8-7b6c4937ce96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:36:25.206260 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d470fadb-4f51-4978-9ab8-7b6c4937ce96 None admin] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:36:25.206787 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d470fadb-4f51-4978-9ab8-7b6c4937ce96 None admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:36:25.208055 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d470fadb-4f51-4978-9ab8-7b6c4937ce96 None admin] PATH_INFO: `/v3/users` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:36:25.209452 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d470fadb-4f51-4978-9ab8-7b6c4937ce96 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=87934) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:36:25.210181 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d470fadb-4f51-4978-9ab8-7b6c4937ce96 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:36:25.212068 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d470fadb-4f51-4978-9ab8-7b6c4937ce96 None admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:36:25.239904 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 353/686] 10.222.0.25 () {56 vars in 1135 bytes} [Tue Sep 13 19:36:25 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:36:25.249996 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d470fadb-4f51-4978-9ab8-7b6c4937ce96 None admin] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:36:25.268682 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG dbcounter [-] [87935] Writing DB stats keystone:SELECT=100 {{(pid=87935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:36:25.337620 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99dacb13-e4f5-464f-b917-12ea63a16410 None admin] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:36:25.390605 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e18879a-ffb9-4b69-a758-880111b63295 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:36:25.409107 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e18879a-ffb9-4b69-a758-880111b63295 None admin] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:36:25.409726 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e18879a-ffb9-4b69-a758-880111b63295 None admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:36:25.410174 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e18879a-ffb9-4b69-a758-880111b63295 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:36:25.419298 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG dbcounter [-] [87934] Writing DB stats keystone:SELECT=100 {{(pid=87934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:36:25.432368 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d470fadb-4f51-4978-9ab8-7b6c4937ce96 None admin] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:36:25.446137 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e18879a-ffb9-4b69-a758-880111b63295 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 19:36:25.451637 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application [None req-0e18879a-ffb9-4b69-a758-880111b63295 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 19:36:25.451637 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:36:25.451637 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:36:25.451637 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:36:25.451637 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:36:25.451637 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:36:25.451637 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:36:25.451637 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:36:25.451637 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:36:25.451637 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:36:25.451637 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:36:25.451637 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:36:25.451637 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 19:36:25.451637 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 19:36:25.451637 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 19:36:25.451637 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 19:36:25.452671 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 19:36:25.452671 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 19:36:25.452671 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 19:36:25.452671 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 19:36:25.452671 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:36:25.452671 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:36:25.452671 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:36:25.452671 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:36:25.452671 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:36:25.452671 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:36:25.452671 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:36:25.452671 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application with Lock( Sep 13 19:36:25.452671 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:36:25.452671 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:36:25.452671 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:36:25.452671 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:36:25.453516 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:36:25.453516 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:36:25.453516 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:36:25.453516 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:36:25.453516 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 19:36:25.453516 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 19:36:25.453516 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 19:36:25.453516 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 19:36:25.453516 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 19:36:25.453516 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 19:36:25.453516 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 19:36:25.453516 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application Sep 13 19:36:25.461341 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 334/687] 10.222.0.25 () {56 vars in 1096 bytes} [Tue Sep 13 19:36:25 2022] GET /identity/v3/roles/admin => generated 83 bytes in 286 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:36:25.468732 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e18879a-ffb9-4b69-a758-880111b63295 None admin] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:36:25.483026 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d085fec-caa4-4520-8c61-13f9349dd0b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:36:25.484026 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d085fec-caa4-4520-8c61-13f9349dd0b3 None admin] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:36:25.484559 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d085fec-caa4-4520-8c61-13f9349dd0b3 None admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:36:25.485055 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d085fec-caa4-4520-8c61-13f9349dd0b3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:36:25.559397 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d085fec-caa4-4520-8c61-13f9349dd0b3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:36:25.561254 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d085fec-caa4-4520-8c61-13f9349dd0b3 None admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:36:25.626394 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e18879a-ffb9-4b69-a758-880111b63295 None admin] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:36:25.646579 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG dbcounter [-] [87935] Writing DB stats keystone:SELECT=100 {{(pid=87935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:36:25.667352 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b69ccdd-a2a4-4c43-a17d-9792b0911141 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:36:25.668337 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b69ccdd-a2a4-4c43-a17d-9792b0911141 None admin] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:36:25.668825 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b69ccdd-a2a4-4c43-a17d-9792b0911141 None admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:36:25.669775 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b69ccdd-a2a4-4c43-a17d-9792b0911141 None admin] PATH_INFO: `/v3/roles` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:36:25.670765 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b69ccdd-a2a4-4c43-a17d-9792b0911141 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87935) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:36:25.671491 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b69ccdd-a2a4-4c43-a17d-9792b0911141 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:36:25.673216 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b69ccdd-a2a4-4c43-a17d-9792b0911141 None admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:36:25.683548 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 335/688] 10.222.0.25 () {56 vars in 1099 bytes} [Tue Sep 13 19:36:25 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 19:36:25.689577 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b69ccdd-a2a4-4c43-a17d-9792b0911141 None admin] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:36:25.734443 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 354/689] 10.222.0.25 () {58 vars in 1282 bytes} [Tue Sep 13 19:36:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 487 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 13 19:36:25.734928 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG dbcounter [-] [87934] Writing DB stats keystone:SELECT=100 {{(pid=87934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:36:25.745627 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d085fec-caa4-4520-8c61-13f9349dd0b3 None admin] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:36:25.800679 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b69ccdd-a2a4-4c43-a17d-9792b0911141 None admin] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:36:25.837349 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0537f334-81cd-4d25-bb5b-ee6973f6eb96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:36:25.837991 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0537f334-81cd-4d25-bb5b-ee6973f6eb96 None admin] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:36:25.838269 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0537f334-81cd-4d25-bb5b-ee6973f6eb96 None admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:36:25.838542 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0537f334-81cd-4d25-bb5b-ee6973f6eb96 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:36:25.851168 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0537f334-81cd-4d25-bb5b-ee6973f6eb96 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:36:25.852923 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0537f334-81cd-4d25-bb5b-ee6973f6eb96 None admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:36:25.875517 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application [None req-0537f334-81cd-4d25-bb5b-ee6973f6eb96 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 19:36:25.875517 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:36:25.875517 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:36:25.875517 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:36:25.875517 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:36:25.875517 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:36:25.875517 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:36:25.875517 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:36:25.875517 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:36:25.875517 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:36:25.875517 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:36:25.875517 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:36:25.875517 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 19:36:25.875517 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 19:36:25.875517 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 19:36:25.875517 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 19:36:25.876599 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:36:25.876599 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:36:25.876599 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:36:25.876599 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:36:25.876599 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:36:25.876599 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:36:25.876599 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:36:25.876599 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application with Lock( Sep 13 19:36:25.876599 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:36:25.876599 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:36:25.876599 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:36:25.876599 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:36:25.876599 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:36:25.876599 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:36:25.876599 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:36:25.876599 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:36:25.876599 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 19:36:25.877627 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 19:36:25.877627 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 19:36:25.877627 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application Sep 13 19:36:25.877627 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 336/690] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Sep 13 19:36:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 13 19:36:25.882872 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0537f334-81cd-4d25-bb5b-ee6973f6eb96 None admin] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:36:25.921130 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG dbcounter [-] [87935] Writing DB stats keystone:SELECT=100 {{(pid=87935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:36:25.972384 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d085fec-caa4-4520-8c61-13f9349dd0b3 None admin] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:36:26.023401 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9bb2d9-b07c-4101-92b0-9ddfd65cf1e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:36:26.024394 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9bb2d9-b07c-4101-92b0-9ddfd65cf1e6 None admin] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:36:26.024844 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9bb2d9-b07c-4101-92b0-9ddfd65cf1e6 None admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:36:26.025282 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9bb2d9-b07c-4101-92b0-9ddfd65cf1e6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:36:26.046172 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0537f334-81cd-4d25-bb5b-ee6973f6eb96 None admin] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:36:26.070903 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d9bb2d9-b07c-4101-92b0-9ddfd65cf1e6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:36:26.072409 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d9bb2d9-b07c-4101-92b0-9ddfd65cf1e6 None admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:36:26.112000 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application [None req-4d9bb2d9-b07c-4101-92b0-9ddfd65cf1e6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 19:36:26.112000 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:36:26.112000 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:36:26.112000 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:36:26.112000 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:36:26.112000 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:36:26.112000 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:36:26.112000 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:36:26.112000 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:36:26.112000 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:36:26.112000 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:36:26.112000 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:36:26.112000 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 19:36:26.112000 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 19:36:26.112000 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 19:36:26.112000 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 19:36:26.114303 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:36:26.114303 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:36:26.114303 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:36:26.114303 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:36:26.114303 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:36:26.114303 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:36:26.114303 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:36:26.114303 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application with Lock( Sep 13 19:36:26.114303 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:36:26.114303 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:36:26.114303 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:36:26.114303 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:36:26.114303 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:36:26.114303 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:36:26.114303 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:36:26.114303 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:36:26.114303 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 19:36:26.115525 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 19:36:26.115525 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 19:36:26.115525 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application Sep 13 19:36:26.115525 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 355/691] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Sep 13 19:36:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 370 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:36:26.121347 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9bb2d9-b07c-4101-92b0-9ddfd65cf1e6 None admin] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:36:26.125924 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7e04ed-d60d-4cb8-80a5-8dfafdf52458 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:36:26.126538 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7e04ed-d60d-4cb8-80a5-8dfafdf52458 None admin] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:36:26.126866 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7e04ed-d60d-4cb8-80a5-8dfafdf52458 None admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:36:26.127136 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7e04ed-d60d-4cb8-80a5-8dfafdf52458 None admin] PATH_INFO: `/v3/domains` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:36:26.127922 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e7e04ed-d60d-4cb8-80a5-8dfafdf52458 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87935) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:36:26.128234 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e7e04ed-d60d-4cb8-80a5-8dfafdf52458 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:36:26.131337 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e7e04ed-d60d-4cb8-80a5-8dfafdf52458 None admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:36:26.155799 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 337/692] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Sep 13 19:36:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 19:36:26.166493 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7e04ed-d60d-4cb8-80a5-8dfafdf52458 None admin] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:36:26.232778 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG dbcounter [-] [87934] Writing DB stats keystone:SELECT=100 {{(pid=87934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:36:26.351619 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG dbcounter [-] [87935] Writing DB stats keystone:SELECT=100 {{(pid=87935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:36:26.367553 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7e04ed-d60d-4cb8-80a5-8dfafdf52458 None admin] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:36:26.370879 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9bb2d9-b07c-4101-92b0-9ddfd65cf1e6 None admin] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:36:26.436794 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7448738-5cd1-48e4-b229-fe42eb743d91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:36:26.437413 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7448738-5cd1-48e4-b229-fe42eb743d91 None admin] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:36:26.437689 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7448738-5cd1-48e4-b229-fe42eb743d91 None admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:36:26.437960 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7448738-5cd1-48e4-b229-fe42eb743d91 None admin] PATH_INFO: `/v3/domains` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:36:26.438603 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7448738-5cd1-48e4-b229-fe42eb743d91 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87934) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:36:26.438901 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7448738-5cd1-48e4-b229-fe42eb743d91 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:36:26.440272 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7448738-5cd1-48e4-b229-fe42eb743d91 None admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:36:26.443689 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c73adc2-6ce6-4f72-bc43-76c7ce3bf958 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:36:26.444357 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c73adc2-6ce6-4f72-bc43-76c7ce3bf958 None admin] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:36:26.444638 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c73adc2-6ce6-4f72-bc43-76c7ce3bf958 None admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:36:26.444907 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c73adc2-6ce6-4f72-bc43-76c7ce3bf958 None admin] PATH_INFO: `/v3/users/nova` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:36:26.460244 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c73adc2-6ce6-4f72-bc43-76c7ce3bf958 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:36:26.461685 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c73adc2-6ce6-4f72-bc43-76c7ce3bf958 None admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:36:26.469415 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 356/693] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Sep 13 19:36:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 349 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:36:26.474571 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7448738-5cd1-48e4-b229-fe42eb743d91 None admin] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:36:26.483480 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application [None req-7c73adc2-6ce6-4f72-bc43-76c7ce3bf958 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 13 19:36:26.483480 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:36:26.483480 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:36:26.483480 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:36:26.483480 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:36:26.483480 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:36:26.483480 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:36:26.483480 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:36:26.483480 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:36:26.483480 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:36:26.483480 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:36:26.483480 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:36:26.483480 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 13 19:36:26.483480 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 13 19:36:26.483480 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 13 19:36:26.483480 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 13 19:36:26.485084 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:36:26.485084 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:36:26.485084 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 13 19:36:26.485084 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 19:36:26.485084 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 13 19:36:26.485084 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 19:36:26.485084 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:36:26.485084 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:36:26.485084 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:36:26.485084 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:36:26.485084 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:36:26.485084 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application with Lock( Sep 13 19:36:26.485084 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:36:26.485084 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:36:26.485084 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:36:26.485084 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:36:26.485084 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:36:26.485084 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:36:26.486696 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:36:26.486696 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:36:26.486696 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 13 19:36:26.486696 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 13 19:36:26.486696 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 13 19:36:26.486696 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 13 19:36:26.486696 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 13 19:36:26.486696 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 13 19:36:26.486696 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 13 19:36:26.486696 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application Sep 13 19:36:26.490000 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 338/694] 10.222.0.25 () {56 vars in 1093 bytes} [Tue Sep 13 19:36:26 2022] GET /identity/v3/users/nova => generated 82 bytes in 323 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:36:26.497288 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c73adc2-6ce6-4f72-bc43-76c7ce3bf958 None admin] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:36:26.593521 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7448738-5cd1-48e4-b229-fe42eb743d91 None admin] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:36:26.596523 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG dbcounter [-] [87934] Writing DB stats keystone:SELECT=100 {{(pid=87934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:36:26.630980 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddcb5fad-2d8f-48da-beaa-a6d0d48c8fba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:36:26.631626 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcb5fad-2d8f-48da-beaa-a6d0d48c8fba None admin] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:36:26.631902 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcb5fad-2d8f-48da-beaa-a6d0d48c8fba None admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:36:26.632169 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcb5fad-2d8f-48da-beaa-a6d0d48c8fba None admin] PATH_INFO: `/v3/projects/service` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:36:26.640138 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddcb5fad-2d8f-48da-beaa-a6d0d48c8fba None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:36:26.641639 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddcb5fad-2d8f-48da-beaa-a6d0d48c8fba None admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:36:26.655871 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application [None req-ddcb5fad-2d8f-48da-beaa-a6d0d48c8fba None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 19:36:26.655871 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:36:26.655871 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:36:26.655871 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:36:26.655871 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:36:26.655871 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:36:26.655871 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:36:26.655871 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:36:26.655871 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:36:26.655871 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:36:26.655871 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:36:26.655871 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:36:26.655871 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 13 19:36:26.655871 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 13 19:36:26.655871 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 13 19:36:26.658104 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 13 19:36:26.658104 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:36:26.658104 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:36:26.658104 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:36:26.658104 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:36:26.658104 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:36:26.658104 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:36:26.658104 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:36:26.658104 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application with Lock( Sep 13 19:36:26.658104 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:36:26.658104 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:36:26.658104 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:36:26.658104 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:36:26.658104 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:36:26.658104 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:36:26.658104 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:36:26.658104 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:36:26.660400 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 13 19:36:26.660400 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 13 19:36:26.660400 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 13 19:36:26.660400 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 13 19:36:26.660400 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 13 19:36:26.660400 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 13 19:36:26.660400 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 19:36:26.660400 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application Sep 13 19:36:26.660400 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 357/695] 10.222.0.25 () {56 vars in 1111 bytes} [Tue Sep 13 19:36:26 2022] GET /identity/v3/projects/service => generated 88 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:36:26.669443 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddcb5fad-2d8f-48da-beaa-a6d0d48c8fba None admin] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:36:26.711566 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c73adc2-6ce6-4f72-bc43-76c7ce3bf958 None admin] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:36:26.801876 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e0e05c-c19b-4d23-b976-d7876b6c608b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:36:26.802653 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e0e05c-c19b-4d23-b976-d7876b6c608b None admin] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:36:26.805932 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e0e05c-c19b-4d23-b976-d7876b6c608b None admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:36:26.806207 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e0e05c-c19b-4d23-b976-d7876b6c608b None admin] PATH_INFO: `/v3/users` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:36:26.806960 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e0e05c-c19b-4d23-b976-d7876b6c608b None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=87935) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:36:26.807262 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e0e05c-c19b-4d23-b976-d7876b6c608b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:36:26.808753 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e0e05c-c19b-4d23-b976-d7876b6c608b None admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:36:26.815883 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddcb5fad-2d8f-48da-beaa-a6d0d48c8fba None admin] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:36:26.860091 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 339/696] 10.222.0.25 () {56 vars in 1133 bytes} [Tue Sep 13 19:36:26 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 363 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:36:26.866338 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e0e05c-c19b-4d23-b976-d7876b6c608b None admin] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:36:26.891386 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25c5856-cb82-4b7f-bfbb-2de4b5f97388 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:36:26.892439 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25c5856-cb82-4b7f-bfbb-2de4b5f97388 None admin] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:36:26.892927 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25c5856-cb82-4b7f-bfbb-2de4b5f97388 None admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:36:26.893381 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25c5856-cb82-4b7f-bfbb-2de4b5f97388 None admin] PATH_INFO: `/v3/projects` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:36:26.894667 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b25c5856-cb82-4b7f-bfbb-2de4b5f97388 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87934) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:36:26.895737 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b25c5856-cb82-4b7f-bfbb-2de4b5f97388 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:36:26.898381 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b25c5856-cb82-4b7f-bfbb-2de4b5f97388 None admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:36:26.909007 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG dbcounter [-] [87935] Writing DB stats keystone:SELECT=100 {{(pid=87935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:36:26.941469 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 358/697] 10.222.0.25 () {56 vars in 1148 bytes} [Tue Sep 13 19:36:26 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 19:36:26.951858 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25c5856-cb82-4b7f-bfbb-2de4b5f97388 None admin] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:36:27.031367 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG dbcounter [-] [87934] Writing DB stats keystone:SELECT=100 {{(pid=87934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:36:27.131307 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25c5856-cb82-4b7f-bfbb-2de4b5f97388 None admin] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:36:27.174186 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afdc1268-3750-403f-8c82-4684dcfee9c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:36:27.175217 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdc1268-3750-403f-8c82-4684dcfee9c2 None admin] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:36:27.175701 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdc1268-3750-403f-8c82-4684dcfee9c2 None admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:36:27.176171 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdc1268-3750-403f-8c82-4684dcfee9c2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:36:27.177619 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afdc1268-3750-403f-8c82-4684dcfee9c2 None admin] RBAC: Adding query filter params (role.id=60f5ecbf9ce84814968607f126a85a5a, scope.project.id=9a10a4268f3c4cb29f4e00c292e2df62, user.id=fb42d6ac6cdd4d97a80c3ee0c6f8e3f5) {{(pid=87934) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:36:27.178176 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afdc1268-3750-403f-8c82-4684dcfee9c2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:36:27.179924 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afdc1268-3750-403f-8c82-4684dcfee9c2 None admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:36:27.187813 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 359/698] 10.222.0.25 () {56 vars in 1374 bytes} [Tue Sep 13 19:36:26 2022] GET /identity/v3/role_assignments?user.id=fb42d6ac6cdd4d97a80c3ee0c6f8e3f5&scope.project.id=9a10a4268f3c4cb29f4e00c292e2df62&role.id=60f5ecbf9ce84814968607f126a85a5a => generated 608 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:36:27.202892 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e0e05c-c19b-4d23-b976-d7876b6c608b None admin] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:36:27.242432 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d64101-7bff-4d31-a937-60a25166c188 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:36:27.243072 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d64101-7bff-4d31-a937-60a25166c188 None admin] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:36:27.243353 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d64101-7bff-4d31-a937-60a25166c188 None admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:36:27.243624 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d64101-7bff-4d31-a937-60a25166c188 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:36:27.316812 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67cee885-986e-4931-8456-f9d7c47408b6 None None] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:36:27.317666 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67cee885-986e-4931-8456-f9d7c47408b6 None None] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:36:27.317982 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67cee885-986e-4931-8456-f9d7c47408b6 None None] PATH_INFO: `/` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:36:27.319782 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 360/699] 10.222.0.25 () {54 vars in 927 bytes} [Tue Sep 13 19:36:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:36:27.325596 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf1350b-231f-44ba-b5d5-147e77f89a3e None None] REQUEST_METHOD: `POST` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:36:27.326226 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf1350b-231f-44ba-b5d5-147e77f89a3e None None] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:36:27.326700 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf1350b-231f-44ba-b5d5-147e77f89a3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:36:27.346110 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.auth.core [None req-aaf1350b-231f-44ba-b5d5-147e77f89a3e None None] MFA Rules not processed for user `7b0aed92d02344acb92a0e4aa67c3068`. Rule list: `[]` (Enabled: `True`). {{(pid=87934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:36:27.347642 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.fernet_utils [None req-aaf1350b-231f-44ba-b5d5-147e77f89a3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:36:27.377895 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d64101-7bff-4d31-a937-60a25166c188 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:36:27.379456 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d64101-7bff-4d31-a937-60a25166c188 None admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:36:27.404625 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG dbcounter [-] [87935] Writing DB stats keystone:SELECT=100 {{(pid=87935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:36:27.432366 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 361/700] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Sep 13 19:36:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 13 19:36:27.586422 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 340/701] 10.222.0.25 () {58 vars in 1282 bytes} [Tue Sep 13 19:36:26 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 720 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 13 19:36:27.592059 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf1350b-231f-44ba-b5d5-147e77f89a3e None None] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:36:27.628627 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG dbcounter [-] [87934] Writing DB stats keystone:SELECT=100 {{(pid=87934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:36:27.704427 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5ac86b-aa1c-4cc2-8ee9-8bb1293d98ae None None] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:36:27.704620 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5ac86b-aa1c-4cc2-8ee9-8bb1293d98ae None None] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:36:27.704891 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5ac86b-aa1c-4cc2-8ee9-8bb1293d98ae None None] PATH_INFO: `/` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:36:27.706544 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 341/702] 10.222.0.25 () {54 vars in 927 bytes} [Tue Sep 13 19:36:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:36:27.712788 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faaaa104-bb32-4b8e-9e91-7519ff8ff8d7 None None] REQUEST_METHOD: `POST` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:36:27.713409 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faaaa104-bb32-4b8e-9e91-7519ff8ff8d7 None None] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:36:27.713502 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faaaa104-bb32-4b8e-9e91-7519ff8ff8d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:36:27.719279 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf1350b-231f-44ba-b5d5-147e77f89a3e None None] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:36:27.738266 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.auth.core [None req-faaaa104-bb32-4b8e-9e91-7519ff8ff8d7 None None] MFA Rules not processed for user `7b0aed92d02344acb92a0e4aa67c3068`. Rule list: `[]` (Enabled: `True`). {{(pid=87935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:36:27.739786 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.fernet_utils [None req-faaaa104-bb32-4b8e-9e91-7519ff8ff8d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:36:27.765133 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab9ae38-021c-44a6-b061-c41f0dd078fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:36:27.766074 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab9ae38-021c-44a6-b061-c41f0dd078fe None admin] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:36:27.766356 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab9ae38-021c-44a6-b061-c41f0dd078fe None admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:36:27.766631 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab9ae38-021c-44a6-b061-c41f0dd078fe None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:36:27.779538 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab9ae38-021c-44a6-b061-c41f0dd078fe None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:36:27.781032 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab9ae38-021c-44a6-b061-c41f0dd078fe None admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:36:27.797274 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application [None req-3ab9ae38-021c-44a6-b061-c41f0dd078fe None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 19:36:27.797274 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:36:27.797274 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:36:27.797274 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:36:27.797274 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:36:27.797274 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:36:27.797274 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:36:27.797274 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:36:27.797274 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:36:27.797274 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:36:27.797274 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:36:27.797274 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:36:27.797274 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 19:36:27.797274 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 19:36:27.797274 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 19:36:27.797274 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 19:36:27.798385 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:36:27.798385 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:36:27.798385 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:36:27.798385 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:36:27.798385 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:36:27.798385 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:36:27.798385 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:36:27.798385 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application with Lock( Sep 13 19:36:27.798385 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:36:27.798385 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:36:27.798385 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:36:27.798385 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:36:27.798385 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:36:27.798385 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:36:27.798385 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:36:27.798385 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:36:27.798385 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 19:36:27.799318 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 19:36:27.799318 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 19:36:27.799318 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application Sep 13 19:36:27.799318 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 362/703] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Sep 13 19:36:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:36:27.799318 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab9ae38-021c-44a6-b061-c41f0dd078fe None admin] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:36:27.831515 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 342/704] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Sep 13 19:36:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 19:36:27.836753 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faaaa104-bb32-4b8e-9e91-7519ff8ff8d7 None None] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:36:27.925020 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG dbcounter [-] [87934] Writing DB stats keystone:SELECT=100 {{(pid=87934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:36:27.927642 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG dbcounter [-] [87935] Writing DB stats keystone:SELECT=100 {{(pid=87935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:36:27.997892 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab9ae38-021c-44a6-b061-c41f0dd078fe None admin] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:36:28.017133 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faaaa104-bb32-4b8e-9e91-7519ff8ff8d7 None None] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:36:28.071470 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69f7a9a-aaa9-412d-91da-95a74ee32d9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:36:28.072429 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69f7a9a-aaa9-412d-91da-95a74ee32d9c None admin] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:36:28.072709 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69f7a9a-aaa9-412d-91da-95a74ee32d9c None admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:36:28.072978 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69f7a9a-aaa9-412d-91da-95a74ee32d9c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:36:28.079658 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c20ae11-9ded-4d20-a746-81985ddf9029 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:36:28.080294 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c20ae11-9ded-4d20-a746-81985ddf9029 None admin] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:36:28.080576 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c20ae11-9ded-4d20-a746-81985ddf9029 None admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:36:28.080846 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c20ae11-9ded-4d20-a746-81985ddf9029 None admin] PATH_INFO: `/v3/domains` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:36:28.082326 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c20ae11-9ded-4d20-a746-81985ddf9029 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87935) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:36:28.082715 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c20ae11-9ded-4d20-a746-81985ddf9029 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:36:28.084727 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c20ae11-9ded-4d20-a746-81985ddf9029 None admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:36:28.085991 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f69f7a9a-aaa9-412d-91da-95a74ee32d9c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:36:28.088305 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f69f7a9a-aaa9-412d-91da-95a74ee32d9c None admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:36:28.099942 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 343/705] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Sep 13 19:36:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:36:28.101463 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32f4092-e438-428f-ba9a-f966ddea7ec5 None None] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:36:28.101752 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32f4092-e438-428f-ba9a-f966ddea7ec5 None None] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:36:28.102028 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32f4092-e438-428f-ba9a-f966ddea7ec5 None None] PATH_INFO: `/` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:36:28.103641 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 344/706] 10.222.0.25 () {54 vars in 927 bytes} [Tue Sep 13 19:36:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:36:28.104875 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32f4092-e438-428f-ba9a-f966ddea7ec5 None None] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:36:28.109836 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application [None req-f69f7a9a-aaa9-412d-91da-95a74ee32d9c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 19:36:28.109836 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:36:28.109836 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:36:28.109836 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:36:28.109836 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:36:28.109836 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:36:28.109836 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:36:28.109836 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:36:28.109836 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:36:28.109836 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:36:28.109836 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:36:28.109836 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:36:28.109836 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 19:36:28.109836 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 19:36:28.109836 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 19:36:28.109836 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 19:36:28.110856 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:36:28.110856 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:36:28.110856 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:36:28.110856 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:36:28.110856 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:36:28.110856 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:36:28.110856 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:36:28.110856 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application with Lock( Sep 13 19:36:28.110856 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:36:28.110856 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:36:28.110856 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:36:28.110856 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:36:28.110856 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:36:28.110856 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:36:28.110856 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:36:28.110856 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:36:28.110856 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 19:36:28.111814 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 19:36:28.111814 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 19:36:28.111814 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application Sep 13 19:36:28.116563 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 363/707] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Sep 13 19:36:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 312 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:36:28.118023 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1d893d-adf5-4ccc-8974-5e350d536cf8 None None] REQUEST_METHOD: `POST` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:36:28.118299 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1d893d-adf5-4ccc-8974-5e350d536cf8 None None] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:36:28.118568 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1d893d-adf5-4ccc-8974-5e350d536cf8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:36:28.141463 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.auth.core [None req-2e1d893d-adf5-4ccc-8974-5e350d536cf8 None None] MFA Rules not processed for user `7b0aed92d02344acb92a0e4aa67c3068`. Rule list: `[]` (Enabled: `True`). {{(pid=87934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:36:28.142666 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.fernet_utils [None req-2e1d893d-adf5-4ccc-8974-5e350d536cf8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:36:28.220317 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 364/708] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Sep 13 19:36:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 19:36:28.221178 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1d893d-adf5-4ccc-8974-5e350d536cf8 None None] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:36:28.247181 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG dbcounter [-] [87935] Writing DB stats keystone:SELECT=100 {{(pid=87935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:36:28.257287 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32f4092-e438-428f-ba9a-f966ddea7ec5 None None] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:36:28.296363 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG dbcounter [-] [87934] Writing DB stats keystone:SELECT=100 {{(pid=87934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:36:28.317194 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a72fb3-0fa8-4b9e-b88d-a1a1bdbb437a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:36:28.317848 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a72fb3-0fa8-4b9e-b88d-a1a1bdbb437a None admin] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:36:28.318208 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a72fb3-0fa8-4b9e-b88d-a1a1bdbb437a None admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:36:28.318477 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a72fb3-0fa8-4b9e-b88d-a1a1bdbb437a None admin] PATH_INFO: `/v3/projects/service` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:36:28.328982 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a72fb3-0fa8-4b9e-b88d-a1a1bdbb437a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:36:28.330686 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a72fb3-0fa8-4b9e-b88d-a1a1bdbb437a None admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:36:28.349070 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application [None req-57a72fb3-0fa8-4b9e-b88d-a1a1bdbb437a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 19:36:28.349070 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:36:28.349070 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:36:28.349070 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:36:28.349070 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:36:28.349070 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:36:28.349070 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:36:28.349070 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:36:28.349070 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:36:28.349070 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:36:28.349070 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:36:28.349070 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:36:28.349070 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 13 19:36:28.349070 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 13 19:36:28.349070 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 13 19:36:28.350290 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 13 19:36:28.350290 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:36:28.350290 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:36:28.350290 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:36:28.350290 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:36:28.350290 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:36:28.350290 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:36:28.350290 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:36:28.350290 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application with Lock( Sep 13 19:36:28.350290 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:36:28.350290 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:36:28.350290 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:36:28.350290 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:36:28.350290 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:36:28.350290 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:36:28.350290 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:36:28.350290 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:36:28.351199 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 13 19:36:28.351199 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 13 19:36:28.351199 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 13 19:36:28.351199 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 13 19:36:28.351199 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 13 19:36:28.351199 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 13 19:36:28.351199 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 19:36:28.351199 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application Sep 13 19:36:28.355410 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 345/709] 10.222.0.25 () {56 vars in 1111 bytes} [Tue Sep 13 19:36:28 2022] GET /identity/v3/projects/service => generated 88 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 13 19:36:28.356967 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a72fb3-0fa8-4b9e-b88d-a1a1bdbb437a None admin] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:36:28.370817 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1d893d-adf5-4ccc-8974-5e350d536cf8 None None] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:36:28.421297 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac52c3dd-e577-4e93-981e-9e361ec92bd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:36:28.422734 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac52c3dd-e577-4e93-981e-9e361ec92bd6 None admin] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:36:28.423243 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac52c3dd-e577-4e93-981e-9e361ec92bd6 None admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:36:28.423747 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac52c3dd-e577-4e93-981e-9e361ec92bd6 None admin] PATH_INFO: `/v3/domains` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:36:28.425278 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac52c3dd-e577-4e93-981e-9e361ec92bd6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87934) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:36:28.425788 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac52c3dd-e577-4e93-981e-9e361ec92bd6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:36:28.428328 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac52c3dd-e577-4e93-981e-9e361ec92bd6 None admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:36:28.445058 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 365/710] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Sep 13 19:36:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:36:28.446524 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac52c3dd-e577-4e93-981e-9e361ec92bd6 None admin] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:36:28.502458 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a72fb3-0fa8-4b9e-b88d-a1a1bdbb437a None admin] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:36:28.549537 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6984a5d4-5f67-4522-ae14-d9be1566c529 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:36:28.550081 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6984a5d4-5f67-4522-ae14-d9be1566c529 None admin] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:36:28.550356 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6984a5d4-5f67-4522-ae14-d9be1566c529 None admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:36:28.550619 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6984a5d4-5f67-4522-ae14-d9be1566c529 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:36:28.551229 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6984a5d4-5f67-4522-ae14-d9be1566c529 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:36:28.553837 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6984a5d4-5f67-4522-ae14-d9be1566c529 None admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:36:28.570698 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application [None req-6984a5d4-5f67-4522-ae14-d9be1566c529 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 13 19:36:28.570698 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:36:28.570698 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 13 19:36:28.570698 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 13 19:36:28.570698 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 13 19:36:28.570698 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 13 19:36:28.570698 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 13 19:36:28.570698 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 19:36:28.570698 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 13 19:36:28.570698 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application Sep 13 19:36:28.570698 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 13 19:36:28.570698 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application Sep 13 19:36:28.570698 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:36:28.570698 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:36:28.570698 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:36:28.570698 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:36:28.570698 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:36:28.571817 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:36:28.571817 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:36:28.571817 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:36:28.571817 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:36:28.571817 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:36:28.571817 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:36:28.571817 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 13 19:36:28.571817 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 13 19:36:28.571817 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 13 19:36:28.571817 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 13 19:36:28.571817 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:36:28.571817 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:36:28.571817 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:36:28.571817 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:36:28.571817 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:36:28.571817 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:36:28.572755 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:36:28.572755 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application with Lock( Sep 13 19:36:28.572755 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:36:28.572755 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:36:28.572755 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:36:28.572755 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:36:28.572755 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:36:28.572755 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:36:28.572755 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:36:28.572755 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:36:28.572755 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 13 19:36:28.572755 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 19:36:28.572755 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 13 19:36:28.572755 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application Sep 13 19:36:28.572755 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 346/711] 10.222.0.25 () {56 vars in 1129 bytes} [Tue Sep 13 19:36:28 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:36:28.573573 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6984a5d4-5f67-4522-ae14-d9be1566c529 None admin] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:36:28.582024 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac52c3dd-e577-4e93-981e-9e361ec92bd6 None admin] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:36:28.598722 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG dbcounter [-] [87934] Writing DB stats keystone:SELECT=100 {{(pid=87934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:36:28.612446 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG dbcounter [-] [87935] Writing DB stats keystone:SELECT=100 {{(pid=87935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:36:28.630784 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96f9f48-365e-4a7d-ad0c-5b63588db56d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:36:28.631394 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96f9f48-365e-4a7d-ad0c-5b63588db56d None admin] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:36:28.631669 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96f9f48-365e-4a7d-ad0c-5b63588db56d None admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:36:28.631936 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96f9f48-365e-4a7d-ad0c-5b63588db56d None admin] PATH_INFO: `/v3/projects` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:36:28.632665 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b96f9f48-365e-4a7d-ad0c-5b63588db56d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87934) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:36:28.632970 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b96f9f48-365e-4a7d-ad0c-5b63588db56d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:36:28.634415 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b96f9f48-365e-4a7d-ad0c-5b63588db56d None admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:36:28.651912 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 366/712] 10.222.0.25 () {56 vars in 1148 bytes} [Tue Sep 13 19:36:28 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:36:28.651912 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96f9f48-365e-4a7d-ad0c-5b63588db56d None admin] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:36:28.714329 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6984a5d4-5f67-4522-ae14-d9be1566c529 None admin] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:36:28.765360 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269bd93a-348c-4505-87e9-6a66dd82a460 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:36:28.766339 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269bd93a-348c-4505-87e9-6a66dd82a460 None admin] REQUEST_METHOD: `POST` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:36:28.766815 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269bd93a-348c-4505-87e9-6a66dd82a460 None admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:36:28.767270 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269bd93a-348c-4505-87e9-6a66dd82a460 None admin] PATH_INFO: `/v3/users` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:36:28.768426 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-269bd93a-348c-4505-87e9-6a66dd82a460 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:36:28.771577 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-269bd93a-348c-4505-87e9-6a66dd82a460 None admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:36:28.772259 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96f9f48-365e-4a7d-ad0c-5b63588db56d None admin] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:36:28.804329 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 347/713] 10.222.0.25 () {60 vars in 1132 bytes} [Tue Sep 13 19:36:28 2022] POST /identity/v3/users => generated 254 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 19:36:28.804329 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269bd93a-348c-4505-87e9-6a66dd82a460 None admin] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:36:28.824769 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15f9dd5-4be8-4db8-afa2-46b6d9e25d9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:36:28.825502 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15f9dd5-4be8-4db8-afa2-46b6d9e25d9a None admin] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:36:28.825848 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15f9dd5-4be8-4db8-afa2-46b6d9e25d9a None admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:36:28.826187 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15f9dd5-4be8-4db8-afa2-46b6d9e25d9a None admin] PATH_INFO: `/v3/services` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:36:28.826902 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a15f9dd5-4be8-4db8-afa2-46b6d9e25d9a None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=87934) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:36:28.827279 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a15f9dd5-4be8-4db8-afa2-46b6d9e25d9a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:36:28.828945 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a15f9dd5-4be8-4db8-afa2-46b6d9e25d9a None admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:36:28.840549 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 367/714] 10.222.0.25 () {56 vars in 1124 bytes} [Tue Sep 13 19:36:28 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:36:28.841625 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15f9dd5-4be8-4db8-afa2-46b6d9e25d9a None admin] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:36:28.890504 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG dbcounter [-] [87934] Writing DB stats keystone:SELECT=100 {{(pid=87934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:36:28.912079 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG dbcounter [-] [87935] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:36:28.947664 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269bd93a-348c-4505-87e9-6a66dd82a460 None admin] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:36:28.994805 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15f9dd5-4be8-4db8-afa2-46b6d9e25d9a None admin] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:36:29.004826 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b277e6b-daca-4e8b-b279-7b60f6a7111c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:36:29.006400 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b277e6b-daca-4e8b-b279-7b60f6a7111c None admin] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:36:29.006892 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b277e6b-daca-4e8b-b279-7b60f6a7111c None admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:36:29.007614 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b277e6b-daca-4e8b-b279-7b60f6a7111c None admin] PATH_INFO: `/v3/services/network` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:36:29.008819 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b277e6b-daca-4e8b-b279-7b60f6a7111c None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:36:29.010691 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b277e6b-daca-4e8b-b279-7b60f6a7111c None admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:36:29.024735 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application [None req-1b277e6b-daca-4e8b-b279-7b60f6a7111c None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Sep 13 19:36:29.024735 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:36:29.024735 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 13 19:36:29.024735 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 13 19:36:29.024735 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 13 19:36:29.024735 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 13 19:36:29.024735 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 13 19:36:29.024735 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 19:36:29.024735 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 13 19:36:29.024735 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application Sep 13 19:36:29.024735 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 13 19:36:29.024735 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application Sep 13 19:36:29.024735 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:36:29.024735 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:36:29.024735 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:36:29.024735 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:36:29.024735 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:36:29.026979 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:36:29.026979 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:36:29.026979 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:36:29.026979 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:36:29.026979 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:36:29.026979 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:36:29.026979 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 13 19:36:29.026979 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 13 19:36:29.026979 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 13 19:36:29.026979 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 13 19:36:29.026979 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:36:29.026979 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:36:29.026979 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:36:29.026979 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:36:29.026979 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:36:29.026979 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:36:29.028943 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:36:29.028943 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application with Lock( Sep 13 19:36:29.028943 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:36:29.028943 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:36:29.028943 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:36:29.028943 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:36:29.028943 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:36:29.028943 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:36:29.028943 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:36:29.028943 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:36:29.028943 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 13 19:36:29.028943 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 19:36:29.028943 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 13 19:36:29.028943 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application Sep 13 19:36:29.028943 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 348/715] 10.222.0.25 () {56 vars in 1111 bytes} [Tue Sep 13 19:36:28 2022] GET /identity/v3/services/network => generated 88 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:36:29.031000 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b277e6b-daca-4e8b-b279-7b60f6a7111c None admin] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:36:29.050787 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8fec9e-4417-489a-8c94-ff9740d17efd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:36:29.051448 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8fec9e-4417-489a-8c94-ff9740d17efd None admin] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:36:29.051818 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8fec9e-4417-489a-8c94-ff9740d17efd None admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:36:29.052093 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8fec9e-4417-489a-8c94-ff9740d17efd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:36:29.052858 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d8fec9e-4417-489a-8c94-ff9740d17efd None admin] RBAC: Adding query filter params (role.id=6ca1d4427ff64e0a9d25d96cfb1445f6, scope.project.id=9a10a4268f3c4cb29f4e00c292e2df62, user.id=d71fe5a8275f4ea98555afdcefc902a0) {{(pid=87934) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:36:29.053167 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d8fec9e-4417-489a-8c94-ff9740d17efd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:36:29.054669 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d8fec9e-4417-489a-8c94-ff9740d17efd None admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:36:29.061079 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 368/716] 10.222.0.25 () {56 vars in 1374 bytes} [Tue Sep 13 19:36:28 2022] GET /identity/v3/role_assignments?user.id=d71fe5a8275f4ea98555afdcefc902a0&scope.project.id=9a10a4268f3c4cb29f4e00c292e2df62&role.id=6ca1d4427ff64e0a9d25d96cfb1445f6 => generated 259 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:36:29.062768 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8fec9e-4417-489a-8c94-ff9740d17efd None admin] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:36:29.185201 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG dbcounter [-] [87934] Writing DB stats keystone:SELECT=100 {{(pid=87934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:36:29.191341 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8fec9e-4417-489a-8c94-ff9740d17efd None admin] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:36:29.201972 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b277e6b-daca-4e8b-b279-7b60f6a7111c None admin] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:36:29.237082 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5fa810-dce8-4e82-adf7-2eb8b24e705e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:36:29.237732 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5fa810-dce8-4e82-adf7-2eb8b24e705e None admin] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:36:29.238123 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5fa810-dce8-4e82-adf7-2eb8b24e705e None admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:36:29.238735 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5fa810-dce8-4e82-adf7-2eb8b24e705e None admin] PATH_INFO: `/v3/services` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:36:29.239731 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc5fa810-dce8-4e82-adf7-2eb8b24e705e None admin] RBAC: Adding query filter params (name=network) {{(pid=87934) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:36:29.240279 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc5fa810-dce8-4e82-adf7-2eb8b24e705e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:36:29.242242 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc5fa810-dce8-4e82-adf7-2eb8b24e705e None admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:36:29.248456 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 369/717] 10.222.0.25 () {56 vars in 1112 bytes} [Tue Sep 13 19:36:29 2022] GET /identity/v3/services?name=network => generated 124 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:36:29.252477 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb38cd9-dbc2-479a-a6b2-b0ee32fb0ed0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:36:29.253365 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb38cd9-dbc2-479a-a6b2-b0ee32fb0ed0 None admin] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:36:29.253844 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb38cd9-dbc2-479a-a6b2-b0ee32fb0ed0 None admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:36:29.254911 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb38cd9-dbc2-479a-a6b2-b0ee32fb0ed0 None admin] PATH_INFO: `/v3/services` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:36:29.255739 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb38cd9-dbc2-479a-a6b2-b0ee32fb0ed0 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=87935) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:36:29.256241 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb38cd9-dbc2-479a-a6b2-b0ee32fb0ed0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:36:29.258110 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb38cd9-dbc2-479a-a6b2-b0ee32fb0ed0 None admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:36:29.259326 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5fa810-dce8-4e82-adf7-2eb8b24e705e None admin] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:36:29.267273 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 349/718] 10.222.0.25 () {56 vars in 1124 bytes} [Tue Sep 13 19:36:29 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:36:29.423949 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5fa810-dce8-4e82-adf7-2eb8b24e705e None admin] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:36:29.485330 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c322d223-5852-4761-b4e5-c3cb29b512ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:36:29.485954 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c322d223-5852-4761-b4e5-c3cb29b512ba None admin] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:36:29.486234 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c322d223-5852-4761-b4e5-c3cb29b512ba None admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:36:29.486504 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c322d223-5852-4761-b4e5-c3cb29b512ba None admin] PATH_INFO: `/v3/services` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:36:29.487203 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c322d223-5852-4761-b4e5-c3cb29b512ba None admin] RBAC: Adding query filter params (type=network) {{(pid=87934) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:36:29.487447 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c322d223-5852-4761-b4e5-c3cb29b512ba None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:36:29.488928 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c322d223-5852-4761-b4e5-c3cb29b512ba None admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:36:29.497101 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 370/719] 10.222.0.25 () {56 vars in 1112 bytes} [Tue Sep 13 19:36:29 2022] GET /identity/v3/services?type=network => generated 124 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:36:29.936137 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d0e0b7-670a-49bd-9d02-77dfaa6ccda3 None None] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:36:29.936687 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d0e0b7-670a-49bd-9d02-77dfaa6ccda3 None None] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:36:29.936687 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d0e0b7-670a-49bd-9d02-77dfaa6ccda3 None None] PATH_INFO: `/` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:36:29.938259 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 350/720] 10.222.0.25 () {54 vars in 927 bytes} [Tue Sep 13 19:36:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:36:29.944098 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fed8c1-5df6-4f32-be35-6a2272b4e596 None None] REQUEST_METHOD: `POST` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:36:29.944499 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fed8c1-5df6-4f32-be35-6a2272b4e596 None None] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:36:29.944748 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fed8c1-5df6-4f32-be35-6a2272b4e596 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:36:29.973969 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.auth.core [None req-d7fed8c1-5df6-4f32-be35-6a2272b4e596 None None] MFA Rules not processed for user `7b0aed92d02344acb92a0e4aa67c3068`. Rule list: `[]` (Enabled: `True`). {{(pid=87934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:36:29.975403 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.fernet_utils [None req-d7fed8c1-5df6-4f32-be35-6a2272b4e596 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:36:30.008393 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG dbcounter [-] [87934] Writing DB stats keystone:SELECT=100 {{(pid=87934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:36:30.064224 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 371/721] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Sep 13 19:36:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 19:36:30.482183 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d0e0b7-670a-49bd-9d02-77dfaa6ccda3 None None] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:36:30.495372 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG dbcounter [-] [87935] Writing DB stats keystone:SELECT=100 {{(pid=87935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:36:30.633604 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d0e0b7-670a-49bd-9d02-77dfaa6ccda3 None None] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:36:30.678725 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1c6708-1bdf-441c-afb2-7e4df34c1879 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:36:30.679358 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1c6708-1bdf-441c-afb2-7e4df34c1879 None admin] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:36:30.679634 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1c6708-1bdf-441c-afb2-7e4df34c1879 None admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:36:30.679902 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1c6708-1bdf-441c-afb2-7e4df34c1879 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:36:30.691021 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c1c6708-1bdf-441c-afb2-7e4df34c1879 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 19:36:30.696233 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application [None req-1c1c6708-1bdf-441c-afb2-7e4df34c1879 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 19:36:30.696233 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:36:30.696233 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:36:30.696233 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:36:30.696233 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:36:30.696233 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:36:30.696233 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:36:30.696233 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:36:30.696233 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:36:30.696233 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:36:30.696233 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:36:30.696233 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:36:30.696233 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 19:36:30.696233 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 19:36:30.696233 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 19:36:30.696233 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 19:36:30.698435 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 19:36:30.698435 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 19:36:30.698435 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 19:36:30.698435 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 19:36:30.698435 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:36:30.698435 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:36:30.698435 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:36:30.698435 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:36:30.698435 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:36:30.698435 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:36:30.698435 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:36:30.698435 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application with Lock( Sep 13 19:36:30.698435 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:36:30.698435 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:36:30.698435 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:36:30.698435 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:36:30.701801 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:36:30.701801 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:36:30.701801 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:36:30.701801 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:36:30.701801 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 19:36:30.701801 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 19:36:30.701801 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 19:36:30.701801 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 19:36:30.701801 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 19:36:30.701801 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 19:36:30.701801 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 19:36:30.701801 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application Sep 13 19:36:30.701801 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 351/722] 10.222.0.25 () {56 vars in 1096 bytes} [Tue Sep 13 19:36:30 2022] GET /identity/v3/roles/admin => generated 83 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:36:30.709485 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7fed8c1-5df6-4f32-be35-6a2272b4e596 None None] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:36:30.843316 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7fed8c1-5df6-4f32-be35-6a2272b4e596 None None] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:36:30.895996 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a1263f-baa4-4c44-b097-03356723fcb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:36:30.896574 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a1263f-baa4-4c44-b097-03356723fcb0 None admin] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:36:30.896853 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a1263f-baa4-4c44-b097-03356723fcb0 None admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:36:30.897120 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a1263f-baa4-4c44-b097-03356723fcb0 None admin] PATH_INFO: `/v3/roles` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:36:30.897781 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a1263f-baa4-4c44-b097-03356723fcb0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87934) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:36:30.898081 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a1263f-baa4-4c44-b097-03356723fcb0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:36:30.899441 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a1263f-baa4-4c44-b097-03356723fcb0 None admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:36:30.912405 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 372/723] 10.222.0.25 () {56 vars in 1099 bytes} [Tue Sep 13 19:36:30 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:36:30.918129 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1c6708-1bdf-441c-afb2-7e4df34c1879 None admin] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:36:31.007452 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG dbcounter [-] [87935] Writing DB stats keystone:SELECT=100 {{(pid=87935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:36:31.055283 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1c6708-1bdf-441c-afb2-7e4df34c1879 None admin] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:36:31.092698 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ada378-ddd7-4483-86a3-10dac467e68d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:36:31.093677 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ada378-ddd7-4483-86a3-10dac467e68d None admin] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:36:31.094158 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ada378-ddd7-4483-86a3-10dac467e68d None admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:36:31.094624 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ada378-ddd7-4483-86a3-10dac467e68d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:36:31.106149 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ada378-ddd7-4483-86a3-10dac467e68d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:36:31.107927 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ada378-ddd7-4483-86a3-10dac467e68d None admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:36:31.123293 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application [None req-58ada378-ddd7-4483-86a3-10dac467e68d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 19:36:31.123293 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:36:31.123293 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:36:31.123293 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:36:31.123293 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:36:31.123293 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:36:31.123293 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:36:31.123293 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:36:31.123293 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:36:31.123293 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:36:31.123293 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:36:31.123293 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:36:31.123293 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 19:36:31.123293 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 19:36:31.123293 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 19:36:31.123293 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 19:36:31.124381 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:36:31.124381 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:36:31.124381 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:36:31.124381 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:36:31.124381 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:36:31.124381 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:36:31.124381 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:36:31.124381 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application with Lock( Sep 13 19:36:31.124381 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:36:31.124381 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:36:31.124381 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:36:31.124381 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:36:31.124381 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:36:31.124381 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:36:31.124381 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:36:31.124381 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:36:31.124381 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 19:36:31.125309 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 19:36:31.125309 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 19:36:31.125309 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application Sep 13 19:36:31.127419 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 352/724] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Sep 13 19:36:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:36:31.132902 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a1263f-baa4-4c44-b097-03356723fcb0 None admin] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:36:31.170297 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG dbcounter [-] [87934] Writing DB stats keystone:SELECT=100 {{(pid=87934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:36:31.260885 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a1263f-baa4-4c44-b097-03356723fcb0 None admin] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:36:31.310250 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1acff66f-d00e-436b-803b-8759705ad32c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:36:31.310700 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acff66f-d00e-436b-803b-8759705ad32c None admin] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:36:31.310985 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acff66f-d00e-436b-803b-8759705ad32c None admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:36:31.311261 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acff66f-d00e-436b-803b-8759705ad32c None admin] PATH_INFO: `/v3/domains` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:36:31.312200 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1acff66f-d00e-436b-803b-8759705ad32c None admin] RBAC: Adding query filter params (name=Default) {{(pid=87934) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:36:31.312627 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1acff66f-d00e-436b-803b-8759705ad32c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:36:31.314218 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1acff66f-d00e-436b-803b-8759705ad32c None admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:36:31.340903 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 373/725] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Sep 13 19:36:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:36:31.346435 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ada378-ddd7-4483-86a3-10dac467e68d None admin] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:36:31.477713 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ada378-ddd7-4483-86a3-10dac467e68d None admin] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:36:31.498996 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG dbcounter [-] [87935] Writing DB stats keystone:SELECT=100 {{(pid=87935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:36:31.515198 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9734e3f1-1022-4643-8b45-79f1bd965484 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:36:31.516283 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9734e3f1-1022-4643-8b45-79f1bd965484 None admin] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:36:31.516601 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9734e3f1-1022-4643-8b45-79f1bd965484 None admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:36:31.516869 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9734e3f1-1022-4643-8b45-79f1bd965484 None admin] PATH_INFO: `/v3/users/swift` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:36:31.525510 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9734e3f1-1022-4643-8b45-79f1bd965484 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:36:31.526940 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9734e3f1-1022-4643-8b45-79f1bd965484 None admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:36:31.538444 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application [None req-9734e3f1-1022-4643-8b45-79f1bd965484 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 13 19:36:31.538444 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:36:31.538444 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:36:31.538444 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:36:31.538444 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:36:31.538444 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:36:31.538444 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:36:31.538444 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:36:31.538444 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:36:31.538444 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:36:31.538444 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:36:31.538444 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:36:31.538444 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 13 19:36:31.538444 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 13 19:36:31.538444 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 13 19:36:31.538444 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 13 19:36:31.539414 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:36:31.539414 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:36:31.539414 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 13 19:36:31.539414 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 19:36:31.539414 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 13 19:36:31.539414 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 19:36:31.539414 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:36:31.539414 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:36:31.539414 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:36:31.539414 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:36:31.539414 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:36:31.539414 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application with Lock( Sep 13 19:36:31.539414 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:36:31.539414 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:36:31.539414 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:36:31.539414 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:36:31.539414 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:36:31.539414 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:36:31.540414 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:36:31.540414 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:36:31.540414 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 13 19:36:31.540414 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 13 19:36:31.540414 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 13 19:36:31.540414 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 13 19:36:31.540414 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 13 19:36:31.540414 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 13 19:36:31.540414 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 13 19:36:31.540414 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application Sep 13 19:36:31.540414 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 353/726] 10.222.0.25 () {56 vars in 1096 bytes} [Tue Sep 13 19:36:31 2022] GET /identity/v3/users/swift => generated 83 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:36:31.545295 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1acff66f-d00e-436b-803b-8759705ad32c None admin] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:36:31.643548 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG dbcounter [-] [87934] Writing DB stats keystone:SELECT=100 {{(pid=87934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:36:31.674686 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1acff66f-d00e-436b-803b-8759705ad32c None admin] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:36:31.724433 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad82ba3f-b64d-4811-b882-6a2309f09f57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:36:31.725063 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad82ba3f-b64d-4811-b882-6a2309f09f57 None admin] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:36:31.725326 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad82ba3f-b64d-4811-b882-6a2309f09f57 None admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:36:31.725604 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad82ba3f-b64d-4811-b882-6a2309f09f57 None admin] PATH_INFO: `/v3/users` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:36:31.726335 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad82ba3f-b64d-4811-b882-6a2309f09f57 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=87934) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:36:31.726643 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad82ba3f-b64d-4811-b882-6a2309f09f57 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:36:31.728121 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad82ba3f-b64d-4811-b882-6a2309f09f57 None admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:36:31.754929 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 374/727] 10.222.0.25 () {56 vars in 1135 bytes} [Tue Sep 13 19:36:31 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:36:31.760176 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9734e3f1-1022-4643-8b45-79f1bd965484 None admin] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:36:31.896097 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9734e3f1-1022-4643-8b45-79f1bd965484 None admin] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:36:31.931337 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf8d86b-5f39-4821-b478-7b00d8757b0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:36:31.931941 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf8d86b-5f39-4821-b478-7b00d8757b0f None admin] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:36:31.932234 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf8d86b-5f39-4821-b478-7b00d8757b0f None admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:36:31.932509 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf8d86b-5f39-4821-b478-7b00d8757b0f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:36:31.989326 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG dbcounter [-] [87935] Writing DB stats keystone:SELECT=100 {{(pid=87935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:36:32.012997 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf8d86b-5f39-4821-b478-7b00d8757b0f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:36:32.014488 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf8d86b-5f39-4821-b478-7b00d8757b0f None admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:36:32.082818 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54317137-113b-4a63-a0b5-f04e5ff29c48 None None] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:36:32.083287 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54317137-113b-4a63-a0b5-f04e5ff29c48 None None] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:36:32.083563 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54317137-113b-4a63-a0b5-f04e5ff29c48 None None] PATH_INFO: `/` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:36:32.085223 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 375/728] 10.222.0.25 () {54 vars in 927 bytes} [Tue Sep 13 19:36:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:36:32.090047 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae749a8f-5dc3-49d9-bdb6-a2aa350dd87b None None] REQUEST_METHOD: `POST` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:36:32.090331 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae749a8f-5dc3-49d9-bdb6-a2aa350dd87b None None] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:36:32.090606 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae749a8f-5dc3-49d9-bdb6-a2aa350dd87b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:36:32.118135 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.auth.core [None req-ae749a8f-5dc3-49d9-bdb6-a2aa350dd87b None None] MFA Rules not processed for user `7b0aed92d02344acb92a0e4aa67c3068`. Rule list: `[]` (Enabled: `True`). {{(pid=87934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:36:32.119925 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.fernet_utils [None req-ae749a8f-5dc3-49d9-bdb6-a2aa350dd87b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:36:32.123277 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 354/729] 10.222.0.25 () {58 vars in 1282 bytes} [Tue Sep 13 19:36:31 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 363 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 13 19:36:32.124602 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f723c7-d295-4480-bd1a-cd455e5ed5dc None None] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:36:32.124885 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f723c7-d295-4480-bd1a-cd455e5ed5dc None None] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:36:32.125156 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f723c7-d295-4480-bd1a-cd455e5ed5dc None None] PATH_INFO: `/` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:36:32.126743 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 355/730] 10.222.0.25 () {54 vars in 927 bytes} [Tue Sep 13 19:36:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:36:32.132173 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f723c7-d295-4480-bd1a-cd455e5ed5dc None None] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:36:32.198556 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 376/731] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Sep 13 19:36:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 13 19:36:32.199815 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b30810-1f78-4f2f-b5c5-eec5181fccf6 None None] REQUEST_METHOD: `POST` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:36:32.200096 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b30810-1f78-4f2f-b5c5-eec5181fccf6 None None] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:36:32.200395 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b30810-1f78-4f2f-b5c5-eec5181fccf6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:36:32.218619 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.auth.core [None req-22b30810-1f78-4f2f-b5c5-eec5181fccf6 None None] MFA Rules not processed for user `7b0aed92d02344acb92a0e4aa67c3068`. Rule list: `[]` (Enabled: `True`). {{(pid=87934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:36:32.219806 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.fernet_utils [None req-22b30810-1f78-4f2f-b5c5-eec5181fccf6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:36:32.238324 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG dbcounter [-] [87935] Writing DB stats keystone:SELECT=100 {{(pid=87935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:36:32.265220 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f723c7-d295-4480-bd1a-cd455e5ed5dc None None] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:36:32.308570 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c554e7b0-cedd-4e9b-8157-09ea3720d8d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:36:32.309188 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c554e7b0-cedd-4e9b-8157-09ea3720d8d7 None admin] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:36:32.309520 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c554e7b0-cedd-4e9b-8157-09ea3720d8d7 None admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:36:32.309860 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c554e7b0-cedd-4e9b-8157-09ea3720d8d7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:36:32.312422 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG dbcounter [-] [87934] Writing DB stats keystone:SELECT=100 {{(pid=87934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:36:32.321907 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 377/732] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Sep 13 19:36:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 19:36:32.323860 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17bd93fc-36ed-4bea-9900-b215ebbe48be None None] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:36:32.323970 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c554e7b0-cedd-4e9b-8157-09ea3720d8d7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:36:32.324482 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17bd93fc-36ed-4bea-9900-b215ebbe48be None None] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:36:32.324926 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17bd93fc-36ed-4bea-9900-b215ebbe48be None None] PATH_INFO: `/` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:36:32.325732 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c554e7b0-cedd-4e9b-8157-09ea3720d8d7 None admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:36:32.327045 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 378/733] 10.222.0.25 () {54 vars in 927 bytes} [Tue Sep 13 19:36:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:36:32.335500 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd60e78d-bffd-4200-bf6c-7fe24d25bcbb None None] REQUEST_METHOD: `POST` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:36:32.336057 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd60e78d-bffd-4200-bf6c-7fe24d25bcbb None None] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:36:32.336529 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd60e78d-bffd-4200-bf6c-7fe24d25bcbb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:36:32.360252 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application [None req-c554e7b0-cedd-4e9b-8157-09ea3720d8d7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 19:36:32.360252 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:36:32.360252 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:36:32.360252 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:36:32.360252 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:36:32.360252 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:36:32.360252 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:36:32.360252 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:36:32.360252 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:36:32.360252 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:36:32.360252 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:36:32.360252 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:36:32.360252 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 19:36:32.360252 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 19:36:32.360252 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 19:36:32.360252 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 19:36:32.361272 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:36:32.361272 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:36:32.361272 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:36:32.361272 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:36:32.361272 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:36:32.361272 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:36:32.361272 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:36:32.361272 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application with Lock( Sep 13 19:36:32.361272 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:36:32.361272 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:36:32.361272 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:36:32.361272 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:36:32.361272 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:36:32.361272 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:36:32.361272 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:36:32.361272 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:36:32.361272 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 19:36:32.362195 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 19:36:32.362195 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 19:36:32.362195 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application Sep 13 19:36:32.368550 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 356/734] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Sep 13 19:36:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:36:32.370453 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c554e7b0-cedd-4e9b-8157-09ea3720d8d7 None admin] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:36:32.378302 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.auth.core [None req-cd60e78d-bffd-4200-bf6c-7fe24d25bcbb None None] MFA Rules not processed for user `7b0aed92d02344acb92a0e4aa67c3068`. Rule list: `[]` (Enabled: `True`). {{(pid=87934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:36:32.385156 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.fernet_utils [None req-cd60e78d-bffd-4200-bf6c-7fe24d25bcbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:36:32.496966 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c554e7b0-cedd-4e9b-8157-09ea3720d8d7 None admin] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:36:32.497797 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 379/735] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Sep 13 19:36:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 19:36:32.499314 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f328883-2998-48eb-90fd-0afef85976f4 None None] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:36:32.499605 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f328883-2998-48eb-90fd-0afef85976f4 None None] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:36:32.499876 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f328883-2998-48eb-90fd-0afef85976f4 None None] PATH_INFO: `/` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:36:32.505681 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 380/736] 10.222.0.25 () {54 vars in 927 bytes} [Tue Sep 13 19:36:32 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:36:32.506558 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f328883-2998-48eb-90fd-0afef85976f4 None None] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:36:32.528362 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG dbcounter [-] [87935] Writing DB stats keystone:SELECT=100 {{(pid=87935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:36:32.536427 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40206841-c3d3-47d6-b286-082e9968eb91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:36:32.537377 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40206841-c3d3-47d6-b286-082e9968eb91 None admin] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:36:32.537855 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40206841-c3d3-47d6-b286-082e9968eb91 None admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:36:32.538418 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40206841-c3d3-47d6-b286-082e9968eb91 None admin] PATH_INFO: `/v3/domains` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:36:32.539365 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40206841-c3d3-47d6-b286-082e9968eb91 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87935) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:36:32.539864 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40206841-c3d3-47d6-b286-082e9968eb91 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:36:32.541584 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40206841-c3d3-47d6-b286-082e9968eb91 None admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:36:32.559709 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 357/737] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Sep 13 19:36:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:36:32.561153 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c99dc6-2555-456b-9d71-015fb2d68776 None None] REQUEST_METHOD: `POST` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:36:32.561447 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c99dc6-2555-456b-9d71-015fb2d68776 None None] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:36:32.561718 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c99dc6-2555-456b-9d71-015fb2d68776 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:36:32.580712 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.auth.core [None req-c5c99dc6-2555-456b-9d71-015fb2d68776 None None] MFA Rules not processed for user `7b0aed92d02344acb92a0e4aa67c3068`. Rule list: `[]` (Enabled: `True`). {{(pid=87935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:36:32.581915 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.fernet_utils [None req-c5c99dc6-2555-456b-9d71-015fb2d68776 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:36:32.638389 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f328883-2998-48eb-90fd-0afef85976f4 None None] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:36:32.654284 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 358/738] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Sep 13 19:36:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 19:36:32.661317 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c99dc6-2555-456b-9d71-015fb2d68776 None None] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:36:32.672390 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG dbcounter [-] [87934] Writing DB stats keystone:SELECT=100 {{(pid=87934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:36:32.684527 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854b0c51-6e88-456c-a6fe-6b3dab43a3f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:36:32.685158 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854b0c51-6e88-456c-a6fe-6b3dab43a3f9 None admin] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:36:32.685440 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854b0c51-6e88-456c-a6fe-6b3dab43a3f9 None admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:36:32.685713 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854b0c51-6e88-456c-a6fe-6b3dab43a3f9 None admin] PATH_INFO: `/v3/roles/service` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:36:32.698120 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-854b0c51-6e88-456c-a6fe-6b3dab43a3f9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 19:36:32.703625 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application [None req-854b0c51-6e88-456c-a6fe-6b3dab43a3f9 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 13 19:36:32.703625 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:36:32.703625 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:36:32.703625 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:36:32.703625 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:36:32.703625 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:36:32.703625 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:36:32.703625 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:36:32.703625 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:36:32.703625 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:36:32.703625 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:36:32.703625 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:36:32.703625 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 19:36:32.703625 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 19:36:32.703625 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 19:36:32.703625 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 19:36:32.704603 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 19:36:32.704603 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 19:36:32.704603 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 19:36:32.704603 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 19:36:32.704603 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:36:32.704603 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:36:32.704603 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:36:32.704603 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:36:32.704603 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:36:32.704603 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:36:32.704603 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:36:32.704603 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application with Lock( Sep 13 19:36:32.704603 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:36:32.704603 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:36:32.704603 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:36:32.704603 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:36:32.705491 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:36:32.705491 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:36:32.705491 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:36:32.705491 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:36:32.705491 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 19:36:32.705491 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 19:36:32.705491 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 19:36:32.705491 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 19:36:32.705491 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 19:36:32.705491 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 19:36:32.705491 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 13 19:36:32.705491 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application Sep 13 19:36:32.705491 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 381/739] 10.222.0.25 () {56 vars in 1102 bytes} [Tue Sep 13 19:36:32 2022] GET /identity/v3/roles/service => generated 85 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:36:32.706193 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854b0c51-6e88-456c-a6fe-6b3dab43a3f9 None admin] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:36:32.779010 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c99dc6-2555-456b-9d71-015fb2d68776 None None] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:36:32.804171 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG dbcounter [-] [87935] Writing DB stats keystone:SELECT=100 {{(pid=87935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:36:32.817547 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153c5c69-c7d0-40cb-acf7-5f3be05d0d80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:36:32.818183 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153c5c69-c7d0-40cb-acf7-5f3be05d0d80 None admin] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:36:32.818457 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153c5c69-c7d0-40cb-acf7-5f3be05d0d80 None admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:36:32.818725 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153c5c69-c7d0-40cb-acf7-5f3be05d0d80 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:36:32.824301 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854b0c51-6e88-456c-a6fe-6b3dab43a3f9 None admin] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:36:32.825682 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-153c5c69-c7d0-40cb-acf7-5f3be05d0d80 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:36:32.827123 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-153c5c69-c7d0-40cb-acf7-5f3be05d0d80 None admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:36:32.839323 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application [None req-153c5c69-c7d0-40cb-acf7-5f3be05d0d80 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 19:36:32.839323 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:36:32.839323 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:36:32.839323 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:36:32.839323 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:36:32.839323 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:36:32.839323 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:36:32.839323 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:36:32.839323 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:36:32.839323 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:36:32.839323 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:36:32.839323 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:36:32.839323 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 13 19:36:32.839323 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 13 19:36:32.839323 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 13 19:36:32.840276 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 13 19:36:32.840276 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:36:32.840276 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:36:32.840276 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:36:32.840276 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:36:32.840276 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:36:32.840276 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:36:32.840276 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:36:32.840276 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application with Lock( Sep 13 19:36:32.840276 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:36:32.840276 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:36:32.840276 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:36:32.840276 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:36:32.840276 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:36:32.840276 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:36:32.840276 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:36:32.840276 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:36:32.845497 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 13 19:36:32.845497 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 13 19:36:32.845497 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 13 19:36:32.845497 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 13 19:36:32.845497 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 13 19:36:32.845497 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 13 19:36:32.845497 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 19:36:32.845497 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application Sep 13 19:36:32.845497 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 359/740] 10.222.0.25 () {56 vars in 1111 bytes} [Tue Sep 13 19:36:32 2022] GET /identity/v3/projects/service => generated 88 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:36:32.845497 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153c5c69-c7d0-40cb-acf7-5f3be05d0d80 None admin] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:36:32.867683 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55cdbbe3-ef52-488e-9fb8-62e07c2a7f4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:36:32.868353 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55cdbbe3-ef52-488e-9fb8-62e07c2a7f4b None admin] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:36:32.868643 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55cdbbe3-ef52-488e-9fb8-62e07c2a7f4b None admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:36:32.868909 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55cdbbe3-ef52-488e-9fb8-62e07c2a7f4b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:36:32.880005 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55cdbbe3-ef52-488e-9fb8-62e07c2a7f4b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 19:36:32.885002 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application [None req-55cdbbe3-ef52-488e-9fb8-62e07c2a7f4b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 19:36:32.885002 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:36:32.885002 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:36:32.885002 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:36:32.885002 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:36:32.885002 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:36:32.885002 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:36:32.885002 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:36:32.885002 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:36:32.885002 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:36:32.885002 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:36:32.885002 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:36:32.885002 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 19:36:32.885002 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 19:36:32.885002 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 19:36:32.885002 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 19:36:32.885953 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 19:36:32.885953 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 19:36:32.885953 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 19:36:32.885953 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 19:36:32.885953 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:36:32.885953 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:36:32.885953 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:36:32.885953 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:36:32.885953 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:36:32.885953 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:36:32.885953 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:36:32.885953 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application with Lock( Sep 13 19:36:32.885953 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:36:32.885953 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:36:32.885953 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:36:32.885953 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:36:32.886806 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:36:32.886806 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:36:32.886806 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:36:32.886806 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:36:32.886806 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 19:36:32.886806 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 19:36:32.886806 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 19:36:32.886806 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 19:36:32.886806 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 19:36:32.886806 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 19:36:32.886806 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 19:36:32.886806 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application Sep 13 19:36:32.886806 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 382/741] 10.222.0.25 () {56 vars in 1096 bytes} [Tue Sep 13 19:36:32 2022] GET /identity/v3/roles/admin => generated 83 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:36:32.887507 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55cdbbe3-ef52-488e-9fb8-62e07c2a7f4b None admin] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:36:32.943081 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG dbcounter [-] [87934] Writing DB stats keystone:SELECT=100 {{(pid=87934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:36:32.965030 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153c5c69-c7d0-40cb-acf7-5f3be05d0d80 None admin] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:36:33.000238 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da2e8ab-40f0-4cfe-a28c-5010de9cd782 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:36:33.000902 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da2e8ab-40f0-4cfe-a28c-5010de9cd782 None admin] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:36:33.001109 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da2e8ab-40f0-4cfe-a28c-5010de9cd782 None admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:36:33.001375 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da2e8ab-40f0-4cfe-a28c-5010de9cd782 None admin] PATH_INFO: `/v3/roles` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:36:33.002030 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da2e8ab-40f0-4cfe-a28c-5010de9cd782 None admin] RBAC: Adding query filter params (name=service) {{(pid=87935) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:36:33.002325 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da2e8ab-40f0-4cfe-a28c-5010de9cd782 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:36:33.003701 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da2e8ab-40f0-4cfe-a28c-5010de9cd782 None admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:36:33.010421 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55cdbbe3-ef52-488e-9fb8-62e07c2a7f4b None admin] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:36:33.012041 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 360/742] 10.222.0.25 () {56 vars in 1103 bytes} [Tue Sep 13 19:36:32 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:36:33.012934 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da2e8ab-40f0-4cfe-a28c-5010de9cd782 None admin] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:36:33.057364 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4f3bc2-c3e6-40b1-838b-080d4d1e3ad7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:36:33.058245 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4f3bc2-c3e6-40b1-838b-080d4d1e3ad7 None admin] REQUEST_METHOD: `POST` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:36:33.058521 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4f3bc2-c3e6-40b1-838b-080d4d1e3ad7 None admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:36:33.058791 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4f3bc2-c3e6-40b1-838b-080d4d1e3ad7 None admin] PATH_INFO: `/v3/services` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:36:33.059450 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e4f3bc2-c3e6-40b1-838b-080d4d1e3ad7 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:36:33.060859 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e4f3bc2-c3e6-40b1-838b-080d4d1e3ad7 None admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:36:33.070288 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG dbcounter [-] [87935] Writing DB stats keystone:SELECT=100 {{(pid=87935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:36:33.084261 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 383/743] 10.222.0.25 () {60 vars in 1141 bytes} [Tue Sep 13 19:36:32 2022] POST /identity/v3/services => generated 251 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 19:36:33.084261 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4f3bc2-c3e6-40b1-838b-080d4d1e3ad7 None admin] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:36:33.139303 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da2e8ab-40f0-4cfe-a28c-5010de9cd782 None admin] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:36:33.194980 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e232b928-3888-495a-b910-011cc1f912d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:36:33.196500 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e232b928-3888-495a-b910-011cc1f912d4 None admin] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:36:33.196982 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e232b928-3888-495a-b910-011cc1f912d4 None admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:36:33.197448 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e232b928-3888-495a-b910-011cc1f912d4 None admin] PATH_INFO: `/v3/projects` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:36:33.198355 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e232b928-3888-495a-b910-011cc1f912d4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87935) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:36:33.198742 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e232b928-3888-495a-b910-011cc1f912d4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:36:33.200191 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e232b928-3888-495a-b910-011cc1f912d4 None admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:36:33.223873 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 361/744] 10.222.0.25 () {56 vars in 1148 bytes} [Tue Sep 13 19:36:33 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:36:33.224865 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e232b928-3888-495a-b910-011cc1f912d4 None admin] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:36:33.240962 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4f3bc2-c3e6-40b1-838b-080d4d1e3ad7 None admin] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:36:33.252395 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG dbcounter [-] [87934] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:36:33.286391 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0d11fc-3eb6-4029-bd03-6216fbd16f58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:36:33.287279 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0d11fc-3eb6-4029-bd03-6216fbd16f58 None admin] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:36:33.287562 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0d11fc-3eb6-4029-bd03-6216fbd16f58 None admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:36:33.287836 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0d11fc-3eb6-4029-bd03-6216fbd16f58 None admin] PATH_INFO: `/v3/roles` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:36:33.289313 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d0d11fc-3eb6-4029-bd03-6216fbd16f58 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87934) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:36:33.289313 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d0d11fc-3eb6-4029-bd03-6216fbd16f58 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:36:33.290245 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d0d11fc-3eb6-4029-bd03-6216fbd16f58 None admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:36:33.302380 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 384/745] 10.222.0.25 () {56 vars in 1099 bytes} [Tue Sep 13 19:36:33 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:36:33.302797 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0d11fc-3eb6-4029-bd03-6216fbd16f58 None admin] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:36:33.346139 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG dbcounter [-] [87935] Writing DB stats keystone:SELECT=100 {{(pid=87935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:36:33.350248 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e232b928-3888-495a-b910-011cc1f912d4 None admin] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:36:33.393975 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138a744f-8f72-4534-9983-904a99e70751 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:36:33.393975 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138a744f-8f72-4534-9983-904a99e70751 None admin] REQUEST_METHOD: `POST` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:36:33.393975 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138a744f-8f72-4534-9983-904a99e70751 None admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:36:33.393975 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138a744f-8f72-4534-9983-904a99e70751 None admin] PATH_INFO: `/v3/services` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:36:33.394440 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-138a744f-8f72-4534-9983-904a99e70751 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:36:33.397622 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-138a744f-8f72-4534-9983-904a99e70751 None admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:36:33.420290 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 362/746] 10.222.0.25 () {60 vars in 1141 bytes} [Tue Sep 13 19:36:33 2022] POST /identity/v3/services => generated 240 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 19:36:33.420290 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138a744f-8f72-4534-9983-904a99e70751 None admin] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:36:33.431646 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0d11fc-3eb6-4029-bd03-6216fbd16f58 None admin] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:36:33.499136 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1384eec1-8beb-4603-b314-ac48d71adff5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:36:33.499968 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1384eec1-8beb-4603-b314-ac48d71adff5 None admin] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:36:33.500415 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1384eec1-8beb-4603-b314-ac48d71adff5 None admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:36:33.500792 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1384eec1-8beb-4603-b314-ac48d71adff5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:36:33.514229 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1384eec1-8beb-4603-b314-ac48d71adff5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:36:33.516040 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1384eec1-8beb-4603-b314-ac48d71adff5 None admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:36:33.533694 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application [None req-1384eec1-8beb-4603-b314-ac48d71adff5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 19:36:33.533694 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:36:33.533694 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:36:33.533694 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:36:33.533694 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:36:33.533694 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:36:33.533694 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:36:33.533694 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:36:33.533694 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:36:33.533694 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:36:33.533694 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:36:33.533694 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:36:33.533694 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 19:36:33.533694 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 19:36:33.533694 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 19:36:33.533694 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 19:36:33.534963 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:36:33.534963 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:36:33.534963 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:36:33.534963 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:36:33.534963 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:36:33.534963 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:36:33.534963 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:36:33.534963 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application with Lock( Sep 13 19:36:33.534963 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:36:33.534963 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:36:33.534963 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:36:33.534963 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:36:33.534963 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:36:33.534963 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:36:33.534963 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:36:33.534963 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:36:33.534963 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 19:36:33.536236 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 19:36:33.536236 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 19:36:33.536236 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application Sep 13 19:36:33.542626 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 385/747] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Sep 13 19:36:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:36:33.543444 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1384eec1-8beb-4603-b314-ac48d71adff5 None admin] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:36:33.566037 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG dbcounter [-] [87934] Writing DB stats keystone:SELECT=100 {{(pid=87934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:36:33.567432 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138a744f-8f72-4534-9983-904a99e70751 None admin] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:36:33.610909 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b350cbff-e911-450d-a3d0-f75b43c62963 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:36:33.611775 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b350cbff-e911-450d-a3d0-f75b43c62963 None admin] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:36:33.612307 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b350cbff-e911-450d-a3d0-f75b43c62963 None admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:36:33.612763 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b350cbff-e911-450d-a3d0-f75b43c62963 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:36:33.614348 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b350cbff-e911-450d-a3d0-f75b43c62963 None admin] RBAC: Adding query filter params (role.id=6ca1d4427ff64e0a9d25d96cfb1445f6, scope.project.id=9a10a4268f3c4cb29f4e00c292e2df62, user.id=fb42d6ac6cdd4d97a80c3ee0c6f8e3f5) {{(pid=87935) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:36:33.614876 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b350cbff-e911-450d-a3d0-f75b43c62963 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:36:33.616731 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b350cbff-e911-450d-a3d0-f75b43c62963 None admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:36:33.623162 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 363/748] 10.222.0.25 () {56 vars in 1374 bytes} [Tue Sep 13 19:36:33 2022] GET /identity/v3/role_assignments?user.id=fb42d6ac6cdd4d97a80c3ee0c6f8e3f5&scope.project.id=9a10a4268f3c4cb29f4e00c292e2df62&role.id=6ca1d4427ff64e0a9d25d96cfb1445f6 => generated 259 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:36:33.628371 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b350cbff-e911-450d-a3d0-f75b43c62963 None admin] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:36:33.664109 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1384eec1-8beb-4603-b314-ac48d71adff5 None admin] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:36:33.665597 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG dbcounter [-] [87935] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:36:33.737389 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4b84b5-c713-42ee-8a6c-fda96be58b55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:36:33.739369 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4b84b5-c713-42ee-8a6c-fda96be58b55 None admin] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:36:33.741105 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4b84b5-c713-42ee-8a6c-fda96be58b55 None admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:36:33.741771 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4b84b5-c713-42ee-8a6c-fda96be58b55 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:36:33.764509 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a4b84b5-c713-42ee-8a6c-fda96be58b55 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:36:33.767800 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a4b84b5-c713-42ee-8a6c-fda96be58b55 None admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:36:33.803472 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application [None req-2a4b84b5-c713-42ee-8a6c-fda96be58b55 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 19:36:33.803472 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:36:33.803472 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:36:33.803472 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:36:33.803472 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:36:33.803472 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:36:33.803472 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:36:33.803472 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:36:33.803472 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:36:33.803472 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:36:33.803472 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:36:33.803472 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:36:33.803472 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 19:36:33.803472 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 19:36:33.803472 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 19:36:33.803472 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 19:36:33.804550 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:36:33.804550 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:36:33.804550 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:36:33.804550 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:36:33.804550 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:36:33.804550 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:36:33.804550 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:36:33.804550 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application with Lock( Sep 13 19:36:33.804550 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:36:33.804550 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:36:33.804550 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:36:33.804550 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:36:33.804550 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:36:33.804550 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:36:33.804550 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:36:33.804550 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:36:33.804550 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 19:36:33.805465 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 19:36:33.805465 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 19:36:33.805465 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application Sep 13 19:36:33.807397 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 386/749] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Sep 13 19:36:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 265 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:36:33.815531 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4b84b5-c713-42ee-8a6c-fda96be58b55 None admin] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:36:33.841057 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b350cbff-e911-450d-a3d0-f75b43c62963 None admin] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:36:33.888161 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15771940-1f20-4a66-81d5-133b2c0f65b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:36:33.889207 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15771940-1f20-4a66-81d5-133b2c0f65b1 None admin] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:36:33.889689 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15771940-1f20-4a66-81d5-133b2c0f65b1 None admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:36:33.890179 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15771940-1f20-4a66-81d5-133b2c0f65b1 None admin] PATH_INFO: `/v3/domains` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:36:33.890830 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15771940-1f20-4a66-81d5-133b2c0f65b1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87935) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:36:33.891131 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15771940-1f20-4a66-81d5-133b2c0f65b1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:36:33.892528 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15771940-1f20-4a66-81d5-133b2c0f65b1 None admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:36:33.906121 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 364/750] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Sep 13 19:36:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:36:33.911847 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15771940-1f20-4a66-81d5-133b2c0f65b1 None admin] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:36:33.953825 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG dbcounter [-] [87934] Writing DB stats keystone:SELECT=100 {{(pid=87934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:36:34.000229 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG dbcounter [-] [87935] Writing DB stats keystone:SELECT=100 {{(pid=87935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:36:34.020399 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15771940-1f20-4a66-81d5-133b2c0f65b1 None admin] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:36:34.022661 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4b84b5-c713-42ee-8a6c-fda96be58b55 None admin] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:36:34.076298 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f25176-a7f0-430b-a003-414c799059ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:36:34.076984 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f25176-a7f0-430b-a003-414c799059ad None admin] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:36:34.077210 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f25176-a7f0-430b-a003-414c799059ad None admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:36:34.077481 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f25176-a7f0-430b-a003-414c799059ad None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:36:34.090308 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f25176-a7f0-430b-a003-414c799059ad None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:36:34.091755 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f25176-a7f0-430b-a003-414c799059ad None admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:36:34.093352 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d3d829-8df1-48d7-9e96-ceb58ff86910 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:36:34.093969 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d3d829-8df1-48d7-9e96-ceb58ff86910 None admin] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:36:34.094243 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d3d829-8df1-48d7-9e96-ceb58ff86910 None admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:36:34.094508 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d3d829-8df1-48d7-9e96-ceb58ff86910 None admin] PATH_INFO: `/v3/domains` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:36:34.095152 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d3d829-8df1-48d7-9e96-ceb58ff86910 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87934) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:36:34.095452 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d3d829-8df1-48d7-9e96-ceb58ff86910 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:36:34.096828 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d3d829-8df1-48d7-9e96-ceb58ff86910 None admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:36:34.119396 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application [None req-f5f25176-a7f0-430b-a003-414c799059ad None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 13 19:36:34.119396 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:36:34.119396 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:36:34.119396 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:36:34.119396 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:36:34.119396 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:36:34.119396 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:36:34.119396 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:36:34.119396 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:36:34.119396 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:36:34.119396 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:36:34.119396 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:36:34.119396 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 13 19:36:34.119396 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 13 19:36:34.119396 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 13 19:36:34.119396 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 13 19:36:34.120459 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:36:34.120459 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:36:34.120459 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 13 19:36:34.120459 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 19:36:34.120459 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 13 19:36:34.120459 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 19:36:34.120459 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:36:34.120459 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:36:34.120459 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:36:34.120459 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:36:34.120459 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:36:34.120459 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application with Lock( Sep 13 19:36:34.120459 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:36:34.120459 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:36:34.120459 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:36:34.120459 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:36:34.120459 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:36:34.120459 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:36:34.122038 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:36:34.122038 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:36:34.122038 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 13 19:36:34.122038 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 13 19:36:34.122038 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 13 19:36:34.122038 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 13 19:36:34.122038 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 13 19:36:34.122038 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 13 19:36:34.122038 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 13 19:36:34.122038 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application Sep 13 19:36:34.122038 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 365/751] 10.222.0.25 () {56 vars in 1117 bytes} [Tue Sep 13 19:36:33 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:36:34.126404 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 387/752] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Sep 13 19:36:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 311 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:36:34.128387 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f25176-a7f0-430b-a003-414c799059ad None admin] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:36:34.131561 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d3d829-8df1-48d7-9e96-ceb58ff86910 None admin] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:36:34.305855 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f25176-a7f0-430b-a003-414c799059ad None admin] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:36:34.331755 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d3d829-8df1-48d7-9e96-ceb58ff86910 None admin] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:36:34.347240 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f172a7-4a2c-49e9-8122-16e77e361cf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:36:34.348338 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f172a7-4a2c-49e9-8122-16e77e361cf5 None admin] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:36:34.348969 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f172a7-4a2c-49e9-8122-16e77e361cf5 None admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:36:34.349453 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f172a7-4a2c-49e9-8122-16e77e361cf5 None admin] PATH_INFO: `/v3/users` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:36:34.350396 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f172a7-4a2c-49e9-8122-16e77e361cf5 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=87935) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:36:34.350900 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f172a7-4a2c-49e9-8122-16e77e361cf5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:36:34.352563 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f172a7-4a2c-49e9-8122-16e77e361cf5 None admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:36:34.374076 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 366/753] 10.222.0.25 () {56 vars in 1149 bytes} [Tue Sep 13 19:36:34 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 19:36:34.380317 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f172a7-4a2c-49e9-8122-16e77e361cf5 None admin] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:36:34.388547 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG dbcounter [-] [87935] Writing DB stats keystone:SELECT=100 {{(pid=87935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:36:34.390354 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG dbcounter [-] [87934] Writing DB stats keystone:SELECT=100 {{(pid=87934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:36:34.398872 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b013c70c-0f45-4d4c-bfca-bc96085d7b38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:36:34.400147 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b013c70c-0f45-4d4c-bfca-bc96085d7b38 None admin] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:36:34.400483 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b013c70c-0f45-4d4c-bfca-bc96085d7b38 None admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:36:34.400754 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b013c70c-0f45-4d4c-bfca-bc96085d7b38 None admin] PATH_INFO: `/v3/users/nova` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:36:34.409823 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b013c70c-0f45-4d4c-bfca-bc96085d7b38 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:36:34.419216 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b013c70c-0f45-4d4c-bfca-bc96085d7b38 None admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:36:34.424368 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application [None req-b013c70c-0f45-4d4c-bfca-bc96085d7b38 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 13 19:36:34.424368 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:36:34.424368 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:36:34.424368 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:36:34.424368 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:36:34.424368 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:36:34.424368 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:36:34.424368 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:36:34.424368 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:36:34.424368 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:36:34.424368 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:36:34.424368 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:36:34.424368 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 13 19:36:34.424368 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 13 19:36:34.424368 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 13 19:36:34.424368 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 13 19:36:34.425948 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:36:34.425948 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:36:34.425948 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 13 19:36:34.425948 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 19:36:34.425948 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 13 19:36:34.425948 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 19:36:34.425948 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:36:34.425948 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:36:34.425948 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:36:34.425948 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:36:34.425948 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:36:34.425948 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application with Lock( Sep 13 19:36:34.425948 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:36:34.425948 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:36:34.425948 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:36:34.425948 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:36:34.425948 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:36:34.425948 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:36:34.427678 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:36:34.427678 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:36:34.427678 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 13 19:36:34.427678 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 13 19:36:34.427678 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 13 19:36:34.427678 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 13 19:36:34.427678 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 13 19:36:34.427678 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 13 19:36:34.427678 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 13 19:36:34.427678 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application Sep 13 19:36:34.427678 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 388/754] 10.222.0.25 () {56 vars in 1093 bytes} [Tue Sep 13 19:36:34 2022] GET /identity/v3/users/nova => generated 82 bytes in 295 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 13 19:36:34.433189 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b013c70c-0f45-4d4c-bfca-bc96085d7b38 None admin] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:36:34.590939 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b013c70c-0f45-4d4c-bfca-bc96085d7b38 None admin] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:36:34.630349 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2acdb859-3a23-4632-bef2-2f6a29fa2af3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:36:34.630960 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acdb859-3a23-4632-bef2-2f6a29fa2af3 None admin] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:36:34.631399 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acdb859-3a23-4632-bef2-2f6a29fa2af3 None admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:36:34.631680 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acdb859-3a23-4632-bef2-2f6a29fa2af3 None admin] PATH_INFO: `/v3/users` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:36:34.632856 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2acdb859-3a23-4632-bef2-2f6a29fa2af3 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=87934) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:36:34.633175 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2acdb859-3a23-4632-bef2-2f6a29fa2af3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:36:34.634931 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2acdb859-3a23-4632-bef2-2f6a29fa2af3 None admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:36:34.656085 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f172a7-4a2c-49e9-8122-16e77e361cf5 None admin] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:36:34.656332 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 389/755] 10.222.0.25 () {56 vars in 1133 bytes} [Tue Sep 13 19:36:34 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:36:34.662056 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2acdb859-3a23-4632-bef2-2f6a29fa2af3 None admin] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:36:34.719188 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG dbcounter [-] [87934] Writing DB stats keystone:SELECT=100 {{(pid=87934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:36:34.763721 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee10c362-282a-4f9d-acb3-2379df0c884c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:36:34.764666 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee10c362-282a-4f9d-acb3-2379df0c884c None admin] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:36:34.765150 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee10c362-282a-4f9d-acb3-2379df0c884c None admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:36:34.765594 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee10c362-282a-4f9d-acb3-2379df0c884c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:36:34.779759 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2acdb859-3a23-4632-bef2-2f6a29fa2af3 None admin] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:36:34.841816 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ec8bce-74a0-4c7f-ba6e-3940717448e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:36:34.842833 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ec8bce-74a0-4c7f-ba6e-3940717448e8 None admin] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:36:34.843326 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ec8bce-74a0-4c7f-ba6e-3940717448e8 None admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:36:34.843795 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ec8bce-74a0-4c7f-ba6e-3940717448e8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:36:34.867015 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ec8bce-74a0-4c7f-ba6e-3940717448e8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:36:34.868964 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ec8bce-74a0-4c7f-ba6e-3940717448e8 None admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:36:34.902970 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application [None req-f2ec8bce-74a0-4c7f-ba6e-3940717448e8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 19:36:34.902970 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:36:34.902970 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:36:34.902970 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:36:34.902970 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:36:34.902970 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:36:34.902970 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:36:34.902970 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:36:34.902970 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:36:34.902970 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:36:34.902970 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:36:34.902970 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:36:34.902970 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 19:36:34.902970 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 19:36:34.902970 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 19:36:34.902970 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 19:36:34.904072 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:36:34.904072 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:36:34.904072 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:36:34.904072 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:36:34.904072 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:36:34.904072 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:36:34.904072 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:36:34.904072 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application with Lock( Sep 13 19:36:34.904072 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:36:34.904072 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:36:34.904072 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:36:34.904072 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:36:34.904072 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:36:34.904072 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:36:34.904072 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:36:34.904072 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:36:34.904072 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 19:36:34.905052 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 19:36:34.905052 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 19:36:34.905052 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application Sep 13 19:36:34.905052 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 390/756] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Sep 13 19:36:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:36:34.910696 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee10c362-282a-4f9d-acb3-2379df0c884c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:36:34.912461 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee10c362-282a-4f9d-acb3-2379df0c884c None admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:36:34.913169 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ec8bce-74a0-4c7f-ba6e-3940717448e8 None admin] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:36:34.915255 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG dbcounter [-] [87935] Writing DB stats keystone:SELECT=100 {{(pid=87935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:36:35.025621 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 367/757] 10.222.0.25 () {58 vars in 1282 bytes} [Tue Sep 13 19:36:34 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 646 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 13 19:36:35.030627 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee10c362-282a-4f9d-acb3-2379df0c884c None admin] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:36:35.122239 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG dbcounter [-] [87934] Writing DB stats keystone:SELECT=100 {{(pid=87934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:36:35.128348 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ec8bce-74a0-4c7f-ba6e-3940717448e8 None admin] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:36:35.139449 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee10c362-282a-4f9d-acb3-2379df0c884c None admin] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:36:35.144600 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG dbcounter [-] [87935] Writing DB stats keystone:SELECT=100 {{(pid=87935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:36:35.177799 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea7d4f2-dce9-425a-8681-2a13bb402886 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:36:35.178825 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea7d4f2-dce9-425a-8681-2a13bb402886 None admin] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:36:35.179305 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea7d4f2-dce9-425a-8681-2a13bb402886 None admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:36:35.179799 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea7d4f2-dce9-425a-8681-2a13bb402886 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:36:35.190669 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea7d4f2-dce9-425a-8681-2a13bb402886 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:36:35.192765 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea7d4f2-dce9-425a-8681-2a13bb402886 None admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:36:35.196131 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc2aed9-d0a3-4dbc-8019-14c25856731c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:36:35.197991 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc2aed9-d0a3-4dbc-8019-14c25856731c None admin] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:36:35.200240 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc2aed9-d0a3-4dbc-8019-14c25856731c None admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:36:35.200665 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc2aed9-d0a3-4dbc-8019-14c25856731c None admin] PATH_INFO: `/v3/domains` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:36:35.201477 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc2aed9-d0a3-4dbc-8019-14c25856731c None admin] RBAC: Adding query filter params (name=Default) {{(pid=87934) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:36:35.201925 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc2aed9-d0a3-4dbc-8019-14c25856731c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:36:35.206088 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc2aed9-d0a3-4dbc-8019-14c25856731c None admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:36:35.223401 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application [None req-cea7d4f2-dce9-425a-8681-2a13bb402886 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 19:36:35.223401 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:36:35.223401 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:36:35.223401 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:36:35.223401 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:36:35.223401 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:36:35.223401 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:36:35.223401 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:36:35.223401 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:36:35.223401 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:36:35.223401 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:36:35.223401 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:36:35.223401 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 19:36:35.223401 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 19:36:35.223401 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 19:36:35.223401 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 19:36:35.224549 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:36:35.224549 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:36:35.224549 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:36:35.224549 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:36:35.224549 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:36:35.224549 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:36:35.224549 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:36:35.224549 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application with Lock( Sep 13 19:36:35.224549 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:36:35.224549 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:36:35.224549 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:36:35.224549 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:36:35.224549 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:36:35.224549 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:36:35.224549 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:36:35.224549 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:36:35.224549 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 19:36:35.225637 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 19:36:35.225637 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 19:36:35.225637 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application Sep 13 19:36:35.229798 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 368/758] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Sep 13 19:36:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:36:35.233096 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 391/759] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Sep 13 19:36:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 320 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:36:35.234107 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea7d4f2-dce9-425a-8681-2a13bb402886 None admin] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:36:35.239728 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc2aed9-d0a3-4dbc-8019-14c25856731c None admin] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:36:35.419808 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc2aed9-d0a3-4dbc-8019-14c25856731c None admin] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:36:35.442309 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea7d4f2-dce9-425a-8681-2a13bb402886 None admin] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:36:35.479921 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a412008b-61be-4577-a8f6-541a843eceb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:36:35.480581 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a412008b-61be-4577-a8f6-541a843eceb6 None admin] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:36:35.480858 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a412008b-61be-4577-a8f6-541a843eceb6 None admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:36:35.481128 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a412008b-61be-4577-a8f6-541a843eceb6 None admin] PATH_INFO: `/v3/domains` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:36:35.481772 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a412008b-61be-4577-a8f6-541a843eceb6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87935) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:36:35.482071 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a412008b-61be-4577-a8f6-541a843eceb6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:36:35.483437 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a412008b-61be-4577-a8f6-541a843eceb6 None admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:36:35.497349 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 369/760] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Sep 13 19:36:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 19:36:35.502792 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a412008b-61be-4577-a8f6-541a843eceb6 None admin] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:36:35.521527 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f860fe-0661-4c6a-8484-341fe56f2797 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:36:35.522182 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG dbcounter [-] [87935] Writing DB stats keystone:SELECT=100 {{(pid=87935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:36:35.522295 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f860fe-0661-4c6a-8484-341fe56f2797 None admin] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:36:35.522497 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f860fe-0661-4c6a-8484-341fe56f2797 None admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:36:35.522774 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f860fe-0661-4c6a-8484-341fe56f2797 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:36:35.530220 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f860fe-0661-4c6a-8484-341fe56f2797 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:36:35.531689 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f860fe-0661-4c6a-8484-341fe56f2797 None admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:36:35.543555 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application [None req-06f860fe-0661-4c6a-8484-341fe56f2797 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 19:36:35.543555 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:36:35.543555 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:36:35.543555 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:36:35.543555 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:36:35.543555 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:36:35.543555 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:36:35.543555 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:36:35.543555 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:36:35.543555 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:36:35.543555 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:36:35.543555 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:36:35.543555 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 13 19:36:35.543555 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 13 19:36:35.543555 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 13 19:36:35.544522 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 13 19:36:35.544522 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:36:35.544522 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:36:35.544522 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:36:35.544522 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:36:35.544522 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:36:35.544522 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:36:35.544522 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:36:35.544522 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application with Lock( Sep 13 19:36:35.544522 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:36:35.544522 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:36:35.544522 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:36:35.544522 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:36:35.544522 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:36:35.544522 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:36:35.544522 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:36:35.544522 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:36:35.545432 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 13 19:36:35.545432 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 13 19:36:35.545432 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 13 19:36:35.545432 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 13 19:36:35.545432 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 13 19:36:35.545432 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 13 19:36:35.545432 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 19:36:35.545432 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application Sep 13 19:36:35.545432 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 392/761] 10.222.0.25 () {56 vars in 1111 bytes} [Tue Sep 13 19:36:35 2022] GET /identity/v3/projects/service => generated 88 bytes in 306 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:36:35.546573 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ca425a-db03-4644-848b-cb842a5f21e5 None None] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:36:35.546573 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ca425a-db03-4644-848b-cb842a5f21e5 None None] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:36:35.546871 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ca425a-db03-4644-848b-cb842a5f21e5 None None] PATH_INFO: `/` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:36:35.548292 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 393/762] 10.222.0.25 () {54 vars in 927 bytes} [Tue Sep 13 19:36:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:36:35.554708 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ca425a-db03-4644-848b-cb842a5f21e5 None None] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:36:35.587263 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG dbcounter [-] [87934] Writing DB stats keystone:SELECT=100 {{(pid=87934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:36:35.650768 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a412008b-61be-4577-a8f6-541a843eceb6 None admin] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:36:35.699955 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4ef30c-71aa-415f-9e36-485599f77fc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:36:35.701132 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4ef30c-71aa-415f-9e36-485599f77fc4 None admin] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:36:35.701585 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4ef30c-71aa-415f-9e36-485599f77fc4 None admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:36:35.702097 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4ef30c-71aa-415f-9e36-485599f77fc4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:36:35.702485 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ca425a-db03-4644-848b-cb842a5f21e5 None None] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:36:35.713831 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a4ef30c-71aa-415f-9e36-485599f77fc4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:36:35.715555 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a4ef30c-71aa-415f-9e36-485599f77fc4 None admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:36:35.731477 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application [None req-9a4ef30c-71aa-415f-9e36-485599f77fc4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 19:36:35.731477 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:36:35.731477 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:36:35.731477 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:36:35.731477 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:36:35.731477 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:36:35.731477 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:36:35.731477 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:36:35.731477 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:36:35.731477 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:36:35.731477 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:36:35.731477 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:36:35.731477 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 13 19:36:35.731477 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 13 19:36:35.731477 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 13 19:36:35.732623 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 13 19:36:35.732623 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:36:35.732623 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:36:35.732623 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:36:35.732623 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:36:35.732623 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:36:35.732623 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:36:35.732623 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:36:35.732623 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application with Lock( Sep 13 19:36:35.732623 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:36:35.732623 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:36:35.732623 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:36:35.732623 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:36:35.732623 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:36:35.732623 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:36:35.732623 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:36:35.732623 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:36:35.733659 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 13 19:36:35.733659 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 13 19:36:35.733659 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 13 19:36:35.733659 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 13 19:36:35.733659 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 13 19:36:35.733659 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 13 19:36:35.733659 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 19:36:35.733659 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application Sep 13 19:36:35.736274 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 370/763] 10.222.0.25 () {56 vars in 1111 bytes} [Tue Sep 13 19:36:35 2022] GET /identity/v3/projects/service => generated 88 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:36:35.737682 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0deb92e5-7e14-44a0-9050-7ab9f7d608ef None None] REQUEST_METHOD: `POST` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:36:35.738108 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0deb92e5-7e14-44a0-9050-7ab9f7d608ef None None] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:36:35.739049 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0deb92e5-7e14-44a0-9050-7ab9f7d608ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:36:35.755867 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3e83db-ae96-4ad2-bc0e-be94b6cd7e3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:36:35.756568 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3e83db-ae96-4ad2-bc0e-be94b6cd7e3f None admin] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:36:35.756987 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3e83db-ae96-4ad2-bc0e-be94b6cd7e3f None admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:36:35.757445 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3e83db-ae96-4ad2-bc0e-be94b6cd7e3f None admin] PATH_INFO: `/v3/projects` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:36:35.758142 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d3e83db-ae96-4ad2-bc0e-be94b6cd7e3f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87934) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:36:35.758442 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d3e83db-ae96-4ad2-bc0e-be94b6cd7e3f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:36:35.759875 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d3e83db-ae96-4ad2-bc0e-be94b6cd7e3f None admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:36:35.761902 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.auth.core [None req-0deb92e5-7e14-44a0-9050-7ab9f7d608ef None None] MFA Rules not processed for user `7b0aed92d02344acb92a0e4aa67c3068`. Rule list: `[]` (Enabled: `True`). {{(pid=87935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:36:35.763629 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.fernet_utils [None req-0deb92e5-7e14-44a0-9050-7ab9f7d608ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:36:35.776380 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 394/764] 10.222.0.25 () {56 vars in 1148 bytes} [Tue Sep 13 19:36:35 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 19:36:35.777478 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3e83db-ae96-4ad2-bc0e-be94b6cd7e3f None admin] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:36:35.856661 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 371/765] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Sep 13 19:36:35 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 13 19:36:35.857550 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0deb92e5-7e14-44a0-9050-7ab9f7d608ef None None] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:36:35.861208 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG dbcounter [-] [87935] Writing DB stats keystone:SELECT=100 {{(pid=87935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:36:35.864784 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG dbcounter [-] [87934] Writing DB stats keystone:SELECT=100 {{(pid=87934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:36:35.884331 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3e83db-ae96-4ad2-bc0e-be94b6cd7e3f None admin] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:36:35.920032 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d9dc12-8ad7-436f-ad08-07b8e9e51d68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:36:35.920943 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d9dc12-8ad7-436f-ad08-07b8e9e51d68 None admin] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:36:35.921364 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d9dc12-8ad7-436f-ad08-07b8e9e51d68 None admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:36:35.921787 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d9dc12-8ad7-436f-ad08-07b8e9e51d68 None admin] PATH_INFO: `/v3/projects` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:36:35.922613 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d9dc12-8ad7-436f-ad08-07b8e9e51d68 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87934) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:36:35.923056 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d9dc12-8ad7-436f-ad08-07b8e9e51d68 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:36:35.924737 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d9dc12-8ad7-436f-ad08-07b8e9e51d68 None admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:36:35.937957 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 395/766] 10.222.0.25 () {56 vars in 1148 bytes} [Tue Sep 13 19:36:35 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:36:35.944800 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d9dc12-8ad7-436f-ad08-07b8e9e51d68 None admin] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:36:36.041746 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0deb92e5-7e14-44a0-9050-7ab9f7d608ef None None] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:36:36.079281 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d9dc12-8ad7-436f-ad08-07b8e9e51d68 None admin] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:36:36.079783 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5272f5ea-7207-417f-a75d-4f4fd9c63d6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:36:36.080476 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5272f5ea-7207-417f-a75d-4f4fd9c63d6d None admin] REQUEST_METHOD: `PUT` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:36:36.080751 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5272f5ea-7207-417f-a75d-4f4fd9c63d6d None admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:36:36.081020 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5272f5ea-7207-417f-a75d-4f4fd9c63d6d None admin] PATH_INFO: `/v3/projects/9a10a4268f3c4cb29f4e00c292e2df62/users/d71fe5a8275f4ea98555afdcefc902a0/roles/6ca1d4427ff64e0a9d25d96cfb1445f6` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:36:36.089072 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5272f5ea-7207-417f-a75d-4f4fd9c63d6d None admin] RBAC: Authorizing `identity:create_grant(project_id=9a10a4268f3c4cb29f4e00c292e2df62, user_id=d71fe5a8275f4ea98555afdcefc902a0, role_id=6ca1d4427ff64e0a9d25d96cfb1445f6)` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:36:36.089072 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5272f5ea-7207-417f-a75d-4f4fd9c63d6d None admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:36:36.111221 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 372/767] 10.222.0.25 () {58 vars in 1439 bytes} [Tue Sep 13 19:36:35 2022] PUT /identity/v3/projects/9a10a4268f3c4cb29f4e00c292e2df62/users/d71fe5a8275f4ea98555afdcefc902a0/roles/6ca1d4427ff64e0a9d25d96cfb1445f6 => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 19:36:36.127578 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b44f358-da24-48c0-8230-0c226f7174dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:36:36.128959 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b44f358-da24-48c0-8230-0c226f7174dd None admin] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:36:36.129523 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b44f358-da24-48c0-8230-0c226f7174dd None admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:36:36.129963 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b44f358-da24-48c0-8230-0c226f7174dd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:36:36.130770 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696e2ef7-d577-4cbe-854d-71c8ee0c7505 None None] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:36:36.130997 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b44f358-da24-48c0-8230-0c226f7174dd None admin] RBAC: Adding query filter params (role.id=60f5ecbf9ce84814968607f126a85a5a, scope.project.id=9a10a4268f3c4cb29f4e00c292e2df62, user.id=d44977a3225e43f19cdc4a84f0e170cd) {{(pid=87934) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:36:36.131107 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696e2ef7-d577-4cbe-854d-71c8ee0c7505 None None] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:36:36.131310 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696e2ef7-d577-4cbe-854d-71c8ee0c7505 None None] PATH_INFO: `/` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:36:36.131684 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b44f358-da24-48c0-8230-0c226f7174dd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:36:36.132925 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 373/768] 10.222.0.25 () {54 vars in 927 bytes} [Tue Sep 13 19:36:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:36:36.133514 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b44f358-da24-48c0-8230-0c226f7174dd None admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:36:36.140676 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 396/769] 10.222.0.25 () {56 vars in 1374 bytes} [Tue Sep 13 19:36:35 2022] GET /identity/v3/role_assignments?user.id=d44977a3225e43f19cdc4a84f0e170cd&scope.project.id=9a10a4268f3c4cb29f4e00c292e2df62&role.id=60f5ecbf9ce84814968607f126a85a5a => generated 259 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 19:36:36.144285 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92354183-2463-4ec6-9979-86e8939d9527 None None] REQUEST_METHOD: `POST` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:36:36.144285 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92354183-2463-4ec6-9979-86e8939d9527 None None] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:36:36.144285 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92354183-2463-4ec6-9979-86e8939d9527 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:36:36.177182 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.auth.core [None req-92354183-2463-4ec6-9979-86e8939d9527 None None] MFA Rules not processed for user `7b0aed92d02344acb92a0e4aa67c3068`. Rule list: `[]` (Enabled: `True`). {{(pid=87935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:36:36.178423 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.fernet_utils [None req-92354183-2463-4ec6-9979-86e8939d9527 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:36:36.255463 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG dbcounter [-] [87935] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:36:36.266241 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 374/770] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Sep 13 19:36:36 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 13 19:36:36.384128 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a83058-d2f2-4f38-b585-77c2e45ffcda None None] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:36:36.384439 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a83058-d2f2-4f38-b585-77c2e45ffcda None None] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:36:36.384717 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a83058-d2f2-4f38-b585-77c2e45ffcda None None] PATH_INFO: `/` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:36:36.386394 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 397/771] 10.222.0.25 () {54 vars in 927 bytes} [Tue Sep 13 19:36:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:36:36.392008 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6195d4-5db3-4d3e-b54b-81186ab9b9b8 None None] REQUEST_METHOD: `POST` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:36:36.392317 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6195d4-5db3-4d3e-b54b-81186ab9b9b8 None None] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:36:36.392587 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6195d4-5db3-4d3e-b54b-81186ab9b9b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:36:36.413504 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.auth.core [None req-0e6195d4-5db3-4d3e-b54b-81186ab9b9b8 None None] MFA Rules not processed for user `7b0aed92d02344acb92a0e4aa67c3068`. Rule list: `[]` (Enabled: `True`). {{(pid=87935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:36:36.414687 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.fernet_utils [None req-0e6195d4-5db3-4d3e-b54b-81186ab9b9b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:36:36.417766 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a83058-d2f2-4f38-b585-77c2e45ffcda None None] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:36:36.421947 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG dbcounter [-] [87934] Writing DB stats keystone:SELECT=100 {{(pid=87934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:36:36.522773 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 375/772] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Sep 13 19:36:36 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 13 19:36:36.530430 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a83058-d2f2-4f38-b585-77c2e45ffcda None None] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:36:36.565776 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0901ab71-06e5-4732-b279-4ba29f6afa3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:36:36.566311 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0901ab71-06e5-4732-b279-4ba29f6afa3b None admin] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:36:36.566618 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0901ab71-06e5-4732-b279-4ba29f6afa3b None admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:36:36.566890 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0901ab71-06e5-4732-b279-4ba29f6afa3b None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:36:36.567474 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0901ab71-06e5-4732-b279-4ba29f6afa3b None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:36:36.569020 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0901ab71-06e5-4732-b279-4ba29f6afa3b None admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:36:36.580821 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application [None req-0901ab71-06e5-4732-b279-4ba29f6afa3b None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 13 19:36:36.580821 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:36:36.580821 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 13 19:36:36.580821 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 13 19:36:36.580821 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 13 19:36:36.580821 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 13 19:36:36.580821 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 13 19:36:36.580821 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 19:36:36.580821 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 13 19:36:36.580821 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application Sep 13 19:36:36.580821 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 13 19:36:36.580821 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application Sep 13 19:36:36.580821 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:36:36.580821 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:36:36.580821 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:36:36.580821 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:36:36.580821 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:36:36.581893 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:36:36.581893 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:36:36.581893 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:36:36.581893 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:36:36.581893 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:36:36.581893 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:36:36.581893 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 13 19:36:36.581893 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 13 19:36:36.581893 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 13 19:36:36.581893 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 13 19:36:36.581893 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:36:36.581893 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:36:36.581893 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:36:36.581893 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:36:36.581893 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:36:36.581893 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:36:36.583574 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:36:36.583574 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application with Lock( Sep 13 19:36:36.583574 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:36:36.583574 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:36:36.583574 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:36:36.583574 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:36:36.583574 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:36:36.583574 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:36:36.583574 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:36:36.583574 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:36:36.583574 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 13 19:36:36.583574 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 19:36:36.583574 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 13 19:36:36.583574 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application Sep 13 19:36:36.585073 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 398/773] 10.222.0.25 () {56 vars in 1129 bytes} [Tue Sep 13 19:36:36 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:36:36.589920 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6195d4-5db3-4d3e-b54b-81186ab9b9b8 None None] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:36:36.597323 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0901ab71-06e5-4732-b279-4ba29f6afa3b None admin] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:36:36.725039 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG dbcounter [-] [87934] Writing DB stats keystone:SELECT=100 {{(pid=87934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:36:36.787785 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6195d4-5db3-4d3e-b54b-81186ab9b9b8 None None] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:36:36.796074 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0901ab71-06e5-4732-b279-4ba29f6afa3b None admin] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:36:36.833434 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG dbcounter [-] [87935] Writing DB stats keystone:SELECT=100 {{(pid=87935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:36:36.847459 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66932f1c-0cf2-4a6b-91a8-d8d6bb79fb87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:36:36.848617 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66932f1c-0cf2-4a6b-91a8-d8d6bb79fb87 None admin] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:36:36.848943 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66932f1c-0cf2-4a6b-91a8-d8d6bb79fb87 None admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:36:36.849158 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66932f1c-0cf2-4a6b-91a8-d8d6bb79fb87 None admin] PATH_INFO: `/v3/services` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:36:36.849786 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66932f1c-0cf2-4a6b-91a8-d8d6bb79fb87 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=87935) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:36:36.850016 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a25db9a-de22-4075-8344-023a50f29da1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:36:36.850151 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66932f1c-0cf2-4a6b-91a8-d8d6bb79fb87 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:36:36.850999 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a25db9a-de22-4075-8344-023a50f29da1 None admin] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:36:36.851429 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66932f1c-0cf2-4a6b-91a8-d8d6bb79fb87 None admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:36:36.851695 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a25db9a-de22-4075-8344-023a50f29da1 None admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:36:36.852172 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a25db9a-de22-4075-8344-023a50f29da1 None admin] PATH_INFO: `/v3/services/network` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:36:36.853079 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a25db9a-de22-4075-8344-023a50f29da1 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:36:36.854703 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a25db9a-de22-4075-8344-023a50f29da1 None admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:36:36.856640 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 376/774] 10.222.0.25 () {56 vars in 1124 bytes} [Tue Sep 13 19:36:36 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:36:36.857808 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66932f1c-0cf2-4a6b-91a8-d8d6bb79fb87 None admin] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:36:36.870863 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application [None req-9a25db9a-de22-4075-8344-023a50f29da1 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Sep 13 19:36:36.870863 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:36:36.870863 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 13 19:36:36.870863 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 13 19:36:36.870863 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 13 19:36:36.870863 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 13 19:36:36.870863 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 13 19:36:36.870863 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 19:36:36.870863 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 13 19:36:36.870863 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application Sep 13 19:36:36.870863 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 13 19:36:36.870863 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application Sep 13 19:36:36.870863 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:36:36.870863 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:36:36.870863 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:36:36.870863 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:36:36.870863 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:36:36.871929 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:36:36.871929 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:36:36.871929 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:36:36.871929 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:36:36.871929 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:36:36.871929 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:36:36.871929 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 13 19:36:36.871929 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 13 19:36:36.871929 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 13 19:36:36.871929 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 13 19:36:36.871929 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:36:36.871929 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:36:36.871929 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:36:36.871929 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:36:36.871929 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:36:36.871929 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:36:36.872820 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:36:36.872820 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application with Lock( Sep 13 19:36:36.872820 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:36:36.872820 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:36:36.872820 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:36:36.872820 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:36:36.872820 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:36:36.872820 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:36:36.872820 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:36:36.872820 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:36:36.872820 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 13 19:36:36.872820 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 19:36:36.872820 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 13 19:36:36.872820 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application Sep 13 19:36:36.872820 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 399/775] 10.222.0.25 () {56 vars in 1111 bytes} [Tue Sep 13 19:36:36 2022] GET /identity/v3/services/network => generated 88 bytes in 275 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 13 19:36:36.873643 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a25db9a-de22-4075-8344-023a50f29da1 None admin] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:36:36.985209 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a25db9a-de22-4075-8344-023a50f29da1 None admin] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:36:37.014010 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66932f1c-0cf2-4a6b-91a8-d8d6bb79fb87 None admin] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:36:37.026240 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG dbcounter [-] [87934] Writing DB stats keystone:SELECT=100 {{(pid=87934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:36:37.032119 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3f67fa-a562-46be-bc64-d1f7c0c5d414 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:36:37.032777 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3f67fa-a562-46be-bc64-d1f7c0c5d414 None admin] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:36:37.033051 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3f67fa-a562-46be-bc64-d1f7c0c5d414 None admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:36:37.033318 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3f67fa-a562-46be-bc64-d1f7c0c5d414 None admin] PATH_INFO: `/v3/services` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:36:37.034088 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb3f67fa-a562-46be-bc64-d1f7c0c5d414 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=87934) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:36:37.034274 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb3f67fa-a562-46be-bc64-d1f7c0c5d414 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:36:37.035651 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb3f67fa-a562-46be-bc64-d1f7c0c5d414 None admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:36:37.046322 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 400/776] 10.222.0.25 () {56 vars in 1124 bytes} [Tue Sep 13 19:36:36 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:36:37.047148 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3f67fa-a562-46be-bc64-d1f7c0c5d414 None admin] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:36:37.065120 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eccdf3e-da52-4dd8-8610-a6030c15ec6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:36:37.066278 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eccdf3e-da52-4dd8-8610-a6030c15ec6d None admin] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:36:37.067257 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eccdf3e-da52-4dd8-8610-a6030c15ec6d None admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:36:37.067943 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eccdf3e-da52-4dd8-8610-a6030c15ec6d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:36:37.085916 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eccdf3e-da52-4dd8-8610-a6030c15ec6d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 19:36:37.090779 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application [None req-4eccdf3e-da52-4dd8-8610-a6030c15ec6d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 19:36:37.090779 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:36:37.090779 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:36:37.090779 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:36:37.090779 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:36:37.090779 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:36:37.090779 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:36:37.090779 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:36:37.090779 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:36:37.090779 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:36:37.090779 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:36:37.090779 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:36:37.090779 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 19:36:37.090779 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 19:36:37.090779 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 19:36:37.090779 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 19:36:37.091824 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 19:36:37.091824 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 19:36:37.091824 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 19:36:37.091824 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 19:36:37.091824 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:36:37.091824 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:36:37.091824 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:36:37.091824 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:36:37.091824 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:36:37.091824 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:36:37.091824 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:36:37.091824 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application with Lock( Sep 13 19:36:37.091824 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:36:37.091824 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:36:37.091824 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:36:37.091824 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:36:37.092783 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:36:37.092783 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:36:37.092783 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:36:37.092783 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:36:37.092783 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 19:36:37.092783 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 19:36:37.092783 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 19:36:37.092783 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 19:36:37.092783 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 19:36:37.092783 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 19:36:37.092783 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 19:36:37.092783 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application Sep 13 19:36:37.097010 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 377/777] 10.222.0.25 () {56 vars in 1096 bytes} [Tue Sep 13 19:36:36 2022] GET /identity/v3/roles/admin => generated 83 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:36:37.097951 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eccdf3e-da52-4dd8-8610-a6030c15ec6d None admin] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:36:37.156859 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG dbcounter [-] [87935] Writing DB stats keystone:SELECT=100 {{(pid=87935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:36:37.180789 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3f67fa-a562-46be-bc64-d1f7c0c5d414 None admin] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:36:37.220110 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590c2ae5-f33c-402b-87b5-70e5e1c48c97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:36:37.220715 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590c2ae5-f33c-402b-87b5-70e5e1c48c97 None admin] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:36:37.221115 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590c2ae5-f33c-402b-87b5-70e5e1c48c97 None admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:36:37.221477 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590c2ae5-f33c-402b-87b5-70e5e1c48c97 None admin] PATH_INFO: `/v3/services` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:36:37.222210 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-590c2ae5-f33c-402b-87b5-70e5e1c48c97 None admin] RBAC: Adding query filter params (name=network) {{(pid=87934) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:36:37.222610 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-590c2ae5-f33c-402b-87b5-70e5e1c48c97 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:36:37.224375 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-590c2ae5-f33c-402b-87b5-70e5e1c48c97 None admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:36:37.229972 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 401/778] 10.222.0.25 () {56 vars in 1112 bytes} [Tue Sep 13 19:36:37 2022] GET /identity/v3/services?name=network => generated 124 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:36:37.230987 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590c2ae5-f33c-402b-87b5-70e5e1c48c97 None admin] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:36:37.237295 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eccdf3e-da52-4dd8-8610-a6030c15ec6d None admin] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:36:37.288723 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402c924b-408b-42c0-bc29-4590941f0caa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:36:37.289828 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402c924b-408b-42c0-bc29-4590941f0caa None admin] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:36:37.290634 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402c924b-408b-42c0-bc29-4590941f0caa None admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:36:37.291077 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402c924b-408b-42c0-bc29-4590941f0caa None admin] PATH_INFO: `/v3/endpoints` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:36:37.291939 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-402c924b-408b-42c0-bc29-4590941f0caa None admin] RBAC: Adding query filter params (interface=public, service_id=ef838f86575e4a1ba29db30bdd6c82a2, region_id=RegionOne) {{(pid=87935) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:36:37.292426 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-402c924b-408b-42c0-bc29-4590941f0caa None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:36:37.294491 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-402c924b-408b-42c0-bc29-4590941f0caa None admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:36:37.300581 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG dbcounter [-] [87934] Writing DB stats keystone:SELECT=100 {{(pid=87934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:36:37.310636 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 378/779] 10.222.0.25 () {56 vars in 1251 bytes} [Tue Sep 13 19:36:37 2022] GET /identity/v3/endpoints?service_id=ef838f86575e4a1ba29db30bdd6c82a2&interface=public®ion_id=RegionOne => generated 194 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:36:37.311351 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402c924b-408b-42c0-bc29-4590941f0caa None admin] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:36:37.359886 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590c2ae5-f33c-402b-87b5-70e5e1c48c97 None admin] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:36:37.396690 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d005ace-fb70-4772-b2d4-63af57438547 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:36:37.397734 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d005ace-fb70-4772-b2d4-63af57438547 None admin] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:36:37.398213 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d005ace-fb70-4772-b2d4-63af57438547 None admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:36:37.398688 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d005ace-fb70-4772-b2d4-63af57438547 None admin] PATH_INFO: `/v3/roles` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:36:37.399641 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d005ace-fb70-4772-b2d4-63af57438547 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87934) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:36:37.400151 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d005ace-fb70-4772-b2d4-63af57438547 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:36:37.401760 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d005ace-fb70-4772-b2d4-63af57438547 None admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:36:37.411286 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 402/780] 10.222.0.25 () {56 vars in 1099 bytes} [Tue Sep 13 19:36:37 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:36:37.412513 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d005ace-fb70-4772-b2d4-63af57438547 None admin] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:36:37.427379 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402c924b-408b-42c0-bc29-4590941f0caa None admin] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:36:37.441536 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG dbcounter [-] [87935] Writing DB stats keystone:SELECT=100 {{(pid=87935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:36:37.466177 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614a9788-8360-488f-8033-e16995ec9573 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:36:37.467055 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614a9788-8360-488f-8033-e16995ec9573 None admin] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:36:37.467486 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614a9788-8360-488f-8033-e16995ec9573 None admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:36:37.467958 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614a9788-8360-488f-8033-e16995ec9573 None admin] PATH_INFO: `/v3/services` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:36:37.468759 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-614a9788-8360-488f-8033-e16995ec9573 None admin] RBAC: Adding query filter params (type=network) {{(pid=87935) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:36:37.469245 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-614a9788-8360-488f-8033-e16995ec9573 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:36:37.470769 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-614a9788-8360-488f-8033-e16995ec9573 None admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:36:37.476881 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 379/781] 10.222.0.25 () {56 vars in 1112 bytes} [Tue Sep 13 19:36:37 2022] GET /identity/v3/services?type=network => generated 350 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:36:37.478047 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614a9788-8360-488f-8033-e16995ec9573 None admin] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:36:37.523706 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d005ace-fb70-4772-b2d4-63af57438547 None admin] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:36:37.549856 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG dbcounter [-] [87934] Writing DB stats keystone:SELECT=100 {{(pid=87934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:36:37.563667 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ebf63a1-7a3f-4778-8dfa-3f381e07dc0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:36:37.564479 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebf63a1-7a3f-4778-8dfa-3f381e07dc0a None admin] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:36:37.564858 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebf63a1-7a3f-4778-8dfa-3f381e07dc0a None admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:36:37.565230 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebf63a1-7a3f-4778-8dfa-3f381e07dc0a None admin] PATH_INFO: `/v3/services` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:36:37.565963 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ebf63a1-7a3f-4778-8dfa-3f381e07dc0a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:36:37.567628 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ebf63a1-7a3f-4778-8dfa-3f381e07dc0a None admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:36:37.580632 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 403/782] 10.222.0.25 () {56 vars in 1087 bytes} [Tue Sep 13 19:36:37 2022] GET /identity/v3/services => generated 772 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:36:37.581534 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ebf63a1-7a3f-4778-8dfa-3f381e07dc0a None admin] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:36:37.591595 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614a9788-8360-488f-8033-e16995ec9573 None admin] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:36:37.657472 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7e1fa7-dcf9-484d-91d7-dc5433f61d01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:36:37.658414 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7e1fa7-dcf9-484d-91d7-dc5433f61d01 None admin] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:36:37.658846 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7e1fa7-dcf9-484d-91d7-dc5433f61d01 None admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:36:37.659265 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7e1fa7-dcf9-484d-91d7-dc5433f61d01 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:36:37.690597 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c7e1fa7-dcf9-484d-91d7-dc5433f61d01 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:36:37.692407 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c7e1fa7-dcf9-484d-91d7-dc5433f61d01 None admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:36:37.707410 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ebf63a1-7a3f-4778-8dfa-3f381e07dc0a None admin] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:36:37.726600 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application [None req-4c7e1fa7-dcf9-484d-91d7-dc5433f61d01 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 19:36:37.726600 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:36:37.726600 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:36:37.726600 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:36:37.726600 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:36:37.726600 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:36:37.726600 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:36:37.726600 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:36:37.726600 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:36:37.726600 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:36:37.726600 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:36:37.726600 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:36:37.726600 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 19:36:37.726600 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 19:36:37.726600 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 19:36:37.726600 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 19:36:37.727669 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:36:37.727669 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:36:37.727669 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:36:37.727669 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:36:37.727669 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:36:37.727669 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:36:37.727669 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:36:37.727669 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application with Lock( Sep 13 19:36:37.727669 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:36:37.727669 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:36:37.727669 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:36:37.727669 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:36:37.727669 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:36:37.727669 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:36:37.727669 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:36:37.727669 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:36:37.727669 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 19:36:37.728629 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 19:36:37.728629 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 19:36:37.728629 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application Sep 13 19:36:37.729383 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 380/783] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Sep 13 19:36:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 252 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:36:37.742276 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7e1fa7-dcf9-484d-91d7-dc5433f61d01 None admin] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:36:37.746768 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c537e9-a50a-4c48-aa53-339be63ac003 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:36:37.747396 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c537e9-a50a-4c48-aa53-339be63ac003 None admin] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:36:37.747677 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c537e9-a50a-4c48-aa53-339be63ac003 None admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:36:37.747949 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c537e9-a50a-4c48-aa53-339be63ac003 None admin] PATH_INFO: `/v3/endpoints` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:36:37.748682 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c537e9-a50a-4c48-aa53-339be63ac003 None admin] RBAC: Adding query filter params (interface=public, service_id=384e9a4972d04b288dde905445a76f9a, region_id=RegionOne) {{(pid=87934) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:36:37.748990 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c537e9-a50a-4c48-aa53-339be63ac003 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:36:37.750404 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c537e9-a50a-4c48-aa53-339be63ac003 None admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:36:37.768865 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 404/784] 10.222.0.25 () {56 vars in 1251 bytes} [Tue Sep 13 19:36:37 2022] GET /identity/v3/endpoints?service_id=384e9a4972d04b288dde905445a76f9a&interface=public®ion_id=RegionOne => generated 194 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:36:37.768865 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c537e9-a50a-4c48-aa53-339be63ac003 None admin] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:36:37.823691 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG dbcounter [-] [87935] Writing DB stats keystone:SELECT=100 {{(pid=87935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:36:37.841437 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG dbcounter [-] [87934] Writing DB stats keystone:SELECT=100 {{(pid=87934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:36:37.907143 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c537e9-a50a-4c48-aa53-339be63ac003 None admin] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:36:37.934004 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7e1fa7-dcf9-484d-91d7-dc5433f61d01 None admin] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:36:37.950509 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dfcae9c-92a3-423b-bf87-a8e964b81b5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:36:37.951642 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfcae9c-92a3-423b-bf87-a8e964b81b5d None admin] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:36:37.952488 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfcae9c-92a3-423b-bf87-a8e964b81b5d None admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:36:37.953087 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfcae9c-92a3-423b-bf87-a8e964b81b5d None admin] PATH_INFO: `/v3/services` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:36:37.953958 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dfcae9c-92a3-423b-bf87-a8e964b81b5d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:36:37.955607 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dfcae9c-92a3-423b-bf87-a8e964b81b5d None admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:36:37.963389 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 405/785] 10.222.0.25 () {56 vars in 1087 bytes} [Tue Sep 13 19:36:37 2022] GET /identity/v3/services => generated 772 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:36:37.981573 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49694f93-0c52-469c-995c-b36a48eea4e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:36:37.982204 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49694f93-0c52-469c-995c-b36a48eea4e4 None admin] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:36:37.982484 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49694f93-0c52-469c-995c-b36a48eea4e4 None admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:36:37.982803 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49694f93-0c52-469c-995c-b36a48eea4e4 None admin] PATH_INFO: `/v3/domains` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:36:37.983470 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49694f93-0c52-469c-995c-b36a48eea4e4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87935) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:36:37.983773 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49694f93-0c52-469c-995c-b36a48eea4e4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:36:37.985221 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49694f93-0c52-469c-995c-b36a48eea4e4 None admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:36:38.000985 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 381/786] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Sep 13 19:36:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 19:36:38.006951 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dfcae9c-92a3-423b-bf87-a8e964b81b5d None admin] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:36:38.139113 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dfcae9c-92a3-423b-bf87-a8e964b81b5d None admin] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:36:38.157691 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG dbcounter [-] [87934] Writing DB stats keystone:SELECT=100 {{(pid=87934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:36:38.180676 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6485ef9-1692-465d-ad17-3bca2c9fbe54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:36:38.181716 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6485ef9-1692-465d-ad17-3bca2c9fbe54 None admin] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:36:38.182701 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6485ef9-1692-465d-ad17-3bca2c9fbe54 None admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:36:38.183176 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6485ef9-1692-465d-ad17-3bca2c9fbe54 None admin] PATH_INFO: `/v3/users/swift` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:36:38.192067 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6485ef9-1692-465d-ad17-3bca2c9fbe54 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:36:38.193888 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6485ef9-1692-465d-ad17-3bca2c9fbe54 None admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:36:38.205998 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application [None req-e6485ef9-1692-465d-ad17-3bca2c9fbe54 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 13 19:36:38.205998 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:36:38.205998 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:36:38.205998 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:36:38.205998 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:36:38.205998 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:36:38.205998 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:36:38.205998 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:36:38.205998 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:36:38.205998 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:36:38.205998 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:36:38.205998 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:36:38.205998 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 13 19:36:38.205998 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 13 19:36:38.205998 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 13 19:36:38.205998 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 13 19:36:38.207007 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:36:38.207007 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:36:38.207007 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 13 19:36:38.207007 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 19:36:38.207007 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 13 19:36:38.207007 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 19:36:38.207007 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:36:38.207007 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:36:38.207007 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:36:38.207007 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:36:38.207007 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:36:38.207007 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application with Lock( Sep 13 19:36:38.207007 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:36:38.207007 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:36:38.207007 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:36:38.207007 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:36:38.207007 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:36:38.207007 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:36:38.208851 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:36:38.208851 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:36:38.208851 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 13 19:36:38.208851 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 13 19:36:38.208851 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 13 19:36:38.208851 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 13 19:36:38.208851 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 13 19:36:38.208851 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 13 19:36:38.208851 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 13 19:36:38.208851 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application Sep 13 19:36:38.211504 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 406/787] 10.222.0.25 () {56 vars in 1096 bytes} [Tue Sep 13 19:36:38 2022] GET /identity/v3/users/swift => generated 83 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:36:38.218407 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49694f93-0c52-469c-995c-b36a48eea4e4 None admin] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:36:38.390121 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG dbcounter [-] [87935] Writing DB stats keystone:SELECT=100 {{(pid=87935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:36:38.406240 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49694f93-0c52-469c-995c-b36a48eea4e4 None admin] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:36:38.450376 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb7829d-78eb-47cd-89e8-a97440af1469 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:36:38.450956 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb7829d-78eb-47cd-89e8-a97440af1469 None admin] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:36:38.451228 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb7829d-78eb-47cd-89e8-a97440af1469 None admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:36:38.451493 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb7829d-78eb-47cd-89e8-a97440af1469 None admin] PATH_INFO: `/v3/users` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:36:38.452307 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb7829d-78eb-47cd-89e8-a97440af1469 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=87935) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:36:38.452609 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb7829d-78eb-47cd-89e8-a97440af1469 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:36:38.454034 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb7829d-78eb-47cd-89e8-a97440af1469 None admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:36:38.479625 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 382/788] 10.222.0.25 () {56 vars in 1135 bytes} [Tue Sep 13 19:36:38 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 19:36:38.485461 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6485ef9-1692-465d-ad17-3bca2c9fbe54 None admin] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:36:38.627834 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6485ef9-1692-465d-ad17-3bca2c9fbe54 None admin] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:36:38.685183 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f406db-9256-4bf4-b1fe-0f0190a82a86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:36:38.685887 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f406db-9256-4bf4-b1fe-0f0190a82a86 None admin] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:36:38.686171 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f406db-9256-4bf4-b1fe-0f0190a82a86 None admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:36:38.686441 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f406db-9256-4bf4-b1fe-0f0190a82a86 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:36:38.702557 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f406db-9256-4bf4-b1fe-0f0190a82a86 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:36:38.703970 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f406db-9256-4bf4-b1fe-0f0190a82a86 None admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:36:38.725330 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application [None req-04f406db-9256-4bf4-b1fe-0f0190a82a86 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 19:36:38.725330 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:36:38.725330 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:36:38.725330 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:36:38.725330 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:36:38.725330 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:36:38.725330 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:36:38.725330 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:36:38.725330 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:36:38.725330 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:36:38.725330 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:36:38.725330 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:36:38.725330 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 19:36:38.725330 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 19:36:38.725330 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 19:36:38.725330 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 19:36:38.726352 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:36:38.726352 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:36:38.726352 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:36:38.726352 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:36:38.726352 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:36:38.726352 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:36:38.726352 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:36:38.726352 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application with Lock( Sep 13 19:36:38.726352 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:36:38.726352 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:36:38.726352 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:36:38.726352 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:36:38.726352 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:36:38.726352 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:36:38.726352 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:36:38.726352 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:36:38.726352 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 19:36:38.728491 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 19:36:38.728491 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 19:36:38.728491 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application Sep 13 19:36:38.728491 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 407/789] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Sep 13 19:36:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:36:38.732856 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb7829d-78eb-47cd-89e8-a97440af1469 None admin] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:36:38.733291 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64f5ff0-f3ab-4dbd-ae87-8c46039fe5aa None None] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:36:38.733580 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64f5ff0-f3ab-4dbd-ae87-8c46039fe5aa None None] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:36:38.733856 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64f5ff0-f3ab-4dbd-ae87-8c46039fe5aa None None] PATH_INFO: `/` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:36:38.735483 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 408/790] 10.222.0.25 () {54 vars in 927 bytes} [Tue Sep 13 19:36:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:36:38.743249 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc498e4-cd23-4612-b7d1-9cf0b4692504 None None] REQUEST_METHOD: `POST` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:36:38.743591 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc498e4-cd23-4612-b7d1-9cf0b4692504 None None] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:36:38.743778 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc498e4-cd23-4612-b7d1-9cf0b4692504 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:36:38.780480 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.auth.core [None req-1bc498e4-cd23-4612-b7d1-9cf0b4692504 None None] MFA Rules not processed for user `7b0aed92d02344acb92a0e4aa67c3068`. Rule list: `[]` (Enabled: `True`). {{(pid=87934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:36:38.781704 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.fernet_utils [None req-1bc498e4-cd23-4612-b7d1-9cf0b4692504 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:36:38.824880 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG dbcounter [-] [87934] Writing DB stats keystone:SELECT=100 {{(pid=87934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:36:38.904025 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 409/791] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Sep 13 19:36:38 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 13 19:36:38.905301 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975ae81b-b1b2-4878-a810-5c753d2108b7 None None] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:36:38.905587 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975ae81b-b1b2-4878-a810-5c753d2108b7 None None] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:36:38.905854 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975ae81b-b1b2-4878-a810-5c753d2108b7 None None] PATH_INFO: `/` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:36:38.911740 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 410/792] 10.222.0.25 () {54 vars in 927 bytes} [Tue Sep 13 19:36:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:36:38.914405 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d80a312-8c28-4938-9f4e-287eff5ae0d7 None None] REQUEST_METHOD: `POST` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:36:38.915051 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d80a312-8c28-4938-9f4e-287eff5ae0d7 None None] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:36:38.915051 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d80a312-8c28-4938-9f4e-287eff5ae0d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:36:38.932438 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb7829d-78eb-47cd-89e8-a97440af1469 None admin] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:36:38.953117 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.auth.core [None req-9d80a312-8c28-4938-9f4e-287eff5ae0d7 None None] MFA Rules not processed for user `7b0aed92d02344acb92a0e4aa67c3068`. Rule list: `[]` (Enabled: `True`). {{(pid=87934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:36:38.954234 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.fernet_utils [None req-9d80a312-8c28-4938-9f4e-287eff5ae0d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:36:39.026247 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbbc206b-b5fb-417c-93fe-a9b707ec8945 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:36:39.026864 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbc206b-b5fb-417c-93fe-a9b707ec8945 None admin] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:36:39.027135 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbc206b-b5fb-417c-93fe-a9b707ec8945 None admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:36:39.027397 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbc206b-b5fb-417c-93fe-a9b707ec8945 None admin] PATH_INFO: `/v3/domains` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:36:39.028045 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbbc206b-b5fb-417c-93fe-a9b707ec8945 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87935) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:36:39.028386 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbbc206b-b5fb-417c-93fe-a9b707ec8945 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:36:39.029771 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbbc206b-b5fb-417c-93fe-a9b707ec8945 None admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:36:39.052926 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 383/793] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Sep 13 19:36:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 321 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:36:39.057567 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbbc206b-b5fb-417c-93fe-a9b707ec8945 None admin] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:36:39.073339 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 411/794] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Sep 13 19:36:38 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 13 19:36:39.092591 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG dbcounter [-] [87935] Writing DB stats keystone:SELECT=100 {{(pid=87935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:36:39.178740 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbbc206b-b5fb-417c-93fe-a9b707ec8945 None admin] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:36:39.193297 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d80a312-8c28-4938-9f4e-287eff5ae0d7 None None] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:36:39.245735 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4f138c-04b9-4b28-89db-c3a5d2c4b9d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:36:39.246394 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4f138c-04b9-4b28-89db-c3a5d2c4b9d0 None admin] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:36:39.246643 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4f138c-04b9-4b28-89db-c3a5d2c4b9d0 None admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:36:39.246911 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4f138c-04b9-4b28-89db-c3a5d2c4b9d0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:36:39.262249 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab4f138c-04b9-4b28-89db-c3a5d2c4b9d0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:36:39.263727 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab4f138c-04b9-4b28-89db-c3a5d2c4b9d0 None admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:36:39.282933 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application [None req-ab4f138c-04b9-4b28-89db-c3a5d2c4b9d0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 19:36:39.282933 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:36:39.282933 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:36:39.282933 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:36:39.282933 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:36:39.282933 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:36:39.282933 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:36:39.282933 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:36:39.282933 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:36:39.282933 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:36:39.282933 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:36:39.282933 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:36:39.282933 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 13 19:36:39.282933 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 13 19:36:39.282933 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 13 19:36:39.283881 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 13 19:36:39.283881 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:36:39.283881 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:36:39.283881 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:36:39.283881 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:36:39.283881 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:36:39.283881 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:36:39.283881 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:36:39.283881 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application with Lock( Sep 13 19:36:39.283881 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:36:39.283881 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:36:39.283881 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:36:39.283881 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:36:39.283881 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:36:39.283881 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:36:39.283881 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:36:39.283881 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:36:39.285964 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 13 19:36:39.285964 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 13 19:36:39.285964 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 13 19:36:39.285964 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 13 19:36:39.285964 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 13 19:36:39.285964 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 13 19:36:39.285964 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 19:36:39.285964 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application Sep 13 19:36:39.285964 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 384/795] 10.222.0.25 () {56 vars in 1111 bytes} [Tue Sep 13 19:36:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:36:39.300075 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4f138c-04b9-4b28-89db-c3a5d2c4b9d0 None admin] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:36:39.358285 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG dbcounter [-] [87934] Writing DB stats keystone:SELECT=100 {{(pid=87934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:36:39.390039 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d80a312-8c28-4938-9f4e-287eff5ae0d7 None None] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:36:39.458912 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c2d058-5649-4cf7-9b77-40eb0fc7368b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:36:39.460055 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c2d058-5649-4cf7-9b77-40eb0fc7368b None admin] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:36:39.460628 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c2d058-5649-4cf7-9b77-40eb0fc7368b None admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:36:39.461117 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c2d058-5649-4cf7-9b77-40eb0fc7368b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:36:39.476330 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c2d058-5649-4cf7-9b77-40eb0fc7368b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 19:36:39.482391 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application [None req-d3c2d058-5649-4cf7-9b77-40eb0fc7368b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 19:36:39.482391 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:36:39.482391 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:36:39.482391 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:36:39.482391 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:36:39.482391 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:36:39.482391 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:36:39.482391 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:36:39.482391 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:36:39.482391 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:36:39.482391 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:36:39.482391 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:36:39.482391 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 19:36:39.482391 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 19:36:39.482391 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 19:36:39.482391 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 19:36:39.483490 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 19:36:39.483490 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 19:36:39.483490 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 19:36:39.483490 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 19:36:39.483490 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:36:39.483490 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:36:39.483490 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:36:39.483490 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:36:39.483490 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:36:39.483490 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:36:39.483490 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:36:39.483490 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application with Lock( Sep 13 19:36:39.483490 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:36:39.483490 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:36:39.483490 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:36:39.483490 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:36:39.484380 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:36:39.484380 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:36:39.484380 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:36:39.484380 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:36:39.484380 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 19:36:39.484380 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 19:36:39.484380 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 19:36:39.484380 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 19:36:39.484380 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 19:36:39.484380 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 19:36:39.484380 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 19:36:39.484380 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application Sep 13 19:36:39.488409 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 412/796] 10.222.0.25 () {56 vars in 1096 bytes} [Tue Sep 13 19:36:39 2022] GET /identity/v3/roles/admin => generated 83 bytes in 295 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:36:39.490060 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c2d058-5649-4cf7-9b77-40eb0fc7368b None admin] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:36:39.570515 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG dbcounter [-] [87935] Writing DB stats keystone:SELECT=100 {{(pid=87935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:36:39.617937 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4f138c-04b9-4b28-89db-c3a5d2c4b9d0 None admin] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:36:39.622186 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c2d058-5649-4cf7-9b77-40eb0fc7368b None admin] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:36:39.661383 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6652893-34b6-437b-a0ab-bb71398fc714 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:36:39.662274 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6652893-34b6-437b-a0ab-bb71398fc714 None admin] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:36:39.662700 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6652893-34b6-437b-a0ab-bb71398fc714 None admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:36:39.663115 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6652893-34b6-437b-a0ab-bb71398fc714 None admin] PATH_INFO: `/v3/projects` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:36:39.663947 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6652893-34b6-437b-a0ab-bb71398fc714 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87935) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:36:39.664435 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6652893-34b6-437b-a0ab-bb71398fc714 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:36:39.666035 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6652893-34b6-437b-a0ab-bb71398fc714 None admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:36:39.679385 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 385/797] 10.222.0.25 () {56 vars in 1148 bytes} [Tue Sep 13 19:36:39 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 383 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:36:39.684648 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6652893-34b6-437b-a0ab-bb71398fc714 None admin] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:36:39.686120 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f452ef-ee82-4f1c-b50d-92a812d57555 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:36:39.687202 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f452ef-ee82-4f1c-b50d-92a812d57555 None admin] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:36:39.687792 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f452ef-ee82-4f1c-b50d-92a812d57555 None admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:36:39.688391 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f452ef-ee82-4f1c-b50d-92a812d57555 None admin] PATH_INFO: `/v3/roles/service` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:36:39.703555 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f452ef-ee82-4f1c-b50d-92a812d57555 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 19:36:39.709598 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application [None req-e9f452ef-ee82-4f1c-b50d-92a812d57555 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 13 19:36:39.709598 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:36:39.709598 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:36:39.709598 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:36:39.709598 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:36:39.709598 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:36:39.709598 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:36:39.709598 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:36:39.709598 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:36:39.709598 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:36:39.709598 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:36:39.709598 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:36:39.709598 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 19:36:39.709598 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 19:36:39.709598 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 19:36:39.709598 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 19:36:39.710578 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 19:36:39.710578 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 19:36:39.710578 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 19:36:39.710578 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 19:36:39.710578 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:36:39.710578 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:36:39.710578 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:36:39.710578 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:36:39.710578 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:36:39.710578 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:36:39.710578 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:36:39.710578 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application with Lock( Sep 13 19:36:39.710578 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:36:39.710578 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:36:39.710578 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:36:39.710578 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:36:39.711426 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:36:39.711426 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:36:39.711426 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:36:39.711426 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:36:39.711426 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 19:36:39.711426 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 19:36:39.711426 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 19:36:39.711426 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 19:36:39.711426 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 19:36:39.711426 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 19:36:39.711426 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 13 19:36:39.711426 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application Sep 13 19:36:39.715889 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 413/798] 10.222.0.25 () {56 vars in 1102 bytes} [Tue Sep 13 19:36:39 2022] GET /identity/v3/roles/service => generated 85 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:36:39.716442 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f452ef-ee82-4f1c-b50d-92a812d57555 None admin] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:36:39.727353 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG dbcounter [-] [87934] Writing DB stats keystone:SELECT=100 {{(pid=87934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:36:39.803947 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6652893-34b6-437b-a0ab-bb71398fc714 None admin] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:36:39.833501 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG dbcounter [-] [87935] Writing DB stats keystone:SELECT=100 {{(pid=87935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:36:39.834421 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f452ef-ee82-4f1c-b50d-92a812d57555 None admin] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:36:39.844466 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d369554-77e7-4489-bfa8-e32b381617b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:36:39.845454 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d369554-77e7-4489-bfa8-e32b381617b3 None admin] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:36:39.845934 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d369554-77e7-4489-bfa8-e32b381617b3 None admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:36:39.846426 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d369554-77e7-4489-bfa8-e32b381617b3 None admin] PATH_INFO: `/v3/roles` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:36:39.847313 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d369554-77e7-4489-bfa8-e32b381617b3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87935) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:36:39.848483 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d369554-77e7-4489-bfa8-e32b381617b3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:36:39.850162 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d369554-77e7-4489-bfa8-e32b381617b3 None admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:36:39.864435 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 386/799] 10.222.0.25 () {56 vars in 1099 bytes} [Tue Sep 13 19:36:39 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:36:39.865992 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d369554-77e7-4489-bfa8-e32b381617b3 None admin] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:36:39.881754 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0152331-d4cf-4396-b40a-3fa6810eb435 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:36:39.882857 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0152331-d4cf-4396-b40a-3fa6810eb435 None admin] REQUEST_METHOD: `PUT` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:36:39.883348 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0152331-d4cf-4396-b40a-3fa6810eb435 None admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:36:39.883839 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0152331-d4cf-4396-b40a-3fa6810eb435 None admin] PATH_INFO: `/v3/projects/9a10a4268f3c4cb29f4e00c292e2df62/users/fb42d6ac6cdd4d97a80c3ee0c6f8e3f5/roles/6ca1d4427ff64e0a9d25d96cfb1445f6` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:36:39.887377 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0152331-d4cf-4396-b40a-3fa6810eb435 None admin] RBAC: Authorizing `identity:create_grant(project_id=9a10a4268f3c4cb29f4e00c292e2df62, user_id=fb42d6ac6cdd4d97a80c3ee0c6f8e3f5, role_id=6ca1d4427ff64e0a9d25d96cfb1445f6)` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:36:39.890427 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0152331-d4cf-4396-b40a-3fa6810eb435 None admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:36:39.920239 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 414/800] 10.222.0.25 () {58 vars in 1439 bytes} [Tue Sep 13 19:36:39 2022] PUT /identity/v3/projects/9a10a4268f3c4cb29f4e00c292e2df62/users/fb42d6ac6cdd4d97a80c3ee0c6f8e3f5/roles/6ca1d4427ff64e0a9d25d96cfb1445f6 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 19:36:39.920239 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0152331-d4cf-4396-b40a-3fa6810eb435 None admin] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:36:40.020502 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d369554-77e7-4489-bfa8-e32b381617b3 None admin] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:36:40.022053 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG dbcounter [-] [87934] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:36:40.076426 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0152331-d4cf-4396-b40a-3fa6810eb435 None admin] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:36:40.088334 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5c0d07-43b7-466c-b500-df01e48bbd1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:36:40.089293 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5c0d07-43b7-466c-b500-df01e48bbd1e None admin] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:36:40.089791 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5c0d07-43b7-466c-b500-df01e48bbd1e None admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:36:40.090378 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5c0d07-43b7-466c-b500-df01e48bbd1e None admin] PATH_INFO: `/v3/roles` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:36:40.091367 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c5c0d07-43b7-466c-b500-df01e48bbd1e None admin] RBAC: Adding query filter params (name=service) {{(pid=87935) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:36:40.091908 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c5c0d07-43b7-466c-b500-df01e48bbd1e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:36:40.093556 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c5c0d07-43b7-466c-b500-df01e48bbd1e None admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:36:40.103820 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 387/801] 10.222.0.25 () {56 vars in 1103 bytes} [Tue Sep 13 19:36:39 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:36:40.114659 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5c0d07-43b7-466c-b500-df01e48bbd1e None admin] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:36:40.117172 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12564cb8-631c-4cef-be52-cb762b899476 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:36:40.117939 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12564cb8-631c-4cef-be52-cb762b899476 None admin] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:36:40.118352 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12564cb8-631c-4cef-be52-cb762b899476 None admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:36:40.118695 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12564cb8-631c-4cef-be52-cb762b899476 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:36:40.136237 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12564cb8-631c-4cef-be52-cb762b899476 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:36:40.136237 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12564cb8-631c-4cef-be52-cb762b899476 None admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:36:40.152533 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application [None req-12564cb8-631c-4cef-be52-cb762b899476 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 19:36:40.152533 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:36:40.152533 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:36:40.152533 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:36:40.152533 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:36:40.152533 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:36:40.152533 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:36:40.152533 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:36:40.152533 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:36:40.152533 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:36:40.152533 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:36:40.152533 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:36:40.152533 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 19:36:40.152533 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 19:36:40.152533 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 19:36:40.152533 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 19:36:40.153584 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:36:40.153584 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:36:40.153584 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:36:40.153584 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:36:40.153584 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:36:40.153584 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:36:40.153584 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:36:40.153584 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application with Lock( Sep 13 19:36:40.153584 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:36:40.153584 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:36:40.153584 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:36:40.153584 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:36:40.153584 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:36:40.153584 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:36:40.153584 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:36:40.153584 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:36:40.153584 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 19:36:40.154515 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 19:36:40.154515 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 19:36:40.154515 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application Sep 13 19:36:40.158185 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 415/802] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Sep 13 19:36:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:36:40.160072 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12564cb8-631c-4cef-be52-cb762b899476 None admin] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:36:40.190596 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG dbcounter [-] [87935] Writing DB stats keystone:SELECT=100 {{(pid=87935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:36:40.254287 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5c0d07-43b7-466c-b500-df01e48bbd1e None admin] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:36:40.294975 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43b5e4d-c519-456d-bec7-81d8b970d6d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:36:40.295764 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43b5e4d-c519-456d-bec7-81d8b970d6d4 None admin] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:36:40.296146 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43b5e4d-c519-456d-bec7-81d8b970d6d4 None admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:36:40.296544 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43b5e4d-c519-456d-bec7-81d8b970d6d4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:36:40.308496 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f43b5e4d-c519-456d-bec7-81d8b970d6d4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:36:40.310189 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f43b5e4d-c519-456d-bec7-81d8b970d6d4 None admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:36:40.327777 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application [None req-f43b5e4d-c519-456d-bec7-81d8b970d6d4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 19:36:40.327777 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:36:40.327777 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:36:40.327777 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:36:40.327777 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:36:40.327777 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:36:40.327777 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:36:40.327777 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:36:40.327777 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:36:40.327777 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:36:40.327777 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:36:40.327777 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:36:40.327777 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 19:36:40.327777 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 19:36:40.327777 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 19:36:40.327777 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 19:36:40.328907 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:36:40.328907 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:36:40.328907 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:36:40.328907 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:36:40.328907 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:36:40.328907 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:36:40.328907 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:36:40.328907 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application with Lock( Sep 13 19:36:40.328907 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:36:40.328907 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:36:40.328907 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:36:40.328907 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:36:40.328907 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:36:40.328907 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:36:40.328907 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:36:40.328907 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:36:40.328907 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 19:36:40.329804 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 19:36:40.329804 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 19:36:40.329804 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application Sep 13 19:36:40.329804 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 388/803] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Sep 13 19:36:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 13 19:36:40.336496 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43b5e4d-c519-456d-bec7-81d8b970d6d4 None admin] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:36:40.424015 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12564cb8-631c-4cef-be52-cb762b899476 None admin] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:36:40.447346 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG dbcounter [-] [87934] Writing DB stats keystone:SELECT=100 {{(pid=87934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:36:40.469606 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2405a326-16d4-4a96-9b08-400579acf0bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:36:40.470217 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2405a326-16d4-4a96-9b08-400579acf0bd None admin] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:36:40.470654 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2405a326-16d4-4a96-9b08-400579acf0bd None admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:36:40.470937 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2405a326-16d4-4a96-9b08-400579acf0bd None admin] PATH_INFO: `/v3/domains` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:36:40.471589 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2405a326-16d4-4a96-9b08-400579acf0bd None admin] RBAC: Adding query filter params (name=Default) {{(pid=87934) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:36:40.471893 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2405a326-16d4-4a96-9b08-400579acf0bd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:36:40.474536 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2405a326-16d4-4a96-9b08-400579acf0bd None admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:36:40.487629 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 416/804] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Sep 13 19:36:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 328 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 19:36:40.493504 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2405a326-16d4-4a96-9b08-400579acf0bd None admin] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:36:40.586704 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43b5e4d-c519-456d-bec7-81d8b970d6d4 None admin] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:36:40.589043 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG dbcounter [-] [87935] Writing DB stats keystone:SELECT=100 {{(pid=87935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:36:40.628453 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb09777-c976-4d42-a8c0-415d86732c85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:36:40.630108 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb09777-c976-4d42-a8c0-415d86732c85 None admin] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:36:40.630665 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb09777-c976-4d42-a8c0-415d86732c85 None admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:36:40.631147 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb09777-c976-4d42-a8c0-415d86732c85 None admin] PATH_INFO: `/v3/domains` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:36:40.631528 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2405a326-16d4-4a96-9b08-400579acf0bd None admin] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:36:40.632363 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb09777-c976-4d42-a8c0-415d86732c85 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87935) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:36:40.632895 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb09777-c976-4d42-a8c0-415d86732c85 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:36:40.634525 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb09777-c976-4d42-a8c0-415d86732c85 None admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:36:40.650304 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 389/805] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Sep 13 19:36:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 314 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:36:40.652101 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cae576a-1d68-4ac7-90fc-a223799d22df None None] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:36:40.652669 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cae576a-1d68-4ac7-90fc-a223799d22df None None] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:36:40.653213 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cae576a-1d68-4ac7-90fc-a223799d22df None None] PATH_INFO: `/` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:36:40.659201 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 390/806] 10.222.0.25 () {54 vars in 927 bytes} [Tue Sep 13 19:36:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:36:40.661066 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cae576a-1d68-4ac7-90fc-a223799d22df None None] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:36:40.681069 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85501b21-8e71-4ec3-8d4a-7553d7eff386 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:36:40.681624 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85501b21-8e71-4ec3-8d4a-7553d7eff386 None admin] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:36:40.681906 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85501b21-8e71-4ec3-8d4a-7553d7eff386 None admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:36:40.682176 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85501b21-8e71-4ec3-8d4a-7553d7eff386 None admin] PATH_INFO: `/v3/users/nova` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:36:40.693832 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85501b21-8e71-4ec3-8d4a-7553d7eff386 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:36:40.696036 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85501b21-8e71-4ec3-8d4a-7553d7eff386 None admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:36:40.711754 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application [None req-85501b21-8e71-4ec3-8d4a-7553d7eff386 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 13 19:36:40.711754 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:36:40.711754 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:36:40.711754 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:36:40.711754 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:36:40.711754 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:36:40.711754 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:36:40.711754 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:36:40.711754 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:36:40.711754 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:36:40.711754 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:36:40.711754 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:36:40.711754 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 13 19:36:40.711754 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 13 19:36:40.711754 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 13 19:36:40.711754 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 13 19:36:40.712795 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:36:40.712795 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:36:40.712795 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 13 19:36:40.712795 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 19:36:40.712795 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 13 19:36:40.712795 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 19:36:40.712795 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:36:40.712795 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:36:40.712795 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:36:40.712795 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:36:40.712795 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:36:40.712795 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application with Lock( Sep 13 19:36:40.712795 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:36:40.712795 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:36:40.712795 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:36:40.712795 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:36:40.712795 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:36:40.712795 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:36:40.713760 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:36:40.713760 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:36:40.713760 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 13 19:36:40.713760 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 13 19:36:40.713760 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 13 19:36:40.713760 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 13 19:36:40.713760 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 13 19:36:40.713760 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 13 19:36:40.713760 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 13 19:36:40.713760 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application Sep 13 19:36:40.713760 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 417/807] 10.222.0.25 () {56 vars in 1093 bytes} [Tue Sep 13 19:36:40 2022] GET /identity/v3/users/nova => generated 82 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:36:40.714868 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed157c6-1890-4cc7-bcc7-ec922bee3ac4 None None] REQUEST_METHOD: `POST` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:36:40.714868 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed157c6-1890-4cc7-bcc7-ec922bee3ac4 None None] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:36:40.715121 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed157c6-1890-4cc7-bcc7-ec922bee3ac4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:36:40.740791 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.auth.core [None req-5ed157c6-1890-4cc7-bcc7-ec922bee3ac4 None None] MFA Rules not processed for user `7b0aed92d02344acb92a0e4aa67c3068`. Rule list: `[]` (Enabled: `True`). {{(pid=87934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:36:40.742008 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.fernet_utils [None req-5ed157c6-1890-4cc7-bcc7-ec922bee3ac4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:36:40.779279 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG dbcounter [-] [87934] Writing DB stats keystone:SELECT=100 {{(pid=87934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:36:40.782893 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cae576a-1d68-4ac7-90fc-a223799d22df None None] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:36:40.821114 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9dc91fb-e835-4db3-9fd7-f448a176845a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:36:40.821747 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9dc91fb-e835-4db3-9fd7-f448a176845a None admin] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:36:40.822018 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9dc91fb-e835-4db3-9fd7-f448a176845a None admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:36:40.822280 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9dc91fb-e835-4db3-9fd7-f448a176845a None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:36:40.822723 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 418/808] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Sep 13 19:36:40 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 13 19:36:40.823669 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed157c6-1890-4cc7-bcc7-ec922bee3ac4 None None] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:36:40.842276 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9dc91fb-e835-4db3-9fd7-f448a176845a None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:36:40.846060 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9dc91fb-e835-4db3-9fd7-f448a176845a None admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:36:40.872457 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application [None req-c9dc91fb-e835-4db3-9fd7-f448a176845a None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 13 19:36:40.872457 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:36:40.872457 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:36:40.872457 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:36:40.872457 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:36:40.872457 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:36:40.872457 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:36:40.872457 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:36:40.872457 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:36:40.872457 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:36:40.872457 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:36:40.872457 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:36:40.872457 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 13 19:36:40.872457 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 13 19:36:40.872457 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 13 19:36:40.872457 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 13 19:36:40.873499 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:36:40.873499 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:36:40.873499 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 13 19:36:40.873499 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 19:36:40.873499 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 13 19:36:40.873499 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 19:36:40.873499 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:36:40.873499 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:36:40.873499 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:36:40.873499 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:36:40.873499 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:36:40.873499 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application with Lock( Sep 13 19:36:40.873499 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:36:40.873499 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:36:40.873499 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:36:40.873499 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:36:40.873499 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:36:40.873499 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:36:40.874519 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:36:40.874519 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:36:40.874519 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 13 19:36:40.874519 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 13 19:36:40.874519 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 13 19:36:40.874519 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 13 19:36:40.874519 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 13 19:36:40.874519 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 13 19:36:40.874519 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 13 19:36:40.874519 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application Sep 13 19:36:40.878660 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 391/809] 10.222.0.25 () {56 vars in 1117 bytes} [Tue Sep 13 19:36:40 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:36:40.881240 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f73dcf-8978-4aff-a55b-2beee2370de2 None None] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:36:40.881723 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f73dcf-8978-4aff-a55b-2beee2370de2 None None] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:36:40.882865 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f73dcf-8978-4aff-a55b-2beee2370de2 None None] PATH_INFO: `/` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:36:40.885578 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 392/810] 10.222.0.25 () {54 vars in 927 bytes} [Tue Sep 13 19:36:40 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:36:40.886585 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f73dcf-8978-4aff-a55b-2beee2370de2 None None] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:36:40.924651 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG dbcounter [-] [87935] Writing DB stats keystone:SELECT=100 {{(pid=87935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:36:40.982525 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed157c6-1890-4cc7-bcc7-ec922bee3ac4 None None] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:36:41.037844 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9e17c3-d8b3-473c-a4c5-600b8ce8899b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:36:41.038609 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9e17c3-d8b3-473c-a4c5-600b8ce8899b None admin] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:36:41.038744 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9e17c3-d8b3-473c-a4c5-600b8ce8899b None admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:36:41.038983 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9e17c3-d8b3-473c-a4c5-600b8ce8899b None admin] PATH_INFO: `/v3/users` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:36:41.039713 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a9e17c3-d8b3-473c-a4c5-600b8ce8899b None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=87934) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:36:41.040035 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a9e17c3-d8b3-473c-a4c5-600b8ce8899b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:36:41.041470 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a9e17c3-d8b3-473c-a4c5-600b8ce8899b None admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:36:41.047774 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f73dcf-8978-4aff-a55b-2beee2370de2 None None] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:36:41.063770 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 419/811] 10.222.0.25 () {56 vars in 1133 bytes} [Tue Sep 13 19:36:40 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:36:41.065542 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30b7c6f-2591-4f02-bee1-fc795c1aaba3 None None] REQUEST_METHOD: `POST` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:36:41.066051 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30b7c6f-2591-4f02-bee1-fc795c1aaba3 None None] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:36:41.067155 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30b7c6f-2591-4f02-bee1-fc795c1aaba3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:36:41.092537 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.auth.core [None req-a30b7c6f-2591-4f02-bee1-fc795c1aaba3 None None] MFA Rules not processed for user `7b0aed92d02344acb92a0e4aa67c3068`. Rule list: `[]` (Enabled: `True`). {{(pid=87934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:36:41.094058 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.fernet_utils [None req-a30b7c6f-2591-4f02-bee1-fc795c1aaba3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:36:41.095737 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16ee62f-169b-4187-bed8-818d291cf1e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:36:41.096960 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16ee62f-169b-4187-bed8-818d291cf1e1 None admin] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:36:41.098476 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16ee62f-169b-4187-bed8-818d291cf1e1 None admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:36:41.098994 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16ee62f-169b-4187-bed8-818d291cf1e1 None admin] PATH_INFO: `/v3/users` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:36:41.099940 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e16ee62f-169b-4187-bed8-818d291cf1e1 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=87935) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:36:41.100469 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e16ee62f-169b-4187-bed8-818d291cf1e1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:36:41.102104 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e16ee62f-169b-4187-bed8-818d291cf1e1 None admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:36:41.119326 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG dbcounter [-] [87934] Writing DB stats keystone:SELECT=100 {{(pid=87934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:36:41.132266 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 393/812] 10.222.0.25 () {56 vars in 1149 bytes} [Tue Sep 13 19:36:40 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:36:41.133478 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16ee62f-169b-4187-bed8-818d291cf1e1 None admin] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:36:41.188114 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 420/813] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Sep 13 19:36:41 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 13 19:36:41.189376 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30b7c6f-2591-4f02-bee1-fc795c1aaba3 None None] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:36:41.272854 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG dbcounter [-] [87935] Writing DB stats keystone:SELECT=100 {{(pid=87935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:36:41.302635 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16ee62f-169b-4187-bed8-818d291cf1e1 None admin] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:36:41.348839 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30b7c6f-2591-4f02-bee1-fc795c1aaba3 None None] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:36:41.352872 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe667ca-5924-44e1-aa4c-445e30059382 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:36:41.354977 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe667ca-5924-44e1-aa4c-445e30059382 None admin] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:36:41.356529 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe667ca-5924-44e1-aa4c-445e30059382 None admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:36:41.356811 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe667ca-5924-44e1-aa4c-445e30059382 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:36:41.410907 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca49dab-3cff-4732-a4c1-7c9a3f4f350b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:36:41.411557 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca49dab-3cff-4732-a4c1-7c9a3f4f350b None admin] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:36:41.411830 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca49dab-3cff-4732-a4c1-7c9a3f4f350b None admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:36:41.412095 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca49dab-3cff-4732-a4c1-7c9a3f4f350b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:36:41.426398 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca49dab-3cff-4732-a4c1-7c9a3f4f350b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:36:41.428565 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca49dab-3cff-4732-a4c1-7c9a3f4f350b None admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:36:41.445117 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe667ca-5924-44e1-aa4c-445e30059382 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:36:41.447007 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe667ca-5924-44e1-aa4c-445e30059382 None admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:36:41.449783 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application [None req-3ca49dab-3cff-4732-a4c1-7c9a3f4f350b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 19:36:41.449783 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:36:41.449783 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:36:41.449783 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:36:41.449783 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:36:41.449783 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:36:41.449783 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:36:41.449783 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:36:41.449783 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:36:41.449783 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:36:41.449783 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:36:41.449783 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:36:41.449783 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 19:36:41.449783 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 19:36:41.449783 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 19:36:41.449783 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 19:36:41.450738 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:36:41.450738 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:36:41.450738 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:36:41.450738 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:36:41.450738 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:36:41.450738 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:36:41.450738 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:36:41.450738 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application with Lock( Sep 13 19:36:41.450738 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:36:41.450738 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:36:41.450738 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:36:41.450738 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:36:41.450738 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:36:41.450738 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:36:41.450738 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:36:41.450738 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:36:41.450738 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 19:36:41.456751 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 19:36:41.456751 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 19:36:41.456751 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application Sep 13 19:36:41.456751 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 421/814] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Sep 13 19:36:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 262 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:36:41.456751 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca49dab-3cff-4732-a4c1-7c9a3f4f350b None admin] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:36:41.472062 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG dbcounter [-] [87934] Writing DB stats keystone:SELECT=100 {{(pid=87934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:36:41.550415 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG dbcounter [-] [87935] Writing DB stats keystone:SELECT=100 {{(pid=87935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:36:41.572126 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 394/815] 10.222.0.25 () {58 vars in 1282 bytes} [Tue Sep 13 19:36:41 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 439 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 13 19:36:41.573012 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe667ca-5924-44e1-aa4c-445e30059382 None admin] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:36:41.587191 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca49dab-3cff-4732-a4c1-7c9a3f4f350b None admin] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:36:41.632936 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e01b745-66ed-4e1b-974a-a9ff3f7c803e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:36:41.633571 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e01b745-66ed-4e1b-974a-a9ff3f7c803e None admin] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:36:41.633846 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e01b745-66ed-4e1b-974a-a9ff3f7c803e None admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:36:41.634130 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e01b745-66ed-4e1b-974a-a9ff3f7c803e None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:36:41.634689 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e01b745-66ed-4e1b-974a-a9ff3f7c803e None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:36:41.636099 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e01b745-66ed-4e1b-974a-a9ff3f7c803e None admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:36:41.646647 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application [None req-9e01b745-66ed-4e1b-974a-a9ff3f7c803e None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 13 19:36:41.646647 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:36:41.646647 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 13 19:36:41.646647 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 13 19:36:41.646647 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 13 19:36:41.646647 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 13 19:36:41.646647 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 13 19:36:41.646647 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 19:36:41.646647 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 13 19:36:41.646647 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application Sep 13 19:36:41.646647 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 13 19:36:41.646647 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application Sep 13 19:36:41.646647 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:36:41.646647 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:36:41.646647 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:36:41.646647 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:36:41.646647 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:36:41.647765 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:36:41.647765 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:36:41.647765 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:36:41.647765 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:36:41.647765 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:36:41.647765 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:36:41.647765 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 13 19:36:41.647765 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 13 19:36:41.647765 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 13 19:36:41.647765 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 13 19:36:41.647765 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:36:41.647765 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:36:41.647765 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:36:41.647765 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:36:41.647765 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:36:41.647765 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:36:41.648709 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:36:41.648709 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application with Lock( Sep 13 19:36:41.648709 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:36:41.648709 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:36:41.648709 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:36:41.648709 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:36:41.648709 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:36:41.648709 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:36:41.648709 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:36:41.648709 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:36:41.648709 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 13 19:36:41.648709 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 19:36:41.648709 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 13 19:36:41.648709 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application Sep 13 19:36:41.648709 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 422/816] 10.222.0.25 () {56 vars in 1129 bytes} [Tue Sep 13 19:36:41 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:36:41.649575 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e01b745-66ed-4e1b-974a-a9ff3f7c803e None admin] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:36:41.705164 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe667ca-5924-44e1-aa4c-445e30059382 None admin] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:36:41.731474 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG dbcounter [-] [87934] Writing DB stats keystone:SELECT=100 {{(pid=87934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:36:41.769502 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3bd132-724d-4abc-bac8-f1e027779a46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:36:41.771637 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3bd132-724d-4abc-bac8-f1e027779a46 None admin] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:36:41.771755 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3bd132-724d-4abc-bac8-f1e027779a46 None admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:36:41.772083 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3bd132-724d-4abc-bac8-f1e027779a46 None admin] PATH_INFO: `/v3/domains` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:36:41.773220 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c3bd132-724d-4abc-bac8-f1e027779a46 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87935) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:36:41.773726 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c3bd132-724d-4abc-bac8-f1e027779a46 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:36:41.775968 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c3bd132-724d-4abc-bac8-f1e027779a46 None admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:36:41.780652 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e01b745-66ed-4e1b-974a-a9ff3f7c803e None admin] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:36:41.798968 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 395/817] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Sep 13 19:36:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:36:41.798968 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3bd132-724d-4abc-bac8-f1e027779a46 None admin] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:36:41.837520 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9abbea70-df69-4697-8a36-c13bf41cf1ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:36:41.838070 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abbea70-df69-4697-8a36-c13bf41cf1ea None admin] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:36:41.838350 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abbea70-df69-4697-8a36-c13bf41cf1ea None admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:36:41.838713 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abbea70-df69-4697-8a36-c13bf41cf1ea None admin] PATH_INFO: `/v3/services/network` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:36:41.839398 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9abbea70-df69-4697-8a36-c13bf41cf1ea None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:36:41.840792 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9abbea70-df69-4697-8a36-c13bf41cf1ea None admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:36:41.850924 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application [None req-9abbea70-df69-4697-8a36-c13bf41cf1ea None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Sep 13 19:36:41.850924 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:36:41.850924 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 13 19:36:41.850924 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 13 19:36:41.850924 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 13 19:36:41.850924 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 13 19:36:41.850924 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 13 19:36:41.850924 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 19:36:41.850924 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 13 19:36:41.850924 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application Sep 13 19:36:41.850924 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 13 19:36:41.850924 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application Sep 13 19:36:41.850924 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:36:41.850924 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:36:41.850924 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:36:41.850924 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:36:41.850924 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:36:41.851990 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:36:41.851990 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:36:41.851990 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:36:41.851990 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:36:41.851990 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:36:41.851990 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:36:41.851990 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 13 19:36:41.851990 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 13 19:36:41.851990 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 13 19:36:41.851990 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 13 19:36:41.851990 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:36:41.851990 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:36:41.851990 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:36:41.851990 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:36:41.851990 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:36:41.851990 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:36:41.852918 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:36:41.852918 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application with Lock( Sep 13 19:36:41.852918 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:36:41.852918 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:36:41.852918 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:36:41.852918 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:36:41.852918 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:36:41.852918 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:36:41.852918 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:36:41.852918 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:36:41.852918 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 13 19:36:41.852918 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 19:36:41.852918 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 13 19:36:41.852918 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application Sep 13 19:36:41.856963 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 423/818] 10.222.0.25 () {56 vars in 1111 bytes} [Tue Sep 13 19:36:41 2022] GET /identity/v3/services/network => generated 88 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:36:41.857575 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG dbcounter [-] [87935] Writing DB stats keystone:SELECT=100 {{(pid=87935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:36:41.857814 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9abbea70-df69-4697-8a36-c13bf41cf1ea None admin] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:36:41.932914 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3bd132-724d-4abc-bac8-f1e027779a46 None admin] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:36:41.977750 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9abbea70-df69-4697-8a36-c13bf41cf1ea None admin] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:36:41.978753 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644f582b-bd7d-47e6-8965-57859cdf062d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:36:41.979391 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644f582b-bd7d-47e6-8965-57859cdf062d None admin] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:36:41.979665 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644f582b-bd7d-47e6-8965-57859cdf062d None admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:36:41.979945 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644f582b-bd7d-47e6-8965-57859cdf062d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:36:41.991993 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-644f582b-bd7d-47e6-8965-57859cdf062d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:36:41.993464 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-644f582b-bd7d-47e6-8965-57859cdf062d None admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:36:42.008408 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application [None req-644f582b-bd7d-47e6-8965-57859cdf062d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 19:36:42.008408 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:36:42.008408 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:36:42.008408 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:36:42.008408 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:36:42.008408 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:36:42.008408 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:36:42.008408 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:36:42.008408 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:36:42.008408 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:36:42.008408 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:36:42.008408 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:36:42.008408 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 19:36:42.008408 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 19:36:42.008408 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 19:36:42.008408 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 19:36:42.009611 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:36:42.009611 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:36:42.009611 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:36:42.009611 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:36:42.009611 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:36:42.009611 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:36:42.009611 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:36:42.009611 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application with Lock( Sep 13 19:36:42.009611 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:36:42.009611 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:36:42.009611 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:36:42.009611 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:36:42.009611 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:36:42.009611 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:36:42.009611 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:36:42.009611 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:36:42.009611 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 19:36:42.010687 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 19:36:42.010687 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 19:36:42.010687 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application Sep 13 19:36:42.010687 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 396/819] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Sep 13 19:36:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:36:42.010687 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644f582b-bd7d-47e6-8965-57859cdf062d None admin] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:36:42.024319 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165493bc-3179-482e-b387-c6652d40942c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:36:42.024933 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165493bc-3179-482e-b387-c6652d40942c None admin] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:36:42.025208 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165493bc-3179-482e-b387-c6652d40942c None admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:36:42.025475 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165493bc-3179-482e-b387-c6652d40942c None admin] PATH_INFO: `/v3/services` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:36:42.026107 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-165493bc-3179-482e-b387-c6652d40942c None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=87934) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:36:42.026409 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-165493bc-3179-482e-b387-c6652d40942c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:36:42.027781 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-165493bc-3179-482e-b387-c6652d40942c None admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:36:42.030679 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG dbcounter [-] [87934] Writing DB stats keystone:SELECT=100 {{(pid=87934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:36:42.040365 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 424/820] 10.222.0.25 () {56 vars in 1124 bytes} [Tue Sep 13 19:36:41 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:36:42.041612 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165493bc-3179-482e-b387-c6652d40942c None admin] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:36:42.119757 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG dbcounter [-] [87935] Writing DB stats keystone:SELECT=100 {{(pid=87935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:36:42.130020 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644f582b-bd7d-47e6-8965-57859cdf062d None admin] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:36:42.155250 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165493bc-3179-482e-b387-c6652d40942c None admin] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:36:42.166562 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa85c0b4-7d4e-42ab-95fd-d66479742c2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:36:42.167500 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa85c0b4-7d4e-42ab-95fd-d66479742c2b None admin] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:36:42.167923 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa85c0b4-7d4e-42ab-95fd-d66479742c2b None admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:36:42.168198 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa85c0b4-7d4e-42ab-95fd-d66479742c2b None admin] PATH_INFO: `/v3/projects/service` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:36:42.175259 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa85c0b4-7d4e-42ab-95fd-d66479742c2b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:36:42.176781 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa85c0b4-7d4e-42ab-95fd-d66479742c2b None admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:36:42.188490 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application [None req-aa85c0b4-7d4e-42ab-95fd-d66479742c2b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 19:36:42.188490 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:36:42.188490 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:36:42.188490 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:36:42.188490 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:36:42.188490 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:36:42.188490 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:36:42.188490 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:36:42.188490 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:36:42.188490 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:36:42.188490 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:36:42.188490 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:36:42.188490 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 13 19:36:42.188490 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 13 19:36:42.188490 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 13 19:36:42.189427 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 13 19:36:42.189427 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:36:42.189427 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:36:42.189427 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:36:42.189427 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:36:42.189427 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:36:42.189427 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:36:42.189427 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:36:42.189427 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application with Lock( Sep 13 19:36:42.189427 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:36:42.189427 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:36:42.189427 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:36:42.189427 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:36:42.189427 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:36:42.189427 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:36:42.189427 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:36:42.189427 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:36:42.190337 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 13 19:36:42.190337 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 13 19:36:42.190337 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 13 19:36:42.190337 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 13 19:36:42.190337 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 13 19:36:42.190337 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 13 19:36:42.190337 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 19:36:42.190337 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application Sep 13 19:36:42.190337 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 397/821] 10.222.0.25 () {56 vars in 1111 bytes} [Tue Sep 13 19:36:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:36:42.190833 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa85c0b4-7d4e-42ab-95fd-d66479742c2b None admin] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:36:42.198517 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565c91a6-854b-4673-85cd-917fc61aab4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:36:42.199136 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565c91a6-854b-4673-85cd-917fc61aab4c None admin] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:36:42.199410 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565c91a6-854b-4673-85cd-917fc61aab4c None admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:36:42.199674 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565c91a6-854b-4673-85cd-917fc61aab4c None admin] PATH_INFO: `/v3/services` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:36:42.200379 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-565c91a6-854b-4673-85cd-917fc61aab4c None admin] RBAC: Adding query filter params (name=network) {{(pid=87934) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:36:42.200678 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-565c91a6-854b-4673-85cd-917fc61aab4c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:36:42.202092 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-565c91a6-854b-4673-85cd-917fc61aab4c None admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:36:42.207301 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 425/822] 10.222.0.25 () {56 vars in 1112 bytes} [Tue Sep 13 19:36:42 2022] GET /identity/v3/services?name=network => generated 124 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:36:42.208818 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565c91a6-854b-4673-85cd-917fc61aab4c None admin] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:36:42.282803 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG dbcounter [-] [87934] Writing DB stats keystone:SELECT=100 {{(pid=87934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:36:42.326973 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565c91a6-854b-4673-85cd-917fc61aab4c None admin] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:36:42.327278 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa85c0b4-7d4e-42ab-95fd-d66479742c2b None admin] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:36:42.374713 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae9fb1a-a2c5-4e86-aadb-93eb46adaaf8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:36:42.375287 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae9fb1a-a2c5-4e86-aadb-93eb46adaaf8 None admin] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:36:42.375514 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae9fb1a-a2c5-4e86-aadb-93eb46adaaf8 None admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:36:42.375782 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae9fb1a-a2c5-4e86-aadb-93eb46adaaf8 None admin] PATH_INFO: `/v3/services` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:36:42.376440 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae9fb1a-a2c5-4e86-aadb-93eb46adaaf8 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=87934) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:36:42.376741 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae9fb1a-a2c5-4e86-aadb-93eb46adaaf8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:36:42.378090 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae9fb1a-a2c5-4e86-aadb-93eb46adaaf8 None admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:36:42.380166 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d16992-e84c-422d-9b85-ce1a469ca670 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:36:42.380889 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d16992-e84c-422d-9b85-ce1a469ca670 None admin] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:36:42.381350 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d16992-e84c-422d-9b85-ce1a469ca670 None admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:36:42.381465 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d16992-e84c-422d-9b85-ce1a469ca670 None admin] PATH_INFO: `/v3/domains` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:36:42.382065 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d16992-e84c-422d-9b85-ce1a469ca670 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87935) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:36:42.382411 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d16992-e84c-422d-9b85-ce1a469ca670 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:36:42.383898 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d16992-e84c-422d-9b85-ce1a469ca670 None admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:36:42.384729 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 426/823] 10.222.0.25 () {56 vars in 1124 bytes} [Tue Sep 13 19:36:42 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:36:42.385463 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae9fb1a-a2c5-4e86-aadb-93eb46adaaf8 None admin] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:36:42.409490 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 398/824] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Sep 13 19:36:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:36:42.409490 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d16992-e84c-422d-9b85-ce1a469ca670 None admin] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:36:42.427777 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG dbcounter [-] [87935] Writing DB stats keystone:SELECT=100 {{(pid=87935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:36:42.508236 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae9fb1a-a2c5-4e86-aadb-93eb46adaaf8 None admin] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:36:42.524930 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d16992-e84c-422d-9b85-ce1a469ca670 None admin] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:36:42.535720 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG dbcounter [-] [87934] Writing DB stats keystone:SELECT=100 {{(pid=87934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:36:42.545100 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c4db69-e840-43e2-9f2f-8fb4c6bb40fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:36:42.545717 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c4db69-e840-43e2-9f2f-8fb4c6bb40fc None admin] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:36:42.545993 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c4db69-e840-43e2-9f2f-8fb4c6bb40fc None admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:36:42.546262 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c4db69-e840-43e2-9f2f-8fb4c6bb40fc None admin] PATH_INFO: `/v3/projects` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:36:42.547127 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c4db69-e840-43e2-9f2f-8fb4c6bb40fc None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87934) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:36:42.547433 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c4db69-e840-43e2-9f2f-8fb4c6bb40fc None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:36:42.548907 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c4db69-e840-43e2-9f2f-8fb4c6bb40fc None admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:36:42.561447 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e2c39f-b41e-445b-b1a2-3fb1d1511746 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:36:42.561903 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 427/825] 10.222.0.25 () {56 vars in 1148 bytes} [Tue Sep 13 19:36:42 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:36:42.562067 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e2c39f-b41e-445b-b1a2-3fb1d1511746 None admin] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:36:42.562301 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e2c39f-b41e-445b-b1a2-3fb1d1511746 None admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:36:42.562564 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e2c39f-b41e-445b-b1a2-3fb1d1511746 None admin] PATH_INFO: `/v3/services` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:36:42.562710 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c4db69-e840-43e2-9f2f-8fb4c6bb40fc None admin] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:36:42.563187 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e2c39f-b41e-445b-b1a2-3fb1d1511746 None admin] RBAC: Adding query filter params (type=network) {{(pid=87935) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:36:42.563550 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e2c39f-b41e-445b-b1a2-3fb1d1511746 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:36:42.564935 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e2c39f-b41e-445b-b1a2-3fb1d1511746 None admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:36:42.571707 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 399/826] 10.222.0.25 () {56 vars in 1112 bytes} [Tue Sep 13 19:36:42 2022] GET /identity/v3/services?type=network => generated 350 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:36:42.572539 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e2c39f-b41e-445b-b1a2-3fb1d1511746 None admin] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:36:42.652023 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG dbcounter [-] [87935] Writing DB stats keystone:SELECT=100 {{(pid=87935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:36:42.663055 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c4db69-e840-43e2-9f2f-8fb4c6bb40fc None admin] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:36:42.679159 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e2c39f-b41e-445b-b1a2-3fb1d1511746 None admin] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:36:42.698189 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6717d1a-98e3-41e1-aad4-c5d949b9adbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:36:42.698794 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6717d1a-98e3-41e1-aad4-c5d949b9adbb None admin] REQUEST_METHOD: `POST` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:36:42.699071 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6717d1a-98e3-41e1-aad4-c5d949b9adbb None admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:36:42.699337 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6717d1a-98e3-41e1-aad4-c5d949b9adbb None admin] PATH_INFO: `/v3/endpoints` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:36:42.699995 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6717d1a-98e3-41e1-aad4-c5d949b9adbb None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:36:42.701406 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6717d1a-98e3-41e1-aad4-c5d949b9adbb None admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:36:42.714433 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a36311-a372-4d9c-a7e8-a1f2e0f2f9e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:36:42.715105 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a36311-a372-4d9c-a7e8-a1f2e0f2f9e4 None admin] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:36:42.715380 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a36311-a372-4d9c-a7e8-a1f2e0f2f9e4 None admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:36:42.715647 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a36311-a372-4d9c-a7e8-a1f2e0f2f9e4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:36:42.723359 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a36311-a372-4d9c-a7e8-a1f2e0f2f9e4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:36:42.724290 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 428/827] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Sep 13 19:36:42 2022] POST /identity/v3/endpoints => generated 346 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 19:36:42.724851 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a36311-a372-4d9c-a7e8-a1f2e0f2f9e4 None admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:36:42.725542 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff8e4ca-cdc6-4c12-b8cd-341b14593c9c None None] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:36:42.725825 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff8e4ca-cdc6-4c12-b8cd-341b14593c9c None None] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:36:42.726093 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff8e4ca-cdc6-4c12-b8cd-341b14593c9c None None] PATH_INFO: `/` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:36:42.727345 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 429/828] 10.222.0.25 () {54 vars in 927 bytes} [Tue Sep 13 19:36:42 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:36:42.728056 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff8e4ca-cdc6-4c12-b8cd-341b14593c9c None None] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:36:42.748247 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application [None req-07a36311-a372-4d9c-a7e8-a1f2e0f2f9e4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 19:36:42.748247 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:36:42.748247 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:36:42.748247 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:36:42.748247 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:36:42.748247 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:36:42.748247 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:36:42.748247 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:36:42.748247 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:36:42.748247 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:36:42.748247 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:36:42.748247 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:36:42.748247 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 13 19:36:42.748247 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 13 19:36:42.748247 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 13 19:36:42.749252 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 13 19:36:42.749252 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:36:42.749252 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:36:42.749252 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:36:42.749252 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:36:42.749252 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:36:42.749252 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:36:42.749252 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:36:42.749252 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application with Lock( Sep 13 19:36:42.749252 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:36:42.749252 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:36:42.749252 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:36:42.749252 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:36:42.749252 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:36:42.749252 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:36:42.749252 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:36:42.749252 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:36:42.750691 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 13 19:36:42.750691 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 13 19:36:42.750691 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 13 19:36:42.750691 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 13 19:36:42.750691 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 13 19:36:42.750691 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 13 19:36:42.750691 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 19:36:42.750691 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application Sep 13 19:36:42.750691 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 400/829] 10.222.0.25 () {56 vars in 1111 bytes} [Tue Sep 13 19:36:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:36:42.750691 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a36311-a372-4d9c-a7e8-a1f2e0f2f9e4 None admin] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:36:42.789808 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG dbcounter [-] [87934] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:36:42.870317 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff8e4ca-cdc6-4c12-b8cd-341b14593c9c None None] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:36:42.872776 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a36311-a372-4d9c-a7e8-a1f2e0f2f9e4 None admin] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:36:42.912091 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d050dea0-8ab3-4e30-b5d2-f168fde998d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:36:42.913172 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d050dea0-8ab3-4e30-b5d2-f168fde998d9 None admin] REQUEST_METHOD: `POST` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:36:42.913172 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d050dea0-8ab3-4e30-b5d2-f168fde998d9 None admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:36:42.913379 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34fb179-1022-4bd6-8faa-6b179b97ab93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:36:42.913476 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d050dea0-8ab3-4e30-b5d2-f168fde998d9 None admin] PATH_INFO: `/v3/endpoints` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:36:42.913756 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34fb179-1022-4bd6-8faa-6b179b97ab93 None admin] REQUEST_METHOD: `PUT` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:36:42.913962 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d050dea0-8ab3-4e30-b5d2-f168fde998d9 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:36:42.914058 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34fb179-1022-4bd6-8faa-6b179b97ab93 None admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:36:42.914294 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34fb179-1022-4bd6-8faa-6b179b97ab93 None admin] PATH_INFO: `/v3/projects/9a10a4268f3c4cb29f4e00c292e2df62/users/d44977a3225e43f19cdc4a84f0e170cd/roles/60f5ecbf9ce84814968607f126a85a5a` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:36:42.915324 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d050dea0-8ab3-4e30-b5d2-f168fde998d9 None admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:36:42.921764 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG dbcounter [-] [87935] Writing DB stats keystone:SELECT=100 {{(pid=87935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:36:42.931612 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b34fb179-1022-4bd6-8faa-6b179b97ab93 None admin] RBAC: Authorizing `identity:create_grant(project_id=9a10a4268f3c4cb29f4e00c292e2df62, user_id=d44977a3225e43f19cdc4a84f0e170cd, role_id=60f5ecbf9ce84814968607f126a85a5a)` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:36:42.933080 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b34fb179-1022-4bd6-8faa-6b179b97ab93 None admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:36:42.941793 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 401/830] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Sep 13 19:36:42 2022] POST /identity/v3/endpoints => generated 337 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 19:36:42.943300 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7170b850-d122-41fc-b313-40ace9371651 None None] REQUEST_METHOD: `POST` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:36:42.943613 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7170b850-d122-41fc-b313-40ace9371651 None None] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:36:42.943890 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7170b850-d122-41fc-b313-40ace9371651 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:36:42.955706 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 430/831] 10.222.0.25 () {58 vars in 1439 bytes} [Tue Sep 13 19:36:42 2022] PUT /identity/v3/projects/9a10a4268f3c4cb29f4e00c292e2df62/users/d44977a3225e43f19cdc4a84f0e170cd/roles/60f5ecbf9ce84814968607f126a85a5a => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 19:36:42.957333 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34fb179-1022-4bd6-8faa-6b179b97ab93 None admin] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:36:42.965330 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.auth.core [None req-7170b850-d122-41fc-b313-40ace9371651 None None] MFA Rules not processed for user `7b0aed92d02344acb92a0e4aa67c3068`. Rule list: `[]` (Enabled: `True`). {{(pid=87935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:36:42.966693 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.fernet_utils [None req-7170b850-d122-41fc-b313-40ace9371651 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:36:43.085969 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 402/832] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Sep 13 19:36:42 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 13 19:36:43.110544 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG dbcounter [-] [87934] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:36:43.130755 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34fb179-1022-4bd6-8faa-6b179b97ab93 None admin] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:36:43.179585 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1d6dc9-8366-4823-a604-141e23ad7a92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:36:43.180280 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1d6dc9-8366-4823-a604-141e23ad7a92 None admin] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:36:43.180564 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1d6dc9-8366-4823-a604-141e23ad7a92 None admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:36:43.180832 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1d6dc9-8366-4823-a604-141e23ad7a92 None admin] PATH_INFO: `/v3/projects` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:36:43.181540 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b1d6dc9-8366-4823-a604-141e23ad7a92 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87934) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:36:43.181843 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b1d6dc9-8366-4823-a604-141e23ad7a92 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:36:43.183289 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b1d6dc9-8366-4823-a604-141e23ad7a92 None admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:36:43.197297 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 431/833] 10.222.0.25 () {56 vars in 1148 bytes} [Tue Sep 13 19:36:42 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:36:43.203932 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7170b850-d122-41fc-b313-40ace9371651 None None] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:36:43.322943 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7170b850-d122-41fc-b313-40ace9371651 None None] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:36:43.344478 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG dbcounter [-] [87935] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:36:43.368852 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d4026b-f521-44bf-9069-5b6d406cbd10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:36:43.369478 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d4026b-f521-44bf-9069-5b6d406cbd10 None admin] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:36:43.369758 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d4026b-f521-44bf-9069-5b6d406cbd10 None admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:36:43.370029 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d4026b-f521-44bf-9069-5b6d406cbd10 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:36:43.370770 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d4026b-f521-44bf-9069-5b6d406cbd10 None admin] RBAC: Adding query filter params (role.id=6ca1d4427ff64e0a9d25d96cfb1445f6, scope.project.id=9a10a4268f3c4cb29f4e00c292e2df62, user.id=d71fe5a8275f4ea98555afdcefc902a0) {{(pid=87935) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:36:43.371079 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d4026b-f521-44bf-9069-5b6d406cbd10 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:36:43.372637 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d4026b-f521-44bf-9069-5b6d406cbd10 None admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:36:43.379530 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 403/834] 10.222.0.25 () {56 vars in 1374 bytes} [Tue Sep 13 19:36:43 2022] GET /identity/v3/role_assignments?user.id=d71fe5a8275f4ea98555afdcefc902a0&scope.project.id=9a10a4268f3c4cb29f4e00c292e2df62&role.id=6ca1d4427ff64e0a9d25d96cfb1445f6 => generated 608 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:36:43.449907 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1d6dc9-8366-4823-a604-141e23ad7a92 None admin] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:36:43.596855 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1d6dc9-8366-4823-a604-141e23ad7a92 None admin] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:36:43.643592 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c173b42-1576-4b1a-b792-52d87d1abc88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:36:43.644741 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c173b42-1576-4b1a-b792-52d87d1abc88 None admin] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:36:43.645226 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c173b42-1576-4b1a-b792-52d87d1abc88 None admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:36:43.645690 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c173b42-1576-4b1a-b792-52d87d1abc88 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:36:43.665300 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c173b42-1576-4b1a-b792-52d87d1abc88 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 19:36:43.670769 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application [None req-9c173b42-1576-4b1a-b792-52d87d1abc88 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 19:36:43.670769 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:36:43.670769 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:36:43.670769 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:36:43.670769 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:36:43.670769 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:36:43.670769 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:36:43.670769 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:36:43.670769 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:36:43.670769 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:36:43.670769 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:36:43.670769 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:36:43.670769 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 19:36:43.670769 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 19:36:43.670769 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 19:36:43.670769 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 19:36:43.673033 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 19:36:43.673033 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 19:36:43.673033 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 19:36:43.673033 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 19:36:43.673033 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:36:43.673033 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:36:43.673033 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:36:43.673033 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:36:43.673033 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:36:43.673033 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:36:43.673033 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:36:43.673033 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application with Lock( Sep 13 19:36:43.673033 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:36:43.673033 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:36:43.673033 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:36:43.673033 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:36:43.675093 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:36:43.675093 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:36:43.675093 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:36:43.675093 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:36:43.675093 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 19:36:43.675093 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 19:36:43.675093 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 19:36:43.675093 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 19:36:43.675093 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 19:36:43.675093 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 19:36:43.675093 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 19:36:43.675093 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application Sep 13 19:36:43.675093 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 432/835] 10.222.0.25 () {56 vars in 1096 bytes} [Tue Sep 13 19:36:43 2022] GET /identity/v3/roles/admin => generated 83 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:36:43.679381 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d4026b-f521-44bf-9069-5b6d406cbd10 None admin] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:36:43.792660 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d4026b-f521-44bf-9069-5b6d406cbd10 None admin] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:36:43.831466 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0201cff9-8db3-4a21-8ce8-82b054d051ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:36:43.832769 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0201cff9-8db3-4a21-8ce8-82b054d051ea None admin] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:36:43.833037 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0201cff9-8db3-4a21-8ce8-82b054d051ea None admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:36:43.833287 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0201cff9-8db3-4a21-8ce8-82b054d051ea None admin] PATH_INFO: `/v3/roles` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:36:43.833958 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0201cff9-8db3-4a21-8ce8-82b054d051ea None admin] RBAC: Adding query filter params (name=admin) {{(pid=87935) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:36:43.834256 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0201cff9-8db3-4a21-8ce8-82b054d051ea None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:36:43.835671 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0201cff9-8db3-4a21-8ce8-82b054d051ea None admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:36:43.845582 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 404/836] 10.222.0.25 () {56 vars in 1099 bytes} [Tue Sep 13 19:36:43 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:36:43.851637 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c173b42-1576-4b1a-b792-52d87d1abc88 None admin] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:36:43.876631 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG dbcounter [-] [87934] Writing DB stats keystone:SELECT=100 {{(pid=87934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:36:43.981575 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c173b42-1576-4b1a-b792-52d87d1abc88 None admin] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:36:44.019565 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94fa5fac-6bd8-45ca-a48d-f65ed45a82e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:36:44.020138 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fa5fac-6bd8-45ca-a48d-f65ed45a82e5 None admin] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:36:44.020518 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fa5fac-6bd8-45ca-a48d-f65ed45a82e5 None admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:36:44.020771 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fa5fac-6bd8-45ca-a48d-f65ed45a82e5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:36:44.032950 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94fa5fac-6bd8-45ca-a48d-f65ed45a82e5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:36:44.034393 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94fa5fac-6bd8-45ca-a48d-f65ed45a82e5 None admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:36:44.051178 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application [None req-94fa5fac-6bd8-45ca-a48d-f65ed45a82e5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 19:36:44.051178 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:36:44.051178 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:36:44.051178 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:36:44.051178 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:36:44.051178 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:36:44.051178 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:36:44.051178 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:36:44.051178 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:36:44.051178 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:36:44.051178 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:36:44.051178 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:36:44.051178 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 19:36:44.051178 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 19:36:44.051178 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 19:36:44.051178 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 19:36:44.053858 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:36:44.053858 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:36:44.053858 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:36:44.053858 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:36:44.053858 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:36:44.053858 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:36:44.053858 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:36:44.053858 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application with Lock( Sep 13 19:36:44.053858 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:36:44.053858 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:36:44.053858 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:36:44.053858 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:36:44.053858 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:36:44.053858 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:36:44.053858 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:36:44.053858 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:36:44.053858 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 19:36:44.056041 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 19:36:44.056041 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 19:36:44.056041 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application Sep 13 19:36:44.056041 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 433/837] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Sep 13 19:36:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:36:44.060285 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0201cff9-8db3-4a21-8ce8-82b054d051ea None admin] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:36:44.109431 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG dbcounter [-] [87935] Writing DB stats keystone:SELECT=100 {{(pid=87935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:36:44.170875 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0201cff9-8db3-4a21-8ce8-82b054d051ea None admin] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:36:44.208094 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1442932c-930a-4a8c-9a2c-b0f99f50babb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:36:44.208872 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1442932c-930a-4a8c-9a2c-b0f99f50babb None admin] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:36:44.209149 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1442932c-930a-4a8c-9a2c-b0f99f50babb None admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:36:44.209417 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1442932c-930a-4a8c-9a2c-b0f99f50babb None admin] PATH_INFO: `/v3/domains` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:36:44.210060 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1442932c-930a-4a8c-9a2c-b0f99f50babb None admin] RBAC: Adding query filter params (name=Default) {{(pid=87935) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:36:44.210364 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1442932c-930a-4a8c-9a2c-b0f99f50babb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:36:44.211730 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1442932c-930a-4a8c-9a2c-b0f99f50babb None admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:36:44.225747 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 405/838] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Sep 13 19:36:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:36:44.231512 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94fa5fac-6bd8-45ca-a48d-f65ed45a82e5 None admin] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:36:44.310499 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG dbcounter [-] [87934] Writing DB stats keystone:SELECT=100 {{(pid=87934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:36:44.374894 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94fa5fac-6bd8-45ca-a48d-f65ed45a82e5 None admin] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:36:44.417544 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447c229c-f3e7-4405-a368-76501c068ecb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:36:44.418173 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447c229c-f3e7-4405-a368-76501c068ecb None admin] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:36:44.418450 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447c229c-f3e7-4405-a368-76501c068ecb None admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:36:44.418714 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447c229c-f3e7-4405-a368-76501c068ecb None admin] PATH_INFO: `/v3/users/swift` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:36:44.427663 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-447c229c-f3e7-4405-a368-76501c068ecb None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:36:44.430034 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-447c229c-f3e7-4405-a368-76501c068ecb None admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:36:44.446260 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application [None req-447c229c-f3e7-4405-a368-76501c068ecb None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 13 19:36:44.446260 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:36:44.446260 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:36:44.446260 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:36:44.446260 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:36:44.446260 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:36:44.446260 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:36:44.446260 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:36:44.446260 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:36:44.446260 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:36:44.446260 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:36:44.446260 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:36:44.446260 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 13 19:36:44.446260 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 13 19:36:44.446260 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 13 19:36:44.446260 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 13 19:36:44.448507 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:36:44.448507 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:36:44.448507 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 13 19:36:44.448507 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 19:36:44.448507 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 13 19:36:44.448507 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 19:36:44.448507 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:36:44.448507 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:36:44.448507 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:36:44.448507 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:36:44.448507 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:36:44.448507 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application with Lock( Sep 13 19:36:44.448507 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:36:44.448507 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:36:44.448507 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:36:44.448507 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:36:44.448507 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:36:44.448507 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:36:44.450784 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:36:44.450784 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:36:44.450784 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 13 19:36:44.450784 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 13 19:36:44.450784 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 13 19:36:44.450784 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 13 19:36:44.450784 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 13 19:36:44.450784 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 13 19:36:44.450784 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 13 19:36:44.450784 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application Sep 13 19:36:44.461900 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1442932c-930a-4a8c-9a2c-b0f99f50babb None admin] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:36:44.465963 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 434/839] 10.222.0.25 () {56 vars in 1096 bytes} [Tue Sep 13 19:36:44 2022] GET /identity/v3/users/swift => generated 83 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:36:44.599631 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1442932c-930a-4a8c-9a2c-b0f99f50babb None admin] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:36:44.602023 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG dbcounter [-] [87935] Writing DB stats keystone:SELECT=100 {{(pid=87935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:36:44.639673 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa8ca3d-21eb-49f4-9652-1ba8f8c4c6dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:36:44.640490 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa8ca3d-21eb-49f4-9652-1ba8f8c4c6dc None admin] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:36:44.640930 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa8ca3d-21eb-49f4-9652-1ba8f8c4c6dc None admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:36:44.641257 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa8ca3d-21eb-49f4-9652-1ba8f8c4c6dc None admin] PATH_INFO: `/v3/users` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:36:44.641987 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa8ca3d-21eb-49f4-9652-1ba8f8c4c6dc None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=87935) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:36:44.642430 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa8ca3d-21eb-49f4-9652-1ba8f8c4c6dc None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:36:44.644038 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa8ca3d-21eb-49f4-9652-1ba8f8c4c6dc None admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:36:44.662573 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 406/840] 10.222.0.25 () {56 vars in 1135 bytes} [Tue Sep 13 19:36:44 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:36:44.668273 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447c229c-f3e7-4405-a368-76501c068ecb None admin] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:36:44.795110 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447c229c-f3e7-4405-a368-76501c068ecb None admin] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:36:44.824590 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG dbcounter [-] [87934] Writing DB stats keystone:SELECT=100 {{(pid=87934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:36:44.835618 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1d126f-a14d-4708-9f18-8a21257861eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:36:44.836256 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1d126f-a14d-4708-9f18-8a21257861eb None admin] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:36:44.836547 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1d126f-a14d-4708-9f18-8a21257861eb None admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:36:44.836820 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1d126f-a14d-4708-9f18-8a21257861eb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:36:44.915342 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b1d126f-a14d-4708-9f18-8a21257861eb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:36:44.916789 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b1d126f-a14d-4708-9f18-8a21257861eb None admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:36:45.032865 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 435/841] 10.222.0.25 () {58 vars in 1282 bytes} [Tue Sep 13 19:36:44 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 365 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 13 19:36:45.040317 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa8ca3d-21eb-49f4-9652-1ba8f8c4c6dc None admin] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:36:45.164368 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa8ca3d-21eb-49f4-9652-1ba8f8c4c6dc None admin] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:36:45.206329 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1caea05d-a2c7-4d9e-ac8d-02bf4ae045c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:36:45.207307 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1caea05d-a2c7-4d9e-ac8d-02bf4ae045c2 None admin] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:36:45.207803 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1caea05d-a2c7-4d9e-ac8d-02bf4ae045c2 None admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:36:45.208333 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1caea05d-a2c7-4d9e-ac8d-02bf4ae045c2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:36:45.219839 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1caea05d-a2c7-4d9e-ac8d-02bf4ae045c2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:36:45.221447 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1caea05d-a2c7-4d9e-ac8d-02bf4ae045c2 None admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:36:45.238824 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application [None req-1caea05d-a2c7-4d9e-ac8d-02bf4ae045c2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 19:36:45.238824 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:36:45.238824 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:36:45.238824 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:36:45.238824 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:36:45.238824 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:36:45.238824 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:36:45.238824 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:36:45.238824 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:36:45.238824 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:36:45.238824 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:36:45.238824 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:36:45.238824 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 19:36:45.238824 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 19:36:45.238824 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 19:36:45.238824 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 19:36:45.240697 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:36:45.240697 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:36:45.240697 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:36:45.240697 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:36:45.240697 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:36:45.240697 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:36:45.240697 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:36:45.240697 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application with Lock( Sep 13 19:36:45.240697 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:36:45.240697 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:36:45.240697 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:36:45.240697 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:36:45.240697 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:36:45.240697 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:36:45.240697 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:36:45.240697 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:36:45.240697 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 19:36:45.242465 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 19:36:45.242465 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 19:36:45.242465 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application Sep 13 19:36:45.242465 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 407/842] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Sep 13 19:36:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:36:45.254957 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1d126f-a14d-4708-9f18-8a21257861eb None admin] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:36:45.274818 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG dbcounter [-] [87934] Writing DB stats keystone:SELECT=100 {{(pid=87934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:36:45.362415 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1d126f-a14d-4708-9f18-8a21257861eb None admin] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:36:45.368634 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573c7c68-26af-4003-ac0d-a061cdefe34b None None] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:36:45.368930 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573c7c68-26af-4003-ac0d-a061cdefe34b None None] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:36:45.369193 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573c7c68-26af-4003-ac0d-a061cdefe34b None None] PATH_INFO: `/` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:36:45.372103 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 408/843] 10.222.0.25 () {54 vars in 927 bytes} [Tue Sep 13 19:36:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 13 19:36:45.376686 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0cd4dd-36a8-43e9-9538-30b3241d1e12 None None] REQUEST_METHOD: `POST` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:36:45.376966 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0cd4dd-36a8-43e9-9538-30b3241d1e12 None None] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:36:45.377240 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0cd4dd-36a8-43e9-9538-30b3241d1e12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:36:45.401595 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.auth.core [None req-2f0cd4dd-36a8-43e9-9538-30b3241d1e12 None None] MFA Rules not processed for user `7b0aed92d02344acb92a0e4aa67c3068`. Rule list: `[]` (Enabled: `True`). {{(pid=87935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:36:45.403461 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.fernet_utils [None req-2f0cd4dd-36a8-43e9-9538-30b3241d1e12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:36:45.403982 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55be1457-d714-4f2b-abfd-39aff5fb069c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:36:45.404827 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55be1457-d714-4f2b-abfd-39aff5fb069c None admin] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:36:45.405265 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55be1457-d714-4f2b-abfd-39aff5fb069c None admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:36:45.405698 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55be1457-d714-4f2b-abfd-39aff5fb069c None admin] PATH_INFO: `/v3/domains` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:36:45.406487 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55be1457-d714-4f2b-abfd-39aff5fb069c None admin] RBAC: Adding query filter params (name=Default) {{(pid=87934) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:36:45.407134 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55be1457-d714-4f2b-abfd-39aff5fb069c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:36:45.409614 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55be1457-d714-4f2b-abfd-39aff5fb069c None admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:36:45.425285 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 436/844] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Sep 13 19:36:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:36:45.430346 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG dbcounter [-] [87935] Writing DB stats keystone:SELECT=100 {{(pid=87935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:36:45.431658 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55be1457-d714-4f2b-abfd-39aff5fb069c None admin] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:36:45.501138 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 409/845] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Sep 13 19:36:45 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 13 19:36:45.502410 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50144a42-06d5-4085-855b-7fcfde6cdec2 None None] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:36:45.502689 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50144a42-06d5-4085-855b-7fcfde6cdec2 None None] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:36:45.502954 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50144a42-06d5-4085-855b-7fcfde6cdec2 None None] PATH_INFO: `/` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:36:45.509571 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 410/846] 10.222.0.25 () {54 vars in 927 bytes} [Tue Sep 13 19:36:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:36:45.510574 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7836c1d2-7351-4d3c-a867-12d4d1c4e165 None None] REQUEST_METHOD: `POST` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:36:45.510850 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7836c1d2-7351-4d3c-a867-12d4d1c4e165 None None] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:36:45.511116 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7836c1d2-7351-4d3c-a867-12d4d1c4e165 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:36:45.531273 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.auth.core [None req-7836c1d2-7351-4d3c-a867-12d4d1c4e165 None None] MFA Rules not processed for user `7b0aed92d02344acb92a0e4aa67c3068`. Rule list: `[]` (Enabled: `True`). {{(pid=87935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:36:45.532562 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.fernet_utils [None req-7836c1d2-7351-4d3c-a867-12d4d1c4e165 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:36:45.533967 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG dbcounter [-] [87934] Writing DB stats keystone:SELECT=100 {{(pid=87934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:36:45.558054 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55be1457-d714-4f2b-abfd-39aff5fb069c None admin] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:36:45.603989 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8dcf6a-62cc-4de8-a9a5-fb3af03c5f87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:36:45.604651 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8dcf6a-62cc-4de8-a9a5-fb3af03c5f87 None admin] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:36:45.605180 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8dcf6a-62cc-4de8-a9a5-fb3af03c5f87 None admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:36:45.605455 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8dcf6a-62cc-4de8-a9a5-fb3af03c5f87 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:36:45.620172 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e8dcf6a-62cc-4de8-a9a5-fb3af03c5f87 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:36:45.620172 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e8dcf6a-62cc-4de8-a9a5-fb3af03c5f87 None admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:36:45.620938 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 411/847] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Sep 13 19:36:45 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 13 19:36:45.629685 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application [None req-0e8dcf6a-62cc-4de8-a9a5-fb3af03c5f87 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 19:36:45.629685 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:36:45.629685 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:36:45.629685 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:36:45.629685 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:36:45.629685 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:36:45.629685 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:36:45.629685 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:36:45.629685 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:36:45.629685 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:36:45.629685 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:36:45.629685 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:36:45.629685 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 13 19:36:45.629685 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 13 19:36:45.629685 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 13 19:36:45.630754 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 13 19:36:45.630754 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:36:45.630754 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:36:45.630754 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:36:45.630754 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:36:45.630754 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:36:45.630754 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:36:45.630754 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:36:45.630754 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application with Lock( Sep 13 19:36:45.630754 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:36:45.630754 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:36:45.630754 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:36:45.630754 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:36:45.630754 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:36:45.630754 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:36:45.630754 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:36:45.630754 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:36:45.631657 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 13 19:36:45.631657 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 13 19:36:45.631657 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 13 19:36:45.631657 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 13 19:36:45.631657 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 13 19:36:45.631657 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 13 19:36:45.631657 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 19:36:45.631657 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application Sep 13 19:36:45.631657 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 437/848] 10.222.0.25 () {56 vars in 1111 bytes} [Tue Sep 13 19:36:45 2022] GET /identity/v3/projects/service => generated 88 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:36:45.637142 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7836c1d2-7351-4d3c-a867-12d4d1c4e165 None None] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:36:45.719613 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG dbcounter [-] [87935] Writing DB stats keystone:SELECT=100 {{(pid=87935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:36:45.746472 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7836c1d2-7351-4d3c-a867-12d4d1c4e165 None None] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:36:45.782617 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0ed12e-267f-4e04-8c87-744512c06550 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:36:45.783338 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0ed12e-267f-4e04-8c87-744512c06550 None admin] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:36:45.783610 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0ed12e-267f-4e04-8c87-744512c06550 None admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:36:45.783871 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0ed12e-267f-4e04-8c87-744512c06550 None admin] PATH_INFO: `/v3/projects` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:36:45.784588 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b0ed12e-267f-4e04-8c87-744512c06550 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87935) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:36:45.785509 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b0ed12e-267f-4e04-8c87-744512c06550 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:36:45.786944 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b0ed12e-267f-4e04-8c87-744512c06550 None admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:36:45.797537 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8dcf6a-62cc-4de8-a9a5-fb3af03c5f87 None admin] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:36:45.800356 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 412/849] 10.222.0.25 () {56 vars in 1148 bytes} [Tue Sep 13 19:36:45 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:36:45.809270 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0ed12e-267f-4e04-8c87-744512c06550 None admin] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:36:45.922627 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8dcf6a-62cc-4de8-a9a5-fb3af03c5f87 None admin] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:36:45.926079 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0ed12e-267f-4e04-8c87-744512c06550 None admin] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:36:45.960862 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c60770-ffbe-4bc3-95df-c6fbac6c186e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:36:45.961508 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c60770-ffbe-4bc3-95df-c6fbac6c186e None admin] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:36:45.961783 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c60770-ffbe-4bc3-95df-c6fbac6c186e None admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:36:45.962046 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c60770-ffbe-4bc3-95df-c6fbac6c186e None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:36:45.962630 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c60770-ffbe-4bc3-95df-c6fbac6c186e None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:36:45.964032 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c60770-ffbe-4bc3-95df-c6fbac6c186e None admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:36:45.964762 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8154604a-3a2f-4dc6-be18-dcfbfe316720 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:36:45.965394 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8154604a-3a2f-4dc6-be18-dcfbfe316720 None admin] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:36:45.965672 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8154604a-3a2f-4dc6-be18-dcfbfe316720 None admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:36:45.965941 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8154604a-3a2f-4dc6-be18-dcfbfe316720 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:36:45.967431 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8154604a-3a2f-4dc6-be18-dcfbfe316720 None admin] RBAC: Adding query filter params (role.id=6ca1d4427ff64e0a9d25d96cfb1445f6, scope.project.id=9a10a4268f3c4cb29f4e00c292e2df62, user.id=fb42d6ac6cdd4d97a80c3ee0c6f8e3f5) {{(pid=87935) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:36:45.967645 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8154604a-3a2f-4dc6-be18-dcfbfe316720 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:36:45.969530 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8154604a-3a2f-4dc6-be18-dcfbfe316720 None admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:36:45.971648 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG dbcounter [-] [87935] Writing DB stats keystone:SELECT=100 {{(pid=87935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:36:45.974767 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application [None req-95c60770-ffbe-4bc3-95df-c6fbac6c186e None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 13 19:36:45.974767 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:36:45.974767 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 13 19:36:45.974767 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 13 19:36:45.974767 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 13 19:36:45.974767 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 13 19:36:45.974767 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 13 19:36:45.974767 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 19:36:45.974767 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 13 19:36:45.974767 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application Sep 13 19:36:45.974767 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 13 19:36:45.974767 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application Sep 13 19:36:45.974767 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:36:45.974767 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:36:45.974767 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:36:45.974767 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:36:45.974767 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:36:45.975829 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:36:45.975829 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:36:45.975829 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:36:45.975829 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:36:45.975829 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:36:45.975829 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:36:45.975829 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 13 19:36:45.975829 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 13 19:36:45.975829 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 13 19:36:45.975829 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 13 19:36:45.975829 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:36:45.975829 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:36:45.975829 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:36:45.975829 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:36:45.975829 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:36:45.975829 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:36:45.976748 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:36:45.976748 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application with Lock( Sep 13 19:36:45.976748 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:36:45.976748 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:36:45.976748 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:36:45.976748 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:36:45.976748 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:36:45.976748 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:36:45.976748 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:36:45.976748 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:36:45.976748 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 13 19:36:45.976748 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 19:36:45.976748 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 13 19:36:45.976748 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application Sep 13 19:36:45.976748 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 438/850] 10.222.0.25 () {56 vars in 1114 bytes} [Tue Sep 13 19:36:45 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 13 19:36:45.977554 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c60770-ffbe-4bc3-95df-c6fbac6c186e None admin] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:36:45.981322 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 413/851] 10.222.0.25 () {56 vars in 1374 bytes} [Tue Sep 13 19:36:45 2022] GET /identity/v3/role_assignments?user.id=fb42d6ac6cdd4d97a80c3ee0c6f8e3f5&scope.project.id=9a10a4268f3c4cb29f4e00c292e2df62&role.id=6ca1d4427ff64e0a9d25d96cfb1445f6 => generated 608 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:36:45.983325 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8154604a-3a2f-4dc6-be18-dcfbfe316720 None admin] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:36:45.996733 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG dbcounter [-] [87934] Writing DB stats keystone:SELECT=100 {{(pid=87934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:36:46.119499 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8154604a-3a2f-4dc6-be18-dcfbfe316720 None admin] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:36:46.135145 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c60770-ffbe-4bc3-95df-c6fbac6c186e None admin] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:36:46.164116 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860adf7b-2b0f-4537-a71c-d637ab54de8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:36:46.164771 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860adf7b-2b0f-4537-a71c-d637ab54de8a None admin] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:36:46.165043 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860adf7b-2b0f-4537-a71c-d637ab54de8a None admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:36:46.165309 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860adf7b-2b0f-4537-a71c-d637ab54de8a None admin] PATH_INFO: `/v3/services` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:36:46.165951 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860adf7b-2b0f-4537-a71c-d637ab54de8a None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=87935) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:36:46.166331 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860adf7b-2b0f-4537-a71c-d637ab54de8a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:36:46.168852 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860adf7b-2b0f-4537-a71c-d637ab54de8a None admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:36:46.174931 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 414/852] 10.222.0.25 () {56 vars in 1114 bytes} [Tue Sep 13 19:36:45 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:36:46.176937 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08125cb4-12b3-4ce1-ba04-ae73767a03a9 None None] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:36:46.177167 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08125cb4-12b3-4ce1-ba04-ae73767a03a9 None None] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:36:46.177664 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08125cb4-12b3-4ce1-ba04-ae73767a03a9 None None] PATH_INFO: `/` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:36:46.179058 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 415/853] 10.222.0.25 () {54 vars in 927 bytes} [Tue Sep 13 19:36:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:36:46.179326 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2019f17f-56e8-4296-9d50-b1d0ee17047d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:36:46.179965 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2019f17f-56e8-4296-9d50-b1d0ee17047d None admin] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:36:46.184264 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2019f17f-56e8-4296-9d50-b1d0ee17047d None admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:36:46.184264 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2019f17f-56e8-4296-9d50-b1d0ee17047d None admin] PATH_INFO: `/v3/roles/service` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:36:46.184533 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08125cb4-12b3-4ce1-ba04-ae73767a03a9 None None] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:36:46.205193 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2019f17f-56e8-4296-9d50-b1d0ee17047d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 19:36:46.211738 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application [None req-2019f17f-56e8-4296-9d50-b1d0ee17047d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 13 19:36:46.211738 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:36:46.211738 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:36:46.211738 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:36:46.211738 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:36:46.211738 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:36:46.211738 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:36:46.211738 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:36:46.211738 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:36:46.211738 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:36:46.211738 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:36:46.211738 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:36:46.211738 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 19:36:46.211738 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 19:36:46.211738 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 19:36:46.211738 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 19:36:46.212861 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 19:36:46.212861 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 19:36:46.212861 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 19:36:46.212861 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 19:36:46.212861 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:36:46.212861 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:36:46.212861 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:36:46.212861 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:36:46.212861 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:36:46.212861 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:36:46.212861 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:36:46.212861 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application with Lock( Sep 13 19:36:46.212861 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:36:46.212861 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:36:46.212861 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:36:46.212861 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:36:46.213766 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:36:46.213766 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:36:46.213766 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:36:46.213766 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:36:46.213766 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 19:36:46.213766 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 19:36:46.213766 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 19:36:46.213766 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 19:36:46.213766 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 19:36:46.213766 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 19:36:46.213766 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 13 19:36:46.213766 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application Sep 13 19:36:46.218360 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 439/854] 10.222.0.25 () {56 vars in 1102 bytes} [Tue Sep 13 19:36:45 2022] GET /identity/v3/roles/service => generated 85 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:36:46.220293 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079dd7de-1238-44b4-8859-bfaec824bb1e None None] REQUEST_METHOD: `POST` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:36:46.220293 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079dd7de-1238-44b4-8859-bfaec824bb1e None None] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:36:46.220293 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079dd7de-1238-44b4-8859-bfaec824bb1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:36:46.241236 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.auth.core [None req-079dd7de-1238-44b4-8859-bfaec824bb1e None None] MFA Rules not processed for user `7b0aed92d02344acb92a0e4aa67c3068`. Rule list: `[]` (Enabled: `True`). {{(pid=87934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:36:46.241766 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.fernet_utils [None req-079dd7de-1238-44b4-8859-bfaec824bb1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:36:46.271394 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG dbcounter [-] [87935] Writing DB stats keystone:SELECT=100 {{(pid=87935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:36:46.315525 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG dbcounter [-] [87934] Writing DB stats keystone:SELECT=100 {{(pid=87934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:36:46.317101 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08125cb4-12b3-4ce1-ba04-ae73767a03a9 None None] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:36:46.325280 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 440/855] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Sep 13 19:36:46 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 13 19:36:46.329473 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079dd7de-1238-44b4-8859-bfaec824bb1e None None] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:36:46.352801 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d7935c-c255-4c2b-aeff-8df2c060ab67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:36:46.353276 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d7935c-c255-4c2b-aeff-8df2c060ab67 None admin] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:36:46.353553 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d7935c-c255-4c2b-aeff-8df2c060ab67 None admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:36:46.353822 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d7935c-c255-4c2b-aeff-8df2c060ab67 None admin] PATH_INFO: `/v3/services` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:36:46.354453 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29d7935c-c255-4c2b-aeff-8df2c060ab67 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=87935) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:36:46.354756 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29d7935c-c255-4c2b-aeff-8df2c060ab67 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:36:46.356119 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29d7935c-c255-4c2b-aeff-8df2c060ab67 None admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:36:46.364279 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 416/856] 10.222.0.25 () {56 vars in 1114 bytes} [Tue Sep 13 19:36:46 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 19:36:46.471098 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079dd7de-1238-44b4-8859-bfaec824bb1e None None] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:36:46.524971 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817750b2-22d1-44a8-beee-f70ddba6ef52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:36:46.525963 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817750b2-22d1-44a8-beee-f70ddba6ef52 None admin] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:36:46.526438 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817750b2-22d1-44a8-beee-f70ddba6ef52 None admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:36:46.526889 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817750b2-22d1-44a8-beee-f70ddba6ef52 None admin] PATH_INFO: `/v3/roles` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:36:46.527862 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-817750b2-22d1-44a8-beee-f70ddba6ef52 None admin] RBAC: Adding query filter params (name=service) {{(pid=87934) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:36:46.528591 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-817750b2-22d1-44a8-beee-f70ddba6ef52 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:36:46.530781 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-817750b2-22d1-44a8-beee-f70ddba6ef52 None admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:36:46.543141 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 441/857] 10.222.0.25 () {56 vars in 1103 bytes} [Tue Sep 13 19:36:46 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:36:46.548128 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d7935c-c255-4c2b-aeff-8df2c060ab67 None admin] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:36:46.625652 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817750b2-22d1-44a8-beee-f70ddba6ef52 None admin] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:36:46.672803 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d7935c-c255-4c2b-aeff-8df2c060ab67 None admin] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:36:46.701476 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG dbcounter [-] [87935] Writing DB stats keystone:SELECT=100 {{(pid=87935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:36:46.712370 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e423a9cb-ea48-49bf-90ed-d1d487e6e30c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:36:46.713035 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG dbcounter [-] [87934] Writing DB stats keystone:SELECT=100 {{(pid=87934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:36:46.713518 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e423a9cb-ea48-49bf-90ed-d1d487e6e30c None admin] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:36:46.714020 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e423a9cb-ea48-49bf-90ed-d1d487e6e30c None admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:36:46.714606 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e423a9cb-ea48-49bf-90ed-d1d487e6e30c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:36:46.728411 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e423a9cb-ea48-49bf-90ed-d1d487e6e30c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:36:46.730208 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e423a9cb-ea48-49bf-90ed-d1d487e6e30c None admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:36:46.746843 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application [None req-e423a9cb-ea48-49bf-90ed-d1d487e6e30c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 19:36:46.746843 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:36:46.746843 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:36:46.746843 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:36:46.746843 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:36:46.746843 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:36:46.746843 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:36:46.746843 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:36:46.746843 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:36:46.746843 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:36:46.746843 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:36:46.746843 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:36:46.746843 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 19:36:46.746843 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 19:36:46.746843 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 19:36:46.746843 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 19:36:46.747851 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:36:46.747851 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:36:46.747851 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:36:46.747851 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:36:46.747851 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:36:46.747851 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:36:46.747851 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:36:46.747851 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application with Lock( Sep 13 19:36:46.747851 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:36:46.747851 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:36:46.747851 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:36:46.747851 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:36:46.747851 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:36:46.747851 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:36:46.747851 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:36:46.747851 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:36:46.747851 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 19:36:46.748768 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 19:36:46.748768 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 19:36:46.748768 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application Sep 13 19:36:46.750890 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 417/858] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Sep 13 19:36:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:36:46.758173 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e423a9cb-ea48-49bf-90ed-d1d487e6e30c None admin] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:36:46.777201 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817750b2-22d1-44a8-beee-f70ddba6ef52 None admin] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:36:46.824818 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7368b55-b885-46e0-8da2-992f66cdc395 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:36:46.825722 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7368b55-b885-46e0-8da2-992f66cdc395 None admin] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:36:46.825722 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7368b55-b885-46e0-8da2-992f66cdc395 None admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:36:46.826192 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7368b55-b885-46e0-8da2-992f66cdc395 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:36:46.832341 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7368b55-b885-46e0-8da2-992f66cdc395 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:36:46.832341 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7368b55-b885-46e0-8da2-992f66cdc395 None admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:36:46.840728 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application [None req-a7368b55-b885-46e0-8da2-992f66cdc395 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 13 19:36:46.840728 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:36:46.840728 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 13 19:36:46.840728 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 13 19:36:46.840728 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 13 19:36:46.840728 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 13 19:36:46.840728 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 13 19:36:46.840728 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 19:36:46.840728 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 13 19:36:46.840728 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application Sep 13 19:36:46.840728 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 13 19:36:46.840728 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application Sep 13 19:36:46.840728 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:36:46.840728 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:36:46.840728 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:36:46.840728 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:36:46.841886 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:36:46.841886 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:36:46.841886 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:36:46.841886 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:36:46.841886 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:36:46.841886 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:36:46.841886 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:36:46.841886 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 13 19:36:46.841886 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 13 19:36:46.841886 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 13 19:36:46.841886 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 13 19:36:46.841886 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:36:46.841886 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:36:46.841886 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:36:46.841886 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:36:46.841886 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:36:46.841886 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:36:46.842818 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:36:46.842818 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application with Lock( Sep 13 19:36:46.842818 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:36:46.842818 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:36:46.842818 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:36:46.842818 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:36:46.842818 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:36:46.842818 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:36:46.842818 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:36:46.842818 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:36:46.842818 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 13 19:36:46.842818 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 19:36:46.842818 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 13 19:36:46.842818 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application Sep 13 19:36:46.842818 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 442/859] 10.222.0.25 () {56 vars in 1132 bytes} [Tue Sep 13 19:36:46 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 13 19:36:46.852141 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7368b55-b885-46e0-8da2-992f66cdc395 None admin] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:36:46.892690 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e423a9cb-ea48-49bf-90ed-d1d487e6e30c None admin] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:36:46.932853 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb73b08-de5d-4ad0-996c-362ed157ab16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:36:46.933463 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb73b08-de5d-4ad0-996c-362ed157ab16 None admin] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:36:46.933740 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb73b08-de5d-4ad0-996c-362ed157ab16 None admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:36:46.934011 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb73b08-de5d-4ad0-996c-362ed157ab16 None admin] PATH_INFO: `/v3/domains` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:36:46.934641 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb73b08-de5d-4ad0-996c-362ed157ab16 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87935) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:36:46.934942 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb73b08-de5d-4ad0-996c-362ed157ab16 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:36:46.936343 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb73b08-de5d-4ad0-996c-362ed157ab16 None admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:36:46.954568 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 418/860] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Sep 13 19:36:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 19:36:46.955504 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb73b08-de5d-4ad0-996c-362ed157ab16 None admin] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:36:47.000101 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7368b55-b885-46e0-8da2-992f66cdc395 None admin] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:36:47.001549 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG dbcounter [-] [87935] Writing DB stats keystone:SELECT=100 {{(pid=87935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:36:47.037284 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG dbcounter [-] [87934] Writing DB stats keystone:SELECT=100 {{(pid=87934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:36:47.055210 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a24dcfb-7461-4b6f-822d-2e12aa73adc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:36:47.056480 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a24dcfb-7461-4b6f-822d-2e12aa73adc1 None admin] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:36:47.057386 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a24dcfb-7461-4b6f-822d-2e12aa73adc1 None admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:36:47.057865 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a24dcfb-7461-4b6f-822d-2e12aa73adc1 None admin] PATH_INFO: `/v3/services` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:36:47.058700 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a24dcfb-7461-4b6f-822d-2e12aa73adc1 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=87934) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:36:47.059236 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a24dcfb-7461-4b6f-822d-2e12aa73adc1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:36:47.061693 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a24dcfb-7461-4b6f-822d-2e12aa73adc1 None admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:36:47.073586 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 443/861] 10.222.0.25 () {56 vars in 1126 bytes} [Tue Sep 13 19:36:46 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:36:47.076257 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a24dcfb-7461-4b6f-822d-2e12aa73adc1 None admin] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:36:47.078021 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb73b08-de5d-4ad0-996c-362ed157ab16 None admin] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:36:47.122962 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6523dccc-96a8-43cd-a082-2e5086a049f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:36:47.123681 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6523dccc-96a8-43cd-a082-2e5086a049f7 None admin] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:36:47.124058 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6523dccc-96a8-43cd-a082-2e5086a049f7 None admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:36:47.124254 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6523dccc-96a8-43cd-a082-2e5086a049f7 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:36:47.133893 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6523dccc-96a8-43cd-a082-2e5086a049f7 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:36:47.135586 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6523dccc-96a8-43cd-a082-2e5086a049f7 None admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:36:47.151075 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application [None req-6523dccc-96a8-43cd-a082-2e5086a049f7 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 13 19:36:47.151075 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:36:47.151075 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:36:47.151075 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:36:47.151075 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:36:47.151075 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:36:47.151075 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:36:47.151075 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:36:47.151075 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:36:47.151075 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:36:47.151075 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:36:47.151075 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:36:47.151075 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 13 19:36:47.151075 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 13 19:36:47.151075 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 13 19:36:47.151075 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 13 19:36:47.152429 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:36:47.152429 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:36:47.152429 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 13 19:36:47.152429 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 19:36:47.152429 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 13 19:36:47.152429 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 19:36:47.152429 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:36:47.152429 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:36:47.152429 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:36:47.152429 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:36:47.152429 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:36:47.152429 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application with Lock( Sep 13 19:36:47.152429 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:36:47.152429 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:36:47.152429 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:36:47.152429 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:36:47.152429 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:36:47.152429 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:36:47.153794 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:36:47.153794 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:36:47.153794 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 13 19:36:47.153794 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 13 19:36:47.153794 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 13 19:36:47.153794 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 13 19:36:47.153794 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 13 19:36:47.153794 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 13 19:36:47.153794 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 13 19:36:47.153794 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application Sep 13 19:36:47.153794 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 419/862] 10.222.0.25 () {56 vars in 1117 bytes} [Tue Sep 13 19:36:46 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:36:47.158506 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6523dccc-96a8-43cd-a082-2e5086a049f7 None admin] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:36:47.223665 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a24dcfb-7461-4b6f-822d-2e12aa73adc1 None admin] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:36:47.262755 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48c2a3e-3d25-48c0-83e7-a2ce927fb329 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:36:47.263753 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48c2a3e-3d25-48c0-83e7-a2ce927fb329 None admin] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:36:47.264266 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48c2a3e-3d25-48c0-83e7-a2ce927fb329 None admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:36:47.264759 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48c2a3e-3d25-48c0-83e7-a2ce927fb329 None admin] PATH_INFO: `/v3/services` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:36:47.265600 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e48c2a3e-3d25-48c0-83e7-a2ce927fb329 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=87934) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:36:47.266121 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e48c2a3e-3d25-48c0-83e7-a2ce927fb329 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:36:47.267707 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e48c2a3e-3d25-48c0-83e7-a2ce927fb329 None admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:36:47.280529 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 444/863] 10.222.0.25 () {56 vars in 1126 bytes} [Tue Sep 13 19:36:47 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:36:47.281316 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG dbcounter [-] [87935] Writing DB stats keystone:SELECT=100 {{(pid=87935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:36:47.287005 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6523dccc-96a8-43cd-a082-2e5086a049f7 None admin] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:36:47.337516 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902ce0f0-9d7d-4912-a8c3-8c4b4c3986b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:36:47.338150 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902ce0f0-9d7d-4912-a8c3-8c4b4c3986b6 None admin] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:36:47.338425 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902ce0f0-9d7d-4912-a8c3-8c4b4c3986b6 None admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:36:47.338692 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902ce0f0-9d7d-4912-a8c3-8c4b4c3986b6 None admin] PATH_INFO: `/v3/users` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:36:47.339479 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-902ce0f0-9d7d-4912-a8c3-8c4b4c3986b6 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=87935) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:36:47.339786 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-902ce0f0-9d7d-4912-a8c3-8c4b4c3986b6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:36:47.341477 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-902ce0f0-9d7d-4912-a8c3-8c4b4c3986b6 None admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:36:47.365796 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 420/864] 10.222.0.25 () {56 vars in 1149 bytes} [Tue Sep 13 19:36:47 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:36:47.372876 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48c2a3e-3d25-48c0-83e7-a2ce927fb329 None admin] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:36:47.432139 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG dbcounter [-] [87934] Writing DB stats keystone:SELECT=100 {{(pid=87934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:36:47.489403 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48c2a3e-3d25-48c0-83e7-a2ce927fb329 None admin] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:36:47.523848 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073998fe-8ba2-4d2e-9b60-7315a8fdec3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:36:47.524463 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073998fe-8ba2-4d2e-9b60-7315a8fdec3e None admin] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:36:47.524750 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073998fe-8ba2-4d2e-9b60-7315a8fdec3e None admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:36:47.525019 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073998fe-8ba2-4d2e-9b60-7315a8fdec3e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:36:47.596237 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-073998fe-8ba2-4d2e-9b60-7315a8fdec3e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:36:47.598307 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-073998fe-8ba2-4d2e-9b60-7315a8fdec3e None admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:36:47.651456 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG dbcounter [-] [87934] Writing DB stats keystone:SELECT=100 {{(pid=87934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:36:47.705709 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 445/865] 10.222.0.25 () {58 vars in 1282 bytes} [Tue Sep 13 19:36:47 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 13 19:36:47.712073 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902ce0f0-9d7d-4912-a8c3-8c4b4c3986b6 None admin] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:36:47.819420 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902ce0f0-9d7d-4912-a8c3-8c4b4c3986b6 None admin] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:36:47.857157 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621244ae-2ea3-4dcb-83f1-0037ae93fe91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:36:47.857841 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621244ae-2ea3-4dcb-83f1-0037ae93fe91 None admin] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:36:47.858113 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621244ae-2ea3-4dcb-83f1-0037ae93fe91 None admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:36:47.858378 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621244ae-2ea3-4dcb-83f1-0037ae93fe91 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:36:47.869147 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-621244ae-2ea3-4dcb-83f1-0037ae93fe91 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:36:47.870575 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-621244ae-2ea3-4dcb-83f1-0037ae93fe91 None admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:36:47.885747 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application [None req-621244ae-2ea3-4dcb-83f1-0037ae93fe91 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 19:36:47.885747 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:36:47.885747 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:36:47.885747 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:36:47.885747 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:36:47.885747 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:36:47.885747 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:36:47.885747 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:36:47.885747 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:36:47.885747 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:36:47.885747 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:36:47.885747 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:36:47.885747 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 19:36:47.885747 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 19:36:47.885747 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 19:36:47.885747 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 19:36:47.886737 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:36:47.886737 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:36:47.886737 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:36:47.886737 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:36:47.886737 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:36:47.886737 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:36:47.886737 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:36:47.886737 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application with Lock( Sep 13 19:36:47.886737 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:36:47.886737 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:36:47.886737 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:36:47.886737 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:36:47.886737 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:36:47.886737 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:36:47.886737 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:36:47.886737 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:36:47.886737 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 19:36:47.887625 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 19:36:47.887625 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 19:36:47.887625 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application Sep 13 19:36:47.887625 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 421/866] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Sep 13 19:36:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:36:47.892705 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073998fe-8ba2-4d2e-9b60-7315a8fdec3e None admin] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:36:47.995599 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073998fe-8ba2-4d2e-9b60-7315a8fdec3e None admin] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:36:48.030330 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da25482b-6705-489f-8249-902a81c8cbad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:36:48.030940 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da25482b-6705-489f-8249-902a81c8cbad None admin] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:36:48.031212 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da25482b-6705-489f-8249-902a81c8cbad None admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:36:48.031476 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da25482b-6705-489f-8249-902a81c8cbad None admin] PATH_INFO: `/v3/domains` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:36:48.032115 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da25482b-6705-489f-8249-902a81c8cbad None admin] RBAC: Adding query filter params (name=Default) {{(pid=87934) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:36:48.032442 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da25482b-6705-489f-8249-902a81c8cbad None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:36:48.033784 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da25482b-6705-489f-8249-902a81c8cbad None admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:36:48.046444 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 446/867] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Sep 13 19:36:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:36:48.052641 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621244ae-2ea3-4dcb-83f1-0037ae93fe91 None admin] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:36:48.064609 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG dbcounter [-] [87935] Writing DB stats keystone:SELECT=100 {{(pid=87935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:36:48.162662 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621244ae-2ea3-4dcb-83f1-0037ae93fe91 None admin] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:36:48.200102 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f8c19e-1c19-4231-9647-5f8a84cf8fc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:36:48.200846 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f8c19e-1c19-4231-9647-5f8a84cf8fc8 None admin] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:36:48.201121 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f8c19e-1c19-4231-9647-5f8a84cf8fc8 None admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:36:48.201438 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f8c19e-1c19-4231-9647-5f8a84cf8fc8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:36:48.210070 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f8c19e-1c19-4231-9647-5f8a84cf8fc8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:36:48.211632 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f8c19e-1c19-4231-9647-5f8a84cf8fc8 None admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:36:48.225606 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application [None req-b2f8c19e-1c19-4231-9647-5f8a84cf8fc8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 19:36:48.225606 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:36:48.225606 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:36:48.225606 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:36:48.225606 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:36:48.225606 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:36:48.225606 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:36:48.225606 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:36:48.225606 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:36:48.225606 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:36:48.225606 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:36:48.225606 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:36:48.225606 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 13 19:36:48.225606 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 13 19:36:48.225606 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 13 19:36:48.226581 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 13 19:36:48.226581 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:36:48.226581 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:36:48.226581 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:36:48.226581 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:36:48.226581 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:36:48.226581 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:36:48.226581 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:36:48.226581 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application with Lock( Sep 13 19:36:48.226581 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:36:48.226581 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:36:48.226581 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:36:48.226581 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:36:48.226581 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:36:48.226581 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:36:48.226581 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:36:48.226581 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:36:48.227481 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 13 19:36:48.227481 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 13 19:36:48.227481 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 13 19:36:48.227481 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 13 19:36:48.227481 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 13 19:36:48.227481 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 13 19:36:48.227481 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 19:36:48.227481 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application Sep 13 19:36:48.227481 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 422/868] 10.222.0.25 () {56 vars in 1111 bytes} [Tue Sep 13 19:36:48 2022] GET /identity/v3/projects/service => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:36:48.232886 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da25482b-6705-489f-8249-902a81c8cbad None admin] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:36:48.252682 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG dbcounter [-] [87934] Writing DB stats keystone:SELECT=100 {{(pid=87934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:36:48.326855 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ea77c0-ae5c-434f-8ee8-66fd6b4f3669 None None] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:36:48.327490 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ea77c0-ae5c-434f-8ee8-66fd6b4f3669 None None] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:36:48.328005 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ea77c0-ae5c-434f-8ee8-66fd6b4f3669 None None] PATH_INFO: `/` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:36:48.329851 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 423/869] 10.222.0.25 () {54 vars in 927 bytes} [Tue Sep 13 19:36:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 13 19:36:48.336589 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a104d5-499d-47e3-8787-fc1f3f37b905 None None] REQUEST_METHOD: `POST` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:36:48.337205 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a104d5-499d-47e3-8787-fc1f3f37b905 None None] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:36:48.337678 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a104d5-499d-47e3-8787-fc1f3f37b905 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:36:48.357607 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.auth.core [None req-41a104d5-499d-47e3-8787-fc1f3f37b905 None None] MFA Rules not processed for user `7b0aed92d02344acb92a0e4aa67c3068`. Rule list: `[]` (Enabled: `True`). {{(pid=87935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:36:48.359182 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.fernet_utils [None req-41a104d5-499d-47e3-8787-fc1f3f37b905 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:36:48.363921 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da25482b-6705-489f-8249-902a81c8cbad None admin] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:36:48.413908 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab36bc3-01ce-4b14-b3fc-b8d394d64cba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:36:48.414916 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab36bc3-01ce-4b14-b3fc-b8d394d64cba None admin] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:36:48.415396 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab36bc3-01ce-4b14-b3fc-b8d394d64cba None admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:36:48.415867 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab36bc3-01ce-4b14-b3fc-b8d394d64cba None admin] PATH_INFO: `/v3/projects` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:36:48.416926 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab36bc3-01ce-4b14-b3fc-b8d394d64cba None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87934) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:36:48.417485 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab36bc3-01ce-4b14-b3fc-b8d394d64cba None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:36:48.419219 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab36bc3-01ce-4b14-b3fc-b8d394d64cba None admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:36:48.440919 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 447/870] 10.222.0.25 () {56 vars in 1148 bytes} [Tue Sep 13 19:36:48 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:36:48.448391 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab36bc3-01ce-4b14-b3fc-b8d394d64cba None admin] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:36:48.465263 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG dbcounter [-] [87935] Writing DB stats keystone:SELECT=100 {{(pid=87935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:36:48.480238 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 424/871] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Sep 13 19:36:48 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 13 19:36:48.531538 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG dbcounter [-] [87934] Writing DB stats keystone:SELECT=100 {{(pid=87934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:36:48.566378 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab36bc3-01ce-4b14-b3fc-b8d394d64cba None admin] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:36:48.607448 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf3969c-03fa-4f34-bf3c-06d60fbdfbb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:36:48.608080 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf3969c-03fa-4f34-bf3c-06d60fbdfbb2 None admin] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:36:48.608395 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf3969c-03fa-4f34-bf3c-06d60fbdfbb2 None admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:36:48.608666 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf3969c-03fa-4f34-bf3c-06d60fbdfbb2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:36:48.609417 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf3969c-03fa-4f34-bf3c-06d60fbdfbb2 None admin] RBAC: Adding query filter params (role.id=60f5ecbf9ce84814968607f126a85a5a, scope.project.id=9a10a4268f3c4cb29f4e00c292e2df62, user.id=d44977a3225e43f19cdc4a84f0e170cd) {{(pid=87934) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:36:48.609723 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf3969c-03fa-4f34-bf3c-06d60fbdfbb2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:36:48.611278 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf3969c-03fa-4f34-bf3c-06d60fbdfbb2 None admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:36:48.619570 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 448/872] 10.222.0.25 () {56 vars in 1374 bytes} [Tue Sep 13 19:36:48 2022] GET /identity/v3/role_assignments?user.id=d44977a3225e43f19cdc4a84f0e170cd&scope.project.id=9a10a4268f3c4cb29f4e00c292e2df62&role.id=60f5ecbf9ce84814968607f126a85a5a => generated 608 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:36:48.714978 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941c6263-ae78-42fb-92e8-593b18ebb730 None None] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:36:48.715478 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941c6263-ae78-42fb-92e8-593b18ebb730 None None] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:36:48.715478 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941c6263-ae78-42fb-92e8-593b18ebb730 None None] PATH_INFO: `/` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:36:48.717205 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 425/873] 10.222.0.25 () {54 vars in 927 bytes} [Tue Sep 13 19:36:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:36:48.723974 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018ba800-17d0-41d5-8742-0652a7326cc6 None None] REQUEST_METHOD: `POST` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:36:48.724457 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018ba800-17d0-41d5-8742-0652a7326cc6 None None] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:36:48.724636 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018ba800-17d0-41d5-8742-0652a7326cc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:36:48.744884 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.auth.core [None req-018ba800-17d0-41d5-8742-0652a7326cc6 None None] MFA Rules not processed for user `7b0aed92d02344acb92a0e4aa67c3068`. Rule list: `[]` (Enabled: `True`). {{(pid=87934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:36:48.746117 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.fernet_utils [None req-018ba800-17d0-41d5-8742-0652a7326cc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:36:48.757970 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941c6263-ae78-42fb-92e8-593b18ebb730 None None] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:36:48.828176 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 449/874] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Sep 13 19:36:48 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 13 19:36:48.892587 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941c6263-ae78-42fb-92e8-593b18ebb730 None None] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:36:48.929206 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64484c4-c053-443d-afc5-387207f97f6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:36:48.929842 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64484c4-c053-443d-afc5-387207f97f6c None admin] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:36:48.930119 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64484c4-c053-443d-afc5-387207f97f6c None admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:36:48.930391 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64484c4-c053-443d-afc5-387207f97f6c None admin] PATH_INFO: `/v3/services/object-store` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:36:48.930972 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e64484c4-c053-443d-afc5-387207f97f6c None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:36:48.932366 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e64484c4-c053-443d-afc5-387207f97f6c None admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:36:48.941935 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application [None req-e64484c4-c053-443d-afc5-387207f97f6c None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 13 19:36:48.941935 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:36:48.941935 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 13 19:36:48.941935 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 13 19:36:48.941935 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 13 19:36:48.941935 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 13 19:36:48.941935 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 13 19:36:48.941935 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 19:36:48.941935 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 13 19:36:48.941935 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application Sep 13 19:36:48.941935 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 13 19:36:48.941935 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application Sep 13 19:36:48.941935 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:36:48.941935 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:36:48.941935 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:36:48.941935 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:36:48.941935 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:36:48.943204 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:36:48.943204 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:36:48.943204 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:36:48.943204 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:36:48.943204 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:36:48.943204 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:36:48.943204 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 13 19:36:48.943204 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 13 19:36:48.943204 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 13 19:36:48.943204 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 13 19:36:48.943204 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:36:48.943204 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:36:48.943204 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:36:48.943204 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:36:48.943204 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:36:48.943204 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:36:48.944112 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:36:48.944112 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application with Lock( Sep 13 19:36:48.944112 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:36:48.944112 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:36:48.944112 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:36:48.944112 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:36:48.944112 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:36:48.944112 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:36:48.944112 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:36:48.944112 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:36:48.944112 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 13 19:36:48.944112 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 19:36:48.944112 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 13 19:36:48.944112 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application Sep 13 19:36:48.944112 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 426/875] 10.222.0.25 () {56 vars in 1126 bytes} [Tue Sep 13 19:36:48 2022] GET /identity/v3/services/object-store => generated 93 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 13 19:36:48.950189 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018ba800-17d0-41d5-8742-0652a7326cc6 None None] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:36:49.021130 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG dbcounter [-] [87934] Writing DB stats keystone:SELECT=100 {{(pid=87934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:36:49.062075 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018ba800-17d0-41d5-8742-0652a7326cc6 None None] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:36:49.100565 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c35141a-fe21-4ec7-a234-163f3bdb6b8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:36:49.101194 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c35141a-fe21-4ec7-a234-163f3bdb6b8d None admin] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:36:49.101475 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c35141a-fe21-4ec7-a234-163f3bdb6b8d None admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:36:49.101747 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c35141a-fe21-4ec7-a234-163f3bdb6b8d None admin] PATH_INFO: `/v3/services` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:36:49.102390 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c35141a-fe21-4ec7-a234-163f3bdb6b8d None admin] RBAC: Adding query filter params (name=object-store) {{(pid=87934) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:36:49.102692 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c35141a-fe21-4ec7-a234-163f3bdb6b8d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:36:49.104077 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c35141a-fe21-4ec7-a234-163f3bdb6b8d None admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:36:49.109668 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 450/876] 10.222.0.25 () {56 vars in 1122 bytes} [Tue Sep 13 19:36:48 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:36:49.115660 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64484c4-c053-443d-afc5-387207f97f6c None admin] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:36:49.125349 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c35141a-fe21-4ec7-a234-163f3bdb6b8d None admin] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:36:49.185387 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG dbcounter [-] [87935] Writing DB stats keystone:SELECT=100 {{(pid=87935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:36:49.242231 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64484c4-c053-443d-afc5-387207f97f6c None admin] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:36:49.243520 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c35141a-fe21-4ec7-a234-163f3bdb6b8d None admin] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:36:49.283107 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c918d3-90c6-478c-933f-d2e222dc5102 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:36:49.283417 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG dbcounter [-] [87934] Writing DB stats keystone:SELECT=100 {{(pid=87934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:36:49.283796 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c918d3-90c6-478c-933f-d2e222dc5102 None admin] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:36:49.284537 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c918d3-90c6-478c-933f-d2e222dc5102 None admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:36:49.285125 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c918d3-90c6-478c-933f-d2e222dc5102 None admin] PATH_INFO: `/v3/services` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:36:49.286234 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c918d3-90c6-478c-933f-d2e222dc5102 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=87935) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:36:49.286547 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c918d3-90c6-478c-933f-d2e222dc5102 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:36:49.288111 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c918d3-90c6-478c-933f-d2e222dc5102 None admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:36:49.294212 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 427/877] 10.222.0.25 () {56 vars in 1122 bytes} [Tue Sep 13 19:36:49 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:36:49.301967 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ebfaf5e-bc47-4d42-a5df-2e50ce0a6434 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:36:49.302959 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebfaf5e-bc47-4d42-a5df-2e50ce0a6434 None admin] REQUEST_METHOD: `POST` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:36:49.303477 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebfaf5e-bc47-4d42-a5df-2e50ce0a6434 None admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:36:49.303939 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebfaf5e-bc47-4d42-a5df-2e50ce0a6434 None admin] PATH_INFO: `/v3/services` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:36:49.304864 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ebfaf5e-bc47-4d42-a5df-2e50ce0a6434 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:36:49.306296 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ebfaf5e-bc47-4d42-a5df-2e50ce0a6434 None admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:36:49.331312 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 451/878] 10.222.0.25 () {60 vars in 1141 bytes} [Tue Sep 13 19:36:49 2022] POST /identity/v3/services => generated 251 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 19:36:49.613973 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95165ae-17a4-4d70-a8b6-95a04c72b149 None None] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:36:49.614295 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95165ae-17a4-4d70-a8b6-95a04c72b149 None None] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:36:49.614460 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95165ae-17a4-4d70-a8b6-95a04c72b149 None None] PATH_INFO: `/` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:36:49.616160 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 428/879] 10.222.0.25 () {54 vars in 927 bytes} [Tue Sep 13 19:36:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:36:49.621875 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94294189-b2e5-4881-91bd-65371a057854 None None] REQUEST_METHOD: `POST` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:36:49.622158 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94294189-b2e5-4881-91bd-65371a057854 None None] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:36:49.622425 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94294189-b2e5-4881-91bd-65371a057854 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:36:49.641708 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.auth.core [None req-94294189-b2e5-4881-91bd-65371a057854 None None] MFA Rules not processed for user `7b0aed92d02344acb92a0e4aa67c3068`. Rule list: `[]` (Enabled: `True`). {{(pid=87934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:36:49.642895 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.fernet_utils [None req-94294189-b2e5-4881-91bd-65371a057854 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:36:49.727682 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 452/880] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Sep 13 19:36:49 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 13 19:36:49.999606 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95165ae-17a4-4d70-a8b6-95a04c72b149 None None] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:36:50.111182 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95165ae-17a4-4d70-a8b6-95a04c72b149 None None] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:36:50.139898 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG dbcounter [-] [87935] Writing DB stats keystone:SELECT=100 {{(pid=87935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:36:50.151145 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb87048-a991-4bbc-8dfd-8e78b116a12b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:36:50.151760 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb87048-a991-4bbc-8dfd-8e78b116a12b None admin] REQUEST_METHOD: `POST` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:36:50.152035 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb87048-a991-4bbc-8dfd-8e78b116a12b None admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:36:50.152331 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb87048-a991-4bbc-8dfd-8e78b116a12b None admin] PATH_INFO: `/v3/services` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:36:50.152999 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb87048-a991-4bbc-8dfd-8e78b116a12b None admin] RBAC: Authorizing `identity:create_service()` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:36:50.154356 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb87048-a991-4bbc-8dfd-8e78b116a12b None admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:36:50.170473 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 429/881] 10.222.0.25 () {60 vars in 1141 bytes} [Tue Sep 13 19:36:49 2022] POST /identity/v3/services => generated 269 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 19:36:51.072541 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ed1f6a-3a26-45e0-850e-2f0f30a89b50 None None] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:36:51.073095 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ed1f6a-3a26-45e0-850e-2f0f30a89b50 None None] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:36:51.073095 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ed1f6a-3a26-45e0-850e-2f0f30a89b50 None None] PATH_INFO: `/` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:36:51.074866 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 453/882] 10.222.0.25 () {54 vars in 927 bytes} [Tue Sep 13 19:36:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:36:51.080341 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd1ea9d-cfb9-4e44-81fa-ad3e97df0bb4 None None] REQUEST_METHOD: `POST` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:36:51.080816 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd1ea9d-cfb9-4e44-81fa-ad3e97df0bb4 None None] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:36:51.080898 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd1ea9d-cfb9-4e44-81fa-ad3e97df0bb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:36:51.100989 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.auth.core [None req-5dd1ea9d-cfb9-4e44-81fa-ad3e97df0bb4 None None] MFA Rules not processed for user `7b0aed92d02344acb92a0e4aa67c3068`. Rule list: `[]` (Enabled: `True`). {{(pid=87935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:36:51.102179 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.fernet_utils [None req-5dd1ea9d-cfb9-4e44-81fa-ad3e97df0bb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:36:51.189988 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 430/883] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Sep 13 19:36:51 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 13 19:36:51.475418 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ed1f6a-3a26-45e0-850e-2f0f30a89b50 None None] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:36:51.602099 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ed1f6a-3a26-45e0-850e-2f0f30a89b50 None None] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:36:51.618847 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG dbcounter [-] [87934] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:36:51.642089 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e298b0-81ce-4f1f-a939-c9b75f5260b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:36:51.642730 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e298b0-81ce-4f1f-a939-c9b75f5260b6 None admin] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:36:51.643053 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e298b0-81ce-4f1f-a939-c9b75f5260b6 None admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:36:51.643330 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e298b0-81ce-4f1f-a939-c9b75f5260b6 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:36:51.654197 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e298b0-81ce-4f1f-a939-c9b75f5260b6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 19:36:51.659181 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application [None req-54e298b0-81ce-4f1f-a939-c9b75f5260b6 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 13 19:36:51.659181 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:36:51.659181 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:36:51.659181 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:36:51.659181 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:36:51.659181 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:36:51.659181 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:36:51.659181 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:36:51.659181 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:36:51.659181 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:36:51.659181 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:36:51.659181 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:36:51.659181 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 19:36:51.659181 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 19:36:51.659181 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 19:36:51.659181 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 19:36:51.660483 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 19:36:51.660483 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 19:36:51.660483 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 19:36:51.660483 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 19:36:51.660483 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:36:51.660483 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:36:51.660483 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:36:51.660483 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:36:51.660483 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:36:51.660483 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:36:51.660483 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:36:51.660483 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application with Lock( Sep 13 19:36:51.660483 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:36:51.660483 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:36:51.660483 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:36:51.660483 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:36:51.662119 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:36:51.662119 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:36:51.662119 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:36:51.662119 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:36:51.662119 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 19:36:51.662119 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 19:36:51.662119 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 19:36:51.662119 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 19:36:51.662119 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 19:36:51.662119 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 19:36:51.662119 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 13 19:36:51.662119 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application Sep 13 19:36:51.662119 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 454/884] 10.222.0.25 () {56 vars in 1120 bytes} [Tue Sep 13 19:36:51 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:36:51.666727 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd1ea9d-cfb9-4e44-81fa-ad3e97df0bb4 None None] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:36:51.708311 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4c301c-eb37-4140-a2e8-08e7ce603def None None] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:36:51.708728 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4c301c-eb37-4140-a2e8-08e7ce603def None None] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:36:51.708877 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4c301c-eb37-4140-a2e8-08e7ce603def None None] PATH_INFO: `/` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:36:51.710974 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 455/885] 10.222.0.25 () {54 vars in 927 bytes} [Tue Sep 13 19:36:51 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:36:51.712070 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34317453-be17-4580-b887-f5fdd4be2065 None None] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:36:51.713279 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34317453-be17-4580-b887-f5fdd4be2065 None None] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:36:51.713279 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34317453-be17-4580-b887-f5fdd4be2065 None None] PATH_INFO: `/` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:36:51.716830 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 456/886] 10.222.0.25 () {54 vars in 927 bytes} [Tue Sep 13 19:36:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:36:51.719476 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8342d7c2-6d5a-4a1a-922f-eb377fa7f887 None None] REQUEST_METHOD: `POST` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:36:51.719765 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8342d7c2-6d5a-4a1a-922f-eb377fa7f887 None None] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:36:51.720039 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8342d7c2-6d5a-4a1a-922f-eb377fa7f887 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:36:51.739750 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.auth.core [None req-8342d7c2-6d5a-4a1a-922f-eb377fa7f887 None None] MFA Rules not processed for user `7b0aed92d02344acb92a0e4aa67c3068`. Rule list: `[]` (Enabled: `True`). {{(pid=87934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:36:51.740923 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.fernet_utils [None req-8342d7c2-6d5a-4a1a-922f-eb377fa7f887 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:36:51.779928 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd1ea9d-cfb9-4e44-81fa-ad3e97df0bb4 None None] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:36:51.794273 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG dbcounter [-] [87935] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:36:51.816255 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 457/887] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Sep 13 19:36:51 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 13 19:36:51.816255 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372fcb85-4861-4c7d-b7c1-1c2f7ab48e17 None None] REQUEST_METHOD: `POST` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:36:51.816255 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372fcb85-4861-4c7d-b7c1-1c2f7ab48e17 None None] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:36:51.816255 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372fcb85-4861-4c7d-b7c1-1c2f7ab48e17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:36:51.825776 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7edd6ac2-3613-4369-8927-44de320c6931 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:36:51.826725 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edd6ac2-3613-4369-8927-44de320c6931 None admin] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:36:51.827190 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edd6ac2-3613-4369-8927-44de320c6931 None admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:36:51.827529 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edd6ac2-3613-4369-8927-44de320c6931 None admin] PATH_INFO: `/v3/roles` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:36:51.828323 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7edd6ac2-3613-4369-8927-44de320c6931 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=87935) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:36:51.828684 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7edd6ac2-3613-4369-8927-44de320c6931 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:36:51.830221 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7edd6ac2-3613-4369-8927-44de320c6931 None admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:36:51.846113 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.auth.core [None req-372fcb85-4861-4c7d-b7c1-1c2f7ab48e17 None None] MFA Rules not processed for user `7b0aed92d02344acb92a0e4aa67c3068`. Rule list: `[]` (Enabled: `True`). {{(pid=87934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:36:51.847985 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 431/888] 10.222.0.25 () {56 vars in 1115 bytes} [Tue Sep 13 19:36:51 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:36:51.848853 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.fernet_utils [None req-372fcb85-4861-4c7d-b7c1-1c2f7ab48e17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:36:51.849508 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7edd6ac2-3613-4369-8927-44de320c6931 None admin] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:36:51.959833 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 458/889] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Sep 13 19:36:51 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 13 19:36:51.997933 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7edd6ac2-3613-4369-8927-44de320c6931 None admin] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:36:52.036226 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62530606-400a-4b1d-9dfc-d053dedbec8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:36:52.037296 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62530606-400a-4b1d-9dfc-d053dedbec8f None admin] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:36:52.037770 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62530606-400a-4b1d-9dfc-d053dedbec8f None admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:36:52.038234 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62530606-400a-4b1d-9dfc-d053dedbec8f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:36:52.050811 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62530606-400a-4b1d-9dfc-d053dedbec8f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:36:52.052783 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62530606-400a-4b1d-9dfc-d053dedbec8f None admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:36:52.069297 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application [None req-62530606-400a-4b1d-9dfc-d053dedbec8f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 19:36:52.069297 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:36:52.069297 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:36:52.069297 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:36:52.069297 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:36:52.069297 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:36:52.069297 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:36:52.069297 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:36:52.069297 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:36:52.069297 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:36:52.069297 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:36:52.069297 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:36:52.069297 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 19:36:52.069297 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 19:36:52.069297 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 19:36:52.069297 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 19:36:52.070304 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:36:52.070304 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:36:52.070304 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:36:52.070304 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:36:52.070304 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:36:52.070304 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:36:52.070304 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:36:52.070304 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application with Lock( Sep 13 19:36:52.070304 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:36:52.070304 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:36:52.070304 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:36:52.070304 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:36:52.070304 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:36:52.070304 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:36:52.070304 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:36:52.070304 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:36:52.070304 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 19:36:52.071199 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 19:36:52.071199 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 19:36:52.071199 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application Sep 13 19:36:52.073342 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 432/890] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Sep 13 19:36:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:36:52.079337 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372fcb85-4861-4c7d-b7c1-1c2f7ab48e17 None None] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:36:52.097869 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62530606-400a-4b1d-9dfc-d053dedbec8f None admin] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:36:52.121202 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG dbcounter [-] [87934] Writing DB stats keystone:SELECT=100 {{(pid=87934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:36:52.131589 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG dbcounter [-] [87935] Writing DB stats keystone:SELECT=100 {{(pid=87935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:36:52.196966 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372fcb85-4861-4c7d-b7c1-1c2f7ab48e17 None None] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:36:52.214259 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62530606-400a-4b1d-9dfc-d053dedbec8f None admin] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:36:52.234981 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499c1cc1-8e27-434e-b12c-cb93b5c91e54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:36:52.235593 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499c1cc1-8e27-434e-b12c-cb93b5c91e54 None admin] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:36:52.236247 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499c1cc1-8e27-434e-b12c-cb93b5c91e54 None admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:36:52.236537 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499c1cc1-8e27-434e-b12c-cb93b5c91e54 None admin] PATH_INFO: `/v3/domains` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:36:52.237185 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-499c1cc1-8e27-434e-b12c-cb93b5c91e54 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87934) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:36:52.237484 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-499c1cc1-8e27-434e-b12c-cb93b5c91e54 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:36:52.239401 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-499c1cc1-8e27-434e-b12c-cb93b5c91e54 None admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:36:52.254559 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 459/891] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Sep 13 19:36:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:36:52.254733 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb5bc96-5ad7-44b6-ae51-abcc8e1db7e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:36:52.255373 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb5bc96-5ad7-44b6-ae51-abcc8e1db7e7 None admin] REQUEST_METHOD: `POST` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:36:52.255649 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb5bc96-5ad7-44b6-ae51-abcc8e1db7e7 None admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:36:52.255914 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb5bc96-5ad7-44b6-ae51-abcc8e1db7e7 None admin] PATH_INFO: `/v3/services` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:36:52.256557 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499c1cc1-8e27-434e-b12c-cb93b5c91e54 None admin] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:36:52.256666 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb5bc96-5ad7-44b6-ae51-abcc8e1db7e7 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:36:52.258111 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb5bc96-5ad7-44b6-ae51-abcc8e1db7e7 None admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:36:52.276859 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 433/892] 10.222.0.25 () {60 vars in 1141 bytes} [Tue Sep 13 19:36:52 2022] POST /identity/v3/services => generated 241 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 13 19:36:52.277742 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb5bc96-5ad7-44b6-ae51-abcc8e1db7e7 None admin] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:36:52.410341 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG dbcounter [-] [87934] Writing DB stats keystone:SELECT=100 {{(pid=87934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:36:52.419008 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499c1cc1-8e27-434e-b12c-cb93b5c91e54 None admin] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:36:52.427641 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG dbcounter [-] [87935] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:36:52.458066 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb5bc96-5ad7-44b6-ae51-abcc8e1db7e7 None admin] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:36:52.466230 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e270fb-ea56-418c-b41c-b25b941cffb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:36:52.466864 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e270fb-ea56-418c-b41c-b25b941cffb2 None admin] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:36:52.467150 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e270fb-ea56-418c-b41c-b25b941cffb2 None admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:36:52.467422 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e270fb-ea56-418c-b41c-b25b941cffb2 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:36:52.468014 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e270fb-ea56-418c-b41c-b25b941cffb2 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:36:52.469420 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e270fb-ea56-418c-b41c-b25b941cffb2 None admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:36:52.481137 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application [None req-32e270fb-ea56-418c-b41c-b25b941cffb2 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 13 19:36:52.481137 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:36:52.481137 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 13 19:36:52.481137 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 13 19:36:52.481137 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 13 19:36:52.481137 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 13 19:36:52.481137 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 13 19:36:52.481137 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 19:36:52.481137 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 13 19:36:52.481137 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application Sep 13 19:36:52.481137 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 13 19:36:52.481137 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application Sep 13 19:36:52.481137 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:36:52.481137 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:36:52.481137 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:36:52.481137 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:36:52.481137 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:36:52.482218 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:36:52.482218 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:36:52.482218 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:36:52.482218 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:36:52.482218 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:36:52.482218 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:36:52.482218 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 13 19:36:52.482218 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 13 19:36:52.482218 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 13 19:36:52.482218 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 13 19:36:52.482218 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:36:52.482218 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:36:52.482218 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:36:52.482218 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:36:52.482218 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:36:52.482218 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:36:52.483256 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:36:52.483256 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application with Lock( Sep 13 19:36:52.483256 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:36:52.483256 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:36:52.483256 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:36:52.483256 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:36:52.483256 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:36:52.483256 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:36:52.483256 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:36:52.483256 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:36:52.483256 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 13 19:36:52.483256 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 19:36:52.483256 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 13 19:36:52.483256 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application Sep 13 19:36:52.485389 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 460/893] 10.222.0.25 () {56 vars in 1114 bytes} [Tue Sep 13 19:36:52 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:36:52.486906 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed236227-f216-496f-90d3-6c9572ce1ade None None] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:36:52.487191 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed236227-f216-496f-90d3-6c9572ce1ade None None] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:36:52.487462 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed236227-f216-496f-90d3-6c9572ce1ade None None] PATH_INFO: `/` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:36:52.489576 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 461/894] 10.222.0.25 () {54 vars in 927 bytes} [Tue Sep 13 19:36:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:36:52.493537 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed236227-f216-496f-90d3-6c9572ce1ade None None] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:36:52.504020 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7cbe14-1834-4160-bfdc-5c1f9806aca3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:36:52.504974 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7cbe14-1834-4160-bfdc-5c1f9806aca3 None admin] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:36:52.505195 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7cbe14-1834-4160-bfdc-5c1f9806aca3 None admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:36:52.505475 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7cbe14-1834-4160-bfdc-5c1f9806aca3 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:36:52.516888 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff7cbe14-1834-4160-bfdc-5c1f9806aca3 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:36:52.518357 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff7cbe14-1834-4160-bfdc-5c1f9806aca3 None admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:36:52.532909 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application [None req-ff7cbe14-1834-4160-bfdc-5c1f9806aca3 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 13 19:36:52.532909 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:36:52.532909 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:36:52.532909 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:36:52.532909 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:36:52.532909 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:36:52.532909 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:36:52.532909 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:36:52.532909 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:36:52.532909 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:36:52.532909 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:36:52.532909 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:36:52.532909 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 13 19:36:52.532909 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 13 19:36:52.532909 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 13 19:36:52.532909 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 13 19:36:52.535292 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:36:52.535292 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:36:52.535292 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 13 19:36:52.535292 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 19:36:52.535292 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 13 19:36:52.535292 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 19:36:52.535292 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:36:52.535292 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:36:52.535292 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:36:52.535292 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:36:52.535292 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:36:52.535292 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application with Lock( Sep 13 19:36:52.535292 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:36:52.535292 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:36:52.535292 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:36:52.535292 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:36:52.535292 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:36:52.535292 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:36:52.537537 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:36:52.537537 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:36:52.537537 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 13 19:36:52.537537 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 13 19:36:52.537537 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 13 19:36:52.537537 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 13 19:36:52.537537 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 13 19:36:52.537537 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 13 19:36:52.537537 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 13 19:36:52.537537 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application Sep 13 19:36:52.537537 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 434/895] 10.222.0.25 () {56 vars in 1117 bytes} [Tue Sep 13 19:36:52 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 257 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:36:52.537537 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e491d13-be9d-4423-ad77-475bd1695b85 None None] REQUEST_METHOD: `POST` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:36:52.537537 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e491d13-be9d-4423-ad77-475bd1695b85 None None] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:36:52.538983 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e491d13-be9d-4423-ad77-475bd1695b85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:36:52.556907 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.auth.core [None req-1e491d13-be9d-4423-ad77-475bd1695b85 None None] MFA Rules not processed for user `7b0aed92d02344acb92a0e4aa67c3068`. Rule list: `[]` (Enabled: `True`). {{(pid=87935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:36:52.558081 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.fernet_utils [None req-1e491d13-be9d-4423-ad77-475bd1695b85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:36:52.632924 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 435/896] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Sep 13 19:36:52 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 13 19:36:52.633301 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed236227-f216-496f-90d3-6c9572ce1ade None None] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:36:52.634273 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e491d13-be9d-4423-ad77-475bd1695b85 None None] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:36:52.688693 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ac29e7-7ecf-49c0-9852-07fb8cb43022 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:36:52.689565 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ac29e7-7ecf-49c0-9852-07fb8cb43022 None admin] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:36:52.690013 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ac29e7-7ecf-49c0-9852-07fb8cb43022 None admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:36:52.690445 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ac29e7-7ecf-49c0-9852-07fb8cb43022 None admin] PATH_INFO: `/v3/services` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:36:52.692103 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ac29e7-7ecf-49c0-9852-07fb8cb43022 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=87934) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:36:52.692976 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ac29e7-7ecf-49c0-9852-07fb8cb43022 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:36:52.694772 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ac29e7-7ecf-49c0-9852-07fb8cb43022 None admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:36:52.701781 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 462/897] 10.222.0.25 () {56 vars in 1114 bytes} [Tue Sep 13 19:36:52 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:36:52.708324 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ac29e7-7ecf-49c0-9852-07fb8cb43022 None admin] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:36:52.728574 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG dbcounter [-] [87935] Writing DB stats keystone:SELECT=100 {{(pid=87935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:36:52.734793 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG dbcounter [-] [87934] Writing DB stats keystone:SELECT=100 {{(pid=87934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:36:52.766917 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e491d13-be9d-4423-ad77-475bd1695b85 None None] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:36:52.821358 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ac29e7-7ecf-49c0-9852-07fb8cb43022 None admin] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:36:52.826675 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104ed8de-0fd3-42e7-964f-427f2255b83a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:36:52.827656 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104ed8de-0fd3-42e7-964f-427f2255b83a None admin] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:36:52.828123 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104ed8de-0fd3-42e7-964f-427f2255b83a None admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:36:52.828621 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104ed8de-0fd3-42e7-964f-427f2255b83a None admin] PATH_INFO: `/v3/users` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:36:52.829631 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-104ed8de-0fd3-42e7-964f-427f2255b83a None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=87935) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:36:52.830115 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-104ed8de-0fd3-42e7-964f-427f2255b83a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:36:52.831981 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-104ed8de-0fd3-42e7-964f-427f2255b83a None admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:36:52.851831 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 436/898] 10.222.0.25 () {56 vars in 1149 bytes} [Tue Sep 13 19:36:52 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:36:52.860264 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104ed8de-0fd3-42e7-964f-427f2255b83a None admin] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:36:52.865210 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb63b65-6822-42bf-9db5-51b42d29d0d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:36:52.866552 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb63b65-6822-42bf-9db5-51b42d29d0d9 None admin] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:36:52.867018 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb63b65-6822-42bf-9db5-51b42d29d0d9 None admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:36:52.867482 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb63b65-6822-42bf-9db5-51b42d29d0d9 None admin] PATH_INFO: `/v3/services` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:36:52.868421 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb63b65-6822-42bf-9db5-51b42d29d0d9 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=87934) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:36:52.868872 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb63b65-6822-42bf-9db5-51b42d29d0d9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:36:52.870513 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb63b65-6822-42bf-9db5-51b42d29d0d9 None admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:36:52.881198 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 463/899] 10.222.0.25 () {56 vars in 1114 bytes} [Tue Sep 13 19:36:52 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 19:36:52.883334 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb63b65-6822-42bf-9db5-51b42d29d0d9 None admin] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:36:52.971204 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104ed8de-0fd3-42e7-964f-427f2255b83a None admin] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:36:52.982750 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG dbcounter [-] [87934] Writing DB stats keystone:SELECT=100 {{(pid=87934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:36:53.001166 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb63b65-6822-42bf-9db5-51b42d29d0d9 None admin] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:36:53.006505 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG dbcounter [-] [87935] Writing DB stats keystone:SELECT=100 {{(pid=87935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:36:53.013574 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1cdec6d-5930-4e22-8f98-bbf65f2d9db0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:36:53.014190 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1cdec6d-5930-4e22-8f98-bbf65f2d9db0 None admin] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:36:53.014471 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1cdec6d-5930-4e22-8f98-bbf65f2d9db0 None admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:36:53.014742 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1cdec6d-5930-4e22-8f98-bbf65f2d9db0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:36:53.042447 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8441c9-ca1a-4687-b47d-39536a68d748 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:36:53.043362 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8441c9-ca1a-4687-b47d-39536a68d748 None admin] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:36:53.043787 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8441c9-ca1a-4687-b47d-39536a68d748 None admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:36:53.044251 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8441c9-ca1a-4687-b47d-39536a68d748 None admin] PATH_INFO: `/v3/endpoints` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:36:53.045211 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c8441c9-ca1a-4687-b47d-39536a68d748 None admin] RBAC: Adding query filter params (interface=public, service_id=b08b73bc0fab442bba189bfa7cf19510, region_id=RegionOne) {{(pid=87934) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:36:53.045726 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c8441c9-ca1a-4687-b47d-39536a68d748 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:36:53.047233 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c8441c9-ca1a-4687-b47d-39536a68d748 None admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:36:53.053024 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 464/900] 10.222.0.25 () {56 vars in 1251 bytes} [Tue Sep 13 19:36:52 2022] GET /identity/v3/endpoints?service_id=b08b73bc0fab442bba189bfa7cf19510&interface=public®ion_id=RegionOne => generated 194 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 19:36:53.054146 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8441c9-ca1a-4687-b47d-39536a68d748 None admin] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:36:53.093757 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1cdec6d-5930-4e22-8f98-bbf65f2d9db0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:36:53.095229 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1cdec6d-5930-4e22-8f98-bbf65f2d9db0 None admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:36:53.166114 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8441c9-ca1a-4687-b47d-39536a68d748 None admin] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:36:53.207687 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 437/901] 10.222.0.25 () {58 vars in 1282 bytes} [Tue Sep 13 19:36:52 2022] GET /identity/v3/auth/tokens => generated 1474 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Sep 13 19:36:53.207687 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1cdec6d-5930-4e22-8f98-bbf65f2d9db0 None admin] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:36:53.209893 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e9bb0e-6394-448b-9f8f-2dfbbde798e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:36:53.210738 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e9bb0e-6394-448b-9f8f-2dfbbde798e7 None admin] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:36:53.211207 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e9bb0e-6394-448b-9f8f-2dfbbde798e7 None admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:36:53.211627 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e9bb0e-6394-448b-9f8f-2dfbbde798e7 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:36:53.212439 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e9bb0e-6394-448b-9f8f-2dfbbde798e7 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:36:53.214026 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e9bb0e-6394-448b-9f8f-2dfbbde798e7 None admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:36:53.224254 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application [None req-77e9bb0e-6394-448b-9f8f-2dfbbde798e7 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 13 19:36:53.224254 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:36:53.224254 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 13 19:36:53.224254 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 13 19:36:53.224254 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 13 19:36:53.224254 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 13 19:36:53.224254 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 13 19:36:53.224254 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 19:36:53.224254 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 13 19:36:53.224254 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application Sep 13 19:36:53.224254 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 13 19:36:53.224254 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application Sep 13 19:36:53.224254 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:36:53.224254 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:36:53.224254 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:36:53.224254 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:36:53.225458 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:36:53.225458 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:36:53.225458 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:36:53.225458 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:36:53.225458 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:36:53.225458 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:36:53.225458 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:36:53.225458 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 13 19:36:53.225458 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 13 19:36:53.225458 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 13 19:36:53.225458 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 13 19:36:53.225458 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:36:53.225458 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:36:53.225458 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:36:53.225458 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:36:53.225458 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:36:53.225458 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:36:53.226594 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:36:53.226594 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application with Lock( Sep 13 19:36:53.226594 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:36:53.226594 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:36:53.226594 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:36:53.226594 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:36:53.226594 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:36:53.226594 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:36:53.226594 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:36:53.226594 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:36:53.226594 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 13 19:36:53.226594 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 19:36:53.226594 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 13 19:36:53.226594 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application Sep 13 19:36:53.228742 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 465/902] 10.222.0.25 () {56 vars in 1132 bytes} [Tue Sep 13 19:36:53 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:36:53.229765 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e9bb0e-6394-448b-9f8f-2dfbbde798e7 None admin] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:36:53.241735 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG dbcounter [-] [87935] Writing DB stats keystone:SELECT=100 {{(pid=87935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:36:53.252058 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG dbcounter [-] [87934] Writing DB stats keystone:SELECT=100 {{(pid=87934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:36:53.324579 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1cdec6d-5930-4e22-8f98-bbf65f2d9db0 None admin] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:36:53.352226 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e9bb0e-6394-448b-9f8f-2dfbbde798e7 None admin] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:36:53.365843 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb159f6d-2af8-425d-9d20-d2c09eaa37e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:36:53.366456 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb159f6d-2af8-425d-9d20-d2c09eaa37e7 None admin] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:36:53.366734 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb159f6d-2af8-425d-9d20-d2c09eaa37e7 None admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:36:53.367003 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb159f6d-2af8-425d-9d20-d2c09eaa37e7 None admin] PATH_INFO: `/v3/services` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:36:53.367608 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb159f6d-2af8-425d-9d20-d2c09eaa37e7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:36:53.369016 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb159f6d-2af8-425d-9d20-d2c09eaa37e7 None admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:36:53.375345 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 438/903] 10.222.0.25 () {56 vars in 1087 bytes} [Tue Sep 13 19:36:53 2022] GET /identity/v3/services => generated 1497 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 19:36:53.375954 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb159f6d-2af8-425d-9d20-d2c09eaa37e7 None admin] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:36:53.404509 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a30603-70ff-4c78-a59f-779f0bf5661c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:36:53.405918 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a30603-70ff-4c78-a59f-779f0bf5661c None admin] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:36:53.406419 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a30603-70ff-4c78-a59f-779f0bf5661c None admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:36:53.407474 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a30603-70ff-4c78-a59f-779f0bf5661c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:36:53.424834 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a30603-70ff-4c78-a59f-779f0bf5661c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:36:53.426768 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a30603-70ff-4c78-a59f-779f0bf5661c None admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:36:53.447287 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application [None req-32a30603-70ff-4c78-a59f-779f0bf5661c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 19:36:53.447287 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:36:53.447287 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:36:53.447287 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:36:53.447287 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:36:53.447287 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:36:53.447287 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:36:53.447287 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:36:53.447287 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:36:53.447287 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:36:53.447287 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:36:53.447287 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:36:53.447287 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 19:36:53.447287 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 19:36:53.447287 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 19:36:53.447287 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 19:36:53.448391 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:36:53.448391 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:36:53.448391 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:36:53.448391 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:36:53.448391 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:36:53.448391 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:36:53.448391 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:36:53.448391 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application with Lock( Sep 13 19:36:53.448391 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:36:53.448391 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:36:53.448391 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:36:53.448391 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:36:53.448391 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:36:53.448391 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:36:53.448391 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:36:53.448391 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:36:53.448391 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 19:36:53.449311 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 19:36:53.449311 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 19:36:53.449311 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application Sep 13 19:36:53.453607 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 466/904] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Sep 13 19:36:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:36:53.454691 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a30603-70ff-4c78-a59f-779f0bf5661c None admin] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:36:53.511554 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG dbcounter [-] [87935] Writing DB stats keystone:SELECT=100 {{(pid=87935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:36:53.522308 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb159f6d-2af8-425d-9d20-d2c09eaa37e7 None admin] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:36:53.542931 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG dbcounter [-] [87934] Writing DB stats keystone:SELECT=100 {{(pid=87934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:36:53.579564 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9bcb19d-5f05-4b63-a281-712b740570d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:36:53.580557 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bcb19d-5f05-4b63-a281-712b740570d6 None admin] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:36:53.581074 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bcb19d-5f05-4b63-a281-712b740570d6 None admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:36:53.582339 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bcb19d-5f05-4b63-a281-712b740570d6 None admin] PATH_INFO: `/v3/services` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:36:53.583899 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9bcb19d-5f05-4b63-a281-712b740570d6 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=87935) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:36:53.584416 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9bcb19d-5f05-4b63-a281-712b740570d6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:36:53.586593 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9bcb19d-5f05-4b63-a281-712b740570d6 None admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:36:53.596460 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 439/905] 10.222.0.25 () {56 vars in 1126 bytes} [Tue Sep 13 19:36:53 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:36:53.604675 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9bcb19d-5f05-4b63-a281-712b740570d6 None admin] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:36:53.609173 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a30603-70ff-4c78-a59f-779f0bf5661c None admin] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:36:53.655349 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e18627-a956-4a2f-b543-ec011f645077 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:36:53.655961 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e18627-a956-4a2f-b543-ec011f645077 None admin] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:36:53.656257 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e18627-a956-4a2f-b543-ec011f645077 None admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:36:53.656532 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e18627-a956-4a2f-b543-ec011f645077 None admin] PATH_INFO: `/v3/domains` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:36:53.657174 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e18627-a956-4a2f-b543-ec011f645077 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87934) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:36:53.657474 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e18627-a956-4a2f-b543-ec011f645077 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:36:53.658887 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e18627-a956-4a2f-b543-ec011f645077 None admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:36:53.676867 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 467/906] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Sep 13 19:36:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:36:53.682459 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e18627-a956-4a2f-b543-ec011f645077 None admin] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:36:53.732476 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9bcb19d-5f05-4b63-a281-712b740570d6 None admin] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:36:53.772307 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6f80c8-004b-45ec-8fb5-9f734fc61bea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:36:53.773210 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6f80c8-004b-45ec-8fb5-9f734fc61bea None admin] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:36:53.773488 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6f80c8-004b-45ec-8fb5-9f734fc61bea None admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:36:53.773759 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6f80c8-004b-45ec-8fb5-9f734fc61bea None admin] PATH_INFO: `/v3/services` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:36:53.774558 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca6f80c8-004b-45ec-8fb5-9f734fc61bea None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=87935) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:36:53.774857 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca6f80c8-004b-45ec-8fb5-9f734fc61bea None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:36:53.776997 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca6f80c8-004b-45ec-8fb5-9f734fc61bea None admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:36:53.783760 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 440/907] 10.222.0.25 () {56 vars in 1126 bytes} [Tue Sep 13 19:36:53 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 19:36:53.790772 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6f80c8-004b-45ec-8fb5-9f734fc61bea None admin] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:36:53.799424 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e18627-a956-4a2f-b543-ec011f645077 None admin] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:36:53.823963 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG dbcounter [-] [87935] Writing DB stats keystone:SELECT=100 {{(pid=87935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:36:53.832714 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG dbcounter [-] [87934] Writing DB stats keystone:SELECT=100 {{(pid=87934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:36:53.849512 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e45c0f9-df91-4f72-8596-1842916254d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:36:53.850892 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e45c0f9-df91-4f72-8596-1842916254d6 None admin] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:36:53.851526 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e45c0f9-df91-4f72-8596-1842916254d6 None admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:36:53.852079 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e45c0f9-df91-4f72-8596-1842916254d6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:36:53.861762 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e45c0f9-df91-4f72-8596-1842916254d6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:36:53.864787 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e45c0f9-df91-4f72-8596-1842916254d6 None admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:36:53.882928 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application [None req-4e45c0f9-df91-4f72-8596-1842916254d6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 19:36:53.882928 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:36:53.882928 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:36:53.882928 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:36:53.882928 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:36:53.882928 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:36:53.882928 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:36:53.882928 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:36:53.882928 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:36:53.882928 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:36:53.882928 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:36:53.882928 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:36:53.882928 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 13 19:36:53.882928 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 13 19:36:53.882928 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 13 19:36:53.883886 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 13 19:36:53.883886 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:36:53.883886 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:36:53.883886 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:36:53.883886 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:36:53.883886 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:36:53.883886 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:36:53.883886 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:36:53.883886 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application with Lock( Sep 13 19:36:53.883886 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:36:53.883886 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:36:53.883886 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:36:53.883886 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:36:53.883886 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:36:53.883886 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:36:53.883886 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:36:53.883886 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:36:53.884827 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 13 19:36:53.884827 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 13 19:36:53.884827 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 13 19:36:53.884827 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 13 19:36:53.884827 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 13 19:36:53.884827 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 13 19:36:53.884827 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 19:36:53.884827 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application Sep 13 19:36:53.887726 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 468/908] 10.222.0.25 () {56 vars in 1111 bytes} [Tue Sep 13 19:36:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 13 19:36:53.894767 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e45c0f9-df91-4f72-8596-1842916254d6 None admin] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:36:53.921535 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6f80c8-004b-45ec-8fb5-9f734fc61bea None admin] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:36:53.962193 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a28472b-621e-4d0f-a6c4-a31c33715793 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:36:53.963202 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a28472b-621e-4d0f-a6c4-a31c33715793 None admin] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:36:53.963707 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a28472b-621e-4d0f-a6c4-a31c33715793 None admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:36:53.963977 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a28472b-621e-4d0f-a6c4-a31c33715793 None admin] PATH_INFO: `/v3/endpoints` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:36:53.965071 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a28472b-621e-4d0f-a6c4-a31c33715793 None admin] RBAC: Adding query filter params (interface=public, service_id=3959da78aee9427cad7e0775e861c18d, region_id=RegionOne) {{(pid=87935) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:36:53.965453 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a28472b-621e-4d0f-a6c4-a31c33715793 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:36:53.966913 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a28472b-621e-4d0f-a6c4-a31c33715793 None admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:36:53.977672 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 441/909] 10.222.0.25 () {56 vars in 1251 bytes} [Tue Sep 13 19:36:53 2022] GET /identity/v3/endpoints?service_id=3959da78aee9427cad7e0775e861c18d&interface=public®ion_id=RegionOne => generated 194 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 19:36:53.979837 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a28472b-621e-4d0f-a6c4-a31c33715793 None admin] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:36:54.023125 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e45c0f9-df91-4f72-8596-1842916254d6 None admin] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:36:54.060905 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9f1cc0-ce1a-4dd9-9f99-cf966a309ec8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:36:54.061573 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9f1cc0-ce1a-4dd9-9f99-cf966a309ec8 None admin] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:36:54.061851 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9f1cc0-ce1a-4dd9-9f99-cf966a309ec8 None admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:36:54.062120 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9f1cc0-ce1a-4dd9-9f99-cf966a309ec8 None admin] PATH_INFO: `/v3/projects` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:36:54.062865 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e9f1cc0-ce1a-4dd9-9f99-cf966a309ec8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87934) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:36:54.063173 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e9f1cc0-ce1a-4dd9-9f99-cf966a309ec8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:36:54.064721 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e9f1cc0-ce1a-4dd9-9f99-cf966a309ec8 None admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:36:54.078786 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 469/910] 10.222.0.25 () {56 vars in 1148 bytes} [Tue Sep 13 19:36:53 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 19:36:54.085661 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9f1cc0-ce1a-4dd9-9f99-cf966a309ec8 None admin] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:36:54.087543 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG dbcounter [-] [87935] Writing DB stats keystone:SELECT=100 {{(pid=87935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:36:54.108375 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a28472b-621e-4d0f-a6c4-a31c33715793 None admin] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:36:54.139713 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG dbcounter [-] [87934] Writing DB stats keystone:SELECT=100 {{(pid=87934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:36:54.147242 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380b5ddc-c487-488d-ae5a-d7600212441b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:36:54.147901 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380b5ddc-c487-488d-ae5a-d7600212441b None admin] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:36:54.148183 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380b5ddc-c487-488d-ae5a-d7600212441b None admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:36:54.148480 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380b5ddc-c487-488d-ae5a-d7600212441b None admin] PATH_INFO: `/v3/services` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:36:54.149433 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-380b5ddc-c487-488d-ae5a-d7600212441b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:36:54.150763 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-380b5ddc-c487-488d-ae5a-d7600212441b None admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:36:54.158268 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 442/911] 10.222.0.25 () {56 vars in 1087 bytes} [Tue Sep 13 19:36:53 2022] GET /identity/v3/services => generated 1497 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 13 19:36:54.207943 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9f1cc0-ce1a-4dd9-9f99-cf966a309ec8 None admin] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:36:54.254432 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb05baa8-b853-40a2-a61d-2f5a2a853e2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:36:54.255557 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb05baa8-b853-40a2-a61d-2f5a2a853e2d None admin] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:36:54.256042 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb05baa8-b853-40a2-a61d-2f5a2a853e2d None admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:36:54.256544 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb05baa8-b853-40a2-a61d-2f5a2a853e2d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:36:54.257504 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb05baa8-b853-40a2-a61d-2f5a2a853e2d None admin] RBAC: Adding query filter params (role.id=14ffeae2f0594a2c9da6bfd35829457e, scope.project.id=9a10a4268f3c4cb29f4e00c292e2df62, user.id=d44977a3225e43f19cdc4a84f0e170cd) {{(pid=87934) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:36:54.258019 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb05baa8-b853-40a2-a61d-2f5a2a853e2d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:36:54.259714 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb05baa8-b853-40a2-a61d-2f5a2a853e2d None admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:36:54.266772 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 470/912] 10.222.0.25 () {56 vars in 1374 bytes} [Tue Sep 13 19:36:54 2022] GET /identity/v3/role_assignments?user.id=d44977a3225e43f19cdc4a84f0e170cd&scope.project.id=9a10a4268f3c4cb29f4e00c292e2df62&role.id=14ffeae2f0594a2c9da6bfd35829457e => generated 259 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:36:54.599257 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd36aae1-e594-4b0f-9b6c-12768c91b7d9 None None] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:36:54.599802 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd36aae1-e594-4b0f-9b6c-12768c91b7d9 None None] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:36:54.599802 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd36aae1-e594-4b0f-9b6c-12768c91b7d9 None None] PATH_INFO: `/` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:36:54.605204 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 443/913] 10.222.0.25 () {54 vars in 927 bytes} [Tue Sep 13 19:36:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:36:54.608680 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d877d88d-8383-465a-a359-25bfda5c1638 None None] REQUEST_METHOD: `POST` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:36:54.608680 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d877d88d-8383-465a-a359-25bfda5c1638 None None] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:36:54.608680 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d877d88d-8383-465a-a359-25bfda5c1638 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:36:54.628855 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.auth.core [None req-d877d88d-8383-465a-a359-25bfda5c1638 None None] MFA Rules not processed for user `7b0aed92d02344acb92a0e4aa67c3068`. Rule list: `[]` (Enabled: `True`). {{(pid=87934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:36:54.630217 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.fernet_utils [None req-d877d88d-8383-465a-a359-25bfda5c1638 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:36:54.708009 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 471/914] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Sep 13 19:36:54 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 13 19:36:55.017601 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd36aae1-e594-4b0f-9b6c-12768c91b7d9 None None] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:36:55.146454 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd36aae1-e594-4b0f-9b6c-12768c91b7d9 None None] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:36:55.203114 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d313cb-b07b-4e26-8a58-90ea245a6cc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:36:55.203782 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d313cb-b07b-4e26-8a58-90ea245a6cc4 None admin] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:36:55.204068 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d313cb-b07b-4e26-8a58-90ea245a6cc4 None admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:36:55.204379 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d313cb-b07b-4e26-8a58-90ea245a6cc4 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:36:55.205317 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d313cb-b07b-4e26-8a58-90ea245a6cc4 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:36:55.207481 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d313cb-b07b-4e26-8a58-90ea245a6cc4 None admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:36:55.220375 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application [None req-27d313cb-b07b-4e26-8a58-90ea245a6cc4 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 13 19:36:55.220375 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:36:55.220375 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 13 19:36:55.220375 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 13 19:36:55.220375 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 13 19:36:55.220375 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 13 19:36:55.220375 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 13 19:36:55.220375 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 19:36:55.220375 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 13 19:36:55.220375 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application Sep 13 19:36:55.220375 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 13 19:36:55.220375 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application Sep 13 19:36:55.220375 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:36:55.220375 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:36:55.220375 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:36:55.220375 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:36:55.220375 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:36:55.223020 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:36:55.223020 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:36:55.223020 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:36:55.223020 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:36:55.223020 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:36:55.223020 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:36:55.223020 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 13 19:36:55.223020 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 13 19:36:55.223020 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 13 19:36:55.223020 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 13 19:36:55.223020 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:36:55.223020 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:36:55.223020 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:36:55.223020 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:36:55.223020 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:36:55.223020 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:36:55.225075 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:36:55.225075 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application with Lock( Sep 13 19:36:55.225075 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:36:55.225075 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:36:55.225075 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:36:55.225075 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:36:55.225075 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:36:55.225075 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:36:55.225075 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:36:55.225075 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:36:55.225075 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 13 19:36:55.225075 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 19:36:55.225075 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 13 19:36:55.225075 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application Sep 13 19:36:55.232266 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 444/915] 10.222.0.25 () {56 vars in 1126 bytes} [Tue Sep 13 19:36:55 2022] GET /identity/v3/services/object-store => generated 93 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:36:55.232590 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d877d88d-8383-465a-a359-25bfda5c1638 None None] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:36:55.308651 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG dbcounter [-] [87934] Writing DB stats keystone:SELECT=100 {{(pid=87934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:36:55.360705 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d877d88d-8383-465a-a359-25bfda5c1638 None None] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:36:55.402159 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524c4f07-2c15-48ad-96e9-31c0161c64f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:36:55.402769 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524c4f07-2c15-48ad-96e9-31c0161c64f6 None admin] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:36:55.403042 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524c4f07-2c15-48ad-96e9-31c0161c64f6 None admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:36:55.403305 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524c4f07-2c15-48ad-96e9-31c0161c64f6 None admin] PATH_INFO: `/v3/services` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:36:55.403937 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-524c4f07-2c15-48ad-96e9-31c0161c64f6 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=87934) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:36:55.404250 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-524c4f07-2c15-48ad-96e9-31c0161c64f6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:36:55.405680 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-524c4f07-2c15-48ad-96e9-31c0161c64f6 None admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:36:55.411201 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 472/916] 10.222.0.25 () {56 vars in 1122 bytes} [Tue Sep 13 19:36:55 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:36:55.418486 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d313cb-b07b-4e26-8a58-90ea245a6cc4 None admin] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:36:55.442338 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG dbcounter [-] [87935] Writing DB stats keystone:SELECT=100 {{(pid=87935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:36:55.558725 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d313cb-b07b-4e26-8a58-90ea245a6cc4 None admin] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:36:55.609829 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f874a60b-0b60-4b99-ad44-b6c06d106d38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:36:55.610756 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f874a60b-0b60-4b99-ad44-b6c06d106d38 None admin] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:36:55.611039 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f874a60b-0b60-4b99-ad44-b6c06d106d38 None admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:36:55.611310 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f874a60b-0b60-4b99-ad44-b6c06d106d38 None admin] PATH_INFO: `/v3/services` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:36:55.612065 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f874a60b-0b60-4b99-ad44-b6c06d106d38 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=87935) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:36:55.612664 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f874a60b-0b60-4b99-ad44-b6c06d106d38 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:36:55.614846 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f874a60b-0b60-4b99-ad44-b6c06d106d38 None admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:36:55.630749 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 445/917] 10.222.0.25 () {56 vars in 1122 bytes} [Tue Sep 13 19:36:55 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:36:55.632187 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524c4f07-2c15-48ad-96e9-31c0161c64f6 None admin] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:36:55.758578 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6065f3d5-7010-42b7-ad53-d8b1c42f9bc8 None None] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:36:55.758903 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524c4f07-2c15-48ad-96e9-31c0161c64f6 None admin] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:36:55.759094 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6065f3d5-7010-42b7-ad53-d8b1c42f9bc8 None None] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:36:55.759094 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6065f3d5-7010-42b7-ad53-d8b1c42f9bc8 None None] PATH_INFO: `/` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:36:55.759401 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG dbcounter [-] [87934] Writing DB stats keystone:SELECT=100 {{(pid=87934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:36:55.759785 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 446/918] 10.222.0.25 () {54 vars in 927 bytes} [Tue Sep 13 19:36:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:36:55.765522 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3b38e6-879d-445d-a132-55671fe5c08f None None] REQUEST_METHOD: `POST` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:36:55.766117 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3b38e6-879d-445d-a132-55671fe5c08f None None] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:36:55.766601 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3b38e6-879d-445d-a132-55671fe5c08f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:36:55.791932 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.auth.core [None req-6e3b38e6-879d-445d-a132-55671fe5c08f None None] MFA Rules not processed for user `7b0aed92d02344acb92a0e4aa67c3068`. Rule list: `[]` (Enabled: `True`). {{(pid=87935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:36:55.793455 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.fernet_utils [None req-6e3b38e6-879d-445d-a132-55671fe5c08f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:36:55.801322 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57310f0-7bb6-411c-b75d-625004cf7d35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:36:55.802970 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57310f0-7bb6-411c-b75d-625004cf7d35 None admin] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:36:55.803460 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57310f0-7bb6-411c-b75d-625004cf7d35 None admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:36:55.804031 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57310f0-7bb6-411c-b75d-625004cf7d35 None admin] PATH_INFO: `/v3/endpoints` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:36:55.805426 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d57310f0-7bb6-411c-b75d-625004cf7d35 None admin] RBAC: Adding query filter params (interface=public, service_id=ad51c697988145e29711bac0e7d2508c, region_id=RegionOne) {{(pid=87934) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:36:55.806354 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d57310f0-7bb6-411c-b75d-625004cf7d35 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:36:55.808691 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d57310f0-7bb6-411c-b75d-625004cf7d35 None admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:36:55.821852 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 473/919] 10.222.0.25 () {56 vars in 1251 bytes} [Tue Sep 13 19:36:55 2022] GET /identity/v3/endpoints?service_id=ad51c697988145e29711bac0e7d2508c&interface=public®ion_id=RegionOne => generated 194 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:36:55.823803 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57310f0-7bb6-411c-b75d-625004cf7d35 None admin] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:36:55.880193 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 447/920] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Sep 13 19:36:55 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 13 19:36:55.946317 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57310f0-7bb6-411c-b75d-625004cf7d35 None admin] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:36:55.983809 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95d9038-9886-43b0-8e7b-fd380e0eef4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:36:55.984701 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95d9038-9886-43b0-8e7b-fd380e0eef4d None admin] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:36:55.985144 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95d9038-9886-43b0-8e7b-fd380e0eef4d None admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:36:55.985560 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95d9038-9886-43b0-8e7b-fd380e0eef4d None admin] PATH_INFO: `/v3/services` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:36:55.986309 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c95d9038-9886-43b0-8e7b-fd380e0eef4d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:36:55.988404 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c95d9038-9886-43b0-8e7b-fd380e0eef4d None admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:36:56.000377 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 474/921] 10.222.0.25 () {56 vars in 1087 bytes} [Tue Sep 13 19:36:55 2022] GET /identity/v3/services => generated 1497 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 13 19:36:56.228430 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3b38e6-879d-445d-a132-55671fe5c08f None None] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:36:56.241032 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG dbcounter [-] [87935] Writing DB stats keystone:SELECT=100 {{(pid=87935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:36:56.370500 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3b38e6-879d-445d-a132-55671fe5c08f None None] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:36:56.421320 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75003edf-0811-486d-a819-69ef48abb001 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:36:56.422204 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75003edf-0811-486d-a819-69ef48abb001 None admin] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:36:56.422629 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75003edf-0811-486d-a819-69ef48abb001 None admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:36:56.423047 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75003edf-0811-486d-a819-69ef48abb001 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:36:56.423775 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75003edf-0811-486d-a819-69ef48abb001 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:36:56.425406 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75003edf-0811-486d-a819-69ef48abb001 None admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:36:56.435329 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application [None req-75003edf-0811-486d-a819-69ef48abb001 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 13 19:36:56.435329 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:36:56.435329 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 13 19:36:56.435329 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 13 19:36:56.435329 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 13 19:36:56.435329 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 13 19:36:56.435329 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 13 19:36:56.435329 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 19:36:56.435329 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 13 19:36:56.435329 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application Sep 13 19:36:56.435329 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 13 19:36:56.435329 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application Sep 13 19:36:56.435329 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:36:56.435329 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:36:56.435329 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:36:56.435329 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:36:56.435329 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:36:56.436663 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:36:56.436663 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:36:56.436663 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:36:56.436663 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:36:56.436663 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:36:56.436663 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:36:56.436663 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 13 19:36:56.436663 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 13 19:36:56.436663 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 13 19:36:56.436663 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 13 19:36:56.436663 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:36:56.436663 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:36:56.436663 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:36:56.436663 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:36:56.436663 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:36:56.436663 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:36:56.437714 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:36:56.437714 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application with Lock( Sep 13 19:36:56.437714 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:36:56.437714 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:36:56.437714 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:36:56.437714 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:36:56.437714 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:36:56.437714 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:36:56.437714 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:36:56.437714 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:36:56.437714 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 13 19:36:56.437714 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 19:36:56.437714 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 13 19:36:56.437714 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application Sep 13 19:36:56.440133 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 448/922] 10.222.0.25 () {56 vars in 1114 bytes} [Tue Sep 13 19:36:56 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:36:56.448123 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95d9038-9886-43b0-8e7b-fd380e0eef4d None admin] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:36:56.487116 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG dbcounter [-] [87934] Writing DB stats keystone:SELECT=100 {{(pid=87934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:36:56.564351 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95d9038-9886-43b0-8e7b-fd380e0eef4d None admin] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:36:56.581063 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07749189-551c-4e7e-91ea-4a1f336423a2 None None] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:36:56.582757 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07749189-551c-4e7e-91ea-4a1f336423a2 None None] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:36:56.583325 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07749189-551c-4e7e-91ea-4a1f336423a2 None None] PATH_INFO: `/` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:36:56.585903 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 449/923] 10.222.0.25 () {54 vars in 927 bytes} [Tue Sep 13 19:36:56 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:36:56.591678 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7396f2-3543-417a-a0ab-1da8d3ea1a44 None None] REQUEST_METHOD: `POST` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:36:56.592082 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7396f2-3543-417a-a0ab-1da8d3ea1a44 None None] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:36:56.592381 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7396f2-3543-417a-a0ab-1da8d3ea1a44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:36:56.610317 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a6dd1e-4f9e-4d7d-89cd-f5c3f6ce3c7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:36:56.611001 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a6dd1e-4f9e-4d7d-89cd-f5c3f6ce3c7c None admin] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:36:56.611288 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a6dd1e-4f9e-4d7d-89cd-f5c3f6ce3c7c None admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:36:56.611563 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a6dd1e-4f9e-4d7d-89cd-f5c3f6ce3c7c None admin] PATH_INFO: `/v3/services` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:36:56.611673 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.auth.core [None req-2f7396f2-3543-417a-a0ab-1da8d3ea1a44 None None] MFA Rules not processed for user `7b0aed92d02344acb92a0e4aa67c3068`. Rule list: `[]` (Enabled: `True`). {{(pid=87935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:36:56.612226 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a6dd1e-4f9e-4d7d-89cd-f5c3f6ce3c7c None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=87934) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:36:56.613611 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.fernet_utils [None req-2f7396f2-3543-417a-a0ab-1da8d3ea1a44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:36:56.613787 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a6dd1e-4f9e-4d7d-89cd-f5c3f6ce3c7c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:36:56.615310 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a6dd1e-4f9e-4d7d-89cd-f5c3f6ce3c7c None admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:36:56.623586 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 475/924] 10.222.0.25 () {56 vars in 1114 bytes} [Tue Sep 13 19:36:56 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:36:56.628381 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a6dd1e-4f9e-4d7d-89cd-f5c3f6ce3c7c None admin] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:36:56.695895 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 450/925] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Sep 13 19:36:56 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 13 19:36:56.735320 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG dbcounter [-] [87934] Writing DB stats keystone:SELECT=100 {{(pid=87934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:36:56.737054 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5611f9-eba1-4985-89e5-eae438a10b8a None None] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:36:56.737445 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5611f9-eba1-4985-89e5-eae438a10b8a None None] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:36:56.737663 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5611f9-eba1-4985-89e5-eae438a10b8a None None] PATH_INFO: `/` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:36:56.743529 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a6dd1e-4f9e-4d7d-89cd-f5c3f6ce3c7c None admin] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:36:56.744635 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 451/926] 10.222.0.25 () {54 vars in 927 bytes} [Tue Sep 13 19:36:56 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 13 19:36:56.747069 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20c3ba6-6b3f-48b8-a7a4-2006520d651d None None] REQUEST_METHOD: `POST` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:36:56.747341 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20c3ba6-6b3f-48b8-a7a4-2006520d651d None None] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:36:56.747605 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20c3ba6-6b3f-48b8-a7a4-2006520d651d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:36:56.756561 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG dbcounter [-] [87935] Writing DB stats keystone:SELECT=100 {{(pid=87935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:36:56.768453 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.auth.core [None req-b20c3ba6-6b3f-48b8-a7a4-2006520d651d None None] MFA Rules not processed for user `7b0aed92d02344acb92a0e4aa67c3068`. Rule list: `[]` (Enabled: `True`). {{(pid=87935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:36:56.770463 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.fernet_utils [None req-b20c3ba6-6b3f-48b8-a7a4-2006520d651d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:36:56.781016 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715b4cfd-c69f-4cb1-b9a7-afa3d94ce2f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:36:56.781686 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715b4cfd-c69f-4cb1-b9a7-afa3d94ce2f3 None admin] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:36:56.781963 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715b4cfd-c69f-4cb1-b9a7-afa3d94ce2f3 None admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:36:56.782233 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715b4cfd-c69f-4cb1-b9a7-afa3d94ce2f3 None admin] PATH_INFO: `/v3/services` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:36:56.782866 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-715b4cfd-c69f-4cb1-b9a7-afa3d94ce2f3 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=87934) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:36:56.783166 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-715b4cfd-c69f-4cb1-b9a7-afa3d94ce2f3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:36:56.784664 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-715b4cfd-c69f-4cb1-b9a7-afa3d94ce2f3 None admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:36:56.790505 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 476/927] 10.222.0.25 () {56 vars in 1114 bytes} [Tue Sep 13 19:36:56 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:36:56.802754 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715b4cfd-c69f-4cb1-b9a7-afa3d94ce2f3 None admin] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:36:56.856401 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 452/928] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Sep 13 19:36:56 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 13 19:36:56.917097 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715b4cfd-c69f-4cb1-b9a7-afa3d94ce2f3 None admin] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:36:56.954757 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1249231f-2c85-446a-8c4e-ac4cc0f7e86e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:36:56.955375 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1249231f-2c85-446a-8c4e-ac4cc0f7e86e None admin] REQUEST_METHOD: `POST` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:36:56.955649 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1249231f-2c85-446a-8c4e-ac4cc0f7e86e None admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:36:56.955916 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1249231f-2c85-446a-8c4e-ac4cc0f7e86e None admin] PATH_INFO: `/v3/endpoints` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:36:56.957289 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1249231f-2c85-446a-8c4e-ac4cc0f7e86e None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:36:56.959036 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1249231f-2c85-446a-8c4e-ac4cc0f7e86e None admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:36:56.977598 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20c3ba6-6b3f-48b8-a7a4-2006520d651d None None] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:36:56.984280 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 477/929] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Sep 13 19:36:56 2022] POST /identity/v3/endpoints => generated 346 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 19:36:57.127212 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20c3ba6-6b3f-48b8-a7a4-2006520d651d None None] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:36:57.138141 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1249231f-2c85-446a-8c4e-ac4cc0f7e86e None admin] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:36:57.167414 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG dbcounter [-] [87934] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:36:57.173686 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG dbcounter [-] [87935] Writing DB stats keystone:SELECT=100 {{(pid=87935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:36:57.190257 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a9f0dc-6895-4983-87eb-bf25b8da777a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:36:57.191503 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a9f0dc-6895-4983-87eb-bf25b8da777a None admin] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:36:57.191776 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a9f0dc-6895-4983-87eb-bf25b8da777a None admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:36:57.192038 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a9f0dc-6895-4983-87eb-bf25b8da777a None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:36:57.192667 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a9f0dc-6895-4983-87eb-bf25b8da777a None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:36:57.194178 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a9f0dc-6895-4983-87eb-bf25b8da777a None admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:36:57.204532 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application [None req-67a9f0dc-6895-4983-87eb-bf25b8da777a None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 13 19:36:57.204532 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:36:57.204532 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 13 19:36:57.204532 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 13 19:36:57.204532 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 13 19:36:57.204532 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 13 19:36:57.204532 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 13 19:36:57.204532 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 19:36:57.204532 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 13 19:36:57.204532 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application Sep 13 19:36:57.204532 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 13 19:36:57.204532 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application Sep 13 19:36:57.204532 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:36:57.204532 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:36:57.204532 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:36:57.204532 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:36:57.205729 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:36:57.205729 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:36:57.205729 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:36:57.205729 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:36:57.205729 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:36:57.205729 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:36:57.205729 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:36:57.205729 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 13 19:36:57.205729 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 13 19:36:57.205729 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 13 19:36:57.205729 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 13 19:36:57.205729 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:36:57.205729 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:36:57.205729 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:36:57.205729 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:36:57.205729 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:36:57.205729 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:36:57.207903 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:36:57.207903 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application with Lock( Sep 13 19:36:57.207903 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:36:57.207903 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:36:57.207903 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:36:57.207903 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:36:57.207903 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:36:57.207903 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:36:57.207903 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:36:57.207903 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:36:57.207903 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 13 19:36:57.207903 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 19:36:57.207903 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 13 19:36:57.207903 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application Sep 13 19:36:57.207903 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 453/930] 10.222.0.25 () {56 vars in 1132 bytes} [Tue Sep 13 19:36:56 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 13 19:36:57.215543 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a9f0dc-6895-4983-87eb-bf25b8da777a None admin] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:36:57.294548 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1249231f-2c85-446a-8c4e-ac4cc0f7e86e None admin] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:36:57.337731 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc893ba6-fad8-4536-9124-a63f92a5336d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:36:57.338622 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc893ba6-fad8-4536-9124-a63f92a5336d None admin] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:36:57.339081 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc893ba6-fad8-4536-9124-a63f92a5336d None admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:36:57.339523 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc893ba6-fad8-4536-9124-a63f92a5336d None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:36:57.348437 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a9f0dc-6895-4983-87eb-bf25b8da777a None admin] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:36:57.351241 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc893ba6-fad8-4536-9124-a63f92a5336d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 19:36:57.356971 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application [None req-dc893ba6-fad8-4536-9124-a63f92a5336d None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 13 19:36:57.356971 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:36:57.356971 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:36:57.356971 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:36:57.356971 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:36:57.356971 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:36:57.356971 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:36:57.356971 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:36:57.356971 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:36:57.356971 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:36:57.356971 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:36:57.356971 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:36:57.356971 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 19:36:57.356971 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 19:36:57.356971 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 19:36:57.356971 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 19:36:57.357941 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 19:36:57.357941 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 19:36:57.357941 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 19:36:57.357941 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 19:36:57.357941 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:36:57.357941 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:36:57.357941 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:36:57.357941 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:36:57.357941 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:36:57.357941 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:36:57.357941 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:36:57.357941 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application with Lock( Sep 13 19:36:57.357941 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:36:57.357941 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:36:57.357941 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:36:57.357941 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:36:57.358792 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:36:57.358792 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:36:57.358792 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:36:57.358792 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:36:57.358792 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 19:36:57.358792 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 19:36:57.358792 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 19:36:57.358792 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 19:36:57.358792 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 19:36:57.358792 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 19:36:57.358792 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 13 19:36:57.358792 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application Sep 13 19:36:57.361387 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 478/931] 10.222.0.25 () {56 vars in 1120 bytes} [Tue Sep 13 19:36:57 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 13 19:36:57.368501 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc893ba6-fad8-4536-9124-a63f92a5336d None admin] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:36:57.396554 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbcd58d7-4f5a-487a-86c3-7854139a6085 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:36:57.397407 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbcd58d7-4f5a-487a-86c3-7854139a6085 None admin] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:36:57.397739 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbcd58d7-4f5a-487a-86c3-7854139a6085 None admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:36:57.398026 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbcd58d7-4f5a-487a-86c3-7854139a6085 None admin] PATH_INFO: `/v3/services` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:36:57.398834 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbcd58d7-4f5a-487a-86c3-7854139a6085 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=87935) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:36:57.399220 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbcd58d7-4f5a-487a-86c3-7854139a6085 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:36:57.402643 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbcd58d7-4f5a-487a-86c3-7854139a6085 None admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:36:57.416892 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 454/932] 10.222.0.25 () {56 vars in 1126 bytes} [Tue Sep 13 19:36:57 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:36:57.418092 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbcd58d7-4f5a-487a-86c3-7854139a6085 None admin] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:36:57.476200 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG dbcounter [-] [87934] Writing DB stats keystone:SELECT=100 {{(pid=87934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:36:57.496192 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG dbcounter [-] [87935] Writing DB stats keystone:SELECT=100 {{(pid=87935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:36:57.506523 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc893ba6-fad8-4536-9124-a63f92a5336d None admin] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:36:57.543755 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a574c5bf-cff1-4348-96a1-c4dc23ca1c82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:36:57.544788 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a574c5bf-cff1-4348-96a1-c4dc23ca1c82 None admin] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:36:57.545286 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a574c5bf-cff1-4348-96a1-c4dc23ca1c82 None admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:36:57.545766 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a574c5bf-cff1-4348-96a1-c4dc23ca1c82 None admin] PATH_INFO: `/v3/roles` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:36:57.546625 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a574c5bf-cff1-4348-96a1-c4dc23ca1c82 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=87934) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:36:57.547131 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a574c5bf-cff1-4348-96a1-c4dc23ca1c82 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:36:57.548785 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a574c5bf-cff1-4348-96a1-c4dc23ca1c82 None admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:36:57.551059 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbcd58d7-4f5a-487a-86c3-7854139a6085 None admin] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:36:57.564034 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 479/933] 10.222.0.25 () {56 vars in 1115 bytes} [Tue Sep 13 19:36:57 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 19:36:57.565354 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a574c5bf-cff1-4348-96a1-c4dc23ca1c82 None admin] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:36:57.595813 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cec23cc-fea7-4051-9797-e87830fe2923 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:36:57.596460 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cec23cc-fea7-4051-9797-e87830fe2923 None admin] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:36:57.596719 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cec23cc-fea7-4051-9797-e87830fe2923 None admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:36:57.596985 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cec23cc-fea7-4051-9797-e87830fe2923 None admin] PATH_INFO: `/v3/services` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:36:57.597725 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cec23cc-fea7-4051-9797-e87830fe2923 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=87935) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:36:57.598089 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cec23cc-fea7-4051-9797-e87830fe2923 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:36:57.599574 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cec23cc-fea7-4051-9797-e87830fe2923 None admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:36:57.609848 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 455/934] 10.222.0.25 () {56 vars in 1126 bytes} [Tue Sep 13 19:36:57 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:36:57.610934 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cec23cc-fea7-4051-9797-e87830fe2923 None admin] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:36:57.680866 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a574c5bf-cff1-4348-96a1-c4dc23ca1c82 None admin] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:36:57.717981 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab50346e-2a1d-4a1f-b4c5-8fc7d9d88cb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:36:57.719031 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab50346e-2a1d-4a1f-b4c5-8fc7d9d88cb2 None admin] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:36:57.719536 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab50346e-2a1d-4a1f-b4c5-8fc7d9d88cb2 None admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:36:57.719999 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab50346e-2a1d-4a1f-b4c5-8fc7d9d88cb2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:36:57.729542 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG dbcounter [-] [87934] Writing DB stats keystone:SELECT=100 {{(pid=87934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:36:57.733209 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cec23cc-fea7-4051-9797-e87830fe2923 None admin] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:36:57.736366 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab50346e-2a1d-4a1f-b4c5-8fc7d9d88cb2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:36:57.739796 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab50346e-2a1d-4a1f-b4c5-8fc7d9d88cb2 None admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:36:57.756703 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application [None req-ab50346e-2a1d-4a1f-b4c5-8fc7d9d88cb2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 19:36:57.756703 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:36:57.756703 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:36:57.756703 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:36:57.756703 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:36:57.756703 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:36:57.756703 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:36:57.756703 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:36:57.756703 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:36:57.756703 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:36:57.756703 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:36:57.756703 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:36:57.756703 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 19:36:57.756703 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 19:36:57.756703 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 19:36:57.756703 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 19:36:57.757886 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:36:57.757886 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:36:57.757886 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:36:57.757886 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:36:57.757886 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:36:57.757886 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:36:57.757886 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:36:57.757886 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application with Lock( Sep 13 19:36:57.757886 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:36:57.757886 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:36:57.757886 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:36:57.757886 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:36:57.757886 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:36:57.757886 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:36:57.757886 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:36:57.757886 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:36:57.757886 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 19:36:57.758799 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 19:36:57.758799 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 19:36:57.758799 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application Sep 13 19:36:57.763373 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 480/935] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Sep 13 19:36:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:36:57.763958 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG dbcounter [-] [87935] Writing DB stats keystone:SELECT=100 {{(pid=87935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:36:57.764481 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab50346e-2a1d-4a1f-b4c5-8fc7d9d88cb2 None admin] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:36:57.781802 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768c8292-7b69-498e-b3fd-d1e677a33f4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:36:57.782831 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768c8292-7b69-498e-b3fd-d1e677a33f4f None admin] REQUEST_METHOD: `POST` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:36:57.783320 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768c8292-7b69-498e-b3fd-d1e677a33f4f None admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:36:57.783848 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768c8292-7b69-498e-b3fd-d1e677a33f4f None admin] PATH_INFO: `/v3/endpoints` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:36:57.785510 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-768c8292-7b69-498e-b3fd-d1e677a33f4f None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:36:57.787299 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-768c8292-7b69-498e-b3fd-d1e677a33f4f None admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:36:57.814935 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 456/936] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Sep 13 19:36:57 2022] POST /identity/v3/endpoints => generated 347 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 13 19:36:57.897400 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab50346e-2a1d-4a1f-b4c5-8fc7d9d88cb2 None admin] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:36:57.947243 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32669f5b-7a8b-4af0-bc7c-cf164a5372d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:36:57.948277 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32669f5b-7a8b-4af0-bc7c-cf164a5372d1 None admin] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:36:57.948822 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32669f5b-7a8b-4af0-bc7c-cf164a5372d1 None admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:36:57.949408 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32669f5b-7a8b-4af0-bc7c-cf164a5372d1 None admin] PATH_INFO: `/v3/domains` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:36:57.950328 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32669f5b-7a8b-4af0-bc7c-cf164a5372d1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87934) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:36:57.950887 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32669f5b-7a8b-4af0-bc7c-cf164a5372d1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:36:57.952619 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32669f5b-7a8b-4af0-bc7c-cf164a5372d1 None admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:36:57.967827 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 481/937] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Sep 13 19:36:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:36:57.980257 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768c8292-7b69-498e-b3fd-d1e677a33f4f None admin] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:36:58.093994 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768c8292-7b69-498e-b3fd-d1e677a33f4f None admin] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:36:58.131657 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d77e99-253e-47ad-9963-e7639597e52a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:36:58.132630 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d77e99-253e-47ad-9963-e7639597e52a None admin] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:36:58.133047 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d77e99-253e-47ad-9963-e7639597e52a None admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:36:58.133453 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d77e99-253e-47ad-9963-e7639597e52a None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:36:58.141757 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d77e99-253e-47ad-9963-e7639597e52a None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:36:58.143397 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d77e99-253e-47ad-9963-e7639597e52a None admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:36:58.157134 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application [None req-57d77e99-253e-47ad-9963-e7639597e52a None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 13 19:36:58.157134 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:36:58.157134 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:36:58.157134 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:36:58.157134 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:36:58.157134 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:36:58.157134 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:36:58.157134 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:36:58.157134 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:36:58.157134 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:36:58.157134 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:36:58.157134 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:36:58.157134 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 13 19:36:58.157134 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 13 19:36:58.157134 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 13 19:36:58.157134 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 13 19:36:58.158290 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:36:58.158290 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:36:58.158290 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 13 19:36:58.158290 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 19:36:58.158290 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 13 19:36:58.158290 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 19:36:58.158290 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:36:58.158290 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:36:58.158290 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:36:58.158290 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:36:58.158290 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:36:58.158290 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application with Lock( Sep 13 19:36:58.158290 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:36:58.158290 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:36:58.158290 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:36:58.158290 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:36:58.158290 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:36:58.158290 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:36:58.159450 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:36:58.159450 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:36:58.159450 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 13 19:36:58.159450 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 13 19:36:58.159450 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 13 19:36:58.159450 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 13 19:36:58.159450 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 13 19:36:58.159450 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 13 19:36:58.159450 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 13 19:36:58.159450 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application Sep 13 19:36:58.162114 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 457/938] 10.222.0.25 () {56 vars in 1117 bytes} [Tue Sep 13 19:36:57 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:36:58.168101 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32669f5b-7a8b-4af0-bc7c-cf164a5372d1 None admin] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:36:58.220631 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG dbcounter [-] [87934] Writing DB stats keystone:SELECT=100 {{(pid=87934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:36:58.278874 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32669f5b-7a8b-4af0-bc7c-cf164a5372d1 None admin] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:36:58.316615 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad7fb46-f25b-4119-8cdc-d05b7567c398 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:36:58.318084 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad7fb46-f25b-4119-8cdc-d05b7567c398 None admin] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:36:58.318566 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad7fb46-f25b-4119-8cdc-d05b7567c398 None admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:36:58.318851 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad7fb46-f25b-4119-8cdc-d05b7567c398 None admin] PATH_INFO: `/v3/users` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:36:58.319595 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad7fb46-f25b-4119-8cdc-d05b7567c398 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=87934) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:36:58.319902 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad7fb46-f25b-4119-8cdc-d05b7567c398 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:36:58.321448 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad7fb46-f25b-4119-8cdc-d05b7567c398 None admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:36:58.341202 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 482/939] 10.222.0.25 () {56 vars in 1149 bytes} [Tue Sep 13 19:36:58 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:36:58.346610 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d77e99-253e-47ad-9963-e7639597e52a None admin] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:36:58.395624 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG dbcounter [-] [87935] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:36:58.479134 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d77e99-253e-47ad-9963-e7639597e52a None admin] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:36:58.493321 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bb861f-6283-4bd8-af4a-b8fd78b6ba83 None None] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:36:58.493857 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bb861f-6283-4bd8-af4a-b8fd78b6ba83 None None] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:36:58.493857 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bb861f-6283-4bd8-af4a-b8fd78b6ba83 None None] PATH_INFO: `/` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:36:58.495464 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 483/940] 10.222.0.25 () {54 vars in 927 bytes} [Tue Sep 13 19:36:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:36:58.500733 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb390f9-7ede-4f91-818b-19308b7c53b7 None None] REQUEST_METHOD: `POST` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:36:58.501017 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb390f9-7ede-4f91-818b-19308b7c53b7 None None] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:36:58.501287 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb390f9-7ede-4f91-818b-19308b7c53b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:36:58.516411 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0660792c-23a6-4564-b86e-af60382e883e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:36:58.517097 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0660792c-23a6-4564-b86e-af60382e883e None admin] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:36:58.517374 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0660792c-23a6-4564-b86e-af60382e883e None admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:36:58.517674 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0660792c-23a6-4564-b86e-af60382e883e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:36:58.521734 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.auth.core [None req-9eb390f9-7ede-4f91-818b-19308b7c53b7 None None] MFA Rules not processed for user `7b0aed92d02344acb92a0e4aa67c3068`. Rule list: `[]` (Enabled: `True`). {{(pid=87934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:36:58.523049 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.fernet_utils [None req-9eb390f9-7ede-4f91-818b-19308b7c53b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:36:58.529537 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0660792c-23a6-4564-b86e-af60382e883e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:36:58.531112 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0660792c-23a6-4564-b86e-af60382e883e None admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:36:58.547917 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application [None req-0660792c-23a6-4564-b86e-af60382e883e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 19:36:58.547917 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:36:58.547917 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:36:58.547917 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:36:58.547917 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:36:58.547917 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:36:58.547917 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:36:58.547917 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:36:58.547917 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:36:58.547917 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:36:58.547917 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:36:58.547917 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:36:58.547917 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 19:36:58.547917 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 19:36:58.547917 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 19:36:58.547917 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 19:36:58.549163 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:36:58.549163 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:36:58.549163 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:36:58.549163 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:36:58.549163 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:36:58.549163 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:36:58.549163 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:36:58.549163 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application with Lock( Sep 13 19:36:58.549163 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:36:58.549163 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:36:58.549163 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:36:58.549163 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:36:58.549163 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:36:58.549163 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:36:58.549163 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:36:58.549163 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:36:58.549163 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 19:36:58.550087 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 19:36:58.550087 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 19:36:58.550087 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application Sep 13 19:36:58.550087 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 458/941] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Sep 13 19:36:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:36:58.555111 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0660792c-23a6-4564-b86e-af60382e883e None admin] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:36:58.616236 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 484/942] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Sep 13 19:36:58 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 13 19:36:58.656235 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG dbcounter [-] [87935] Writing DB stats keystone:SELECT=100 {{(pid=87935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:36:58.670622 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0660792c-23a6-4564-b86e-af60382e883e None admin] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:36:58.713007 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64215dc1-0e39-4b34-ab4d-ee416795c557 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:36:58.714021 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64215dc1-0e39-4b34-ab4d-ee416795c557 None admin] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:36:58.714502 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64215dc1-0e39-4b34-ab4d-ee416795c557 None admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:36:58.714977 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64215dc1-0e39-4b34-ab4d-ee416795c557 None admin] PATH_INFO: `/v3/domains` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:36:58.715814 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64215dc1-0e39-4b34-ab4d-ee416795c557 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87935) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:36:58.716338 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64215dc1-0e39-4b34-ab4d-ee416795c557 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:36:58.717987 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64215dc1-0e39-4b34-ab4d-ee416795c557 None admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:36:58.731935 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 459/943] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Sep 13 19:36:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 19:36:58.740278 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb390f9-7ede-4f91-818b-19308b7c53b7 None None] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:36:58.775674 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG dbcounter [-] [87934] Writing DB stats keystone:SELECT=100 {{(pid=87934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:36:58.846664 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb390f9-7ede-4f91-818b-19308b7c53b7 None None] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:36:58.886176 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286fd8f3-2989-403a-b5ff-b900678e7a30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:36:58.886815 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286fd8f3-2989-403a-b5ff-b900678e7a30 None admin] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:36:58.887091 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286fd8f3-2989-403a-b5ff-b900678e7a30 None admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:36:58.887361 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286fd8f3-2989-403a-b5ff-b900678e7a30 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:36:58.894798 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-286fd8f3-2989-403a-b5ff-b900678e7a30 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:36:58.896253 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-286fd8f3-2989-403a-b5ff-b900678e7a30 None admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:36:58.907801 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application [None req-286fd8f3-2989-403a-b5ff-b900678e7a30 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 19:36:58.907801 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:36:58.907801 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:36:58.907801 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:36:58.907801 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:36:58.907801 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:36:58.907801 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:36:58.907801 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:36:58.907801 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:36:58.907801 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:36:58.907801 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:36:58.907801 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:36:58.907801 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 13 19:36:58.907801 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 13 19:36:58.907801 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 13 19:36:58.908727 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 13 19:36:58.908727 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:36:58.908727 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:36:58.908727 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:36:58.908727 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:36:58.908727 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:36:58.908727 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:36:58.908727 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:36:58.908727 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application with Lock( Sep 13 19:36:58.908727 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:36:58.908727 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:36:58.908727 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:36:58.908727 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:36:58.908727 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:36:58.908727 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:36:58.908727 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:36:58.908727 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:36:58.909670 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 13 19:36:58.909670 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 13 19:36:58.909670 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 13 19:36:58.909670 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 13 19:36:58.909670 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 13 19:36:58.909670 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 13 19:36:58.909670 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 19:36:58.909670 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application Sep 13 19:36:58.909670 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 485/944] 10.222.0.25 () {56 vars in 1111 bytes} [Tue Sep 13 19:36:58 2022] GET /identity/v3/projects/service => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:36:58.916310 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64215dc1-0e39-4b34-ab4d-ee416795c557 None admin] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:36:58.937782 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286fd8f3-2989-403a-b5ff-b900678e7a30 None admin] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:36:59.033405 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64215dc1-0e39-4b34-ab4d-ee416795c557 None admin] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:36:59.069317 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG dbcounter [-] [87934] Writing DB stats keystone:SELECT=100 {{(pid=87934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:36:59.076979 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be6f493-2334-44dc-be9e-7cd55b9d1bf4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:36:59.080406 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be6f493-2334-44dc-be9e-7cd55b9d1bf4 None admin] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:36:59.080688 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be6f493-2334-44dc-be9e-7cd55b9d1bf4 None admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:36:59.080962 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be6f493-2334-44dc-be9e-7cd55b9d1bf4 None admin] PATH_INFO: `/v3/projects` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:36:59.082275 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be6f493-2334-44dc-be9e-7cd55b9d1bf4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87935) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:36:59.082590 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be6f493-2334-44dc-be9e-7cd55b9d1bf4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:36:59.084097 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be6f493-2334-44dc-be9e-7cd55b9d1bf4 None admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:36:59.084659 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286fd8f3-2989-403a-b5ff-b900678e7a30 None admin] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:36:59.099545 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 460/945] 10.222.0.25 () {56 vars in 1148 bytes} [Tue Sep 13 19:36:58 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:36:59.104994 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be6f493-2334-44dc-be9e-7cd55b9d1bf4 None admin] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:36:59.118502 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG dbcounter [-] [87935] Writing DB stats keystone:SELECT=100 {{(pid=87935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:36:59.131739 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2aca29-4c54-48c5-9cc4-221d7c8e76ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:36:59.132743 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2aca29-4c54-48c5-9cc4-221d7c8e76ea None admin] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:36:59.133248 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2aca29-4c54-48c5-9cc4-221d7c8e76ea None admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:36:59.133711 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2aca29-4c54-48c5-9cc4-221d7c8e76ea None admin] PATH_INFO: `/v3/services/object-store` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:36:59.134502 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be2aca29-4c54-48c5-9cc4-221d7c8e76ea None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:36:59.136079 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be2aca29-4c54-48c5-9cc4-221d7c8e76ea None admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:36:59.145600 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application [None req-be2aca29-4c54-48c5-9cc4-221d7c8e76ea None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 13 19:36:59.145600 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:36:59.145600 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 13 19:36:59.145600 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 13 19:36:59.145600 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 13 19:36:59.145600 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 13 19:36:59.145600 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 13 19:36:59.145600 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 19:36:59.145600 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 13 19:36:59.145600 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application Sep 13 19:36:59.145600 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 13 19:36:59.145600 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application Sep 13 19:36:59.145600 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:36:59.145600 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:36:59.145600 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:36:59.145600 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:36:59.145600 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:36:59.146636 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:36:59.146636 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:36:59.146636 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:36:59.146636 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:36:59.146636 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:36:59.146636 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:36:59.146636 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 13 19:36:59.146636 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 13 19:36:59.146636 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 13 19:36:59.146636 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 13 19:36:59.146636 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:36:59.146636 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:36:59.146636 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:36:59.146636 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:36:59.146636 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:36:59.146636 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:36:59.147484 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:36:59.147484 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application with Lock( Sep 13 19:36:59.147484 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:36:59.147484 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:36:59.147484 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:36:59.147484 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:36:59.147484 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:36:59.147484 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:36:59.147484 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:36:59.147484 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:36:59.147484 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 13 19:36:59.147484 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 19:36:59.147484 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 13 19:36:59.147484 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application Sep 13 19:36:59.150229 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 486/946] 10.222.0.25 () {56 vars in 1126 bytes} [Tue Sep 13 19:36:58 2022] GET /identity/v3/services/object-store => generated 93 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 13 19:36:59.158163 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2aca29-4c54-48c5-9cc4-221d7c8e76ea None admin] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:36:59.221693 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be6f493-2334-44dc-be9e-7cd55b9d1bf4 None admin] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:36:59.263329 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb687df-5792-40a8-9499-51cbe5d2e596 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:36:59.264091 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb687df-5792-40a8-9499-51cbe5d2e596 None admin] REQUEST_METHOD: `PUT` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:36:59.264406 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb687df-5792-40a8-9499-51cbe5d2e596 None admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:36:59.264680 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb687df-5792-40a8-9499-51cbe5d2e596 None admin] PATH_INFO: `/v3/projects/9a10a4268f3c4cb29f4e00c292e2df62/users/d44977a3225e43f19cdc4a84f0e170cd/roles/14ffeae2f0594a2c9da6bfd35829457e` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:36:59.266904 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb687df-5792-40a8-9499-51cbe5d2e596 None admin] RBAC: Authorizing `identity:create_grant(project_id=9a10a4268f3c4cb29f4e00c292e2df62, user_id=d44977a3225e43f19cdc4a84f0e170cd, role_id=14ffeae2f0594a2c9da6bfd35829457e)` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:36:59.268508 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb687df-5792-40a8-9499-51cbe5d2e596 None admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:36:59.272532 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2aca29-4c54-48c5-9cc4-221d7c8e76ea None admin] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:36:59.292320 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 461/947] 10.222.0.25 () {58 vars in 1439 bytes} [Tue Sep 13 19:36:59 2022] PUT /identity/v3/projects/9a10a4268f3c4cb29f4e00c292e2df62/users/d44977a3225e43f19cdc4a84f0e170cd/roles/14ffeae2f0594a2c9da6bfd35829457e => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 19:36:59.326489 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6aafee-4241-43c3-b4d0-523430389f9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:36:59.327123 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6aafee-4241-43c3-b4d0-523430389f9f None admin] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:36:59.327403 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6aafee-4241-43c3-b4d0-523430389f9f None admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:36:59.327673 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6aafee-4241-43c3-b4d0-523430389f9f None admin] PATH_INFO: `/v3/services` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:36:59.328346 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e6aafee-4241-43c3-b4d0-523430389f9f None admin] RBAC: Adding query filter params (name=object-store) {{(pid=87934) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:36:59.328711 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e6aafee-4241-43c3-b4d0-523430389f9f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:36:59.330100 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e6aafee-4241-43c3-b4d0-523430389f9f None admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:36:59.337867 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 487/948] 10.222.0.25 () {56 vars in 1122 bytes} [Tue Sep 13 19:36:59 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 19:36:59.343591 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb687df-5792-40a8-9499-51cbe5d2e596 None admin] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:36:59.431684 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG dbcounter [-] [87935] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:36:59.479634 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb687df-5792-40a8-9499-51cbe5d2e596 None admin] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:36:59.488592 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5f25e8-57e5-4bf4-a61a-008cba34e630 None None] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:36:59.488897 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5f25e8-57e5-4bf4-a61a-008cba34e630 None None] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:36:59.489142 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5f25e8-57e5-4bf4-a61a-008cba34e630 None None] PATH_INFO: `/` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:36:59.494567 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 488/949] 10.222.0.25 () {54 vars in 927 bytes} [Tue Sep 13 19:36:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:36:59.496178 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c5a13e-873b-40f8-881f-58849c6544eb None None] REQUEST_METHOD: `POST` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:36:59.496496 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c5a13e-873b-40f8-881f-58849c6544eb None None] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:36:59.496769 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c5a13e-873b-40f8-881f-58849c6544eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:36:59.517397 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.auth.core [None req-08c5a13e-873b-40f8-881f-58849c6544eb None None] MFA Rules not processed for user `7b0aed92d02344acb92a0e4aa67c3068`. Rule list: `[]` (Enabled: `True`). {{(pid=87934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:36:59.518931 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.fernet_utils [None req-08c5a13e-873b-40f8-881f-58849c6544eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:36:59.521020 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c735de-37f8-46dc-b62f-9bf65e136515 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:36:59.521761 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c735de-37f8-46dc-b62f-9bf65e136515 None admin] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:36:59.521959 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c735de-37f8-46dc-b62f-9bf65e136515 None admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:36:59.522231 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c735de-37f8-46dc-b62f-9bf65e136515 None admin] PATH_INFO: `/v3/services` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:36:59.522873 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c735de-37f8-46dc-b62f-9bf65e136515 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=87935) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:36:59.523180 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c735de-37f8-46dc-b62f-9bf65e136515 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:36:59.524748 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c735de-37f8-46dc-b62f-9bf65e136515 None admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:36:59.530356 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 462/950] 10.222.0.25 () {56 vars in 1122 bytes} [Tue Sep 13 19:36:59 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 19:36:59.538924 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c735de-37f8-46dc-b62f-9bf65e136515 None admin] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:36:59.546321 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG dbcounter [-] [87934] Writing DB stats keystone:SELECT=100 {{(pid=87934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:36:59.623156 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 489/951] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Sep 13 19:36:59 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 13 19:36:59.664726 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c735de-37f8-46dc-b62f-9bf65e136515 None admin] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:36:59.697009 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG dbcounter [-] [87935] Writing DB stats keystone:SELECT=100 {{(pid=87935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:36:59.703845 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afeb8e46-7171-4047-81d1-5ada9f988e50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:36:59.704489 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afeb8e46-7171-4047-81d1-5ada9f988e50 None admin] REQUEST_METHOD: `POST` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:36:59.704770 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afeb8e46-7171-4047-81d1-5ada9f988e50 None admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:36:59.705043 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afeb8e46-7171-4047-81d1-5ada9f988e50 None admin] PATH_INFO: `/v3/endpoints` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:36:59.705729 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afeb8e46-7171-4047-81d1-5ada9f988e50 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:36:59.708006 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afeb8e46-7171-4047-81d1-5ada9f988e50 None admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:36:59.732043 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 463/952] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Sep 13 19:36:59 2022] POST /identity/v3/endpoints => generated 349 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 19:36:59.896332 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c5a13e-873b-40f8-881f-58849c6544eb None None] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:37:00.002687 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c5a13e-873b-40f8-881f-58849c6544eb None None] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:37:00.045782 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92449091-2b83-47c0-9c81-5c6e0c30acf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:37:00.046770 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92449091-2b83-47c0-9c81-5c6e0c30acf5 None admin] REQUEST_METHOD: `POST` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:37:00.047261 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92449091-2b83-47c0-9c81-5c6e0c30acf5 None admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:37:00.047724 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92449091-2b83-47c0-9c81-5c6e0c30acf5 None admin] PATH_INFO: `/v3/projects` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:37:00.048587 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92449091-2b83-47c0-9c81-5c6e0c30acf5 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:37:00.050592 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92449091-2b83-47c0-9c81-5c6e0c30acf5 None admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:37:00.053461 dv-cinder-828805-6-smb devstack@keystone.service[87934]: WARNING keystone.server.flask.common [None req-92449091-2b83-47c0-9c81-5c6e0c30acf5 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Sep 13 19:37:00.073149 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.sql.core [None req-92449091-2b83-47c0-9c81-5c6e0c30acf5 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Sep 13 19:37:00.073149 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Sep 13 19:37:00.073149 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [parameters: {'id': 'b62edfe25eb648c186649ee4319ae0ca', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Sep 13 19:37:00.073149 dv-cinder-828805-6-smb devstack@keystone.service[87934]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=87934) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Sep 13 19:37:00.082461 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application [None req-92449091-2b83-47c0-9c81-5c6e0c30acf5 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id b62edfe25eb648c186649ee4319ae0ca.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id b62edfe25eb648c186649ee4319ae0ca. Sep 13 19:37:00.082461 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:37:00.082461 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 13 19:37:00.082461 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 13 19:37:00.082461 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 13 19:37:00.082461 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 13 19:37:00.082461 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 13 19:37:00.082461 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application result = self._query(query) Sep 13 19:37:00.082461 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 13 19:37:00.082461 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application conn.query(q) Sep 13 19:37:00.082461 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 13 19:37:00.082461 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 13 19:37:00.082461 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 13 19:37:00.083328 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application result.read() Sep 13 19:37:00.083328 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 13 19:37:00.083328 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 13 19:37:00.083328 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 13 19:37:00.083328 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 13 19:37:00.083328 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 13 19:37:00.083328 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 13 19:37:00.083328 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 13 19:37:00.083328 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 13 19:37:00.083328 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Sep 13 19:37:00.083328 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application Sep 13 19:37:00.083328 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Sep 13 19:37:00.083328 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application Sep 13 19:37:00.083328 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:37:00.083328 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Sep 13 19:37:00.083328 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return method(*args, **kwargs) Sep 13 19:37:00.083328 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Sep 13 19:37:00.083328 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return project_ref.to_dict() Sep 13 19:37:00.084345 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 13 19:37:00.084345 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application next(self.gen) Sep 13 19:37:00.084345 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Sep 13 19:37:00.084345 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application yield resource Sep 13 19:37:00.084345 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 13 19:37:00.084345 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application next(self.gen) Sep 13 19:37:00.084345 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Sep 13 19:37:00.084345 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application self.session.rollback() Sep 13 19:37:00.084345 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 13 19:37:00.084345 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application self.force_reraise() Sep 13 19:37:00.084345 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 13 19:37:00.084345 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application raise self.value Sep 13 19:37:00.084345 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Sep 13 19:37:00.084345 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Sep 13 19:37:00.084345 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Sep 13 19:37:00.084345 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application session.commit() Sep 13 19:37:00.084345 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Sep 13 19:37:00.085247 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Sep 13 19:37:00.085247 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Sep 13 19:37:00.085247 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application self._prepare_impl() Sep 13 19:37:00.085247 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Sep 13 19:37:00.085247 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application self.session.flush() Sep 13 19:37:00.085247 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Sep 13 19:37:00.085247 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application self._flush(objects) Sep 13 19:37:00.085247 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Sep 13 19:37:00.085247 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Sep 13 19:37:00.085247 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Sep 13 19:37:00.085247 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application compat.raise_( Sep 13 19:37:00.085247 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 13 19:37:00.085247 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application raise exception Sep 13 19:37:00.085247 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Sep 13 19:37:00.085247 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application flush_context.execute() Sep 13 19:37:00.085247 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Sep 13 19:37:00.085247 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application rec.execute(self) Sep 13 19:37:00.086181 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Sep 13 19:37:00.086181 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Sep 13 19:37:00.086181 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Sep 13 19:37:00.086181 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application _emit_insert_statements( Sep 13 19:37:00.086181 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Sep 13 19:37:00.086181 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application c = connection._execute_20( Sep 13 19:37:00.086181 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Sep 13 19:37:00.086181 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Sep 13 19:37:00.086181 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Sep 13 19:37:00.086181 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Sep 13 19:37:00.086181 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Sep 13 19:37:00.086181 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application ret = self._execute_context( Sep 13 19:37:00.086181 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Sep 13 19:37:00.086181 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Sep 13 19:37:00.086181 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Sep 13 19:37:00.086995 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Sep 13 19:37:00.086995 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 13 19:37:00.086995 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application raise exception Sep 13 19:37:00.086995 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 13 19:37:00.086995 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 13 19:37:00.086995 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 13 19:37:00.086995 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 13 19:37:00.086995 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 13 19:37:00.086995 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application result = self._query(query) Sep 13 19:37:00.086995 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 13 19:37:00.086995 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application conn.query(q) Sep 13 19:37:00.086995 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 13 19:37:00.086995 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 13 19:37:00.086995 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 13 19:37:00.086995 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application result.read() Sep 13 19:37:00.086995 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 13 19:37:00.086995 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 13 19:37:00.087874 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 13 19:37:00.087874 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 13 19:37:00.087874 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 13 19:37:00.087874 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 13 19:37:00.087874 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 13 19:37:00.087874 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 13 19:37:00.087874 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Sep 13 19:37:00.087874 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Sep 13 19:37:00.087874 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application [parameters: {'id': 'b62edfe25eb648c186649ee4319ae0ca', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Sep 13 19:37:00.087874 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Sep 13 19:37:00.087874 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application Sep 13 19:37:00.087874 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 13 19:37:00.087874 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application Sep 13 19:37:00.087874 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:37:00.087874 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Sep 13 19:37:00.090322 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Sep 13 19:37:00.090322 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Sep 13 19:37:00.090322 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Sep 13 19:37:00.090322 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Sep 13 19:37:00.090322 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application Sep 13 19:37:00.090322 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 13 19:37:00.090322 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application Sep 13 19:37:00.090322 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:37:00.090322 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:37:00.090322 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:37:00.090322 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:37:00.090322 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:37:00.090322 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:37:00.090322 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:37:00.090322 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:37:00.090322 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:37:00.090322 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:37:00.092652 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:37:00.092652 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Sep 13 19:37:00.092652 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Sep 13 19:37:00.092652 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:37:00.092652 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:37:00.092652 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Sep 13 19:37:00.092652 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application raise exception.Conflict( Sep 13 19:37:00.092652 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id b62edfe25eb648c186649ee4319ae0ca. Sep 13 19:37:00.092652 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application Sep 13 19:37:00.095320 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 490/953] 10.222.0.25 () {60 vars in 1140 bytes} [Tue Sep 13 19:36:59 2022] POST /identity/v3/projects => generated 262 bytes in 198 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:37:00.100808 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afeb8e46-7171-4047-81d1-5ada9f988e50 None admin] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:37:00.219524 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afeb8e46-7171-4047-81d1-5ada9f988e50 None admin] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:37:00.265321 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d4be7b-ce4b-464a-a5c4-8324f033044f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:37:00.265963 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d4be7b-ce4b-464a-a5c4-8324f033044f None admin] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:37:00.266240 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d4be7b-ce4b-464a-a5c4-8324f033044f None admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:37:00.266510 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d4be7b-ce4b-464a-a5c4-8324f033044f None admin] PATH_INFO: `/v3/projects/service` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:37:00.274116 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032e7c95-2636-4b39-9418-a976e733300e None None] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:37:00.274389 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032e7c95-2636-4b39-9418-a976e733300e None None] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:37:00.274655 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032e7c95-2636-4b39-9418-a976e733300e None None] PATH_INFO: `/` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:37:00.275640 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d4be7b-ce4b-464a-a5c4-8324f033044f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:37:00.277243 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d4be7b-ce4b-464a-a5c4-8324f033044f None admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:37:00.283058 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 491/954] 10.222.0.25 () {54 vars in 927 bytes} [Tue Sep 13 19:37:00 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 13 19:37:00.284703 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9aefcd0-d927-495a-b203-5c5046350c72 None None] REQUEST_METHOD: `POST` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:37:00.284989 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9aefcd0-d927-495a-b203-5c5046350c72 None None] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:37:00.285263 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9aefcd0-d927-495a-b203-5c5046350c72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:37:00.289854 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application [None req-d4d4be7b-ce4b-464a-a5c4-8324f033044f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 19:37:00.289854 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:37:00.289854 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:37:00.289854 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:37:00.289854 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:37:00.289854 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:37:00.289854 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:37:00.289854 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:37:00.289854 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:37:00.289854 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:37:00.289854 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:37:00.289854 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:37:00.289854 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 13 19:37:00.289854 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 13 19:37:00.289854 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 13 19:37:00.291913 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 13 19:37:00.291913 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:37:00.291913 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:37:00.291913 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:37:00.291913 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:37:00.291913 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:37:00.291913 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:37:00.291913 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:37:00.291913 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application with Lock( Sep 13 19:37:00.291913 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:37:00.291913 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:37:00.291913 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:37:00.291913 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:37:00.291913 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:37:00.291913 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:37:00.291913 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:37:00.291913 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:37:00.294146 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 13 19:37:00.294146 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 13 19:37:00.294146 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 13 19:37:00.294146 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 13 19:37:00.294146 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 13 19:37:00.294146 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 13 19:37:00.294146 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 19:37:00.294146 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application Sep 13 19:37:00.294146 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 464/955] 10.222.0.25 () {56 vars in 1111 bytes} [Tue Sep 13 19:37:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:37:00.302127 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d4be7b-ce4b-464a-a5c4-8324f033044f None admin] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:37:00.310658 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG dbcounter [-] [87934] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:37:00.315596 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.auth.core [None req-a9aefcd0-d927-495a-b203-5c5046350c72 None None] MFA Rules not processed for user `7b0aed92d02344acb92a0e4aa67c3068`. Rule list: `[]` (Enabled: `True`). {{(pid=87934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:37:00.318054 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.fernet_utils [None req-a9aefcd0-d927-495a-b203-5c5046350c72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:37:00.356069 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG dbcounter [-] [87935] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:37:00.400649 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 492/956] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Sep 13 19:37:00 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 13 19:37:00.415080 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d4be7b-ce4b-464a-a5c4-8324f033044f None admin] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:37:00.452433 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e899ace-e36f-4525-921e-a506e2fbf288 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:37:00.453048 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e899ace-e36f-4525-921e-a506e2fbf288 None admin] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:37:00.453346 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e899ace-e36f-4525-921e-a506e2fbf288 None admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:37:00.453645 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e899ace-e36f-4525-921e-a506e2fbf288 None admin] PATH_INFO: `/v3/projects` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:37:00.454358 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e899ace-e36f-4525-921e-a506e2fbf288 None admin] RBAC: Adding query filter params (name=service) {{(pid=87935) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:37:00.454666 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e899ace-e36f-4525-921e-a506e2fbf288 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:37:00.456109 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e899ace-e36f-4525-921e-a506e2fbf288 None admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:37:00.475358 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 465/957] 10.222.0.25 () {56 vars in 1112 bytes} [Tue Sep 13 19:37:00 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:37:00.681554 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9aefcd0-d927-495a-b203-5c5046350c72 None None] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:37:00.796288 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9aefcd0-d927-495a-b203-5c5046350c72 None None] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:37:00.858251 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2fa4367-d1a8-48dc-9a8b-28bd77f80831 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:37:00.858901 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fa4367-d1a8-48dc-9a8b-28bd77f80831 None admin] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:37:00.859182 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fa4367-d1a8-48dc-9a8b-28bd77f80831 None admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:37:00.859454 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fa4367-d1a8-48dc-9a8b-28bd77f80831 None admin] PATH_INFO: `/v3/services/compute` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:37:00.860051 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2fa4367-d1a8-48dc-9a8b-28bd77f80831 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:37:00.861703 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2fa4367-d1a8-48dc-9a8b-28bd77f80831 None admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:37:00.864938 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG dbcounter [-] [87934] Writing DB stats keystone:SELECT=100 {{(pid=87934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:37:00.874186 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application [None req-b2fa4367-d1a8-48dc-9a8b-28bd77f80831 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Sep 13 19:37:00.874186 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:37:00.874186 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 13 19:37:00.874186 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 13 19:37:00.874186 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 13 19:37:00.874186 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 13 19:37:00.874186 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 13 19:37:00.874186 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 19:37:00.874186 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 13 19:37:00.874186 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application Sep 13 19:37:00.874186 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 13 19:37:00.874186 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application Sep 13 19:37:00.874186 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:37:00.874186 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:37:00.874186 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:37:00.874186 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:37:00.874186 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:37:00.876754 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:37:00.876754 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:37:00.876754 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:37:00.876754 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:37:00.876754 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:37:00.876754 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:37:00.876754 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 13 19:37:00.876754 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 13 19:37:00.876754 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 13 19:37:00.876754 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 13 19:37:00.876754 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:37:00.876754 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:37:00.876754 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:37:00.876754 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:37:00.876754 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:37:00.876754 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:37:00.879362 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:37:00.879362 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application with Lock( Sep 13 19:37:00.879362 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:37:00.879362 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:37:00.879362 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:37:00.879362 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:37:00.879362 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:37:00.879362 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:37:00.879362 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:37:00.879362 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:37:00.879362 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 13 19:37:00.879362 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 19:37:00.879362 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 13 19:37:00.879362 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application Sep 13 19:37:00.881201 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 493/958] 10.222.0.25 () {56 vars in 1111 bytes} [Tue Sep 13 19:37:00 2022] GET /identity/v3/services/compute => generated 88 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:37:00.882184 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e899ace-e36f-4525-921e-a506e2fbf288 None admin] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:37:01.000081 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e899ace-e36f-4525-921e-a506e2fbf288 None admin] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:37:01.011779 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG dbcounter [-] [87935] Writing DB stats keystone:SELECT=100 {{(pid=87935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:37:01.044630 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1558e9-ade1-4775-87c7-4db0b9dfa083 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:37:01.045240 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1558e9-ade1-4775-87c7-4db0b9dfa083 None admin] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:37:01.045515 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1558e9-ade1-4775-87c7-4db0b9dfa083 None admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:37:01.045784 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1558e9-ade1-4775-87c7-4db0b9dfa083 None admin] PATH_INFO: `/v3/services` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:37:01.046468 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b1558e9-ade1-4775-87c7-4db0b9dfa083 None admin] RBAC: Adding query filter params (name=compute) {{(pid=87935) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:37:01.046776 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b1558e9-ade1-4775-87c7-4db0b9dfa083 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:37:01.048151 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b1558e9-ade1-4775-87c7-4db0b9dfa083 None admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:37:01.053990 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 466/959] 10.222.0.25 () {56 vars in 1112 bytes} [Tue Sep 13 19:37:00 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 19:37:01.059688 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2fa4367-d1a8-48dc-9a8b-28bd77f80831 None admin] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:37:01.189213 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2fa4367-d1a8-48dc-9a8b-28bd77f80831 None admin] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:37:01.224940 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a049413b-cc52-4a52-8f1d-7f177c570f3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:37:01.225561 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a049413b-cc52-4a52-8f1d-7f177c570f3c None admin] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:37:01.225885 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a049413b-cc52-4a52-8f1d-7f177c570f3c None admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:37:01.226101 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a049413b-cc52-4a52-8f1d-7f177c570f3c None admin] PATH_INFO: `/v3/services` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:37:01.226734 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a049413b-cc52-4a52-8f1d-7f177c570f3c None admin] RBAC: Adding query filter params (type=compute) {{(pid=87934) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:37:01.227034 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a049413b-cc52-4a52-8f1d-7f177c570f3c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:37:01.228422 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a049413b-cc52-4a52-8f1d-7f177c570f3c None admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:37:01.233711 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 494/960] 10.222.0.25 () {56 vars in 1112 bytes} [Tue Sep 13 19:37:01 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:37:01.555111 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2430b5-3350-43a7-866b-3b1013635390 None None] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:37:01.555612 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2430b5-3350-43a7-866b-3b1013635390 None None] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:37:01.555612 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2430b5-3350-43a7-866b-3b1013635390 None None] PATH_INFO: `/` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:37:01.557167 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 467/961] 10.222.0.25 () {54 vars in 927 bytes} [Tue Sep 13 19:37:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:37:01.562781 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9ec1c0-8dbf-41d1-82b9-669f9b4ef231 None None] REQUEST_METHOD: `POST` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:37:01.563115 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9ec1c0-8dbf-41d1-82b9-669f9b4ef231 None None] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:37:01.563334 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9ec1c0-8dbf-41d1-82b9-669f9b4ef231 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:37:01.583523 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.auth.core [None req-ec9ec1c0-8dbf-41d1-82b9-669f9b4ef231 None None] MFA Rules not processed for user `7b0aed92d02344acb92a0e4aa67c3068`. Rule list: `[]` (Enabled: `True`). {{(pid=87934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:37:01.584741 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.fernet_utils [None req-ec9ec1c0-8dbf-41d1-82b9-669f9b4ef231 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:37:01.650409 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG dbcounter [-] [87934] Writing DB stats keystone:SELECT=100 {{(pid=87934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:37:01.661890 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 495/962] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Sep 13 19:37:01 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 13 19:37:01.933526 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2430b5-3350-43a7-866b-3b1013635390 None None] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:37:02.049006 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2430b5-3350-43a7-866b-3b1013635390 None None] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:37:02.067509 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a1657a-ed42-4ab1-abdf-057dd116958e None None] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:37:02.067509 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a1657a-ed42-4ab1-abdf-057dd116958e None None] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:37:02.067509 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a1657a-ed42-4ab1-abdf-057dd116958e None None] PATH_INFO: `/` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:37:02.068200 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 496/963] 10.222.0.25 () {54 vars in 927 bytes} [Tue Sep 13 19:37:02 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:37:02.073846 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8919ec8c-8b39-4c44-84bd-3f4302fc66b1 None None] REQUEST_METHOD: `POST` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:37:02.074162 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8919ec8c-8b39-4c44-84bd-3f4302fc66b1 None None] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:37:02.074432 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8919ec8c-8b39-4c44-84bd-3f4302fc66b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:37:02.094151 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.auth.core [None req-8919ec8c-8b39-4c44-84bd-3f4302fc66b1 None None] MFA Rules not processed for user `7b0aed92d02344acb92a0e4aa67c3068`. Rule list: `[]` (Enabled: `True`). {{(pid=87934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:37:02.095321 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.fernet_utils [None req-8919ec8c-8b39-4c44-84bd-3f4302fc66b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:37:02.098167 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e47e70-664e-467b-b932-e4e764e33d44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:37:02.099507 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e47e70-664e-467b-b932-e4e764e33d44 None admin] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:37:02.100273 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e47e70-664e-467b-b932-e4e764e33d44 None admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:37:02.101021 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e47e70-664e-467b-b932-e4e764e33d44 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:37:02.121617 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e47e70-664e-467b-b932-e4e764e33d44 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 19:37:02.126538 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application [None req-25e47e70-664e-467b-b932-e4e764e33d44 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 13 19:37:02.126538 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:37:02.126538 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:37:02.126538 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:37:02.126538 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:37:02.126538 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:37:02.126538 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:37:02.126538 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:37:02.126538 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:37:02.126538 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:37:02.126538 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:37:02.126538 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:37:02.126538 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 19:37:02.126538 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 19:37:02.126538 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 19:37:02.126538 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 19:37:02.127489 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 19:37:02.127489 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 19:37:02.127489 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 19:37:02.127489 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 19:37:02.127489 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:37:02.127489 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:37:02.127489 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:37:02.127489 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:37:02.127489 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:37:02.127489 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:37:02.127489 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:37:02.127489 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application with Lock( Sep 13 19:37:02.127489 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:37:02.127489 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:37:02.127489 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:37:02.127489 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:37:02.128936 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:37:02.128936 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:37:02.128936 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:37:02.128936 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:37:02.128936 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 19:37:02.128936 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 19:37:02.128936 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 19:37:02.128936 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 19:37:02.128936 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 19:37:02.128936 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 19:37:02.128936 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 13 19:37:02.128936 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application Sep 13 19:37:02.128936 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 468/964] 10.222.0.25 () {56 vars in 1120 bytes} [Tue Sep 13 19:37:01 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:37:02.135990 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e47e70-664e-467b-b932-e4e764e33d44 None admin] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:37:02.177901 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG dbcounter [-] [87935] Writing DB stats keystone:SELECT=100 {{(pid=87935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:37:02.193790 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 497/965] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Sep 13 19:37:02 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 13 19:37:02.263906 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e47e70-664e-467b-b932-e4e764e33d44 None admin] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:37:02.310514 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e6437f-dc67-471d-b99a-443f93ee7f9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:37:02.311487 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e6437f-dc67-471d-b99a-443f93ee7f9a None admin] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:37:02.311970 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e6437f-dc67-471d-b99a-443f93ee7f9a None admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:37:02.312478 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e6437f-dc67-471d-b99a-443f93ee7f9a None admin] PATH_INFO: `/v3/roles` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:37:02.313470 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e6437f-dc67-471d-b99a-443f93ee7f9a None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=87935) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:37:02.313984 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e6437f-dc67-471d-b99a-443f93ee7f9a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:37:02.315574 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e6437f-dc67-471d-b99a-443f93ee7f9a None admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:37:02.325901 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 469/966] 10.222.0.25 () {56 vars in 1115 bytes} [Tue Sep 13 19:37:02 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 19:37:02.333170 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8919ec8c-8b39-4c44-84bd-3f4302fc66b1 None None] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:37:02.448177 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8919ec8c-8b39-4c44-84bd-3f4302fc66b1 None None] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:37:02.474086 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG dbcounter [-] [87934] Writing DB stats keystone:SELECT=100 {{(pid=87934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:37:02.488789 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9d69f8-f646-484c-a22f-adae34f66fb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:37:02.489433 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9d69f8-f646-484c-a22f-adae34f66fb5 None admin] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:37:02.489709 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9d69f8-f646-484c-a22f-adae34f66fb5 None admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:37:02.489977 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9d69f8-f646-484c-a22f-adae34f66fb5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:37:02.494021 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e6437f-dc67-471d-b99a-443f93ee7f9a None admin] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:37:02.509389 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd9d69f8-f646-484c-a22f-adae34f66fb5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:37:02.511039 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd9d69f8-f646-484c-a22f-adae34f66fb5 None admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:37:02.528750 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application [None req-cd9d69f8-f646-484c-a22f-adae34f66fb5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 19:37:02.528750 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:37:02.528750 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:37:02.528750 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:37:02.528750 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:37:02.528750 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:37:02.528750 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:37:02.528750 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:37:02.528750 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:37:02.528750 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:37:02.528750 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:37:02.528750 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:37:02.528750 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 19:37:02.528750 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 19:37:02.528750 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 19:37:02.528750 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 19:37:02.529789 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:37:02.529789 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:37:02.529789 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:37:02.529789 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:37:02.529789 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:37:02.529789 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:37:02.529789 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:37:02.529789 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application with Lock( Sep 13 19:37:02.529789 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:37:02.529789 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:37:02.529789 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:37:02.529789 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:37:02.529789 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:37:02.529789 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:37:02.529789 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:37:02.529789 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:37:02.529789 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 19:37:02.530726 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 19:37:02.530726 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 19:37:02.530726 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application Sep 13 19:37:02.530726 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 498/967] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Sep 13 19:37:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:37:02.537751 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9d69f8-f646-484c-a22f-adae34f66fb5 None admin] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:37:02.630918 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG dbcounter [-] [87935] Writing DB stats keystone:SELECT=100 {{(pid=87935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:37:02.643033 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e6437f-dc67-471d-b99a-443f93ee7f9a None admin] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:37:02.683783 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9d69f8-f646-484c-a22f-adae34f66fb5 None admin] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:37:02.693959 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf632cea-b9b5-4728-a7b3-08f4661b80f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:37:02.694926 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf632cea-b9b5-4728-a7b3-08f4661b80f9 None admin] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:37:02.695345 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf632cea-b9b5-4728-a7b3-08f4661b80f9 None admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:37:02.695759 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf632cea-b9b5-4728-a7b3-08f4661b80f9 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:37:02.697544 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf632cea-b9b5-4728-a7b3-08f4661b80f9 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:37:02.699042 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf632cea-b9b5-4728-a7b3-08f4661b80f9 None admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:37:02.714074 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application [None req-cf632cea-b9b5-4728-a7b3-08f4661b80f9 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 13 19:37:02.714074 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:37:02.714074 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 13 19:37:02.714074 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 13 19:37:02.714074 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 13 19:37:02.714074 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 13 19:37:02.714074 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 13 19:37:02.714074 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 19:37:02.714074 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 13 19:37:02.714074 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application Sep 13 19:37:02.714074 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 13 19:37:02.714074 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application Sep 13 19:37:02.714074 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:37:02.714074 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:37:02.714074 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:37:02.714074 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:37:02.714074 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:37:02.715212 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:37:02.715212 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:37:02.715212 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:37:02.715212 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:37:02.715212 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:37:02.715212 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:37:02.715212 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 13 19:37:02.715212 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 13 19:37:02.715212 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 13 19:37:02.715212 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 13 19:37:02.715212 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:37:02.715212 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:37:02.715212 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:37:02.715212 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:37:02.715212 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:37:02.715212 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:37:02.716084 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:37:02.716084 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application with Lock( Sep 13 19:37:02.716084 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:37:02.716084 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:37:02.716084 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:37:02.716084 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:37:02.716084 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:37:02.716084 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:37:02.716084 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:37:02.716084 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:37:02.716084 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 13 19:37:02.716084 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 19:37:02.716084 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 13 19:37:02.716084 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application Sep 13 19:37:02.720295 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 470/968] 10.222.0.25 () {56 vars in 1126 bytes} [Tue Sep 13 19:37:02 2022] GET /identity/v3/services/object-store => generated 93 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:37:02.721444 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf632cea-b9b5-4728-a7b3-08f4661b80f9 None admin] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:37:02.741188 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c9f1da-2de5-4bc2-b92b-99fe105bacc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:37:02.741811 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c9f1da-2de5-4bc2-b92b-99fe105bacc3 None admin] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:37:02.742093 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c9f1da-2de5-4bc2-b92b-99fe105bacc3 None admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:37:02.742378 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c9f1da-2de5-4bc2-b92b-99fe105bacc3 None admin] PATH_INFO: `/v3/domains` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:37:02.743363 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c9f1da-2de5-4bc2-b92b-99fe105bacc3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87934) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:37:02.743669 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c9f1da-2de5-4bc2-b92b-99fe105bacc3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:37:02.745572 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c9f1da-2de5-4bc2-b92b-99fe105bacc3 None admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:37:02.768355 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 499/969] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Sep 13 19:37:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 19:37:02.777697 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c9f1da-2de5-4bc2-b92b-99fe105bacc3 None admin] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:37:02.828266 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG dbcounter [-] [87934] Writing DB stats keystone:SELECT=100 {{(pid=87934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:37:02.903273 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf632cea-b9b5-4728-a7b3-08f4661b80f9 None admin] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:37:02.915870 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c9f1da-2de5-4bc2-b92b-99fe105bacc3 None admin] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:37:02.957521 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c9b02a-ebd8-470f-b407-3708ec67cfc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:37:02.958631 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c9b02a-ebd8-470f-b407-3708ec67cfc8 None admin] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:37:02.959066 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c9b02a-ebd8-470f-b407-3708ec67cfc8 None admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:37:02.959277 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c9b02a-ebd8-470f-b407-3708ec67cfc8 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:37:02.964987 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120e5a6b-a14e-4b00-8df3-a5c2097816e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:37:02.965976 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120e5a6b-a14e-4b00-8df3-a5c2097816e2 None admin] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:37:02.966548 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120e5a6b-a14e-4b00-8df3-a5c2097816e2 None admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:37:02.966903 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120e5a6b-a14e-4b00-8df3-a5c2097816e2 None admin] PATH_INFO: `/v3/services` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:37:02.967451 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c9b02a-ebd8-470f-b407-3708ec67cfc8 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:37:02.967992 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-120e5a6b-a14e-4b00-8df3-a5c2097816e2 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=87935) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:37:02.968499 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-120e5a6b-a14e-4b00-8df3-a5c2097816e2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:37:02.968919 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c9b02a-ebd8-470f-b407-3708ec67cfc8 None admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:37:02.970972 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-120e5a6b-a14e-4b00-8df3-a5c2097816e2 None admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:37:02.985856 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 471/970] 10.222.0.25 () {56 vars in 1122 bytes} [Tue Sep 13 19:37:02 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:37:02.986030 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application [None req-52c9b02a-ebd8-470f-b407-3708ec67cfc8 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 13 19:37:02.986030 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:37:02.986030 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:37:02.986030 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:37:02.986030 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:37:02.986030 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:37:02.986030 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:37:02.986030 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:37:02.986030 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:37:02.986030 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:37:02.986030 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:37:02.986030 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:37:02.986030 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 13 19:37:02.986030 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 13 19:37:02.986030 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 13 19:37:02.986030 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 13 19:37:02.991506 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:37:02.991506 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:37:02.991506 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 13 19:37:02.991506 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 19:37:02.991506 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 13 19:37:02.991506 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 19:37:02.991506 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:37:02.991506 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:37:02.991506 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:37:02.991506 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:37:02.991506 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:37:02.991506 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application with Lock( Sep 13 19:37:02.991506 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:37:02.991506 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:37:02.991506 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:37:02.991506 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:37:02.991506 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:37:02.991506 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:37:02.992536 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:37:02.992536 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:37:02.992536 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 13 19:37:02.992536 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 13 19:37:02.992536 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 13 19:37:02.992536 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 13 19:37:02.992536 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 13 19:37:02.992536 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 13 19:37:02.992536 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 13 19:37:02.992536 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application Sep 13 19:37:02.993200 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a6563e-8317-4184-a6ee-0fa65cc634d1 None None] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:37:02.993200 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a6563e-8317-4184-a6ee-0fa65cc634d1 None None] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:37:02.993200 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a6563e-8317-4184-a6ee-0fa65cc634d1 None None] PATH_INFO: `/` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:37:02.993405 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 500/971] 10.222.0.25 () {56 vars in 1117 bytes} [Tue Sep 13 19:37:02 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 13 19:37:02.993481 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 472/972] 10.222.0.25 () {54 vars in 927 bytes} [Tue Sep 13 19:37:02 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:37:02.993551 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c9b02a-ebd8-470f-b407-3708ec67cfc8 None admin] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:37:02.993620 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a6563e-8317-4184-a6ee-0fa65cc634d1 None None] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:37:03.024680 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG dbcounter [-] [87935] Writing DB stats keystone:SELECT=100 {{(pid=87935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:37:03.101915 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG dbcounter [-] [87934] Writing DB stats keystone:SELECT=100 {{(pid=87934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:37:03.108277 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a6563e-8317-4184-a6ee-0fa65cc634d1 None None] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:37:03.109053 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c9b02a-ebd8-470f-b407-3708ec67cfc8 None admin] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:37:03.147178 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237cd7db-0503-45fa-b635-c38ec9c2e52d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:37:03.147534 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce331623-fc81-4f6d-9ce2-cbdb12628f3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:37:03.147788 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237cd7db-0503-45fa-b635-c38ec9c2e52d None admin] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:37:03.148067 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237cd7db-0503-45fa-b635-c38ec9c2e52d None admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:37:03.148164 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce331623-fc81-4f6d-9ce2-cbdb12628f3b None admin] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:37:03.148371 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237cd7db-0503-45fa-b635-c38ec9c2e52d None admin] PATH_INFO: `/v3/users` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:37:03.148490 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce331623-fc81-4f6d-9ce2-cbdb12628f3b None admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:37:03.148684 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce331623-fc81-4f6d-9ce2-cbdb12628f3b None admin] PATH_INFO: `/v3/services` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:37:03.149105 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-237cd7db-0503-45fa-b635-c38ec9c2e52d None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=87935) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:37:03.149314 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce331623-fc81-4f6d-9ce2-cbdb12628f3b None admin] RBAC: Adding query filter params (type=object-store) {{(pid=87934) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:37:03.149419 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-237cd7db-0503-45fa-b635-c38ec9c2e52d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:37:03.149617 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce331623-fc81-4f6d-9ce2-cbdb12628f3b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:37:03.150826 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-237cd7db-0503-45fa-b635-c38ec9c2e52d None admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:37:03.150996 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce331623-fc81-4f6d-9ce2-cbdb12628f3b None admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:37:03.161508 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 501/973] 10.222.0.25 () {56 vars in 1122 bytes} [Tue Sep 13 19:37:02 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:37:03.161508 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2f3794-190d-4952-9057-a7f430d13e03 None None] REQUEST_METHOD: `POST` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:37:03.161508 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2f3794-190d-4952-9057-a7f430d13e03 None None] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:37:03.161508 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2f3794-190d-4952-9057-a7f430d13e03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:37:03.177251 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 473/974] 10.222.0.25 () {56 vars in 1149 bytes} [Tue Sep 13 19:37:02 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:37:03.177714 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.auth.core [None req-9b2f3794-190d-4952-9057-a7f430d13e03 None None] MFA Rules not processed for user `7b0aed92d02344acb92a0e4aa67c3068`. Rule list: `[]` (Enabled: `True`). {{(pid=87934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:37:03.178633 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237cd7db-0503-45fa-b635-c38ec9c2e52d None admin] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:37:03.178909 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.fernet_utils [None req-9b2f3794-190d-4952-9057-a7f430d13e03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:37:03.268573 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 502/975] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Sep 13 19:37:03 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 13 19:37:03.270505 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2f3794-190d-4952-9057-a7f430d13e03 None None] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:37:03.272317 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG dbcounter [-] [87935] Writing DB stats keystone:SELECT=100 {{(pid=87935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:37:03.307378 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237cd7db-0503-45fa-b635-c38ec9c2e52d None admin] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:37:03.347842 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d656cf-184f-4bcf-804a-feec8322f54f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:37:03.348585 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d656cf-184f-4bcf-804a-feec8322f54f None admin] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:37:03.348916 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d656cf-184f-4bcf-804a-feec8322f54f None admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:37:03.349193 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d656cf-184f-4bcf-804a-feec8322f54f None admin] PATH_INFO: `/v3/endpoints` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:37:03.349903 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d656cf-184f-4bcf-804a-feec8322f54f None admin] RBAC: Adding query filter params (interface=admin, service_id=ad51c697988145e29711bac0e7d2508c, region_id=RegionOne) {{(pid=87935) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:37:03.350218 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d656cf-184f-4bcf-804a-feec8322f54f None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:37:03.351682 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d656cf-184f-4bcf-804a-feec8322f54f None admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:37:03.357816 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 474/976] 10.222.0.25 () {56 vars in 1249 bytes} [Tue Sep 13 19:37:03 2022] GET /identity/v3/endpoints?service_id=ad51c697988145e29711bac0e7d2508c&interface=admin®ion_id=RegionOne => generated 193 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:37:03.364574 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d656cf-184f-4bcf-804a-feec8322f54f None admin] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:37:03.370773 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG dbcounter [-] [87934] Writing DB stats keystone:SELECT=100 {{(pid=87934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:37:03.384022 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2f3794-190d-4952-9057-a7f430d13e03 None None] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:37:03.420458 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec393bc3-3471-4f27-a0ae-54e44354574a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:37:03.421070 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec393bc3-3471-4f27-a0ae-54e44354574a None admin] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:37:03.421348 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec393bc3-3471-4f27-a0ae-54e44354574a None admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:37:03.421617 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec393bc3-3471-4f27-a0ae-54e44354574a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:37:03.495903 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec393bc3-3471-4f27-a0ae-54e44354574a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:37:03.497377 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec393bc3-3471-4f27-a0ae-54e44354574a None admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:37:03.505897 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d656cf-184f-4bcf-804a-feec8322f54f None admin] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:37:03.559097 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb0a8f3-282f-4be4-83b6-99ab65251f0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:37:03.559897 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb0a8f3-282f-4be4-83b6-99ab65251f0f None admin] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:37:03.560176 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb0a8f3-282f-4be4-83b6-99ab65251f0f None admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:37:03.560475 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb0a8f3-282f-4be4-83b6-99ab65251f0f None admin] PATH_INFO: `/v3/services` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:37:03.561273 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb0a8f3-282f-4be4-83b6-99ab65251f0f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:37:03.562963 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb0a8f3-282f-4be4-83b6-99ab65251f0f None admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:37:03.569477 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 475/977] 10.222.0.25 () {56 vars in 1087 bytes} [Tue Sep 13 19:37:03 2022] GET /identity/v3/services => generated 1497 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 19:37:03.570076 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb0a8f3-282f-4be4-83b6-99ab65251f0f None admin] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:37:03.586622 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG dbcounter [-] [87935] Writing DB stats keystone:SELECT=100 {{(pid=87935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:37:03.606923 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG dbcounter [-] [87934] Writing DB stats keystone:SELECT=100 {{(pid=87934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:37:03.633918 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 503/978] 10.222.0.25 () {58 vars in 1282 bytes} [Tue Sep 13 19:37:03 2022] GET /identity/v3/auth/tokens => generated 1474 bytes in 363 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 13 19:37:03.635946 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec393bc3-3471-4f27-a0ae-54e44354574a None admin] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:37:03.716531 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb0a8f3-282f-4be4-83b6-99ab65251f0f None admin] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:37:03.754096 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6d0e12-db09-4098-83c6-62f0b43822f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:37:03.755190 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6d0e12-db09-4098-83c6-62f0b43822f4 None admin] REQUEST_METHOD: `POST` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:37:03.755190 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6d0e12-db09-4098-83c6-62f0b43822f4 None admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:37:03.755363 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec393bc3-3471-4f27-a0ae-54e44354574a None admin] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:37:03.755453 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6d0e12-db09-4098-83c6-62f0b43822f4 None admin] PATH_INFO: `/v3/users` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:37:03.756291 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa6d0e12-db09-4098-83c6-62f0b43822f4 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:37:03.757191 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa6d0e12-db09-4098-83c6-62f0b43822f4 None admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:37:03.759718 dv-cinder-828805-6-smb devstack@keystone.service[87935]: WARNING keystone.server.flask.common [None req-aa6d0e12-db09-4098-83c6-62f0b43822f4 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Sep 13 19:37:03.774482 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.sql.core [None req-aa6d0e12-db09-4098-83c6-62f0b43822f4 None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Sep 13 19:37:03.774482 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Sep 13 19:37:03.774482 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [parameters: {'user_id': '487841bf0a464d9289f8e1498b37fdcc', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Sep 13 19:37:03.774482 dv-cinder-828805-6-smb devstack@keystone.service[87935]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=87935) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Sep 13 19:37:03.790919 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application [None req-aa6d0e12-db09-4098-83c6-62f0b43822f4 None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Sep 13 19:37:03.790919 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:37:03.790919 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 13 19:37:03.790919 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 13 19:37:03.790919 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 13 19:37:03.790919 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 13 19:37:03.790919 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 13 19:37:03.790919 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application result = self._query(query) Sep 13 19:37:03.790919 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 13 19:37:03.790919 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application conn.query(q) Sep 13 19:37:03.790919 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 13 19:37:03.790919 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 13 19:37:03.790919 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 13 19:37:03.790919 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application result.read() Sep 13 19:37:03.790919 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 13 19:37:03.791910 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 13 19:37:03.791910 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 13 19:37:03.791910 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 13 19:37:03.791910 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 13 19:37:03.791910 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 13 19:37:03.791910 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 13 19:37:03.791910 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 13 19:37:03.791910 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Sep 13 19:37:03.791910 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application Sep 13 19:37:03.791910 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Sep 13 19:37:03.791910 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application Sep 13 19:37:03.791910 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:37:03.791910 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Sep 13 19:37:03.791910 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return method(*args, **kwargs) Sep 13 19:37:03.791910 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Sep 13 19:37:03.791910 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Sep 13 19:37:03.791910 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 13 19:37:03.791910 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application next(self.gen) Sep 13 19:37:03.793416 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Sep 13 19:37:03.793416 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application yield resource Sep 13 19:37:03.793416 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 13 19:37:03.793416 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application next(self.gen) Sep 13 19:37:03.793416 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Sep 13 19:37:03.793416 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application self.session.rollback() Sep 13 19:37:03.793416 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 13 19:37:03.793416 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application self.force_reraise() Sep 13 19:37:03.793416 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 13 19:37:03.793416 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application raise self.value Sep 13 19:37:03.793416 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Sep 13 19:37:03.793416 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Sep 13 19:37:03.793416 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Sep 13 19:37:03.793416 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application session.commit() Sep 13 19:37:03.793416 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Sep 13 19:37:03.793416 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Sep 13 19:37:03.793416 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Sep 13 19:37:03.794346 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application self._prepare_impl() Sep 13 19:37:03.794346 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Sep 13 19:37:03.794346 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application self.session.flush() Sep 13 19:37:03.794346 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Sep 13 19:37:03.794346 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application self._flush(objects) Sep 13 19:37:03.794346 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Sep 13 19:37:03.794346 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Sep 13 19:37:03.794346 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Sep 13 19:37:03.794346 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application compat.raise_( Sep 13 19:37:03.794346 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 13 19:37:03.794346 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application raise exception Sep 13 19:37:03.794346 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Sep 13 19:37:03.794346 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application flush_context.execute() Sep 13 19:37:03.794346 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Sep 13 19:37:03.794346 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application rec.execute(self) Sep 13 19:37:03.794346 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Sep 13 19:37:03.794346 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Sep 13 19:37:03.795271 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Sep 13 19:37:03.795271 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application _emit_insert_statements( Sep 13 19:37:03.795271 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Sep 13 19:37:03.795271 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application result = connection._execute_20( Sep 13 19:37:03.795271 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Sep 13 19:37:03.795271 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Sep 13 19:37:03.795271 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Sep 13 19:37:03.795271 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Sep 13 19:37:03.795271 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Sep 13 19:37:03.795271 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application ret = self._execute_context( Sep 13 19:37:03.795271 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Sep 13 19:37:03.795271 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Sep 13 19:37:03.795271 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Sep 13 19:37:03.795271 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Sep 13 19:37:03.795271 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 13 19:37:03.795271 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application raise exception Sep 13 19:37:03.796110 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 13 19:37:03.796110 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 13 19:37:03.796110 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 13 19:37:03.796110 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 13 19:37:03.796110 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 13 19:37:03.796110 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application result = self._query(query) Sep 13 19:37:03.796110 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 13 19:37:03.796110 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application conn.query(q) Sep 13 19:37:03.796110 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 13 19:37:03.796110 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 13 19:37:03.796110 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 13 19:37:03.796110 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application result.read() Sep 13 19:37:03.796110 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 13 19:37:03.796110 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 13 19:37:03.796110 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 13 19:37:03.796110 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 13 19:37:03.799414 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 13 19:37:03.799414 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 13 19:37:03.799414 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 13 19:37:03.799414 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 13 19:37:03.799414 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Sep 13 19:37:03.799414 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Sep 13 19:37:03.799414 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application [parameters: {'user_id': '487841bf0a464d9289f8e1498b37fdcc', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Sep 13 19:37:03.799414 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Sep 13 19:37:03.799414 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application Sep 13 19:37:03.799414 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 13 19:37:03.799414 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application Sep 13 19:37:03.799414 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:37:03.799414 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:37:03.799414 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:37:03.799414 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:37:03.802236 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:37:03.802236 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:37:03.802236 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:37:03.802236 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:37:03.802236 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:37:03.802236 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:37:03.802236 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:37:03.802236 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Sep 13 19:37:03.802236 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Sep 13 19:37:03.802236 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:37:03.802236 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:37:03.802236 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 13 19:37:03.802236 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 19:37:03.802236 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 13 19:37:03.802236 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 19:37:03.802236 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Sep 13 19:37:03.802236 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Sep 13 19:37:03.803688 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Sep 13 19:37:03.803688 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Sep 13 19:37:03.803688 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Sep 13 19:37:03.803688 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Sep 13 19:37:03.803688 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Sep 13 19:37:03.803688 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application Sep 13 19:37:03.803688 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 476/979] 10.222.0.25 () {60 vars in 1131 bytes} [Tue Sep 13 19:37:03 2022] POST /identity/v3/users => generated 160 bytes in 222 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:37:03.803688 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd8eedc-9aac-4583-86b7-2b5fdcec2b9f None None] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:37:03.803688 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd8eedc-9aac-4583-86b7-2b5fdcec2b9f None None] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:37:03.803688 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd8eedc-9aac-4583-86b7-2b5fdcec2b9f None None] PATH_INFO: `/` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:37:03.804746 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 477/980] 10.222.0.25 () {54 vars in 927 bytes} [Tue Sep 13 19:37:03 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:37:03.804746 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd8eedc-9aac-4583-86b7-2b5fdcec2b9f None None] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:37:03.806208 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db220d8-2de8-4674-beea-921391ac7799 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:37:03.807035 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db220d8-2de8-4674-beea-921391ac7799 None admin] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:37:03.807315 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db220d8-2de8-4674-beea-921391ac7799 None admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:37:03.807592 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db220d8-2de8-4674-beea-921391ac7799 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:37:03.820821 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db220d8-2de8-4674-beea-921391ac7799 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:37:03.822179 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db220d8-2de8-4674-beea-921391ac7799 None admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:37:03.849978 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application [None req-3db220d8-2de8-4674-beea-921391ac7799 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 19:37:03.849978 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:37:03.849978 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:37:03.849978 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:37:03.849978 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:37:03.849978 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:37:03.849978 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:37:03.849978 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:37:03.849978 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:37:03.849978 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:37:03.849978 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:37:03.849978 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:37:03.849978 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 19:37:03.849978 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 19:37:03.849978 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 19:37:03.849978 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 19:37:03.851053 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:37:03.851053 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:37:03.851053 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:37:03.851053 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:37:03.851053 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:37:03.851053 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:37:03.851053 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:37:03.851053 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application with Lock( Sep 13 19:37:03.851053 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:37:03.851053 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:37:03.851053 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:37:03.851053 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:37:03.851053 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:37:03.851053 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:37:03.851053 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:37:03.851053 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:37:03.851053 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 19:37:03.857740 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 19:37:03.857740 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 19:37:03.857740 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application Sep 13 19:37:03.857740 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 504/981] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Sep 13 19:37:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:37:03.857740 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae9089c-d12f-4997-be02-2ddbc9bf5471 None None] REQUEST_METHOD: `POST` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:37:03.857740 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae9089c-d12f-4997-be02-2ddbc9bf5471 None None] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:37:03.857740 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae9089c-d12f-4997-be02-2ddbc9bf5471 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:37:03.873956 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.auth.core [None req-aae9089c-d12f-4997-be02-2ddbc9bf5471 None None] MFA Rules not processed for user `7b0aed92d02344acb92a0e4aa67c3068`. Rule list: `[]` (Enabled: `True`). {{(pid=87934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:37:03.875133 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.fernet_utils [None req-aae9089c-d12f-4997-be02-2ddbc9bf5471 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:37:03.890131 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG dbcounter [-] [87935] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=87935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:37:03.912714 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG dbcounter [-] [87934] Writing DB stats keystone:SELECT=100 {{(pid=87934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:37:03.930234 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd8eedc-9aac-4583-86b7-2b5fdcec2b9f None None] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:37:03.947395 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 505/982] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Sep 13 19:37:03 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 13 19:37:03.953141 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae9089c-d12f-4997-be02-2ddbc9bf5471 None None] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:37:03.968954 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cabdd085-aa51-4d4f-88d4-9b3a2d79b79b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:37:03.969898 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabdd085-aa51-4d4f-88d4-9b3a2d79b79b None admin] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:37:03.970096 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabdd085-aa51-4d4f-88d4-9b3a2d79b79b None admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:37:03.970352 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabdd085-aa51-4d4f-88d4-9b3a2d79b79b None admin] PATH_INFO: `/v3/users/cinder` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:37:03.980875 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cabdd085-aa51-4d4f-88d4-9b3a2d79b79b None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:37:03.982508 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cabdd085-aa51-4d4f-88d4-9b3a2d79b79b None admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:37:03.995500 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application [None req-cabdd085-aa51-4d4f-88d4-9b3a2d79b79b None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Sep 13 19:37:03.995500 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:37:03.995500 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:37:03.995500 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:37:03.995500 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:37:03.995500 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:37:03.995500 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:37:03.995500 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:37:03.995500 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:37:03.995500 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:37:03.995500 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:37:03.995500 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:37:03.995500 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 13 19:37:03.995500 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 13 19:37:03.995500 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 13 19:37:03.995500 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 13 19:37:03.996507 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:37:03.996507 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:37:03.996507 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 13 19:37:03.996507 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 19:37:03.996507 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 13 19:37:03.996507 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 19:37:03.996507 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:37:03.996507 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:37:03.996507 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:37:03.996507 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:37:03.996507 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:37:03.996507 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application with Lock( Sep 13 19:37:03.996507 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:37:03.996507 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:37:03.996507 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:37:03.996507 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:37:03.996507 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:37:03.996507 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:37:03.997509 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:37:03.997509 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:37:03.997509 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 13 19:37:03.997509 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 13 19:37:03.997509 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 13 19:37:03.997509 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 13 19:37:03.997509 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 13 19:37:03.997509 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 13 19:37:03.997509 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Sep 13 19:37:03.997509 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application Sep 13 19:37:03.997509 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 478/983] 10.222.0.25 () {56 vars in 1099 bytes} [Tue Sep 13 19:37:03 2022] GET /identity/v3/users/cinder => generated 84 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:37:04.004604 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cabdd085-aa51-4d4f-88d4-9b3a2d79b79b None admin] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:37:04.090797 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae9089c-d12f-4997-be02-2ddbc9bf5471 None None] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:37:04.123286 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cabdd085-aa51-4d4f-88d4-9b3a2d79b79b None admin] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:37:04.134178 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d747bd-8f00-4a3d-9c07-ec771fccb0d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:37:04.134707 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d747bd-8f00-4a3d-9c07-ec771fccb0d0 None admin] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:37:04.135009 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d747bd-8f00-4a3d-9c07-ec771fccb0d0 None admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:37:04.135383 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d747bd-8f00-4a3d-9c07-ec771fccb0d0 None admin] PATH_INFO: `/v3/domains` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:37:04.136130 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d747bd-8f00-4a3d-9c07-ec771fccb0d0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87934) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:37:04.136563 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d747bd-8f00-4a3d-9c07-ec771fccb0d0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:37:04.138049 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d747bd-8f00-4a3d-9c07-ec771fccb0d0 None admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:37:04.155849 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 506/984] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Sep 13 19:37:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:37:04.157050 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d747bd-8f00-4a3d-9c07-ec771fccb0d0 None admin] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:37:04.164769 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG dbcounter [-] [87935] Writing DB stats keystone:SELECT=100 {{(pid=87935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:37:04.174359 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e6e16b-459e-452a-903e-07efb245fc66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:37:04.175960 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e6e16b-459e-452a-903e-07efb245fc66 None admin] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:37:04.177375 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e6e16b-459e-452a-903e-07efb245fc66 None admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:37:04.177994 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e6e16b-459e-452a-903e-07efb245fc66 None admin] PATH_INFO: `/v3/users` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:37:04.179906 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e6e16b-459e-452a-903e-07efb245fc66 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=87935) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:37:04.180961 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e6e16b-459e-452a-903e-07efb245fc66 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:37:04.183638 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e6e16b-459e-452a-903e-07efb245fc66 None admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:37:04.197170 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG dbcounter [-] [87934] Writing DB stats keystone:SELECT=100 {{(pid=87934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:37:04.239130 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 479/985] 10.222.0.25 () {56 vars in 1101 bytes} [Tue Sep 13 19:37:04 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:37:04.240249 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e6e16b-459e-452a-903e-07efb245fc66 None admin] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:37:04.316955 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d747bd-8f00-4a3d-9c07-ec771fccb0d0 None admin] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:37:04.373238 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a62b22-0195-4cf4-bb05-a7a98a226cdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:37:04.373997 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a62b22-0195-4cf4-bb05-a7a98a226cdf None admin] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:37:04.375425 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a62b22-0195-4cf4-bb05-a7a98a226cdf None admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:37:04.375857 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a62b22-0195-4cf4-bb05-a7a98a226cdf None admin] PATH_INFO: `/v3/projects/service` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:37:04.385905 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a62b22-0195-4cf4-bb05-a7a98a226cdf None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:37:04.387553 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a62b22-0195-4cf4-bb05-a7a98a226cdf None admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:37:04.405128 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application [None req-e2a62b22-0195-4cf4-bb05-a7a98a226cdf None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 19:37:04.405128 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:37:04.405128 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:37:04.405128 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:37:04.405128 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:37:04.405128 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:37:04.405128 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:37:04.405128 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:37:04.405128 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:37:04.405128 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:37:04.405128 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:37:04.405128 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:37:04.405128 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 13 19:37:04.405128 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 13 19:37:04.405128 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 13 19:37:04.406295 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 13 19:37:04.406295 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:37:04.406295 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:37:04.406295 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:37:04.406295 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:37:04.406295 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:37:04.406295 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:37:04.406295 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:37:04.406295 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application with Lock( Sep 13 19:37:04.406295 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:37:04.406295 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:37:04.406295 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:37:04.406295 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:37:04.406295 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:37:04.406295 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:37:04.406295 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:37:04.406295 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:37:04.407408 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 13 19:37:04.407408 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 13 19:37:04.407408 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 13 19:37:04.407408 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 13 19:37:04.407408 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 13 19:37:04.407408 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 13 19:37:04.407408 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 19:37:04.407408 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application Sep 13 19:37:04.410581 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 507/986] 10.222.0.25 () {56 vars in 1111 bytes} [Tue Sep 13 19:37:04 2022] GET /identity/v3/projects/service => generated 88 bytes in 254 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:37:04.418231 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a62b22-0195-4cf4-bb05-a7a98a226cdf None admin] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:37:04.430677 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e6e16b-459e-452a-903e-07efb245fc66 None admin] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:37:04.491199 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d485018b-65ed-4942-b4ce-e1c67674afd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:37:04.491844 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d485018b-65ed-4942-b4ce-e1c67674afd4 None admin] REQUEST_METHOD: `POST` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:37:04.492137 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d485018b-65ed-4942-b4ce-e1c67674afd4 None admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:37:04.492439 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d485018b-65ed-4942-b4ce-e1c67674afd4 None admin] PATH_INFO: `/v3/services` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:37:04.493120 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d485018b-65ed-4942-b4ce-e1c67674afd4 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:37:04.494616 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d485018b-65ed-4942-b4ce-e1c67674afd4 None admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:37:04.516267 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 480/987] 10.222.0.25 () {60 vars in 1141 bytes} [Tue Sep 13 19:37:04 2022] POST /identity/v3/services => generated 242 bytes in 276 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 19:37:04.560849 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG dbcounter [-] [87934] Writing DB stats keystone:SELECT=100 {{(pid=87934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:37:04.576184 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a62b22-0195-4cf4-bb05-a7a98a226cdf None admin] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:37:04.627961 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784d7be9-9f4c-42c3-b420-3ab83254391b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:37:04.629179 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784d7be9-9f4c-42c3-b420-3ab83254391b None admin] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:37:04.629550 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784d7be9-9f4c-42c3-b420-3ab83254391b None admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:37:04.630061 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784d7be9-9f4c-42c3-b420-3ab83254391b None admin] PATH_INFO: `/v3/projects` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:37:04.630863 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-784d7be9-9f4c-42c3-b420-3ab83254391b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87934) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:37:04.631321 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-784d7be9-9f4c-42c3-b420-3ab83254391b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:37:04.633149 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-784d7be9-9f4c-42c3-b420-3ab83254391b None admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:37:04.649930 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 508/988] 10.222.0.25 () {56 vars in 1148 bytes} [Tue Sep 13 19:37:04 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:37:04.656011 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d485018b-65ed-4942-b4ce-e1c67674afd4 None admin] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:37:04.723049 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG dbcounter [-] [87935] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:37:04.785437 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d485018b-65ed-4942-b4ce-e1c67674afd4 None admin] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:37:04.823880 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa2857e-c0ca-4ac7-9ff4-31370c74c7e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:37:04.824568 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa2857e-c0ca-4ac7-9ff4-31370c74c7e5 None admin] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:37:04.824843 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa2857e-c0ca-4ac7-9ff4-31370c74c7e5 None admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:37:04.825107 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa2857e-c0ca-4ac7-9ff4-31370c74c7e5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:37:04.825826 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa2857e-c0ca-4ac7-9ff4-31370c74c7e5 None admin] RBAC: Adding query filter params (role.id=14ffeae2f0594a2c9da6bfd35829457e, scope.project.id=9a10a4268f3c4cb29f4e00c292e2df62, user.id=d44977a3225e43f19cdc4a84f0e170cd) {{(pid=87935) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:37:04.826126 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa2857e-c0ca-4ac7-9ff4-31370c74c7e5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:37:04.827540 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa2857e-c0ca-4ac7-9ff4-31370c74c7e5 None admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:37:04.834698 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 481/989] 10.222.0.25 () {56 vars in 1374 bytes} [Tue Sep 13 19:37:04 2022] GET /identity/v3/role_assignments?user.id=d44977a3225e43f19cdc4a84f0e170cd&scope.project.id=9a10a4268f3c4cb29f4e00c292e2df62&role.id=14ffeae2f0594a2c9da6bfd35829457e => generated 608 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:37:05.802829 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687a5880-3bfc-453f-81de-4355cda8340e None None] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:37:05.803361 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687a5880-3bfc-453f-81de-4355cda8340e None None] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:37:05.803361 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687a5880-3bfc-453f-81de-4355cda8340e None None] PATH_INFO: `/` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:37:05.804897 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 509/990] 10.222.0.25 () {54 vars in 927 bytes} [Tue Sep 13 19:37:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:37:05.810443 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e158c2-61ce-4b2a-8f52-72e06cf7b3ee None None] REQUEST_METHOD: `POST` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:37:05.810882 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e158c2-61ce-4b2a-8f52-72e06cf7b3ee None None] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:37:05.811087 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e158c2-61ce-4b2a-8f52-72e06cf7b3ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:37:05.829614 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.auth.core [None req-47e158c2-61ce-4b2a-8f52-72e06cf7b3ee None None] MFA Rules not processed for user `7b0aed92d02344acb92a0e4aa67c3068`. Rule list: `[]` (Enabled: `True`). {{(pid=87935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:37:05.831136 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.fernet_utils [None req-47e158c2-61ce-4b2a-8f52-72e06cf7b3ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:37:05.904000 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 482/991] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Sep 13 19:37:05 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 13 19:37:06.173761 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687a5880-3bfc-453f-81de-4355cda8340e None None] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:37:06.290878 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687a5880-3bfc-453f-81de-4355cda8340e None None] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:37:06.328890 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c11a789-3ff7-4fc4-8ae5-957511cc68cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:37:06.329529 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c11a789-3ff7-4fc4-8ae5-957511cc68cd None admin] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:37:06.329799 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c11a789-3ff7-4fc4-8ae5-957511cc68cd None admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:37:06.330070 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c11a789-3ff7-4fc4-8ae5-957511cc68cd None admin] PATH_INFO: `/v3/services/object-store` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:37:06.330654 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c11a789-3ff7-4fc4-8ae5-957511cc68cd None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:37:06.332969 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c11a789-3ff7-4fc4-8ae5-957511cc68cd None admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:37:06.342215 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application [None req-3c11a789-3ff7-4fc4-8ae5-957511cc68cd None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 13 19:37:06.342215 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:37:06.342215 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 13 19:37:06.342215 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 13 19:37:06.342215 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 13 19:37:06.342215 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 13 19:37:06.342215 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 13 19:37:06.342215 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 19:37:06.342215 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 13 19:37:06.342215 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application Sep 13 19:37:06.342215 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 13 19:37:06.342215 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application Sep 13 19:37:06.342215 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:37:06.342215 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:37:06.342215 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:37:06.342215 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:37:06.342215 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:37:06.343223 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:37:06.343223 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:37:06.343223 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:37:06.343223 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:37:06.343223 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:37:06.343223 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:37:06.343223 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 13 19:37:06.343223 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 13 19:37:06.343223 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 13 19:37:06.343223 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 13 19:37:06.343223 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:37:06.343223 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:37:06.343223 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:37:06.343223 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:37:06.343223 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:37:06.343223 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:37:06.345088 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:37:06.345088 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application with Lock( Sep 13 19:37:06.345088 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:37:06.345088 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:37:06.345088 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:37:06.345088 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:37:06.345088 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:37:06.345088 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:37:06.345088 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:37:06.345088 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:37:06.345088 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 13 19:37:06.345088 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 19:37:06.345088 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 13 19:37:06.345088 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application Sep 13 19:37:06.345088 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 510/992] 10.222.0.25 () {56 vars in 1126 bytes} [Tue Sep 13 19:37:06 2022] GET /identity/v3/services/object-store => generated 93 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:37:06.351117 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e158c2-61ce-4b2a-8f52-72e06cf7b3ee None None] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:37:06.419313 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG dbcounter [-] [87935] Writing DB stats keystone:SELECT=100 {{(pid=87935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:37:06.482529 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e158c2-61ce-4b2a-8f52-72e06cf7b3ee None None] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:37:06.525074 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04590965-fe3f-465b-9498-b5694bcaa1e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:37:06.525687 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04590965-fe3f-465b-9498-b5694bcaa1e7 None admin] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:37:06.525966 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04590965-fe3f-465b-9498-b5694bcaa1e7 None admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:37:06.526230 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04590965-fe3f-465b-9498-b5694bcaa1e7 None admin] PATH_INFO: `/v3/services` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:37:06.526895 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04590965-fe3f-465b-9498-b5694bcaa1e7 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=87935) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:37:06.527196 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04590965-fe3f-465b-9498-b5694bcaa1e7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:37:06.528602 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04590965-fe3f-465b-9498-b5694bcaa1e7 None admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:37:06.538952 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 483/993] 10.222.0.25 () {56 vars in 1122 bytes} [Tue Sep 13 19:37:06 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 19:37:06.540519 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c11a789-3ff7-4fc4-8ae5-957511cc68cd None admin] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:37:06.553375 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG dbcounter [-] [87934] Writing DB stats keystone:SELECT=100 {{(pid=87934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:37:06.646699 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c11a789-3ff7-4fc4-8ae5-957511cc68cd None admin] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:37:06.683694 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6c5fc2-5fad-434f-931f-d6f0436ac184 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:37:06.684327 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6c5fc2-5fad-434f-931f-d6f0436ac184 None admin] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:37:06.684607 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6c5fc2-5fad-434f-931f-d6f0436ac184 None admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:37:06.684872 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6c5fc2-5fad-434f-931f-d6f0436ac184 None admin] PATH_INFO: `/v3/services` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:37:06.685493 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf6c5fc2-5fad-434f-931f-d6f0436ac184 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=87934) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:37:06.685794 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf6c5fc2-5fad-434f-931f-d6f0436ac184 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:37:06.687169 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf6c5fc2-5fad-434f-931f-d6f0436ac184 None admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:37:06.697208 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 511/994] 10.222.0.25 () {56 vars in 1122 bytes} [Tue Sep 13 19:37:06 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 19:37:06.698750 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04590965-fe3f-465b-9498-b5694bcaa1e7 None admin] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:37:06.761035 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be23274-d5d0-46a4-b8d1-b82bf4232f55 None None] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:37:06.761351 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be23274-d5d0-46a4-b8d1-b82bf4232f55 None None] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:37:06.761518 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be23274-d5d0-46a4-b8d1-b82bf4232f55 None None] PATH_INFO: `/` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:37:06.762942 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 512/995] 10.222.0.25 () {54 vars in 927 bytes} [Tue Sep 13 19:37:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 13 19:37:06.767552 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4248cbc5-7790-45df-8912-68717f358df9 None None] REQUEST_METHOD: `POST` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:37:06.767833 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4248cbc5-7790-45df-8912-68717f358df9 None None] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:37:06.768103 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4248cbc5-7790-45df-8912-68717f358df9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:37:06.786845 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.auth.core [None req-4248cbc5-7790-45df-8912-68717f358df9 None None] MFA Rules not processed for user `7b0aed92d02344acb92a0e4aa67c3068`. Rule list: `[]` (Enabled: `True`). {{(pid=87934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:37:06.788008 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.fernet_utils [None req-4248cbc5-7790-45df-8912-68717f358df9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:37:06.806529 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04590965-fe3f-465b-9498-b5694bcaa1e7 None admin] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:37:06.814572 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG dbcounter [-] [87935] Writing DB stats keystone:SELECT=100 {{(pid=87935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:37:06.845788 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12763330-8f5a-4b06-8274-4fbbfa7b2177 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:37:06.846712 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12763330-8f5a-4b06-8274-4fbbfa7b2177 None admin] REQUEST_METHOD: `POST` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:37:06.847349 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12763330-8f5a-4b06-8274-4fbbfa7b2177 None admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:37:06.847621 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12763330-8f5a-4b06-8274-4fbbfa7b2177 None admin] PATH_INFO: `/v3/endpoints` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:37:06.848457 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12763330-8f5a-4b06-8274-4fbbfa7b2177 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:37:06.849760 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12763330-8f5a-4b06-8274-4fbbfa7b2177 None admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:37:06.862166 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 513/996] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Sep 13 19:37:06 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 13 19:37:06.876252 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 484/997] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Sep 13 19:37:06 2022] POST /identity/v3/endpoints => generated 325 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 19:37:07.140523 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4248cbc5-7790-45df-8912-68717f358df9 None None] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:37:07.144510 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG dbcounter [-] [87934] Writing DB stats keystone:SELECT=100 {{(pid=87934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:37:07.153968 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9084f7-9e2c-4a2a-9359-f03cf8d0c36f None None] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:37:07.154264 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9084f7-9e2c-4a2a-9359-f03cf8d0c36f None None] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:37:07.154541 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9084f7-9e2c-4a2a-9359-f03cf8d0c36f None None] PATH_INFO: `/` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:37:07.156114 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 485/998] 10.222.0.25 () {54 vars in 927 bytes} [Tue Sep 13 19:37:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 13 19:37:07.162510 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2e611d-adeb-4a52-a0be-10afa5ff675b None None] REQUEST_METHOD: `POST` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:37:07.162843 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2e611d-adeb-4a52-a0be-10afa5ff675b None None] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:37:07.163073 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2e611d-adeb-4a52-a0be-10afa5ff675b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:37:07.181567 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.auth.core [None req-0c2e611d-adeb-4a52-a0be-10afa5ff675b None None] MFA Rules not processed for user `7b0aed92d02344acb92a0e4aa67c3068`. Rule list: `[]` (Enabled: `True`). {{(pid=87935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:37:07.182779 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.fernet_utils [None req-0c2e611d-adeb-4a52-a0be-10afa5ff675b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:37:07.270169 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4248cbc5-7790-45df-8912-68717f358df9 None None] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:37:07.270531 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 486/999] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Sep 13 19:37:07 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 13 19:37:07.312799 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7849cf2-59ba-4611-987d-ec10ba1c20c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:37:07.313470 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7849cf2-59ba-4611-987d-ec10ba1c20c6 None admin] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:37:07.313751 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7849cf2-59ba-4611-987d-ec10ba1c20c6 None admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:37:07.314023 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7849cf2-59ba-4611-987d-ec10ba1c20c6 None admin] PATH_INFO: `/v3/services/compute` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:37:07.314649 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7849cf2-59ba-4611-987d-ec10ba1c20c6 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:37:07.316373 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7849cf2-59ba-4611-987d-ec10ba1c20c6 None admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:37:07.325531 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application [None req-b7849cf2-59ba-4611-987d-ec10ba1c20c6 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Sep 13 19:37:07.325531 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:37:07.325531 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 13 19:37:07.325531 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 13 19:37:07.325531 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 13 19:37:07.325531 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 13 19:37:07.325531 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 13 19:37:07.325531 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 19:37:07.325531 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 13 19:37:07.325531 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application Sep 13 19:37:07.325531 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 13 19:37:07.325531 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application Sep 13 19:37:07.325531 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:37:07.325531 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:37:07.325531 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:37:07.325531 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:37:07.325531 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:37:07.326576 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:37:07.326576 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:37:07.326576 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:37:07.326576 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:37:07.326576 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:37:07.326576 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:37:07.326576 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 13 19:37:07.326576 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 13 19:37:07.326576 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 13 19:37:07.326576 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 13 19:37:07.326576 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:37:07.326576 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:37:07.326576 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:37:07.326576 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:37:07.326576 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:37:07.326576 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:37:07.333713 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:37:07.333713 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application with Lock( Sep 13 19:37:07.333713 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:37:07.333713 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:37:07.333713 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:37:07.333713 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:37:07.333713 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:37:07.333713 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:37:07.333713 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:37:07.333713 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:37:07.333713 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 13 19:37:07.333713 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 19:37:07.333713 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 13 19:37:07.333713 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application Sep 13 19:37:07.333713 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 514/1000] 10.222.0.25 () {56 vars in 1111 bytes} [Tue Sep 13 19:37:07 2022] GET /identity/v3/services/compute => generated 88 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:37:07.334553 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2e611d-adeb-4a52-a0be-10afa5ff675b None None] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:37:07.433876 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG dbcounter [-] [87935] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:37:07.446148 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2e611d-adeb-4a52-a0be-10afa5ff675b None None] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:37:07.483710 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af15c717-f3ca-4399-a51d-85ddbfef2af8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:37:07.484356 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af15c717-f3ca-4399-a51d-85ddbfef2af8 None admin] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:37:07.484637 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af15c717-f3ca-4399-a51d-85ddbfef2af8 None admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:37:07.484908 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af15c717-f3ca-4399-a51d-85ddbfef2af8 None admin] PATH_INFO: `/v3/services` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:37:07.485542 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af15c717-f3ca-4399-a51d-85ddbfef2af8 None admin] RBAC: Adding query filter params (name=compute) {{(pid=87935) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:37:07.485843 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af15c717-f3ca-4399-a51d-85ddbfef2af8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:37:07.487238 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af15c717-f3ca-4399-a51d-85ddbfef2af8 None admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:37:07.493561 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 487/1001] 10.222.0.25 () {56 vars in 1112 bytes} [Tue Sep 13 19:37:07 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:37:07.499233 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7849cf2-59ba-4611-987d-ec10ba1c20c6 None admin] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:37:07.543004 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af15c717-f3ca-4399-a51d-85ddbfef2af8 None admin] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:37:07.579551 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG dbcounter [-] [87934] Writing DB stats keystone:SELECT=100 {{(pid=87934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:37:07.621989 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7849cf2-59ba-4611-987d-ec10ba1c20c6 None admin] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:37:07.652590 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af15c717-f3ca-4399-a51d-85ddbfef2af8 None admin] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:37:07.657880 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039ff84b-b980-4884-a520-b5fd2fa6cc57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:37:07.658500 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039ff84b-b980-4884-a520-b5fd2fa6cc57 None admin] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:37:07.658772 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039ff84b-b980-4884-a520-b5fd2fa6cc57 None admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:37:07.659037 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039ff84b-b980-4884-a520-b5fd2fa6cc57 None admin] PATH_INFO: `/v3/services` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:37:07.660280 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-039ff84b-b980-4884-a520-b5fd2fa6cc57 None admin] RBAC: Adding query filter params (type=compute) {{(pid=87934) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:37:07.660573 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-039ff84b-b980-4884-a520-b5fd2fa6cc57 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:37:07.661936 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-039ff84b-b980-4884-a520-b5fd2fa6cc57 None admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:37:07.667245 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 515/1002] 10.222.0.25 () {56 vars in 1112 bytes} [Tue Sep 13 19:37:07 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:37:07.673176 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039ff84b-b980-4884-a520-b5fd2fa6cc57 None admin] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:37:07.690554 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d675d900-7576-49df-ab3e-90b5ff91a651 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:37:07.691093 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d675d900-7576-49df-ab3e-90b5ff91a651 None admin] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:37:07.691366 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d675d900-7576-49df-ab3e-90b5ff91a651 None admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:37:07.691632 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d675d900-7576-49df-ab3e-90b5ff91a651 None admin] PATH_INFO: `/v3/services/image` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:37:07.692229 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d675d900-7576-49df-ab3e-90b5ff91a651 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:37:07.693612 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d675d900-7576-49df-ab3e-90b5ff91a651 None admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:37:07.706950 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application [None req-d675d900-7576-49df-ab3e-90b5ff91a651 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Sep 13 19:37:07.706950 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:37:07.706950 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 13 19:37:07.706950 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 13 19:37:07.706950 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 13 19:37:07.706950 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 13 19:37:07.706950 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 13 19:37:07.706950 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 19:37:07.706950 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 13 19:37:07.706950 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application Sep 13 19:37:07.706950 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 13 19:37:07.706950 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application Sep 13 19:37:07.706950 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:37:07.706950 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:37:07.706950 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:37:07.706950 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:37:07.706950 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:37:07.708470 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:37:07.708470 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:37:07.708470 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:37:07.708470 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:37:07.708470 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:37:07.708470 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:37:07.708470 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 13 19:37:07.708470 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 13 19:37:07.708470 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 13 19:37:07.708470 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 13 19:37:07.708470 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:37:07.708470 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:37:07.708470 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:37:07.708470 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:37:07.708470 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:37:07.708470 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:37:07.709376 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:37:07.709376 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application with Lock( Sep 13 19:37:07.709376 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:37:07.709376 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:37:07.709376 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:37:07.709376 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:37:07.709376 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:37:07.709376 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:37:07.709376 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:37:07.709376 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:37:07.709376 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 13 19:37:07.709376 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 19:37:07.709376 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 13 19:37:07.709376 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application Sep 13 19:37:07.715229 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 488/1003] 10.222.0.25 () {56 vars in 1105 bytes} [Tue Sep 13 19:37:07 2022] GET /identity/v3/services/image => generated 86 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 13 19:37:07.716200 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d675d900-7576-49df-ab3e-90b5ff91a651 None admin] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:37:07.742257 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG dbcounter [-] [87935] Writing DB stats keystone:SELECT=100 {{(pid=87935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:37:07.796672 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039ff84b-b980-4884-a520-b5fd2fa6cc57 None admin] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:37:07.830020 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG dbcounter [-] [87934] Writing DB stats keystone:SELECT=100 {{(pid=87934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:37:07.833819 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d675d900-7576-49df-ab3e-90b5ff91a651 None admin] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:37:07.837974 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a6e2e4-41f4-490b-903a-32cc995ef6c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:37:07.838819 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a6e2e4-41f4-490b-903a-32cc995ef6c6 None admin] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:37:07.839285 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a6e2e4-41f4-490b-903a-32cc995ef6c6 None admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:37:07.839759 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a6e2e4-41f4-490b-903a-32cc995ef6c6 None admin] PATH_INFO: `/v3/endpoints` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:37:07.840680 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a6e2e4-41f4-490b-903a-32cc995ef6c6 None admin] RBAC: Adding query filter params (interface=public, service_id=274be06d02f24798937b4e2701a00e23, region_id=RegionOne) {{(pid=87934) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:37:07.841333 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a6e2e4-41f4-490b-903a-32cc995ef6c6 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:37:07.842701 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a6e2e4-41f4-490b-903a-32cc995ef6c6 None admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:37:07.854155 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 516/1004] 10.222.0.25 () {56 vars in 1251 bytes} [Tue Sep 13 19:37:07 2022] GET /identity/v3/endpoints?service_id=274be06d02f24798937b4e2701a00e23&interface=public®ion_id=RegionOne => generated 194 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:37:07.855236 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a6e2e4-41f4-490b-903a-32cc995ef6c6 None admin] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:37:07.875067 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7437305-c01d-4f7c-8d61-e060dfdce591 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:37:07.875673 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7437305-c01d-4f7c-8d61-e060dfdce591 None admin] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:37:07.875943 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7437305-c01d-4f7c-8d61-e060dfdce591 None admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:37:07.876234 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7437305-c01d-4f7c-8d61-e060dfdce591 None admin] PATH_INFO: `/v3/services` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:37:07.876864 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7437305-c01d-4f7c-8d61-e060dfdce591 None admin] RBAC: Adding query filter params (name=image) {{(pid=87935) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:37:07.877147 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7437305-c01d-4f7c-8d61-e060dfdce591 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:37:07.878561 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7437305-c01d-4f7c-8d61-e060dfdce591 None admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:37:07.883527 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 489/1005] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Sep 13 19:37:07 2022] GET /identity/v3/services?name=image => generated 122 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:37:07.889075 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7437305-c01d-4f7c-8d61-e060dfdce591 None admin] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:37:07.966002 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a6e2e4-41f4-490b-903a-32cc995ef6c6 None admin] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:37:07.984162 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG dbcounter [-] [87935] Writing DB stats keystone:SELECT=100 {{(pid=87935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:37:08.005499 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5c4b3d-308e-4c3f-8fec-750c401c3c9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:37:08.006108 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5c4b3d-308e-4c3f-8fec-750c401c3c9b None admin] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:37:08.006387 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5c4b3d-308e-4c3f-8fec-750c401c3c9b None admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:37:08.006657 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5c4b3d-308e-4c3f-8fec-750c401c3c9b None admin] PATH_INFO: `/v3/services` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:37:08.007257 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b5c4b3d-308e-4c3f-8fec-750c401c3c9b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:37:08.008649 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b5c4b3d-308e-4c3f-8fec-750c401c3c9b None admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:37:08.012634 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7437305-c01d-4f7c-8d61-e060dfdce591 None admin] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:37:08.015098 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 517/1006] 10.222.0.25 () {56 vars in 1087 bytes} [Tue Sep 13 19:37:07 2022] GET /identity/v3/services => generated 1727 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 13 19:37:08.056128 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26bf340f-c863-4a01-8571-36be58dae500 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:37:08.056788 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bf340f-c863-4a01-8571-36be58dae500 None admin] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:37:08.057062 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bf340f-c863-4a01-8571-36be58dae500 None admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:37:08.057327 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bf340f-c863-4a01-8571-36be58dae500 None admin] PATH_INFO: `/v3/services` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:37:08.057966 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26bf340f-c863-4a01-8571-36be58dae500 None admin] RBAC: Adding query filter params (type=image) {{(pid=87935) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:37:08.058265 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26bf340f-c863-4a01-8571-36be58dae500 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:37:08.059648 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26bf340f-c863-4a01-8571-36be58dae500 None admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:37:08.065013 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 490/1007] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Sep 13 19:37:07 2022] GET /identity/v3/services?type=image => generated 122 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 19:37:09.241890 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a87d822-d85f-432b-8b85-1d1438cd4c82 None None] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:37:09.242460 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a87d822-d85f-432b-8b85-1d1438cd4c82 None None] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:37:09.242460 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a87d822-d85f-432b-8b85-1d1438cd4c82 None None] PATH_INFO: `/` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:37:09.243888 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 518/1008] 10.222.0.25 () {54 vars in 927 bytes} [Tue Sep 13 19:37:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:37:09.252603 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f53ecc-ffcb-40ae-804b-398d91a11ff9 None None] REQUEST_METHOD: `POST` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:37:09.253183 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f53ecc-ffcb-40ae-804b-398d91a11ff9 None None] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:37:09.253624 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f53ecc-ffcb-40ae-804b-398d91a11ff9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:37:09.283333 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.auth.core [None req-d9f53ecc-ffcb-40ae-804b-398d91a11ff9 None None] MFA Rules not processed for user `7b0aed92d02344acb92a0e4aa67c3068`. Rule list: `[]` (Enabled: `True`). {{(pid=87935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:37:09.285944 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.fernet_utils [None req-d9f53ecc-ffcb-40ae-804b-398d91a11ff9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:37:09.383192 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 491/1009] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Sep 13 19:37:09 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 13 19:37:09.656941 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a87d822-d85f-432b-8b85-1d1438cd4c82 None None] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:37:09.725607 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG dbcounter [-] [87934] Writing DB stats keystone:SELECT=100 {{(pid=87934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:37:09.800886 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a87d822-d85f-432b-8b85-1d1438cd4c82 None None] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:37:09.836545 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1222392-4dd8-4473-992d-7607dc8b48da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:37:09.837189 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1222392-4dd8-4473-992d-7607dc8b48da None admin] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:37:09.837522 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1222392-4dd8-4473-992d-7607dc8b48da None admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:37:09.837805 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1222392-4dd8-4473-992d-7607dc8b48da None admin] PATH_INFO: `/v3/domains/default` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:37:09.838925 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1222392-4dd8-4473-992d-7607dc8b48da None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:37:09.840393 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1222392-4dd8-4473-992d-7607dc8b48da None admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:37:09.842132 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 519/1010] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Sep 13 19:37:09 2022] GET /identity/v3/domains/default => generated 199 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:37:09.848786 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f53ecc-ffcb-40ae-804b-398d91a11ff9 None None] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:37:09.939048 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG dbcounter [-] [87935] Writing DB stats keystone:SELECT=100 {{(pid=87935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:37:09.964932 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f53ecc-ffcb-40ae-804b-398d91a11ff9 None None] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:37:10.002788 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adec91c4-8018-406f-96e3-10a1454a58b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:37:10.004144 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adec91c4-8018-406f-96e3-10a1454a58b9 None admin] REQUEST_METHOD: `POST` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:37:10.004616 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adec91c4-8018-406f-96e3-10a1454a58b9 None admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:37:10.005048 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adec91c4-8018-406f-96e3-10a1454a58b9 None admin] PATH_INFO: `/v3/projects` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:37:10.005884 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adec91c4-8018-406f-96e3-10a1454a58b9 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:37:10.007478 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adec91c4-8018-406f-96e3-10a1454a58b9 None admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:37:10.040407 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 492/1011] 10.222.0.25 () {60 vars in 1141 bytes} [Tue Sep 13 19:37:09 2022] POST /identity/v3/projects => generated 311 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 19:37:10.303989 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8414f2-4206-4948-abcc-f93eb0804221 None None] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:37:10.304472 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8414f2-4206-4948-abcc-f93eb0804221 None None] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:37:10.304553 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8414f2-4206-4948-abcc-f93eb0804221 None None] PATH_INFO: `/` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:37:10.306071 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 520/1012] 10.222.0.25 () {54 vars in 927 bytes} [Tue Sep 13 19:37:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:37:10.311273 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8a64e1-7def-44a7-81b8-0c4a62e7a55b None None] REQUEST_METHOD: `POST` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:37:10.311692 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8a64e1-7def-44a7-81b8-0c4a62e7a55b None None] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:37:10.311875 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8a64e1-7def-44a7-81b8-0c4a62e7a55b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:37:10.330513 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.auth.core [None req-df8a64e1-7def-44a7-81b8-0c4a62e7a55b None None] MFA Rules not processed for user `7b0aed92d02344acb92a0e4aa67c3068`. Rule list: `[]` (Enabled: `True`). {{(pid=87935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:37:10.332525 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.fernet_utils [None req-df8a64e1-7def-44a7-81b8-0c4a62e7a55b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:37:10.345404 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93db5da-1312-4cf2-9e37-a1824c7d8036 None None] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:37:10.345719 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93db5da-1312-4cf2-9e37-a1824c7d8036 None None] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:37:10.345957 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93db5da-1312-4cf2-9e37-a1824c7d8036 None None] PATH_INFO: `/` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:37:10.348067 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 521/1013] 10.222.0.25 () {54 vars in 927 bytes} [Tue Sep 13 19:37:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:37:10.353127 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ddeb7a-6b16-4a09-a79f-de69d8bc0467 None None] REQUEST_METHOD: `POST` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:37:10.353410 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ddeb7a-6b16-4a09-a79f-de69d8bc0467 None None] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:37:10.353674 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ddeb7a-6b16-4a09-a79f-de69d8bc0467 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:37:10.373037 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.auth.core [None req-c3ddeb7a-6b16-4a09-a79f-de69d8bc0467 None None] MFA Rules not processed for user `7b0aed92d02344acb92a0e4aa67c3068`. Rule list: `[]` (Enabled: `True`). {{(pid=87934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:37:10.374252 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.fernet_utils [None req-c3ddeb7a-6b16-4a09-a79f-de69d8bc0467 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:37:10.406036 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 493/1014] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Sep 13 19:37:10 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 13 19:37:10.449544 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 522/1015] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Sep 13 19:37:10 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 13 19:37:10.678722 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8a64e1-7def-44a7-81b8-0c4a62e7a55b None None] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:37:10.719479 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ddeb7a-6b16-4a09-a79f-de69d8bc0467 None None] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:37:10.748334 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG dbcounter [-] [87935] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:37:10.791866 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG dbcounter [-] [87934] Writing DB stats keystone:SELECT=100 {{(pid=87934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:37:10.798643 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8a64e1-7def-44a7-81b8-0c4a62e7a55b None None] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:37:10.838503 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b286da-ba8c-4f57-8c91-f9197d1f9817 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:37:10.839314 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b286da-ba8c-4f57-8c91-f9197d1f9817 None admin] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:37:10.839631 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b286da-ba8c-4f57-8c91-f9197d1f9817 None admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:37:10.840159 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b286da-ba8c-4f57-8c91-f9197d1f9817 None admin] PATH_INFO: `/v3/services/compute` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:37:10.840934 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b286da-ba8c-4f57-8c91-f9197d1f9817 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:37:10.842530 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b286da-ba8c-4f57-8c91-f9197d1f9817 None admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:37:10.843494 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ddeb7a-6b16-4a09-a79f-de69d8bc0467 None None] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:37:10.853951 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application [None req-93b286da-ba8c-4f57-8c91-f9197d1f9817 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Sep 13 19:37:10.853951 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:37:10.853951 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 13 19:37:10.853951 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 13 19:37:10.853951 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 13 19:37:10.853951 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 13 19:37:10.853951 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 13 19:37:10.853951 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 19:37:10.853951 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 13 19:37:10.853951 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application Sep 13 19:37:10.853951 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 13 19:37:10.853951 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application Sep 13 19:37:10.853951 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:37:10.853951 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:37:10.853951 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:37:10.853951 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:37:10.853951 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:37:10.855000 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:37:10.855000 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:37:10.855000 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:37:10.855000 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:37:10.855000 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:37:10.855000 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:37:10.855000 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 13 19:37:10.855000 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 13 19:37:10.855000 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 13 19:37:10.855000 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 13 19:37:10.855000 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:37:10.855000 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:37:10.855000 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:37:10.855000 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:37:10.855000 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:37:10.855000 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:37:10.855860 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:37:10.855860 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application with Lock( Sep 13 19:37:10.855860 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:37:10.855860 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:37:10.855860 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:37:10.855860 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:37:10.855860 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:37:10.855860 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:37:10.855860 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:37:10.855860 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:37:10.855860 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 13 19:37:10.855860 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 19:37:10.855860 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 13 19:37:10.855860 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application Sep 13 19:37:10.856798 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 494/1016] 10.222.0.25 () {56 vars in 1111 bytes} [Tue Sep 13 19:37:10 2022] GET /identity/v3/services/compute => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:37:10.862840 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b286da-ba8c-4f57-8c91-f9197d1f9817 None admin] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:37:10.894683 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c567efcc-eaac-482a-b879-0dddfc1e88d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:37:10.895322 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c567efcc-eaac-482a-b879-0dddfc1e88d2 None admin] REQUEST_METHOD: `POST` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:37:10.895603 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c567efcc-eaac-482a-b879-0dddfc1e88d2 None admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:37:10.895875 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c567efcc-eaac-482a-b879-0dddfc1e88d2 None admin] PATH_INFO: `/v3/services` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:37:10.896575 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c567efcc-eaac-482a-b879-0dddfc1e88d2 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:37:10.898504 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c567efcc-eaac-482a-b879-0dddfc1e88d2 None admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:37:10.916842 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 523/1017] 10.222.0.25 () {60 vars in 1141 bytes} [Tue Sep 13 19:37:10 2022] POST /identity/v3/services => generated 242 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 13 19:37:11.005094 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b286da-ba8c-4f57-8c91-f9197d1f9817 None admin] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:37:11.041878 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG dbcounter [-] [87935] Writing DB stats keystone:SELECT=100 {{(pid=87935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:37:11.063309 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff7556a-3ee6-4157-9edc-15466bc1a083 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:37:11.063926 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff7556a-3ee6-4157-9edc-15466bc1a083 None admin] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:37:11.064200 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff7556a-3ee6-4157-9edc-15466bc1a083 None admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:37:11.064494 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff7556a-3ee6-4157-9edc-15466bc1a083 None admin] PATH_INFO: `/v3/services` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:37:11.065133 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff7556a-3ee6-4157-9edc-15466bc1a083 None admin] RBAC: Adding query filter params (name=compute) {{(pid=87935) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:37:11.065570 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff7556a-3ee6-4157-9edc-15466bc1a083 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:37:11.067774 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff7556a-3ee6-4157-9edc-15466bc1a083 None admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:37:11.078408 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 495/1018] 10.222.0.25 () {56 vars in 1112 bytes} [Tue Sep 13 19:37:10 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:37:11.079473 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c567efcc-eaac-482a-b879-0dddfc1e88d2 None admin] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:37:11.219933 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c567efcc-eaac-482a-b879-0dddfc1e88d2 None admin] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:37:11.241754 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG dbcounter [-] [87934] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:37:11.270738 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988e0a95-1b42-48bb-aa53-492065043732 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:37:11.271326 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988e0a95-1b42-48bb-aa53-492065043732 None admin] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:37:11.271600 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988e0a95-1b42-48bb-aa53-492065043732 None admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:37:11.271871 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988e0a95-1b42-48bb-aa53-492065043732 None admin] PATH_INFO: `/v3/services` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:37:11.272546 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-988e0a95-1b42-48bb-aa53-492065043732 None admin] RBAC: Adding query filter params (type=compute) {{(pid=87934) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:37:11.272858 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-988e0a95-1b42-48bb-aa53-492065043732 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:37:11.274223 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-988e0a95-1b42-48bb-aa53-492065043732 None admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:37:11.279891 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 524/1019] 10.222.0.25 () {56 vars in 1112 bytes} [Tue Sep 13 19:37:11 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:37:11.286010 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff7556a-3ee6-4157-9edc-15466bc1a083 None admin] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:37:11.411087 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff7556a-3ee6-4157-9edc-15466bc1a083 None admin] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:37:11.446520 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e443aa-d8f5-488d-98e1-8dc2c39bb60b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:37:11.447133 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e443aa-d8f5-488d-98e1-8dc2c39bb60b None admin] REQUEST_METHOD: `POST` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:37:11.447408 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e443aa-d8f5-488d-98e1-8dc2c39bb60b None admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:37:11.447676 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e443aa-d8f5-488d-98e1-8dc2c39bb60b None admin] PATH_INFO: `/v3/endpoints` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:37:11.450001 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e443aa-d8f5-488d-98e1-8dc2c39bb60b None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:37:11.450001 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e443aa-d8f5-488d-98e1-8dc2c39bb60b None admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:37:11.471464 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 496/1020] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Sep 13 19:37:11 2022] POST /identity/v3/endpoints => generated 334 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 19:37:12.373171 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e485b1-3038-46f4-86ac-b8533bcc1401 None None] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:37:12.373716 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e485b1-3038-46f4-86ac-b8533bcc1401 None None] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:37:12.373716 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e485b1-3038-46f4-86ac-b8533bcc1401 None None] PATH_INFO: `/` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:37:12.375067 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 525/1021] 10.222.0.25 () {54 vars in 927 bytes} [Tue Sep 13 19:37:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:37:12.381124 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27555fa3-c213-49dd-9e6e-c6c1f8cd445b None None] REQUEST_METHOD: `POST` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:37:12.381408 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27555fa3-c213-49dd-9e6e-c6c1f8cd445b None None] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:37:12.381680 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27555fa3-c213-49dd-9e6e-c6c1f8cd445b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:37:12.403854 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.auth.core [None req-27555fa3-c213-49dd-9e6e-c6c1f8cd445b None None] MFA Rules not processed for user `7b0aed92d02344acb92a0e4aa67c3068`. Rule list: `[]` (Enabled: `True`). {{(pid=87935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:37:12.403854 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.fernet_utils [None req-27555fa3-c213-49dd-9e6e-c6c1f8cd445b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:37:12.439546 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG dbcounter [-] [87935] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:37:12.487110 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 497/1022] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Sep 13 19:37:12 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 13 19:37:12.760502 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e485b1-3038-46f4-86ac-b8533bcc1401 None None] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:37:12.918468 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e485b1-3038-46f4-86ac-b8533bcc1401 None None] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:37:12.975336 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6955b529-a1dc-456d-916a-b6c33fd43a5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:37:12.976897 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6955b529-a1dc-456d-916a-b6c33fd43a5d None admin] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:37:12.977665 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6955b529-a1dc-456d-916a-b6c33fd43a5d None admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:37:12.978411 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6955b529-a1dc-456d-916a-b6c33fd43a5d None admin] PATH_INFO: `/v3/domains/default` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:37:12.980571 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6955b529-a1dc-456d-916a-b6c33fd43a5d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:37:12.983583 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6955b529-a1dc-456d-916a-b6c33fd43a5d None admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:37:12.992664 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 526/1023] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Sep 13 19:37:12 2022] GET /identity/v3/domains/default => generated 199 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:37:12.997006 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27555fa3-c213-49dd-9e6e-c6c1f8cd445b None None] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:37:13.182530 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27555fa3-c213-49dd-9e6e-c6c1f8cd445b None None] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:37:13.182872 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0e7185-4252-433d-b9f5-122c03aae1c5 None None] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:37:13.183161 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0e7185-4252-433d-b9f5-122c03aae1c5 None None] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:37:13.183434 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0e7185-4252-433d-b9f5-122c03aae1c5 None None] PATH_INFO: `/` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:37:13.185037 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 527/1024] 10.222.0.25 () {54 vars in 927 bytes} [Tue Sep 13 19:37:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 13 19:37:13.190133 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a4145a-231b-4189-a86a-22a17661dff0 None None] REQUEST_METHOD: `POST` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:37:13.190451 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a4145a-231b-4189-a86a-22a17661dff0 None None] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:37:13.190726 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a4145a-231b-4189-a86a-22a17661dff0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:37:13.209395 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.auth.core [None req-76a4145a-231b-4189-a86a-22a17661dff0 None None] MFA Rules not processed for user `7b0aed92d02344acb92a0e4aa67c3068`. Rule list: `[]` (Enabled: `True`). {{(pid=87934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:37:13.210586 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.fernet_utils [None req-76a4145a-231b-4189-a86a-22a17661dff0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:37:13.244253 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82d49eb-1c81-4c2c-b3c0-48eb0f23daea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:37:13.244839 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82d49eb-1c81-4c2c-b3c0-48eb0f23daea None admin] REQUEST_METHOD: `POST` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:37:13.245134 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82d49eb-1c81-4c2c-b3c0-48eb0f23daea None admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:37:13.245456 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82d49eb-1c81-4c2c-b3c0-48eb0f23daea None admin] PATH_INFO: `/v3/users` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:37:13.246022 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d82d49eb-1c81-4c2c-b3c0-48eb0f23daea None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:37:13.248793 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d82d49eb-1c81-4c2c-b3c0-48eb0f23daea None admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:37:13.265333 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG dbcounter [-] [87934] Writing DB stats keystone:SELECT=100 {{(pid=87934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:37:13.276284 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 498/1025] 10.222.0.25 () {60 vars in 1132 bytes} [Tue Sep 13 19:37:12 2022] POST /identity/v3/users => generated 285 bytes in 279 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 19:37:13.306391 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 528/1026] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Sep 13 19:37:13 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 13 19:37:13.578325 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82d49eb-1c81-4c2c-b3c0-48eb0f23daea None admin] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:37:13.606323 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG dbcounter [-] [87935] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:37:13.700739 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82d49eb-1c81-4c2c-b3c0-48eb0f23daea None admin] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:37:13.737428 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b307016-cf30-4d3e-af68-ff114b31db61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:37:13.738056 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b307016-cf30-4d3e-af68-ff114b31db61 None admin] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:37:13.738325 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b307016-cf30-4d3e-af68-ff114b31db61 None admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:37:13.738617 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b307016-cf30-4d3e-af68-ff114b31db61 None admin] PATH_INFO: `/v3/services/image` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:37:13.739159 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b307016-cf30-4d3e-af68-ff114b31db61 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:37:13.740624 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b307016-cf30-4d3e-af68-ff114b31db61 None admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:37:13.750288 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application [None req-9b307016-cf30-4d3e-af68-ff114b31db61 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Sep 13 19:37:13.750288 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:37:13.750288 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 13 19:37:13.750288 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 13 19:37:13.750288 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 13 19:37:13.750288 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 13 19:37:13.750288 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 13 19:37:13.750288 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 19:37:13.750288 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 13 19:37:13.750288 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application Sep 13 19:37:13.750288 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 13 19:37:13.750288 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application Sep 13 19:37:13.750288 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:37:13.750288 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:37:13.750288 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:37:13.750288 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:37:13.750288 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:37:13.753611 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:37:13.753611 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:37:13.753611 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:37:13.753611 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:37:13.753611 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:37:13.753611 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:37:13.753611 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 13 19:37:13.753611 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 13 19:37:13.753611 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 13 19:37:13.753611 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 13 19:37:13.753611 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:37:13.753611 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:37:13.753611 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:37:13.753611 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:37:13.753611 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:37:13.753611 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:37:13.755281 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:37:13.755281 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application with Lock( Sep 13 19:37:13.755281 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:37:13.755281 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:37:13.755281 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:37:13.755281 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:37:13.755281 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:37:13.755281 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:37:13.755281 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:37:13.755281 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:37:13.755281 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 13 19:37:13.755281 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 19:37:13.755281 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 13 19:37:13.755281 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application Sep 13 19:37:13.763502 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 499/1027] 10.222.0.25 () {56 vars in 1105 bytes} [Tue Sep 13 19:37:13 2022] GET /identity/v3/services/image => generated 86 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:37:13.763759 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a4145a-231b-4189-a86a-22a17661dff0 None None] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:37:13.897583 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a4145a-231b-4189-a86a-22a17661dff0 None None] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:37:13.937415 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3fc7e74-a66b-485c-a9fd-fd812d30a75a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:37:13.938036 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fc7e74-a66b-485c-a9fd-fd812d30a75a None admin] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:37:13.938312 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fc7e74-a66b-485c-a9fd-fd812d30a75a None admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:37:13.938580 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fc7e74-a66b-485c-a9fd-fd812d30a75a None admin] PATH_INFO: `/v3/services` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:37:13.939207 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3fc7e74-a66b-485c-a9fd-fd812d30a75a None admin] RBAC: Adding query filter params (name=image) {{(pid=87934) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:37:13.939507 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3fc7e74-a66b-485c-a9fd-fd812d30a75a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:37:13.941736 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3fc7e74-a66b-485c-a9fd-fd812d30a75a None admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:37:13.951876 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 529/1028] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Sep 13 19:37:13 2022] GET /identity/v3/services?name=image => generated 122 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 19:37:13.953227 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b307016-cf30-4d3e-af68-ff114b31db61 None admin] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:37:13.970252 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad49c7f-e6ee-42c1-90c1-ce2704f287aa None None] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:37:13.970554 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad49c7f-e6ee-42c1-90c1-ce2704f287aa None None] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:37:13.970816 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad49c7f-e6ee-42c1-90c1-ce2704f287aa None None] PATH_INFO: `/` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:37:13.972870 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 530/1029] 10.222.0.25 () {54 vars in 927 bytes} [Tue Sep 13 19:37:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 13 19:37:13.977968 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94abb721-80ed-4122-b7f3-85b61032b94e None None] REQUEST_METHOD: `POST` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:37:13.978251 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94abb721-80ed-4122-b7f3-85b61032b94e None None] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:37:13.978523 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94abb721-80ed-4122-b7f3-85b61032b94e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:37:13.997718 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.auth.core [None req-94abb721-80ed-4122-b7f3-85b61032b94e None None] MFA Rules not processed for user `7b0aed92d02344acb92a0e4aa67c3068`. Rule list: `[]` (Enabled: `True`). {{(pid=87934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:37:13.998947 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.fernet_utils [None req-94abb721-80ed-4122-b7f3-85b61032b94e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:37:14.045010 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG dbcounter [-] [87934] Writing DB stats keystone:SELECT=100 {{(pid=87934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:37:14.079711 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 531/1030] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Sep 13 19:37:13 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 13 19:37:14.085681 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG dbcounter [-] [87935] Writing DB stats keystone:SELECT=100 {{(pid=87935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:37:14.102619 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b307016-cf30-4d3e-af68-ff114b31db61 None admin] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:37:14.147741 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a942a24-1b42-44bd-8b16-ab485d85c543 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:37:14.148286 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a942a24-1b42-44bd-8b16-ab485d85c543 None admin] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:37:14.148567 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a942a24-1b42-44bd-8b16-ab485d85c543 None admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:37:14.148834 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a942a24-1b42-44bd-8b16-ab485d85c543 None admin] PATH_INFO: `/v3/services` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:37:14.149461 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a942a24-1b42-44bd-8b16-ab485d85c543 None admin] RBAC: Adding query filter params (type=image) {{(pid=87935) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:37:14.149760 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a942a24-1b42-44bd-8b16-ab485d85c543 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:37:14.151145 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a942a24-1b42-44bd-8b16-ab485d85c543 None admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:37:14.161650 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 500/1031] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Sep 13 19:37:13 2022] GET /identity/v3/services?type=image => generated 350 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 19:37:14.162989 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94abb721-80ed-4122-b7f3-85b61032b94e None None] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:37:14.271110 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94abb721-80ed-4122-b7f3-85b61032b94e None None] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:37:14.307898 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4fb039-9e2c-4faa-87da-a210e8abbdb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:37:14.308550 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4fb039-9e2c-4faa-87da-a210e8abbdb3 None admin] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:37:14.308828 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4fb039-9e2c-4faa-87da-a210e8abbdb3 None admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:37:14.309096 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4fb039-9e2c-4faa-87da-a210e8abbdb3 None admin] PATH_INFO: `/v3/endpoints` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:37:14.309799 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac4fb039-9e2c-4faa-87da-a210e8abbdb3 None admin] RBAC: Adding query filter params (interface=public, service_id=91b7d0701a52423fae2db11d11f34114, region_id=RegionOne) {{(pid=87934) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:37:14.310106 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac4fb039-9e2c-4faa-87da-a210e8abbdb3 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:37:14.311477 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac4fb039-9e2c-4faa-87da-a210e8abbdb3 None admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:37:14.322571 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 532/1032] 10.222.0.25 () {56 vars in 1251 bytes} [Tue Sep 13 19:37:14 2022] GET /identity/v3/endpoints?service_id=91b7d0701a52423fae2db11d11f34114&interface=public®ion_id=RegionOne => generated 194 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:37:14.324282 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a942a24-1b42-44bd-8b16-ab485d85c543 None admin] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:37:14.396192 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4fb039-9e2c-4faa-87da-a210e8abbdb3 None admin] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:37:14.442494 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG dbcounter [-] [87934] Writing DB stats keystone:SELECT=100 {{(pid=87934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:37:14.454725 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a942a24-1b42-44bd-8b16-ab485d85c543 None admin] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:37:14.490554 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2980c9a3-c54a-488c-bbcf-a4fb9d26a6b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:37:14.491160 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2980c9a3-c54a-488c-bbcf-a4fb9d26a6b7 None admin] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:37:14.491440 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2980c9a3-c54a-488c-bbcf-a4fb9d26a6b7 None admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:37:14.491711 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2980c9a3-c54a-488c-bbcf-a4fb9d26a6b7 None admin] PATH_INFO: `/v3/services` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:37:14.492346 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2980c9a3-c54a-488c-bbcf-a4fb9d26a6b7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:37:14.493712 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2980c9a3-c54a-488c-bbcf-a4fb9d26a6b7 None admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:37:14.512248 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 501/1033] 10.222.0.25 () {56 vars in 1087 bytes} [Tue Sep 13 19:37:14 2022] GET /identity/v3/services => generated 1957 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 13 19:37:14.520534 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4fb039-9e2c-4faa-87da-a210e8abbdb3 None admin] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:37:14.564248 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b08404-a08c-4b21-8660-79767ead1c95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:37:14.564916 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b08404-a08c-4b21-8660-79767ead1c95 None admin] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:37:14.565194 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b08404-a08c-4b21-8660-79767ead1c95 None admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:37:14.565501 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b08404-a08c-4b21-8660-79767ead1c95 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:37:14.583969 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b08404-a08c-4b21-8660-79767ead1c95 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 19:37:14.584375 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application [None req-36b08404-a08c-4b21-8660-79767ead1c95 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 13 19:37:14.584375 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:37:14.584375 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:37:14.584375 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:37:14.584375 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:37:14.584375 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:37:14.584375 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:37:14.584375 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:37:14.584375 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:37:14.584375 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:37:14.584375 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:37:14.584375 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:37:14.584375 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 19:37:14.584375 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 19:37:14.584375 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 19:37:14.584375 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 19:37:14.585319 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 19:37:14.585319 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 19:37:14.585319 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 19:37:14.585319 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 19:37:14.585319 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:37:14.585319 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:37:14.585319 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:37:14.585319 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:37:14.585319 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:37:14.585319 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:37:14.585319 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:37:14.585319 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application with Lock( Sep 13 19:37:14.585319 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:37:14.585319 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:37:14.585319 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:37:14.585319 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:37:14.586193 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:37:14.586193 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:37:14.586193 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:37:14.586193 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:37:14.586193 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 19:37:14.586193 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 19:37:14.586193 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 19:37:14.586193 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 19:37:14.586193 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 19:37:14.586193 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 19:37:14.586193 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 13 19:37:14.586193 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application Sep 13 19:37:14.586193 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 533/1034] 10.222.0.25 () {56 vars in 1120 bytes} [Tue Sep 13 19:37:14 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 13 19:37:14.591573 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2980c9a3-c54a-488c-bbcf-a4fb9d26a6b7 None admin] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:37:14.610915 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG dbcounter [-] [87935] Writing DB stats keystone:SELECT=100 {{(pid=87935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:37:14.711879 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2980c9a3-c54a-488c-bbcf-a4fb9d26a6b7 None admin] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:37:14.746349 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd03b6b-4014-49b6-bc98-f97658685d31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:37:14.747222 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd03b6b-4014-49b6-bc98-f97658685d31 None admin] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:37:14.747641 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd03b6b-4014-49b6-bc98-f97658685d31 None admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:37:14.748044 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd03b6b-4014-49b6-bc98-f97658685d31 None admin] PATH_INFO: `/v3/roles` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:37:14.748865 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd03b6b-4014-49b6-bc98-f97658685d31 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=87935) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:37:14.749306 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd03b6b-4014-49b6-bc98-f97658685d31 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:37:14.750815 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd03b6b-4014-49b6-bc98-f97658685d31 None admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:37:14.759352 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 502/1035] 10.222.0.25 () {56 vars in 1115 bytes} [Tue Sep 13 19:37:14 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:37:14.764891 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b08404-a08c-4b21-8660-79767ead1c95 None admin] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:37:14.863907 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG dbcounter [-] [87934] Writing DB stats keystone:SELECT=100 {{(pid=87934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:37:14.868843 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b08404-a08c-4b21-8660-79767ead1c95 None admin] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:37:14.902825 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d104e32a-3261-40f3-8471-d97c8881bddc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:37:14.903449 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d104e32a-3261-40f3-8471-d97c8881bddc None admin] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:37:14.903723 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d104e32a-3261-40f3-8471-d97c8881bddc None admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:37:14.903988 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d104e32a-3261-40f3-8471-d97c8881bddc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:37:14.915529 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d104e32a-3261-40f3-8471-d97c8881bddc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:37:14.916974 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d104e32a-3261-40f3-8471-d97c8881bddc None admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:37:14.931085 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application [None req-d104e32a-3261-40f3-8471-d97c8881bddc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 19:37:14.931085 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:37:14.931085 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:37:14.931085 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:37:14.931085 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:37:14.931085 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:37:14.931085 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:37:14.931085 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:37:14.931085 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:37:14.931085 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:37:14.931085 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:37:14.931085 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:37:14.931085 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 19:37:14.931085 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 19:37:14.931085 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 19:37:14.931085 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 19:37:14.932105 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:37:14.932105 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:37:14.932105 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:37:14.932105 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:37:14.932105 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:37:14.932105 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:37:14.932105 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:37:14.932105 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application with Lock( Sep 13 19:37:14.932105 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:37:14.932105 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:37:14.932105 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:37:14.932105 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:37:14.932105 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:37:14.932105 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:37:14.932105 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:37:14.932105 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:37:14.932105 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 19:37:14.938044 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 19:37:14.938044 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 19:37:14.938044 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application Sep 13 19:37:14.938044 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 534/1036] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Sep 13 19:37:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:37:14.938309 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd03b6b-4014-49b6-bc98-f97658685d31 None admin] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:37:15.019839 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG dbcounter [-] [87935] Writing DB stats keystone:SELECT=100 {{(pid=87935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:37:15.044371 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd03b6b-4014-49b6-bc98-f97658685d31 None admin] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:37:15.078570 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4191295-d58c-481e-bad2-9b7222f6592a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:37:15.079167 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4191295-d58c-481e-bad2-9b7222f6592a None admin] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:37:15.079441 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4191295-d58c-481e-bad2-9b7222f6592a None admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:37:15.079702 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4191295-d58c-481e-bad2-9b7222f6592a None admin] PATH_INFO: `/v3/domains` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:37:15.080358 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4191295-d58c-481e-bad2-9b7222f6592a None admin] RBAC: Adding query filter params (name=Default) {{(pid=87935) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:37:15.080655 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4191295-d58c-481e-bad2-9b7222f6592a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:37:15.084091 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4191295-d58c-481e-bad2-9b7222f6592a None admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:37:15.100238 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 503/1037] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Sep 13 19:37:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:37:15.102199 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d104e32a-3261-40f3-8471-d97c8881bddc None admin] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:37:15.210401 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d104e32a-3261-40f3-8471-d97c8881bddc None admin] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:37:15.261721 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c511664-4af5-44aa-bdca-f54df3b8b716 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:37:15.262510 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c511664-4af5-44aa-bdca-f54df3b8b716 None admin] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:37:15.262790 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c511664-4af5-44aa-bdca-f54df3b8b716 None admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:37:15.263052 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c511664-4af5-44aa-bdca-f54df3b8b716 None admin] PATH_INFO: `/v3/users/nova` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:37:15.272305 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c511664-4af5-44aa-bdca-f54df3b8b716 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:37:15.273728 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c511664-4af5-44aa-bdca-f54df3b8b716 None admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:37:15.286254 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application [None req-3c511664-4af5-44aa-bdca-f54df3b8b716 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 13 19:37:15.286254 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:37:15.286254 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:37:15.286254 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:37:15.286254 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:37:15.286254 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:37:15.286254 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:37:15.286254 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:37:15.286254 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:37:15.286254 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:37:15.286254 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:37:15.286254 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:37:15.286254 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 13 19:37:15.286254 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 13 19:37:15.286254 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 13 19:37:15.286254 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 13 19:37:15.287329 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:37:15.287329 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:37:15.287329 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 13 19:37:15.287329 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 19:37:15.287329 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 13 19:37:15.287329 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 19:37:15.287329 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:37:15.287329 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:37:15.287329 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:37:15.287329 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:37:15.287329 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:37:15.287329 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application with Lock( Sep 13 19:37:15.287329 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:37:15.287329 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:37:15.287329 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:37:15.287329 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:37:15.287329 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:37:15.287329 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:37:15.288319 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:37:15.288319 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:37:15.288319 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 13 19:37:15.288319 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 13 19:37:15.288319 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 13 19:37:15.288319 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 13 19:37:15.288319 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 13 19:37:15.288319 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 13 19:37:15.288319 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 13 19:37:15.288319 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application Sep 13 19:37:15.289576 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 535/1038] 10.222.0.25 () {56 vars in 1093 bytes} [Tue Sep 13 19:37:15 2022] GET /identity/v3/users/nova => generated 82 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 13 19:37:15.293255 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4191295-d58c-481e-bad2-9b7222f6592a None admin] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:37:15.418179 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4191295-d58c-481e-bad2-9b7222f6592a None admin] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:37:15.462933 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d90e6e-6ac8-4fd5-a3c9-d3caf4ce484e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:37:15.463558 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d90e6e-6ac8-4fd5-a3c9-d3caf4ce484e None admin] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:37:15.463834 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d90e6e-6ac8-4fd5-a3c9-d3caf4ce484e None admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:37:15.464104 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d90e6e-6ac8-4fd5-a3c9-d3caf4ce484e None admin] PATH_INFO: `/v3/users` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:37:15.464919 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d90e6e-6ac8-4fd5-a3c9-d3caf4ce484e None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=87935) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:37:15.465227 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d90e6e-6ac8-4fd5-a3c9-d3caf4ce484e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:37:15.466679 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d90e6e-6ac8-4fd5-a3c9-d3caf4ce484e None admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:37:15.469818 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG dbcounter [-] [87935] Writing DB stats keystone:SELECT=100 {{(pid=87935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:37:15.486612 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 504/1039] 10.222.0.25 () {56 vars in 1133 bytes} [Tue Sep 13 19:37:15 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:37:15.492991 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c511664-4af5-44aa-bdca-f54df3b8b716 None admin] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:37:15.508120 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG dbcounter [-] [87934] Writing DB stats keystone:SELECT=100 {{(pid=87934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:37:15.560010 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab910fc-4705-4146-8a6e-b291ca1e31d9 None None] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:37:15.560232 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab910fc-4705-4146-8a6e-b291ca1e31d9 None None] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:37:15.560500 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab910fc-4705-4146-8a6e-b291ca1e31d9 None None] PATH_INFO: `/` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:37:15.561976 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 505/1040] 10.222.0.25 () {54 vars in 927 bytes} [Tue Sep 13 19:37:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 13 19:37:15.568497 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e909f9-8366-437d-9a46-36ef184c854b None None] REQUEST_METHOD: `POST` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:37:15.568779 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e909f9-8366-437d-9a46-36ef184c854b None None] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:37:15.569053 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e909f9-8366-437d-9a46-36ef184c854b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:37:15.588787 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.auth.core [None req-67e909f9-8366-437d-9a46-36ef184c854b None None] MFA Rules not processed for user `7b0aed92d02344acb92a0e4aa67c3068`. Rule list: `[]` (Enabled: `True`). {{(pid=87935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:37:15.590006 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.fernet_utils [None req-67e909f9-8366-437d-9a46-36ef184c854b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:37:15.610326 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c511664-4af5-44aa-bdca-f54df3b8b716 None admin] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:37:15.650991 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57f9691-e8c1-4bb9-a1fe-34365e9d5cf6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:37:15.651597 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57f9691-e8c1-4bb9-a1fe-34365e9d5cf6 None admin] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:37:15.651879 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57f9691-e8c1-4bb9-a1fe-34365e9d5cf6 None admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:37:15.652153 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57f9691-e8c1-4bb9-a1fe-34365e9d5cf6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:37:15.667747 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 506/1041] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Sep 13 19:37:15 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 13 19:37:15.726894 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e57f9691-e8c1-4bb9-a1fe-34365e9d5cf6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:37:15.728491 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e57f9691-e8c1-4bb9-a1fe-34365e9d5cf6 None admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:37:15.740786 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG dbcounter [-] [87934] Writing DB stats keystone:SELECT=100 {{(pid=87934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:37:15.839701 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 536/1042] 10.222.0.25 () {58 vars in 1282 bytes} [Tue Sep 13 19:37:15 2022] GET /identity/v3/auth/tokens => generated 1969 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 13 19:37:15.841777 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e909f9-8366-437d-9a46-36ef184c854b None None] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:37:15.945681 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e909f9-8366-437d-9a46-36ef184c854b None None] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:37:15.948076 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57f9691-e8c1-4bb9-a1fe-34365e9d5cf6 None admin] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:37:15.971333 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG dbcounter [-] [87935] Writing DB stats keystone:SELECT=100 {{(pid=87935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:37:15.985166 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b802650-1e64-4166-896d-33c403c580ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:37:15.985801 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b802650-1e64-4166-896d-33c403c580ab None admin] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:37:15.986081 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b802650-1e64-4166-896d-33c403c580ab None admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:37:15.986350 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b802650-1e64-4166-896d-33c403c580ab None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:37:15.998461 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b802650-1e64-4166-896d-33c403c580ab None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:37:15.999946 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b802650-1e64-4166-896d-33c403c580ab None admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:37:16.015343 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application [None req-4b802650-1e64-4166-896d-33c403c580ab None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 19:37:16.015343 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:37:16.015343 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:37:16.015343 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:37:16.015343 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:37:16.015343 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:37:16.015343 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:37:16.015343 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:37:16.015343 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:37:16.015343 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:37:16.015343 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:37:16.015343 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:37:16.015343 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 19:37:16.015343 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 19:37:16.015343 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 19:37:16.015343 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 19:37:16.016368 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:37:16.016368 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:37:16.016368 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:37:16.016368 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:37:16.016368 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:37:16.016368 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:37:16.016368 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:37:16.016368 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application with Lock( Sep 13 19:37:16.016368 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:37:16.016368 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:37:16.016368 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:37:16.016368 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:37:16.016368 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:37:16.016368 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:37:16.016368 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:37:16.016368 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:37:16.016368 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 19:37:16.017262 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 19:37:16.017262 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 19:37:16.017262 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application Sep 13 19:37:16.021351 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 507/1043] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Sep 13 19:37:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 13 19:37:16.022025 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b802650-1e64-4166-896d-33c403c580ab None admin] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:37:16.057536 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57f9691-e8c1-4bb9-a1fe-34365e9d5cf6 None admin] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:37:16.071117 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG dbcounter [-] [87934] Writing DB stats keystone:SELECT=100 {{(pid=87934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:37:16.101326 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050d24fe-7f4a-4e43-9e1f-1d63a89179d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:37:16.101902 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050d24fe-7f4a-4e43-9e1f-1d63a89179d0 None admin] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:37:16.102189 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050d24fe-7f4a-4e43-9e1f-1d63a89179d0 None admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:37:16.102460 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050d24fe-7f4a-4e43-9e1f-1d63a89179d0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:37:16.114713 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-050d24fe-7f4a-4e43-9e1f-1d63a89179d0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 19:37:16.119630 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application [None req-050d24fe-7f4a-4e43-9e1f-1d63a89179d0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 19:37:16.119630 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:37:16.119630 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:37:16.119630 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:37:16.119630 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:37:16.119630 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:37:16.119630 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:37:16.119630 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:37:16.119630 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:37:16.119630 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:37:16.119630 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:37:16.119630 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:37:16.119630 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 19:37:16.119630 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 19:37:16.119630 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 19:37:16.119630 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 19:37:16.120669 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 19:37:16.120669 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 19:37:16.120669 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 19:37:16.120669 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 19:37:16.120669 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:37:16.120669 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:37:16.120669 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:37:16.120669 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:37:16.120669 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:37:16.120669 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:37:16.120669 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:37:16.120669 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application with Lock( Sep 13 19:37:16.120669 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:37:16.120669 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:37:16.120669 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:37:16.120669 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:37:16.121528 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:37:16.121528 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:37:16.121528 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:37:16.121528 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:37:16.121528 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 19:37:16.121528 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 19:37:16.121528 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 19:37:16.121528 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 19:37:16.121528 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 19:37:16.121528 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 19:37:16.121528 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 19:37:16.121528 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application Sep 13 19:37:16.121528 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 537/1044] 10.222.0.25 () {56 vars in 1096 bytes} [Tue Sep 13 19:37:15 2022] GET /identity/v3/roles/admin => generated 83 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:37:16.126737 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050d24fe-7f4a-4e43-9e1f-1d63a89179d0 None admin] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:37:16.134582 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b802650-1e64-4166-896d-33c403c580ab None admin] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:37:16.174885 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303eec03-a3bc-43d6-b232-790b2475b58d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:37:16.175972 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303eec03-a3bc-43d6-b232-790b2475b58d None admin] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:37:16.176682 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303eec03-a3bc-43d6-b232-790b2475b58d None admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:37:16.176952 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303eec03-a3bc-43d6-b232-790b2475b58d None admin] PATH_INFO: `/v3/domains` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:37:16.177789 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-303eec03-a3bc-43d6-b232-790b2475b58d None admin] RBAC: Adding query filter params (name=Default) {{(pid=87935) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:37:16.178097 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-303eec03-a3bc-43d6-b232-790b2475b58d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:37:16.179461 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-303eec03-a3bc-43d6-b232-790b2475b58d None admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:37:16.192119 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 508/1045] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Sep 13 19:37:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:37:16.197496 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303eec03-a3bc-43d6-b232-790b2475b58d None admin] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:37:16.240859 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050d24fe-7f4a-4e43-9e1f-1d63a89179d0 None admin] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:37:16.243302 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG dbcounter [-] [87935] Writing DB stats keystone:SELECT=100 {{(pid=87935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:37:16.281586 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4edcb4-58ce-4969-a94e-d2149af67e03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:37:16.282547 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4edcb4-58ce-4969-a94e-d2149af67e03 None admin] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:37:16.283013 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4edcb4-58ce-4969-a94e-d2149af67e03 None admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:37:16.283487 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4edcb4-58ce-4969-a94e-d2149af67e03 None admin] PATH_INFO: `/v3/roles` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:37:16.285053 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e4edcb4-58ce-4969-a94e-d2149af67e03 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87934) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:37:16.285696 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e4edcb4-58ce-4969-a94e-d2149af67e03 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:37:16.287141 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e4edcb4-58ce-4969-a94e-d2149af67e03 None admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:37:16.303015 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 538/1046] 10.222.0.25 () {56 vars in 1099 bytes} [Tue Sep 13 19:37:16 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 19:37:16.304805 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4edcb4-58ce-4969-a94e-d2149af67e03 None admin] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:37:16.317312 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303eec03-a3bc-43d6-b232-790b2475b58d None admin] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:37:16.341515 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG dbcounter [-] [87934] Writing DB stats keystone:SELECT=100 {{(pid=87934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:37:16.356890 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd2c241-5033-4794-b1f4-c32452b7be2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:37:16.357527 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd2c241-5033-4794-b1f4-c32452b7be2b None admin] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:37:16.357867 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd2c241-5033-4794-b1f4-c32452b7be2b None admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:37:16.358143 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd2c241-5033-4794-b1f4-c32452b7be2b None admin] PATH_INFO: `/v3/projects/service` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:37:16.365956 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd2c241-5033-4794-b1f4-c32452b7be2b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:37:16.367524 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd2c241-5033-4794-b1f4-c32452b7be2b None admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:37:16.380234 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application [None req-0bd2c241-5033-4794-b1f4-c32452b7be2b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 19:37:16.380234 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:37:16.380234 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:37:16.380234 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:37:16.380234 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:37:16.380234 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:37:16.380234 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:37:16.380234 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:37:16.380234 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:37:16.380234 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:37:16.380234 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:37:16.380234 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:37:16.380234 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 13 19:37:16.380234 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 13 19:37:16.380234 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 13 19:37:16.381306 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 13 19:37:16.381306 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:37:16.381306 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:37:16.381306 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:37:16.381306 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:37:16.381306 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:37:16.381306 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:37:16.381306 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:37:16.381306 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application with Lock( Sep 13 19:37:16.381306 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:37:16.381306 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:37:16.381306 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:37:16.381306 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:37:16.381306 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:37:16.381306 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:37:16.381306 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:37:16.381306 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:37:16.387434 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 13 19:37:16.387434 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 13 19:37:16.387434 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 13 19:37:16.387434 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 13 19:37:16.387434 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 13 19:37:16.387434 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 13 19:37:16.387434 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 19:37:16.387434 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application Sep 13 19:37:16.387434 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 509/1047] 10.222.0.25 () {56 vars in 1111 bytes} [Tue Sep 13 19:37:16 2022] GET /identity/v3/projects/service => generated 88 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 13 19:37:16.387434 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd2c241-5033-4794-b1f4-c32452b7be2b None admin] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:37:16.426488 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4edcb4-58ce-4969-a94e-d2149af67e03 None admin] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:37:16.465714 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d001d3d-512b-4895-8751-1f02648b88f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:37:16.466365 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d001d3d-512b-4895-8751-1f02648b88f7 None admin] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:37:16.466639 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d001d3d-512b-4895-8751-1f02648b88f7 None admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:37:16.466907 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d001d3d-512b-4895-8751-1f02648b88f7 None admin] PATH_INFO: `/v3/users/d0d257cfa5cc436e87bc9a0f10e72922` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:37:16.482039 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d001d3d-512b-4895-8751-1f02648b88f7 None admin] RBAC: Authorizing `identity:get_user(user_id=d0d257cfa5cc436e87bc9a0f10e72922)` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:37:16.483549 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d001d3d-512b-4895-8751-1f02648b88f7 None admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:37:16.489900 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 539/1048] 10.222.0.25 () {56 vars in 1177 bytes} [Tue Sep 13 19:37:16 2022] GET /identity/v3/users/d0d257cfa5cc436e87bc9a0f10e72922 => generated 285 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:37:16.490899 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d001d3d-512b-4895-8751-1f02648b88f7 None admin] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:37:16.497294 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG dbcounter [-] [87935] Writing DB stats keystone:SELECT=100 {{(pid=87935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:37:16.505300 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd2c241-5033-4794-b1f4-c32452b7be2b None admin] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:37:16.542710 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865594d8-18d6-4ed7-b924-1352f0295ab0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:37:16.543414 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865594d8-18d6-4ed7-b924-1352f0295ab0 None admin] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:37:16.543768 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865594d8-18d6-4ed7-b924-1352f0295ab0 None admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:37:16.544131 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865594d8-18d6-4ed7-b924-1352f0295ab0 None admin] PATH_INFO: `/v3/projects` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:37:16.544917 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-865594d8-18d6-4ed7-b924-1352f0295ab0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87935) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:37:16.545288 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-865594d8-18d6-4ed7-b924-1352f0295ab0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:37:16.546778 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-865594d8-18d6-4ed7-b924-1352f0295ab0 None admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:37:16.565041 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 510/1049] 10.222.0.25 () {56 vars in 1148 bytes} [Tue Sep 13 19:37:16 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:37:16.566641 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865594d8-18d6-4ed7-b924-1352f0295ab0 None admin] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:37:16.598421 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG dbcounter [-] [87934] Writing DB stats keystone:SELECT=100 {{(pid=87934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:37:16.611425 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d001d3d-512b-4895-8751-1f02648b88f7 None admin] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:37:16.659939 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c651cd03-20f4-4ecd-a19f-5da8c6010952 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:37:16.660773 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c651cd03-20f4-4ecd-a19f-5da8c6010952 None admin] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:37:16.661052 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c651cd03-20f4-4ecd-a19f-5da8c6010952 None admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:37:16.661320 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c651cd03-20f4-4ecd-a19f-5da8c6010952 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:37:16.684793 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865594d8-18d6-4ed7-b924-1352f0295ab0 None admin] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:37:16.733911 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666df9f5-787d-4e54-9a98-f0c95ed01026 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:37:16.734526 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666df9f5-787d-4e54-9a98-f0c95ed01026 None admin] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:37:16.734799 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666df9f5-787d-4e54-9a98-f0c95ed01026 None admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:37:16.735064 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666df9f5-787d-4e54-9a98-f0c95ed01026 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:37:16.735796 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-666df9f5-787d-4e54-9a98-f0c95ed01026 None admin] RBAC: Adding query filter params (role.id=14ffeae2f0594a2c9da6bfd35829457e, scope.project.id=9a10a4268f3c4cb29f4e00c292e2df62, user.id=d71fe5a8275f4ea98555afdcefc902a0) {{(pid=87935) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:37:16.736102 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-666df9f5-787d-4e54-9a98-f0c95ed01026 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:37:16.737829 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-666df9f5-787d-4e54-9a98-f0c95ed01026 None admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:37:16.743389 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c651cd03-20f4-4ecd-a19f-5da8c6010952 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:37:16.744095 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 511/1050] 10.222.0.25 () {56 vars in 1374 bytes} [Tue Sep 13 19:37:16 2022] GET /identity/v3/role_assignments?user.id=d71fe5a8275f4ea98555afdcefc902a0&scope.project.id=9a10a4268f3c4cb29f4e00c292e2df62&role.id=14ffeae2f0594a2c9da6bfd35829457e => generated 259 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:37:16.745492 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c651cd03-20f4-4ecd-a19f-5da8c6010952 None admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:37:16.760853 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de53f05-a913-4248-834a-8f9cf486345a None None] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:37:16.761133 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de53f05-a913-4248-834a-8f9cf486345a None None] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:37:16.761406 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de53f05-a913-4248-834a-8f9cf486345a None None] PATH_INFO: `/` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:37:16.762941 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 512/1051] 10.222.0.25 () {54 vars in 927 bytes} [Tue Sep 13 19:37:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 13 19:37:16.770567 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3a5d87-90e1-46ea-9519-23c2d3d6cde3 None None] REQUEST_METHOD: `POST` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:37:16.771149 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3a5d87-90e1-46ea-9519-23c2d3d6cde3 None None] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:37:16.771425 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3a5d87-90e1-46ea-9519-23c2d3d6cde3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:37:16.798151 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.auth.core [None req-4b3a5d87-90e1-46ea-9519-23c2d3d6cde3 None None] MFA Rules not processed for user `7b0aed92d02344acb92a0e4aa67c3068`. Rule list: `[]` (Enabled: `True`). {{(pid=87935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:37:16.800307 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.fernet_utils [None req-4b3a5d87-90e1-46ea-9519-23c2d3d6cde3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:37:16.818994 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG dbcounter [-] [87935] Writing DB stats keystone:SELECT=100 {{(pid=87935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:37:16.869637 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG dbcounter [-] [87934] Writing DB stats keystone:SELECT=100 {{(pid=87934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:37:16.884715 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 540/1052] 10.222.0.25 () {58 vars in 1282 bytes} [Tue Sep 13 19:37:16 2022] GET /identity/v3/auth/tokens => generated 1969 bytes in 394 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 13 19:37:16.891102 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c651cd03-20f4-4ecd-a19f-5da8c6010952 None admin] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:37:16.909059 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 513/1053] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Sep 13 19:37:16 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 13 19:37:17.007457 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c651cd03-20f4-4ecd-a19f-5da8c6010952 None admin] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:37:17.041642 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68325085-1988-45c9-93df-a963d2cbc506 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:37:17.042267 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68325085-1988-45c9-93df-a963d2cbc506 None admin] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:37:17.042539 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68325085-1988-45c9-93df-a963d2cbc506 None admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:37:17.042804 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68325085-1988-45c9-93df-a963d2cbc506 None admin] PATH_INFO: `/v3/projects/d82644e39c8f487096062ea8d01a4e20` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:37:17.043896 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68325085-1988-45c9-93df-a963d2cbc506 None admin] RBAC: Authorizing `identity:get_project(project_id=d82644e39c8f487096062ea8d01a4e20)` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:37:17.045352 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68325085-1988-45c9-93df-a963d2cbc506 None admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:37:17.047111 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 541/1054] 10.222.0.25 () {56 vars in 1186 bytes} [Tue Sep 13 19:37:16 2022] GET /identity/v3/projects/d82644e39c8f487096062ea8d01a4e20 => generated 311 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 19:37:17.053716 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3a5d87-90e1-46ea-9519-23c2d3d6cde3 None None] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:37:17.154766 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3a5d87-90e1-46ea-9519-23c2d3d6cde3 None None] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:37:17.180676 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68325085-1988-45c9-93df-a963d2cbc506 None admin] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:37:17.199374 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b0bdd7-d845-41f9-b5a8-a2821083097b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:37:17.199374 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b0bdd7-d845-41f9-b5a8-a2821083097b None admin] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:37:17.199374 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b0bdd7-d845-41f9-b5a8-a2821083097b None admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:37:17.199785 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b0bdd7-d845-41f9-b5a8-a2821083097b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:37:17.200330 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b0bdd7-d845-41f9-b5a8-a2821083097b None admin] RBAC: Adding query filter params (role.id=6ca1d4427ff64e0a9d25d96cfb1445f6, scope.project.id=d82644e39c8f487096062ea8d01a4e20, user.id=d0d257cfa5cc436e87bc9a0f10e72922) {{(pid=87935) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:37:17.201391 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b0bdd7-d845-41f9-b5a8-a2821083097b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:37:17.202144 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b0bdd7-d845-41f9-b5a8-a2821083097b None admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:37:17.216668 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 514/1055] 10.222.0.25 () {56 vars in 1374 bytes} [Tue Sep 13 19:37:17 2022] GET /identity/v3/role_assignments?user.id=d0d257cfa5cc436e87bc9a0f10e72922&scope.project.id=d82644e39c8f487096062ea8d01a4e20&role.id=6ca1d4427ff64e0a9d25d96cfb1445f6 => generated 259 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:37:17.274542 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG dbcounter [-] [87934] Writing DB stats keystone:SELECT=100 {{(pid=87934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:37:17.335773 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68325085-1988-45c9-93df-a963d2cbc506 None admin] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:37:17.388449 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f2388b-b9f5-4f5e-b9bc-1c477f7b9a0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:37:17.389100 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f2388b-b9f5-4f5e-b9bc-1c477f7b9a0a None admin] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:37:17.389379 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f2388b-b9f5-4f5e-b9bc-1c477f7b9a0a None admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:37:17.389651 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f2388b-b9f5-4f5e-b9bc-1c477f7b9a0a None admin] PATH_INFO: `/v3/services/image` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:37:17.390239 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f2388b-b9f5-4f5e-b9bc-1c477f7b9a0a None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:37:17.391598 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f2388b-b9f5-4f5e-b9bc-1c477f7b9a0a None admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:37:17.401540 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application [None req-e4f2388b-b9f5-4f5e-b9bc-1c477f7b9a0a None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Sep 13 19:37:17.401540 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:37:17.401540 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 13 19:37:17.401540 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 13 19:37:17.401540 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 13 19:37:17.401540 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 13 19:37:17.401540 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 13 19:37:17.401540 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 19:37:17.401540 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 13 19:37:17.401540 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application Sep 13 19:37:17.401540 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 13 19:37:17.401540 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application Sep 13 19:37:17.401540 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:37:17.401540 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:37:17.401540 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:37:17.401540 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:37:17.401540 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:37:17.402578 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:37:17.402578 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:37:17.402578 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:37:17.402578 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:37:17.402578 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:37:17.402578 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:37:17.402578 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 13 19:37:17.402578 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 13 19:37:17.402578 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 13 19:37:17.402578 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 13 19:37:17.402578 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:37:17.402578 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:37:17.402578 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:37:17.402578 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:37:17.402578 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:37:17.402578 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:37:17.403432 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:37:17.403432 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application with Lock( Sep 13 19:37:17.403432 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:37:17.403432 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:37:17.403432 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:37:17.403432 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:37:17.403432 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:37:17.403432 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:37:17.403432 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:37:17.403432 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:37:17.403432 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 13 19:37:17.403432 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 19:37:17.403432 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 13 19:37:17.403432 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application Sep 13 19:37:17.403432 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 542/1056] 10.222.0.25 () {56 vars in 1105 bytes} [Tue Sep 13 19:37:17 2022] GET /identity/v3/services/image => generated 86 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:37:17.409556 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b0bdd7-d845-41f9-b5a8-a2821083097b None admin] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:37:17.427754 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG dbcounter [-] [87935] Writing DB stats keystone:SELECT=100 {{(pid=87935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:37:17.520688 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b0bdd7-d845-41f9-b5a8-a2821083097b None admin] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:37:17.557222 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8991e99b-bd10-44e2-ad19-daac91a8d1e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:37:17.557832 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8991e99b-bd10-44e2-ad19-daac91a8d1e0 None admin] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:37:17.558108 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8991e99b-bd10-44e2-ad19-daac91a8d1e0 None admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:37:17.558378 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8991e99b-bd10-44e2-ad19-daac91a8d1e0 None admin] PATH_INFO: `/v3/services` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:37:17.559006 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8991e99b-bd10-44e2-ad19-daac91a8d1e0 None admin] RBAC: Adding query filter params (name=image) {{(pid=87935) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:37:17.559303 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8991e99b-bd10-44e2-ad19-daac91a8d1e0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:37:17.560771 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8991e99b-bd10-44e2-ad19-daac91a8d1e0 None admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:37:17.570806 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 515/1057] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Sep 13 19:37:17 2022] GET /identity/v3/services?name=image => generated 122 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 19:37:17.571864 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f2388b-b9f5-4f5e-b9bc-1c477f7b9a0a None admin] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:37:17.712589 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f2388b-b9f5-4f5e-b9bc-1c477f7b9a0a None admin] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:37:17.743105 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG dbcounter [-] [87934] Writing DB stats keystone:SELECT=100 {{(pid=87934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:37:17.759887 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869f022f-e09b-4645-8aa4-72d35812b33a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:37:17.760546 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869f022f-e09b-4645-8aa4-72d35812b33a None admin] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:37:17.760822 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869f022f-e09b-4645-8aa4-72d35812b33a None admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:37:17.761095 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869f022f-e09b-4645-8aa4-72d35812b33a None admin] PATH_INFO: `/v3/services` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:37:17.761729 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-869f022f-e09b-4645-8aa4-72d35812b33a None admin] RBAC: Adding query filter params (type=image) {{(pid=87934) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:37:17.762040 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-869f022f-e09b-4645-8aa4-72d35812b33a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:37:17.763427 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-869f022f-e09b-4645-8aa4-72d35812b33a None admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:37:17.776545 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 543/1058] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Sep 13 19:37:17 2022] GET /identity/v3/services?type=image => generated 350 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:37:17.779225 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8991e99b-bd10-44e2-ad19-daac91a8d1e0 None admin] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:37:17.874027 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG dbcounter [-] [87935] Writing DB stats keystone:SELECT=100 {{(pid=87935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:37:17.899417 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8991e99b-bd10-44e2-ad19-daac91a8d1e0 None admin] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:37:17.935357 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971af9c9-f184-4ef3-966b-8b75831eca78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:37:17.935968 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971af9c9-f184-4ef3-966b-8b75831eca78 None admin] REQUEST_METHOD: `POST` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:37:17.936276 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971af9c9-f184-4ef3-966b-8b75831eca78 None admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:37:17.936551 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971af9c9-f184-4ef3-966b-8b75831eca78 None admin] PATH_INFO: `/v3/endpoints` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:37:17.937220 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-971af9c9-f184-4ef3-966b-8b75831eca78 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:37:17.938585 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-971af9c9-f184-4ef3-966b-8b75831eca78 None admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:37:17.967722 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 516/1059] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Sep 13 19:37:17 2022] POST /identity/v3/endpoints => generated 327 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 19:37:19.003174 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf79f1e-aca9-4040-b5b9-ca8327287115 None None] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:37:19.003765 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf79f1e-aca9-4040-b5b9-ca8327287115 None None] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:37:19.003765 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf79f1e-aca9-4040-b5b9-ca8327287115 None None] PATH_INFO: `/` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:37:19.005272 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 544/1060] 10.222.0.25 () {54 vars in 927 bytes} [Tue Sep 13 19:37:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:37:19.010338 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885e93ea-9cba-41d9-b96e-809e1b0e2f1a None None] REQUEST_METHOD: `POST` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:37:19.010747 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885e93ea-9cba-41d9-b96e-809e1b0e2f1a None None] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:37:19.010916 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885e93ea-9cba-41d9-b96e-809e1b0e2f1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:37:19.030806 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.auth.core [None req-885e93ea-9cba-41d9-b96e-809e1b0e2f1a None None] MFA Rules not processed for user `7b0aed92d02344acb92a0e4aa67c3068`. Rule list: `[]` (Enabled: `True`). {{(pid=87935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:37:19.032018 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.fernet_utils [None req-885e93ea-9cba-41d9-b96e-809e1b0e2f1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:37:19.118643 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 517/1061] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Sep 13 19:37:19 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 13 19:37:19.389763 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf79f1e-aca9-4040-b5b9-ca8327287115 None None] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:37:19.412463 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e755201-5c2c-469e-a7fe-4ab5b966fc70 None None] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:37:19.412799 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e755201-5c2c-469e-a7fe-4ab5b966fc70 None None] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:37:19.413021 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e755201-5c2c-469e-a7fe-4ab5b966fc70 None None] PATH_INFO: `/` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:37:19.414834 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 518/1062] 10.222.0.25 () {54 vars in 927 bytes} [Tue Sep 13 19:37:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:37:19.420565 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e24656-35a5-4885-a069-8283b3d6bebb None None] REQUEST_METHOD: `POST` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:37:19.420848 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e24656-35a5-4885-a069-8283b3d6bebb None None] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:37:19.421122 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e24656-35a5-4885-a069-8283b3d6bebb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:37:19.439956 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.auth.core [None req-30e24656-35a5-4885-a069-8283b3d6bebb None None] MFA Rules not processed for user `7b0aed92d02344acb92a0e4aa67c3068`. Rule list: `[]` (Enabled: `True`). {{(pid=87935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:37:19.442069 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.fernet_utils [None req-30e24656-35a5-4885-a069-8283b3d6bebb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:37:19.508844 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG dbcounter [-] [87935] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:37:19.513898 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf79f1e-aca9-4040-b5b9-ca8327287115 None None] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:37:19.525771 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 519/1063] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Sep 13 19:37:19 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 13 19:37:19.552069 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7646489b-a31e-45f1-a903-17b7c0dfd567 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:37:19.552655 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7646489b-a31e-45f1-a903-17b7c0dfd567 None admin] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:37:19.552928 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7646489b-a31e-45f1-a903-17b7c0dfd567 None admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:37:19.553194 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7646489b-a31e-45f1-a903-17b7c0dfd567 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:37:19.563956 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7646489b-a31e-45f1-a903-17b7c0dfd567 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 19:37:19.569371 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application [None req-7646489b-a31e-45f1-a903-17b7c0dfd567 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 13 19:37:19.569371 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:37:19.569371 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:37:19.569371 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:37:19.569371 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:37:19.569371 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:37:19.569371 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:37:19.569371 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:37:19.569371 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:37:19.569371 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:37:19.569371 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:37:19.569371 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:37:19.569371 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 19:37:19.569371 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 19:37:19.569371 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 19:37:19.569371 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 19:37:19.570328 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 19:37:19.570328 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 19:37:19.570328 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 19:37:19.570328 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 19:37:19.570328 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:37:19.570328 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:37:19.570328 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:37:19.570328 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:37:19.570328 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:37:19.570328 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:37:19.570328 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:37:19.570328 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application with Lock( Sep 13 19:37:19.570328 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:37:19.570328 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:37:19.570328 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:37:19.570328 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:37:19.571205 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:37:19.571205 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:37:19.571205 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:37:19.571205 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:37:19.571205 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 19:37:19.571205 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 19:37:19.571205 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 19:37:19.571205 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 19:37:19.571205 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 19:37:19.571205 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 19:37:19.571205 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 13 19:37:19.571205 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application Sep 13 19:37:19.572825 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 545/1064] 10.222.0.25 () {56 vars in 1120 bytes} [Tue Sep 13 19:37:19 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:37:19.576402 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e24656-35a5-4885-a069-8283b3d6bebb None None] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:37:19.697442 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e24656-35a5-4885-a069-8283b3d6bebb None None] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:37:19.735626 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6763bf4a-3fe8-4b80-b215-80bb312c64ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:37:19.736267 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6763bf4a-3fe8-4b80-b215-80bb312c64ea None admin] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:37:19.736550 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6763bf4a-3fe8-4b80-b215-80bb312c64ea None admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:37:19.736820 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6763bf4a-3fe8-4b80-b215-80bb312c64ea None admin] PATH_INFO: `/v3/roles` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:37:19.737480 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6763bf4a-3fe8-4b80-b215-80bb312c64ea None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=87935) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:37:19.737783 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6763bf4a-3fe8-4b80-b215-80bb312c64ea None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:37:19.739266 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6763bf4a-3fe8-4b80-b215-80bb312c64ea None admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:37:19.747820 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 520/1065] 10.222.0.25 () {56 vars in 1115 bytes} [Tue Sep 13 19:37:19 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:37:19.753897 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7646489b-a31e-45f1-a903-17b7c0dfd567 None admin] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:37:19.801345 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6763bf4a-3fe8-4b80-b215-80bb312c64ea None admin] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:37:19.803076 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG dbcounter [-] [87934] Writing DB stats keystone:SELECT=100 {{(pid=87934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:37:19.860776 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG dbcounter [-] [87935] Writing DB stats keystone:SELECT=100 {{(pid=87935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:37:19.870872 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7646489b-a31e-45f1-a903-17b7c0dfd567 None admin] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:37:19.909797 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0aa90be-11fe-478c-bb41-9189637839ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:37:19.910617 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0aa90be-11fe-478c-bb41-9189637839ed None admin] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:37:19.910897 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0aa90be-11fe-478c-bb41-9189637839ed None admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:37:19.911167 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0aa90be-11fe-478c-bb41-9189637839ed None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:37:19.917973 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6763bf4a-3fe8-4b80-b215-80bb312c64ea None admin] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:37:19.922319 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0aa90be-11fe-478c-bb41-9189637839ed None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:37:19.923773 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0aa90be-11fe-478c-bb41-9189637839ed None admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:37:19.939442 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application [None req-d0aa90be-11fe-478c-bb41-9189637839ed None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 19:37:19.939442 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:37:19.939442 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:37:19.939442 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:37:19.939442 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:37:19.939442 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:37:19.939442 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:37:19.939442 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:37:19.939442 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:37:19.939442 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:37:19.939442 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:37:19.939442 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:37:19.939442 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 19:37:19.939442 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 19:37:19.939442 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 19:37:19.939442 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 19:37:19.940589 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:37:19.940589 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:37:19.940589 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:37:19.940589 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:37:19.940589 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:37:19.940589 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:37:19.940589 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:37:19.940589 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application with Lock( Sep 13 19:37:19.940589 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:37:19.940589 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:37:19.940589 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:37:19.940589 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:37:19.940589 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:37:19.940589 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:37:19.940589 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:37:19.940589 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:37:19.940589 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 19:37:19.941829 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 19:37:19.941829 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 19:37:19.941829 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application Sep 13 19:37:19.941829 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 546/1066] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Sep 13 19:37:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:37:19.946414 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0aa90be-11fe-478c-bb41-9189637839ed None admin] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:37:19.958670 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14f39cb-8d75-447b-92ad-22af87a81677 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:37:19.959307 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14f39cb-8d75-447b-92ad-22af87a81677 None admin] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:37:19.959580 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14f39cb-8d75-447b-92ad-22af87a81677 None admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:37:19.959843 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14f39cb-8d75-447b-92ad-22af87a81677 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:37:19.972192 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e14f39cb-8d75-447b-92ad-22af87a81677 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 19:37:19.977053 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application [None req-e14f39cb-8d75-447b-92ad-22af87a81677 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 19:37:19.977053 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:37:19.977053 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:37:19.977053 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:37:19.977053 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:37:19.977053 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:37:19.977053 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:37:19.977053 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:37:19.977053 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:37:19.977053 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:37:19.977053 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:37:19.977053 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:37:19.977053 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 19:37:19.977053 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 19:37:19.977053 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 19:37:19.977053 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 19:37:19.978038 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 19:37:19.978038 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 19:37:19.978038 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 19:37:19.978038 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 19:37:19.978038 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:37:19.978038 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:37:19.978038 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:37:19.978038 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:37:19.978038 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:37:19.978038 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:37:19.978038 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:37:19.978038 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application with Lock( Sep 13 19:37:19.978038 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:37:19.978038 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:37:19.978038 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:37:19.978038 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:37:19.978898 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:37:19.978898 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:37:19.978898 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:37:19.978898 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:37:19.978898 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 19:37:19.978898 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 19:37:19.978898 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 19:37:19.978898 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 19:37:19.978898 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 19:37:19.978898 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 19:37:19.978898 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 19:37:19.978898 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application Sep 13 19:37:19.978898 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 521/1067] 10.222.0.25 () {56 vars in 1096 bytes} [Tue Sep 13 19:37:19 2022] GET /identity/v3/roles/admin => generated 83 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:37:19.987369 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14f39cb-8d75-447b-92ad-22af87a81677 None admin] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:37:20.077245 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG dbcounter [-] [87934] Writing DB stats keystone:SELECT=100 {{(pid=87934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:37:20.083876 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0aa90be-11fe-478c-bb41-9189637839ed None admin] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:37:20.115762 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14f39cb-8d75-447b-92ad-22af87a81677 None admin] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:37:20.121966 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8907a348-15e8-4239-8771-c67f75ec7117 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:37:20.122850 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8907a348-15e8-4239-8771-c67f75ec7117 None admin] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:37:20.123398 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8907a348-15e8-4239-8771-c67f75ec7117 None admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:37:20.123835 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8907a348-15e8-4239-8771-c67f75ec7117 None admin] PATH_INFO: `/v3/domains` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:37:20.124552 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8907a348-15e8-4239-8771-c67f75ec7117 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87934) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:37:20.124859 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8907a348-15e8-4239-8771-c67f75ec7117 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:37:20.126438 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8907a348-15e8-4239-8771-c67f75ec7117 None admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:37:20.132109 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG dbcounter [-] [87935] Writing DB stats keystone:SELECT=100 {{(pid=87935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:37:20.144834 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 547/1068] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Sep 13 19:37:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:37:20.151498 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8907a348-15e8-4239-8771-c67f75ec7117 None admin] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:37:20.162850 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf80621c-bc59-4e1d-8a9a-e12aee126950 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:37:20.163571 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf80621c-bc59-4e1d-8a9a-e12aee126950 None admin] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:37:20.163925 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf80621c-bc59-4e1d-8a9a-e12aee126950 None admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:37:20.164307 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf80621c-bc59-4e1d-8a9a-e12aee126950 None admin] PATH_INFO: `/v3/roles` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:37:20.165063 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf80621c-bc59-4e1d-8a9a-e12aee126950 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87935) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:37:20.165580 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf80621c-bc59-4e1d-8a9a-e12aee126950 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:37:20.166746 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf80621c-bc59-4e1d-8a9a-e12aee126950 None admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:37:20.182442 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 522/1069] 10.222.0.25 () {56 vars in 1099 bytes} [Tue Sep 13 19:37:19 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 19:37:20.183242 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf80621c-bc59-4e1d-8a9a-e12aee126950 None admin] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:37:20.270118 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8907a348-15e8-4239-8771-c67f75ec7117 None admin] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:37:20.302144 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf80621c-bc59-4e1d-8a9a-e12aee126950 None admin] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:37:20.307817 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9893bf-7a63-41a1-9fe4-d59f70a93afa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:37:20.308488 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9893bf-7a63-41a1-9fe4-d59f70a93afa None admin] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:37:20.308767 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9893bf-7a63-41a1-9fe4-d59f70a93afa None admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:37:20.309037 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9893bf-7a63-41a1-9fe4-d59f70a93afa None admin] PATH_INFO: `/v3/users/nova` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:37:20.317378 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e9893bf-7a63-41a1-9fe4-d59f70a93afa None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:37:20.318829 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e9893bf-7a63-41a1-9fe4-d59f70a93afa None admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:37:20.330823 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application [None req-3e9893bf-7a63-41a1-9fe4-d59f70a93afa None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 13 19:37:20.330823 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:37:20.330823 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:37:20.330823 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:37:20.330823 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:37:20.330823 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:37:20.330823 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:37:20.330823 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:37:20.330823 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:37:20.330823 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:37:20.330823 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:37:20.330823 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:37:20.330823 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 13 19:37:20.330823 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 13 19:37:20.330823 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 13 19:37:20.330823 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 13 19:37:20.332775 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:37:20.332775 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:37:20.332775 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 13 19:37:20.332775 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 19:37:20.332775 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 13 19:37:20.332775 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 19:37:20.332775 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:37:20.332775 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:37:20.332775 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:37:20.332775 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:37:20.332775 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:37:20.332775 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application with Lock( Sep 13 19:37:20.332775 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:37:20.332775 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:37:20.332775 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:37:20.332775 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:37:20.332775 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:37:20.332775 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:37:20.333839 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:37:20.333839 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:37:20.333839 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 13 19:37:20.333839 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 13 19:37:20.333839 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 13 19:37:20.333839 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 13 19:37:20.333839 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 13 19:37:20.333839 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 13 19:37:20.333839 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 13 19:37:20.333839 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application Sep 13 19:37:20.333839 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 548/1070] 10.222.0.25 () {56 vars in 1093 bytes} [Tue Sep 13 19:37:20 2022] GET /identity/v3/users/nova => generated 82 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:37:20.334461 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7fb6ec-cec5-4007-bfe1-385f7eab76df None None] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:37:20.334532 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7fb6ec-cec5-4007-bfe1-385f7eab76df None None] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:37:20.334789 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7fb6ec-cec5-4007-bfe1-385f7eab76df None None] PATH_INFO: `/` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:37:20.336026 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 549/1071] 10.222.0.25 () {54 vars in 927 bytes} [Tue Sep 13 19:37:20 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:37:20.338786 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7fb6ec-cec5-4007-bfe1-385f7eab76df None None] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:37:20.342348 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04769ede-c6e4-4abf-82a4-68ab4af6cadb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:37:20.343019 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04769ede-c6e4-4abf-82a4-68ab4af6cadb None admin] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:37:20.343402 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04769ede-c6e4-4abf-82a4-68ab4af6cadb None admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:37:20.343603 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04769ede-c6e4-4abf-82a4-68ab4af6cadb None admin] PATH_INFO: `/v3/users/d0d257cfa5cc436e87bc9a0f10e72922` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:37:20.344790 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04769ede-c6e4-4abf-82a4-68ab4af6cadb None admin] RBAC: Authorizing `identity:get_user(user_id=d0d257cfa5cc436e87bc9a0f10e72922)` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:37:20.346220 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04769ede-c6e4-4abf-82a4-68ab4af6cadb None admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:37:20.348181 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 523/1072] 10.222.0.25 () {56 vars in 1177 bytes} [Tue Sep 13 19:37:20 2022] GET /identity/v3/users/d0d257cfa5cc436e87bc9a0f10e72922 => generated 285 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:37:20.349510 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4171200-6594-404c-8f3a-99450191f0e8 None None] REQUEST_METHOD: `POST` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:37:20.349790 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4171200-6594-404c-8f3a-99450191f0e8 None None] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:37:20.350059 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4171200-6594-404c-8f3a-99450191f0e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:37:20.361648 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG dbcounter [-] [87934] Writing DB stats keystone:SELECT=100 {{(pid=87934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:37:20.373395 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.auth.core [None req-c4171200-6594-404c-8f3a-99450191f0e8 None None] MFA Rules not processed for user `7b0aed92d02344acb92a0e4aa67c3068`. Rule list: `[]` (Enabled: `True`). {{(pid=87935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:37:20.374996 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.fernet_utils [None req-c4171200-6594-404c-8f3a-99450191f0e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:37:20.412606 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG dbcounter [-] [87935] Writing DB stats keystone:SELECT=100 {{(pid=87935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:37:20.450379 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 524/1073] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Sep 13 19:37:20 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 13 19:37:20.451538 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4171200-6594-404c-8f3a-99450191f0e8 None None] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:37:20.455039 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7fb6ec-cec5-4007-bfe1-385f7eab76df None None] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:37:20.490828 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910c5dab-ae5c-436d-b8fb-4db8606c3479 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:37:20.491695 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910c5dab-ae5c-436d-b8fb-4db8606c3479 None admin] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:37:20.491974 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910c5dab-ae5c-436d-b8fb-4db8606c3479 None admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:37:20.492268 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910c5dab-ae5c-436d-b8fb-4db8606c3479 None admin] PATH_INFO: `/v3/users` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:37:20.493089 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-910c5dab-ae5c-436d-b8fb-4db8606c3479 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=87934) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:37:20.493395 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-910c5dab-ae5c-436d-b8fb-4db8606c3479 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:37:20.494847 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-910c5dab-ae5c-436d-b8fb-4db8606c3479 None admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:37:20.514225 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 550/1074] 10.222.0.25 () {56 vars in 1133 bytes} [Tue Sep 13 19:37:20 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 19:37:20.520479 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910c5dab-ae5c-436d-b8fb-4db8606c3479 None admin] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:37:20.562011 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4171200-6594-404c-8f3a-99450191f0e8 None None] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:37:20.599971 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG dbcounter [-] [87934] Writing DB stats keystone:SELECT=100 {{(pid=87934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:37:20.602993 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67db7551-ab92-4ba4-86cb-c74200d364a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:37:20.603622 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67db7551-ab92-4ba4-86cb-c74200d364a4 None admin] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:37:20.603895 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67db7551-ab92-4ba4-86cb-c74200d364a4 None admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:37:20.604159 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67db7551-ab92-4ba4-86cb-c74200d364a4 None admin] PATH_INFO: `/v3/projects/d82644e39c8f487096062ea8d01a4e20` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:37:20.605304 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67db7551-ab92-4ba4-86cb-c74200d364a4 None admin] RBAC: Authorizing `identity:get_project(project_id=d82644e39c8f487096062ea8d01a4e20)` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:37:20.606726 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67db7551-ab92-4ba4-86cb-c74200d364a4 None admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:37:20.609597 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 525/1075] 10.222.0.25 () {56 vars in 1186 bytes} [Tue Sep 13 19:37:20 2022] GET /identity/v3/projects/d82644e39c8f487096062ea8d01a4e20 => generated 311 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:37:20.616694 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67db7551-ab92-4ba4-86cb-c74200d364a4 None admin] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:37:20.633758 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910c5dab-ae5c-436d-b8fb-4db8606c3479 None admin] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:37:20.659995 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG dbcounter [-] [87935] Writing DB stats keystone:SELECT=100 {{(pid=87935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:37:20.670020 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4cfe46-3430-49e5-a197-2e57ab69297a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:37:20.670646 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4cfe46-3430-49e5-a197-2e57ab69297a None admin] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:37:20.670924 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4cfe46-3430-49e5-a197-2e57ab69297a None admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:37:20.671188 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4cfe46-3430-49e5-a197-2e57ab69297a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:37:20.682478 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec4cfe46-3430-49e5-a197-2e57ab69297a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:37:20.684031 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec4cfe46-3430-49e5-a197-2e57ab69297a None admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:37:20.699280 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application [None req-ec4cfe46-3430-49e5-a197-2e57ab69297a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 19:37:20.699280 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:37:20.699280 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:37:20.699280 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:37:20.699280 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:37:20.699280 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:37:20.699280 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:37:20.699280 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:37:20.699280 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:37:20.699280 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:37:20.699280 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:37:20.699280 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:37:20.699280 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 19:37:20.699280 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 19:37:20.699280 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 19:37:20.699280 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 19:37:20.700340 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:37:20.700340 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:37:20.700340 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:37:20.700340 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:37:20.700340 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:37:20.700340 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:37:20.700340 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:37:20.700340 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application with Lock( Sep 13 19:37:20.700340 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:37:20.700340 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:37:20.700340 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:37:20.700340 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:37:20.700340 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:37:20.700340 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:37:20.700340 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:37:20.700340 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:37:20.700340 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 19:37:20.701257 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 19:37:20.701257 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 19:37:20.701257 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application Sep 13 19:37:20.701257 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 551/1076] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Sep 13 19:37:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 13 19:37:20.706160 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4cfe46-3430-49e5-a197-2e57ab69297a None admin] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:37:20.724370 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67db7551-ab92-4ba4-86cb-c74200d364a4 None admin] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:37:20.759152 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d89d4f4-e0ca-4f69-a8b0-bf7251919750 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:37:20.759795 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d89d4f4-e0ca-4f69-a8b0-bf7251919750 None admin] REQUEST_METHOD: `PUT` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:37:20.760066 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d89d4f4-e0ca-4f69-a8b0-bf7251919750 None admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:37:20.760363 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d89d4f4-e0ca-4f69-a8b0-bf7251919750 None admin] PATH_INFO: `/v3/projects/d82644e39c8f487096062ea8d01a4e20/users/d0d257cfa5cc436e87bc9a0f10e72922/roles/6ca1d4427ff64e0a9d25d96cfb1445f6` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:37:20.762251 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d89d4f4-e0ca-4f69-a8b0-bf7251919750 None admin] RBAC: Authorizing `identity:create_grant(project_id=d82644e39c8f487096062ea8d01a4e20, user_id=d0d257cfa5cc436e87bc9a0f10e72922, role_id=6ca1d4427ff64e0a9d25d96cfb1445f6)` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:37:20.763665 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d89d4f4-e0ca-4f69-a8b0-bf7251919750 None admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:37:20.777199 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 526/1077] 10.222.0.25 () {58 vars in 1439 bytes} [Tue Sep 13 19:37:20 2022] PUT /identity/v3/projects/d82644e39c8f487096062ea8d01a4e20/users/d0d257cfa5cc436e87bc9a0f10e72922/roles/6ca1d4427ff64e0a9d25d96cfb1445f6 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 19:37:20.778276 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d89d4f4-e0ca-4f69-a8b0-bf7251919750 None admin] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:37:20.819190 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4cfe46-3430-49e5-a197-2e57ab69297a None admin] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:37:20.848343 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG dbcounter [-] [87934] Writing DB stats keystone:SELECT=100 {{(pid=87934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:37:20.858213 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dbe26a7-4428-4b3d-bc47-7a0e6718fba0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:37:20.858746 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbe26a7-4428-4b3d-bc47-7a0e6718fba0 None admin] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:37:20.859018 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbe26a7-4428-4b3d-bc47-7a0e6718fba0 None admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:37:20.859283 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbe26a7-4428-4b3d-bc47-7a0e6718fba0 None admin] PATH_INFO: `/v3/domains` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:37:20.859936 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dbe26a7-4428-4b3d-bc47-7a0e6718fba0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87934) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:37:20.860263 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dbe26a7-4428-4b3d-bc47-7a0e6718fba0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:37:20.861662 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dbe26a7-4428-4b3d-bc47-7a0e6718fba0 None admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:37:20.881606 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 552/1078] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Sep 13 19:37:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 19:37:20.882895 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dbe26a7-4428-4b3d-bc47-7a0e6718fba0 None admin] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:37:20.903863 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG dbcounter [-] [87935] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:37:20.908383 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d89d4f4-e0ca-4f69-a8b0-bf7251919750 None admin] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:37:20.955348 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec0e579-3998-47fd-93d4-a58314942dab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:37:20.956006 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec0e579-3998-47fd-93d4-a58314942dab None admin] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:37:20.956312 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec0e579-3998-47fd-93d4-a58314942dab None admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:37:20.956586 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec0e579-3998-47fd-93d4-a58314942dab None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:37:21.001957 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dbe26a7-4428-4b3d-bc47-7a0e6718fba0 None admin] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:37:21.040497 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd454205-1001-4a1f-a75a-c0518e7cf219 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:37:21.041153 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd454205-1001-4a1f-a75a-c0518e7cf219 None admin] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:37:21.041439 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd454205-1001-4a1f-a75a-c0518e7cf219 None admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:37:21.041708 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd454205-1001-4a1f-a75a-c0518e7cf219 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:37:21.044230 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec0e579-3998-47fd-93d4-a58314942dab None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:37:21.046293 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec0e579-3998-47fd-93d4-a58314942dab None admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:37:21.048951 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd454205-1001-4a1f-a75a-c0518e7cf219 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:37:21.050958 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd454205-1001-4a1f-a75a-c0518e7cf219 None admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:37:21.063046 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application [None req-dd454205-1001-4a1f-a75a-c0518e7cf219 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 19:37:21.063046 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:37:21.063046 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:37:21.063046 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:37:21.063046 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:37:21.063046 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:37:21.063046 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:37:21.063046 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:37:21.063046 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:37:21.063046 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:37:21.063046 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:37:21.063046 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:37:21.063046 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 13 19:37:21.063046 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 13 19:37:21.063046 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 13 19:37:21.064125 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 13 19:37:21.064125 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:37:21.064125 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:37:21.064125 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:37:21.064125 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:37:21.064125 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:37:21.064125 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:37:21.064125 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:37:21.064125 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application with Lock( Sep 13 19:37:21.064125 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:37:21.064125 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:37:21.064125 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:37:21.064125 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:37:21.064125 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:37:21.064125 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:37:21.064125 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:37:21.064125 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:37:21.065126 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 13 19:37:21.065126 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 13 19:37:21.065126 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 13 19:37:21.065126 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 13 19:37:21.065126 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 13 19:37:21.065126 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 13 19:37:21.065126 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 19:37:21.065126 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application Sep 13 19:37:21.065126 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 553/1079] 10.222.0.25 () {56 vars in 1111 bytes} [Tue Sep 13 19:37:20 2022] GET /identity/v3/projects/service => generated 88 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 13 19:37:21.069659 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd454205-1001-4a1f-a75a-c0518e7cf219 None admin] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:37:21.122963 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG dbcounter [-] [87934] Writing DB stats keystone:SELECT=100 {{(pid=87934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:37:21.156426 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG dbcounter [-] [87935] Writing DB stats keystone:SELECT=100 {{(pid=87935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:37:21.164265 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 527/1080] 10.222.0.25 () {58 vars in 1282 bytes} [Tue Sep 13 19:37:20 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 383 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 13 19:37:21.166768 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec0e579-3998-47fd-93d4-a58314942dab None admin] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:37:21.187332 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd454205-1001-4a1f-a75a-c0518e7cf219 None admin] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:37:21.231352 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da72e05-baf9-46c8-a8da-aec5fd36173c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:37:21.231964 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da72e05-baf9-46c8-a8da-aec5fd36173c None admin] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:37:21.232340 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da72e05-baf9-46c8-a8da-aec5fd36173c None admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:37:21.232587 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da72e05-baf9-46c8-a8da-aec5fd36173c None admin] PATH_INFO: `/v3/projects` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:37:21.233230 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da72e05-baf9-46c8-a8da-aec5fd36173c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87934) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:37:21.233534 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da72e05-baf9-46c8-a8da-aec5fd36173c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:37:21.234966 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da72e05-baf9-46c8-a8da-aec5fd36173c None admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:37:21.253878 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 554/1081] 10.222.0.25 () {56 vars in 1148 bytes} [Tue Sep 13 19:37:21 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 19:37:21.254826 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da72e05-baf9-46c8-a8da-aec5fd36173c None admin] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:37:21.279327 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec0e579-3998-47fd-93d4-a58314942dab None admin] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:37:21.322209 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20152133-7f61-488f-a0b1-eaf446495910 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:37:21.322844 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20152133-7f61-488f-a0b1-eaf446495910 None admin] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:37:21.323126 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20152133-7f61-488f-a0b1-eaf446495910 None admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:37:21.323401 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20152133-7f61-488f-a0b1-eaf446495910 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:37:21.334910 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20152133-7f61-488f-a0b1-eaf446495910 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:37:21.336459 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20152133-7f61-488f-a0b1-eaf446495910 None admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:37:21.352620 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application [None req-20152133-7f61-488f-a0b1-eaf446495910 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 19:37:21.352620 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:37:21.352620 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:37:21.352620 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:37:21.352620 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:37:21.352620 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:37:21.352620 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:37:21.352620 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:37:21.352620 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:37:21.352620 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:37:21.352620 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:37:21.352620 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:37:21.352620 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 19:37:21.352620 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 19:37:21.352620 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 19:37:21.352620 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 19:37:21.353707 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:37:21.353707 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:37:21.353707 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:37:21.353707 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:37:21.353707 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:37:21.353707 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:37:21.353707 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:37:21.353707 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application with Lock( Sep 13 19:37:21.353707 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:37:21.353707 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:37:21.353707 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:37:21.353707 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:37:21.353707 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:37:21.353707 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:37:21.353707 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:37:21.353707 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:37:21.353707 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 19:37:21.354717 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 19:37:21.354717 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 19:37:21.354717 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application Sep 13 19:37:21.354717 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 528/1082] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Sep 13 19:37:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 13 19:37:21.361535 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20152133-7f61-488f-a0b1-eaf446495910 None admin] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:37:21.381525 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da72e05-baf9-46c8-a8da-aec5fd36173c None admin] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:37:21.392853 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG dbcounter [-] [87934] Writing DB stats keystone:SELECT=100 {{(pid=87934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:37:21.420971 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG dbcounter [-] [87935] Writing DB stats keystone:SELECT=100 {{(pid=87935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:37:21.423313 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed97ec5-790a-45ea-a541-de746fbcc602 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:37:21.423994 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed97ec5-790a-45ea-a541-de746fbcc602 None admin] REQUEST_METHOD: `PUT` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:37:21.424303 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed97ec5-790a-45ea-a541-de746fbcc602 None admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:37:21.424610 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed97ec5-790a-45ea-a541-de746fbcc602 None admin] PATH_INFO: `/v3/projects/9a10a4268f3c4cb29f4e00c292e2df62/users/d71fe5a8275f4ea98555afdcefc902a0/roles/14ffeae2f0594a2c9da6bfd35829457e` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:37:21.427257 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed97ec5-790a-45ea-a541-de746fbcc602 None admin] RBAC: Authorizing `identity:create_grant(project_id=9a10a4268f3c4cb29f4e00c292e2df62, user_id=d71fe5a8275f4ea98555afdcefc902a0, role_id=14ffeae2f0594a2c9da6bfd35829457e)` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:37:21.428743 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed97ec5-790a-45ea-a541-de746fbcc602 None admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:37:21.444697 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 555/1083] 10.222.0.25 () {58 vars in 1439 bytes} [Tue Sep 13 19:37:21 2022] PUT /identity/v3/projects/9a10a4268f3c4cb29f4e00c292e2df62/users/d71fe5a8275f4ea98555afdcefc902a0/roles/14ffeae2f0594a2c9da6bfd35829457e => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 19:37:21.487721 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20152133-7f61-488f-a0b1-eaf446495910 None admin] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:37:21.528360 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34748e5-6610-4063-a5e1-fcf1f017e179 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:37:21.528987 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34748e5-6610-4063-a5e1-fcf1f017e179 None admin] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:37:21.529266 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34748e5-6610-4063-a5e1-fcf1f017e179 None admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:37:21.529532 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34748e5-6610-4063-a5e1-fcf1f017e179 None admin] PATH_INFO: `/v3/domains` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:37:21.530187 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e34748e5-6610-4063-a5e1-fcf1f017e179 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87935) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:37:21.530489 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e34748e5-6610-4063-a5e1-fcf1f017e179 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:37:21.531900 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e34748e5-6610-4063-a5e1-fcf1f017e179 None admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:37:21.552240 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 529/1084] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Sep 13 19:37:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 19:37:22.983565 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d175aab-a7e6-48d9-a1ef-29de9edf1ebb None None] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:37:22.984109 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d175aab-a7e6-48d9-a1ef-29de9edf1ebb None None] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:37:22.984109 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d175aab-a7e6-48d9-a1ef-29de9edf1ebb None None] PATH_INFO: `/` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:37:22.985537 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 556/1085] 10.222.0.25 () {54 vars in 927 bytes} [Tue Sep 13 19:37:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:37:22.991839 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437fb7bf-15d8-45fd-9367-e5460cce41b4 None None] REQUEST_METHOD: `POST` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:37:22.992351 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437fb7bf-15d8-45fd-9367-e5460cce41b4 None None] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:37:22.992450 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437fb7bf-15d8-45fd-9367-e5460cce41b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:37:23.011232 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.auth.core [None req-437fb7bf-15d8-45fd-9367-e5460cce41b4 None None] MFA Rules not processed for user `7b0aed92d02344acb92a0e4aa67c3068`. Rule list: `[]` (Enabled: `True`). {{(pid=87935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:37:23.012444 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.fernet_utils [None req-437fb7bf-15d8-45fd-9367-e5460cce41b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:37:23.087229 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 530/1086] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Sep 13 19:37:22 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 13 19:37:23.359248 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d175aab-a7e6-48d9-a1ef-29de9edf1ebb None None] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:37:23.461937 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d175aab-a7e6-48d9-a1ef-29de9edf1ebb None None] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:37:23.501344 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c87a57-3731-40d8-b086-d08e0f89ec62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:37:23.501974 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c87a57-3731-40d8-b086-d08e0f89ec62 None admin] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:37:23.502249 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c87a57-3731-40d8-b086-d08e0f89ec62 None admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:37:23.502562 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c87a57-3731-40d8-b086-d08e0f89ec62 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:37:23.513095 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c87a57-3731-40d8-b086-d08e0f89ec62 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 19:37:23.517897 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application [None req-d6c87a57-3731-40d8-b086-d08e0f89ec62 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 19:37:23.517897 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:37:23.517897 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:37:23.517897 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:37:23.517897 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:37:23.517897 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:37:23.517897 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:37:23.517897 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:37:23.517897 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:37:23.517897 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:37:23.517897 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:37:23.517897 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:37:23.517897 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 19:37:23.517897 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 19:37:23.517897 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 19:37:23.517897 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 19:37:23.519505 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 19:37:23.519505 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 19:37:23.519505 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 19:37:23.519505 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 19:37:23.519505 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:37:23.519505 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:37:23.519505 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:37:23.519505 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:37:23.519505 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:37:23.519505 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:37:23.519505 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:37:23.519505 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application with Lock( Sep 13 19:37:23.519505 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:37:23.519505 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:37:23.519505 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:37:23.519505 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:37:23.520844 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:37:23.520844 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:37:23.520844 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:37:23.520844 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:37:23.520844 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 19:37:23.520844 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 19:37:23.520844 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 19:37:23.520844 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 19:37:23.520844 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 19:37:23.520844 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 19:37:23.520844 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 19:37:23.520844 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application Sep 13 19:37:23.520844 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 557/1087] 10.222.0.25 () {56 vars in 1096 bytes} [Tue Sep 13 19:37:23 2022] GET /identity/v3/roles/admin => generated 83 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:37:23.525343 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437fb7bf-15d8-45fd-9367-e5460cce41b4 None None] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:37:23.575405 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG dbcounter [-] [87935] Writing DB stats keystone:SELECT=100 {{(pid=87935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:37:23.650672 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437fb7bf-15d8-45fd-9367-e5460cce41b4 None None] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:37:23.661116 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb898db-72b1-41f8-872a-fc94bb6a3635 None None] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:37:23.662061 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb898db-72b1-41f8-872a-fc94bb6a3635 None None] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:37:23.662393 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb898db-72b1-41f8-872a-fc94bb6a3635 None None] PATH_INFO: `/` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:37:23.664245 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 558/1088] 10.222.0.25 () {54 vars in 927 bytes} [Tue Sep 13 19:37:23 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:37:23.669830 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6714d2d-f3bf-4550-a7a3-68633033dd87 None None] REQUEST_METHOD: `POST` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:37:23.670119 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6714d2d-f3bf-4550-a7a3-68633033dd87 None None] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:37:23.670395 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6714d2d-f3bf-4550-a7a3-68633033dd87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:37:23.688781 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53470d1d-a001-4bca-9568-605909ef0f4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:37:23.689036 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.auth.core [None req-f6714d2d-f3bf-4550-a7a3-68633033dd87 None None] MFA Rules not processed for user `7b0aed92d02344acb92a0e4aa67c3068`. Rule list: `[]` (Enabled: `True`). {{(pid=87934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:37:23.689393 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53470d1d-a001-4bca-9568-605909ef0f4b None admin] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:37:23.689670 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53470d1d-a001-4bca-9568-605909ef0f4b None admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:37:23.689968 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53470d1d-a001-4bca-9568-605909ef0f4b None admin] PATH_INFO: `/v3/roles` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:37:23.690393 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.fernet_utils [None req-f6714d2d-f3bf-4550-a7a3-68633033dd87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:37:23.690639 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53470d1d-a001-4bca-9568-605909ef0f4b None admin] RBAC: Adding query filter params (name=admin) {{(pid=87935) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:37:23.690940 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53470d1d-a001-4bca-9568-605909ef0f4b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:37:23.692388 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53470d1d-a001-4bca-9568-605909ef0f4b None admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:37:23.703282 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 531/1089] 10.222.0.25 () {56 vars in 1099 bytes} [Tue Sep 13 19:37:23 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:37:23.710877 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53470d1d-a001-4bca-9568-605909ef0f4b None admin] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:37:23.721914 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG dbcounter [-] [87934] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:37:23.772047 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 559/1090] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Sep 13 19:37:23 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 13 19:37:23.818489 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53470d1d-a001-4bca-9568-605909ef0f4b None admin] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:37:23.821633 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG dbcounter [-] [87935] Writing DB stats keystone:SELECT=100 {{(pid=87935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:37:23.855724 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0dae798-8b21-4a53-990d-2ca538e76b08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:37:23.856304 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0dae798-8b21-4a53-990d-2ca538e76b08 None admin] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:37:23.856584 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0dae798-8b21-4a53-990d-2ca538e76b08 None admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:37:23.856851 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0dae798-8b21-4a53-990d-2ca538e76b08 None admin] PATH_INFO: `/v3/users/d0d257cfa5cc436e87bc9a0f10e72922` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:37:23.857979 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0dae798-8b21-4a53-990d-2ca538e76b08 None admin] RBAC: Authorizing `identity:get_user(user_id=d0d257cfa5cc436e87bc9a0f10e72922)` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:37:23.859397 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0dae798-8b21-4a53-990d-2ca538e76b08 None admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:37:23.861023 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 532/1091] 10.222.0.25 () {56 vars in 1177 bytes} [Tue Sep 13 19:37:23 2022] GET /identity/v3/users/d0d257cfa5cc436e87bc9a0f10e72922 => generated 285 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 19:37:23.866894 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6714d2d-f3bf-4550-a7a3-68633033dd87 None None] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:37:23.988756 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6714d2d-f3bf-4550-a7a3-68633033dd87 None None] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:37:24.025010 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8976cbd-a639-4303-baa5-0ce630b8a0cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:37:24.025632 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8976cbd-a639-4303-baa5-0ce630b8a0cc None admin] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:37:24.026063 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8976cbd-a639-4303-baa5-0ce630b8a0cc None admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:37:24.026328 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8976cbd-a639-4303-baa5-0ce630b8a0cc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:37:24.054318 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0dae798-8b21-4a53-990d-2ca538e76b08 None admin] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:37:24.057573 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG dbcounter [-] [87934] Writing DB stats keystone:SELECT=100 {{(pid=87934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:37:24.113107 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8976cbd-a639-4303-baa5-0ce630b8a0cc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:37:24.114481 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8976cbd-a639-4303-baa5-0ce630b8a0cc None admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:37:24.168075 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0dae798-8b21-4a53-990d-2ca538e76b08 None admin] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:37:24.204554 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2ebe21-78d4-447d-a281-eb9be7afff7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:37:24.205200 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2ebe21-78d4-447d-a281-eb9be7afff7b None admin] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:37:24.205477 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2ebe21-78d4-447d-a281-eb9be7afff7b None admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:37:24.206520 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2ebe21-78d4-447d-a281-eb9be7afff7b None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:37:24.218591 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea2ebe21-78d4-447d-a281-eb9be7afff7b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 19:37:24.219836 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 560/1092] 10.222.0.25 () {58 vars in 1282 bytes} [Tue Sep 13 19:37:23 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 13 19:37:24.223507 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application [None req-ea2ebe21-78d4-447d-a281-eb9be7afff7b None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 13 19:37:24.223507 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:37:24.223507 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:37:24.223507 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:37:24.223507 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:37:24.223507 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:37:24.223507 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:37:24.223507 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:37:24.223507 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:37:24.223507 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:37:24.223507 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:37:24.223507 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:37:24.223507 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 19:37:24.223507 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 19:37:24.223507 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 19:37:24.223507 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 19:37:24.224693 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 19:37:24.224693 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 19:37:24.224693 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 19:37:24.224693 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 19:37:24.224693 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:37:24.224693 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:37:24.224693 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:37:24.224693 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:37:24.224693 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:37:24.224693 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:37:24.224693 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:37:24.224693 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application with Lock( Sep 13 19:37:24.224693 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:37:24.224693 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:37:24.224693 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:37:24.224693 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:37:24.226120 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:37:24.226120 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:37:24.226120 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:37:24.226120 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:37:24.226120 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 19:37:24.226120 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 19:37:24.226120 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 19:37:24.226120 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 19:37:24.226120 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 19:37:24.226120 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 19:37:24.226120 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 13 19:37:24.226120 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application Sep 13 19:37:24.226120 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 533/1093] 10.222.0.25 () {56 vars in 1120 bytes} [Tue Sep 13 19:37:24 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 13 19:37:24.227020 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8976cbd-a639-4303-baa5-0ce630b8a0cc None admin] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:37:24.230442 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2ebe21-78d4-447d-a281-eb9be7afff7b None admin] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:37:24.263186 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG dbcounter [-] [87935] Writing DB stats keystone:SELECT=100 {{(pid=87935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:37:24.290406 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG dbcounter [-] [87934] Writing DB stats keystone:SELECT=100 {{(pid=87934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:37:24.333327 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8976cbd-a639-4303-baa5-0ce630b8a0cc None admin] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:37:24.336555 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2ebe21-78d4-447d-a281-eb9be7afff7b None admin] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:37:24.372513 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31fa91b2-0ddb-4595-95b9-67f70460e591 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:37:24.373063 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fa91b2-0ddb-4595-95b9-67f70460e591 None admin] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:37:24.373344 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fa91b2-0ddb-4595-95b9-67f70460e591 None admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:37:24.373617 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fa91b2-0ddb-4595-95b9-67f70460e591 None admin] PATH_INFO: `/v3/projects/d82644e39c8f487096062ea8d01a4e20` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:37:24.374417 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84f2322-7b60-4fe9-9951-484b197cdda3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:37:24.374725 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31fa91b2-0ddb-4595-95b9-67f70460e591 None admin] RBAC: Authorizing `identity:get_project(project_id=d82644e39c8f487096062ea8d01a4e20)` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:37:24.375020 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84f2322-7b60-4fe9-9951-484b197cdda3 None admin] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:37:24.375298 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84f2322-7b60-4fe9-9951-484b197cdda3 None admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:37:24.375567 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84f2322-7b60-4fe9-9951-484b197cdda3 None admin] PATH_INFO: `/v3/roles` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:37:24.376150 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31fa91b2-0ddb-4595-95b9-67f70460e591 None admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:37:24.376286 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f84f2322-7b60-4fe9-9951-484b197cdda3 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=87935) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:37:24.376550 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f84f2322-7b60-4fe9-9951-484b197cdda3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:37:24.383376 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 561/1094] 10.222.0.25 () {56 vars in 1186 bytes} [Tue Sep 13 19:37:24 2022] GET /identity/v3/projects/d82644e39c8f487096062ea8d01a4e20 => generated 311 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:37:24.383653 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f84f2322-7b60-4fe9-9951-484b197cdda3 None admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:37:24.384624 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31fa91b2-0ddb-4595-95b9-67f70460e591 None admin] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:37:24.391109 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 534/1095] 10.222.0.25 () {56 vars in 1115 bytes} [Tue Sep 13 19:37:24 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 19:37:24.396853 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84f2322-7b60-4fe9-9951-484b197cdda3 None admin] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:37:24.487373 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31fa91b2-0ddb-4595-95b9-67f70460e591 None admin] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:37:24.494287 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG dbcounter [-] [87935] Writing DB stats keystone:SELECT=100 {{(pid=87935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:37:24.502386 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84f2322-7b60-4fe9-9951-484b197cdda3 None admin] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:37:24.514724 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG dbcounter [-] [87934] Writing DB stats keystone:SELECT=100 {{(pid=87934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:37:24.523732 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63306e4-a7e1-47c2-8002-9532306d18f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:37:24.524378 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63306e4-a7e1-47c2-8002-9532306d18f1 None admin] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:37:24.524652 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63306e4-a7e1-47c2-8002-9532306d18f1 None admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:37:24.524917 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63306e4-a7e1-47c2-8002-9532306d18f1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:37:24.525638 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f63306e4-a7e1-47c2-8002-9532306d18f1 None admin] RBAC: Adding query filter params (role.id=6ca1d4427ff64e0a9d25d96cfb1445f6, scope.project.id=d82644e39c8f487096062ea8d01a4e20, user.id=d0d257cfa5cc436e87bc9a0f10e72922) {{(pid=87934) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:37:24.525943 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f63306e4-a7e1-47c2-8002-9532306d18f1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:37:24.527362 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f63306e4-a7e1-47c2-8002-9532306d18f1 None admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:37:24.534833 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 562/1096] 10.222.0.25 () {56 vars in 1374 bytes} [Tue Sep 13 19:37:24 2022] GET /identity/v3/role_assignments?user.id=d0d257cfa5cc436e87bc9a0f10e72922&scope.project.id=d82644e39c8f487096062ea8d01a4e20&role.id=6ca1d4427ff64e0a9d25d96cfb1445f6 => generated 608 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 19:37:24.539794 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620ff35b-71f9-40e5-b387-3a343c7b0859 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:37:24.540478 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620ff35b-71f9-40e5-b387-3a343c7b0859 None admin] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:37:24.540761 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620ff35b-71f9-40e5-b387-3a343c7b0859 None admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:37:24.541034 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620ff35b-71f9-40e5-b387-3a343c7b0859 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:37:24.554172 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-620ff35b-71f9-40e5-b387-3a343c7b0859 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:37:24.555668 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-620ff35b-71f9-40e5-b387-3a343c7b0859 None admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:37:24.572547 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application [None req-620ff35b-71f9-40e5-b387-3a343c7b0859 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 19:37:24.572547 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:37:24.572547 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:37:24.572547 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:37:24.572547 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:37:24.572547 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:37:24.572547 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:37:24.572547 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:37:24.572547 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:37:24.572547 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:37:24.572547 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:37:24.572547 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:37:24.572547 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 19:37:24.572547 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 19:37:24.572547 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 19:37:24.572547 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 19:37:24.573613 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:37:24.573613 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:37:24.573613 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:37:24.573613 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:37:24.573613 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:37:24.573613 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:37:24.573613 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:37:24.573613 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application with Lock( Sep 13 19:37:24.573613 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:37:24.573613 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:37:24.573613 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:37:24.573613 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:37:24.573613 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:37:24.573613 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:37:24.573613 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:37:24.573613 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:37:24.573613 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 19:37:24.574528 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 19:37:24.574528 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 19:37:24.574528 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application Sep 13 19:37:24.574528 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 535/1097] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Sep 13 19:37:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 13 19:37:24.580097 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63306e4-a7e1-47c2-8002-9532306d18f1 None admin] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:37:24.689732 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63306e4-a7e1-47c2-8002-9532306d18f1 None admin] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:37:24.726717 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d76ec00-a805-4e8e-afed-babb4d6fd57c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:37:24.727331 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d76ec00-a805-4e8e-afed-babb4d6fd57c None admin] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:37:24.727608 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d76ec00-a805-4e8e-afed-babb4d6fd57c None admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:37:24.727877 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d76ec00-a805-4e8e-afed-babb4d6fd57c None admin] PATH_INFO: `/v3/domains` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:37:24.728626 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d76ec00-a805-4e8e-afed-babb4d6fd57c None admin] RBAC: Adding query filter params (name=Default) {{(pid=87934) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:37:24.728933 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d76ec00-a805-4e8e-afed-babb4d6fd57c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:37:24.730282 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d76ec00-a805-4e8e-afed-babb4d6fd57c None admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:37:24.743969 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 563/1098] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Sep 13 19:37:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:37:24.749996 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620ff35b-71f9-40e5-b387-3a343c7b0859 None admin] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:37:24.866838 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620ff35b-71f9-40e5-b387-3a343c7b0859 None admin] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:37:24.900334 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b49be0-a33f-4a20-aa78-c78096a58883 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:37:24.900959 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b49be0-a33f-4a20-aa78-c78096a58883 None admin] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:37:24.901236 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b49be0-a33f-4a20-aa78-c78096a58883 None admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:37:24.901507 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b49be0-a33f-4a20-aa78-c78096a58883 None admin] PATH_INFO: `/v3/users/nova` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:37:24.909913 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b49be0-a33f-4a20-aa78-c78096a58883 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:37:24.911339 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b49be0-a33f-4a20-aa78-c78096a58883 None admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:37:24.922552 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application [None req-52b49be0-a33f-4a20-aa78-c78096a58883 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 13 19:37:24.922552 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:37:24.922552 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:37:24.922552 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:37:24.922552 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:37:24.922552 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:37:24.922552 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:37:24.922552 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:37:24.922552 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:37:24.922552 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:37:24.922552 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:37:24.922552 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:37:24.922552 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 13 19:37:24.922552 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 13 19:37:24.922552 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 13 19:37:24.922552 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 13 19:37:24.923655 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:37:24.923655 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:37:24.923655 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 13 19:37:24.923655 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 19:37:24.923655 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 13 19:37:24.923655 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 19:37:24.923655 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:37:24.923655 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:37:24.923655 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:37:24.923655 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:37:24.923655 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:37:24.923655 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application with Lock( Sep 13 19:37:24.923655 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:37:24.923655 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:37:24.923655 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:37:24.923655 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:37:24.923655 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:37:24.923655 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:37:24.925474 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:37:24.925474 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:37:24.925474 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 13 19:37:24.925474 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 13 19:37:24.925474 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 13 19:37:24.925474 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 13 19:37:24.925474 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 13 19:37:24.925474 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 13 19:37:24.925474 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 13 19:37:24.925474 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application Sep 13 19:37:24.925474 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 536/1099] 10.222.0.25 () {56 vars in 1093 bytes} [Tue Sep 13 19:37:24 2022] GET /identity/v3/users/nova => generated 82 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:37:24.930110 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d76ec00-a805-4e8e-afed-babb4d6fd57c None admin] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:37:24.980873 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG dbcounter [-] [87934] Writing DB stats keystone:SELECT=100 {{(pid=87934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:37:25.031065 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d76ec00-a805-4e8e-afed-babb4d6fd57c None admin] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:37:25.065636 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23842c5d-1200-4f9a-9e3a-4625214264bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:37:25.066234 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23842c5d-1200-4f9a-9e3a-4625214264bb None admin] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:37:25.066507 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23842c5d-1200-4f9a-9e3a-4625214264bb None admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:37:25.066768 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23842c5d-1200-4f9a-9e3a-4625214264bb None admin] PATH_INFO: `/v3/users` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:37:25.067485 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23842c5d-1200-4f9a-9e3a-4625214264bb None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=87934) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:37:25.067783 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23842c5d-1200-4f9a-9e3a-4625214264bb None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:37:25.069225 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23842c5d-1200-4f9a-9e3a-4625214264bb None admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:37:25.087241 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 564/1100] 10.222.0.25 () {56 vars in 1133 bytes} [Tue Sep 13 19:37:24 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 19:37:25.093117 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b49be0-a33f-4a20-aa78-c78096a58883 None admin] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:37:25.104316 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG dbcounter [-] [87935] Writing DB stats keystone:SELECT=100 {{(pid=87935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:37:25.197416 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b49be0-a33f-4a20-aa78-c78096a58883 None admin] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:37:25.236641 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289461fe-957a-4866-935e-ef008840597c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:37:25.237962 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289461fe-957a-4866-935e-ef008840597c None admin] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:37:25.238237 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289461fe-957a-4866-935e-ef008840597c None admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:37:25.238508 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289461fe-957a-4866-935e-ef008840597c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:37:25.307047 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-289461fe-957a-4866-935e-ef008840597c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:37:25.308528 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-289461fe-957a-4866-935e-ef008840597c None admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:37:25.317159 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG dbcounter [-] [87935] Writing DB stats keystone:SELECT=100 {{(pid=87935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:37:25.411506 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 537/1101] 10.222.0.25 () {58 vars in 1282 bytes} [Tue Sep 13 19:37:25 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 13 19:37:25.417368 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23842c5d-1200-4f9a-9e3a-4625214264bb None admin] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:37:25.520665 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23842c5d-1200-4f9a-9e3a-4625214264bb None admin] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:37:25.530050 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG dbcounter [-] [87934] Writing DB stats keystone:SELECT=100 {{(pid=87934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:37:25.557161 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dea45d9-e76f-4427-8d0f-4ded3fa6f100 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:37:25.557789 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dea45d9-e76f-4427-8d0f-4ded3fa6f100 None admin] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:37:25.558060 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dea45d9-e76f-4427-8d0f-4ded3fa6f100 None admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:37:25.558321 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dea45d9-e76f-4427-8d0f-4ded3fa6f100 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:37:25.568628 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dea45d9-e76f-4427-8d0f-4ded3fa6f100 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:37:25.570048 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dea45d9-e76f-4427-8d0f-4ded3fa6f100 None admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:37:25.584793 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application [None req-8dea45d9-e76f-4427-8d0f-4ded3fa6f100 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 19:37:25.584793 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:37:25.584793 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:37:25.584793 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:37:25.584793 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:37:25.584793 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:37:25.584793 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:37:25.584793 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:37:25.584793 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:37:25.584793 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:37:25.584793 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:37:25.584793 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:37:25.584793 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 19:37:25.584793 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 19:37:25.584793 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 19:37:25.584793 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 19:37:25.585786 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:37:25.585786 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:37:25.585786 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:37:25.585786 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:37:25.585786 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:37:25.585786 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:37:25.585786 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:37:25.585786 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application with Lock( Sep 13 19:37:25.585786 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:37:25.585786 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:37:25.585786 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:37:25.585786 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:37:25.585786 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:37:25.585786 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:37:25.585786 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:37:25.585786 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:37:25.585786 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 19:37:25.587197 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 19:37:25.587197 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 19:37:25.587197 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application Sep 13 19:37:25.587197 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 565/1102] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Sep 13 19:37:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:37:25.591603 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289461fe-957a-4866-935e-ef008840597c None admin] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:37:25.696327 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289461fe-957a-4866-935e-ef008840597c None admin] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:37:25.704074 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG dbcounter [-] [87935] Writing DB stats keystone:SELECT=100 {{(pid=87935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:37:25.734736 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7da45bf-19cd-4bff-b065-e732457989f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:37:25.735338 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7da45bf-19cd-4bff-b065-e732457989f3 None admin] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:37:25.735641 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7da45bf-19cd-4bff-b065-e732457989f3 None admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:37:25.735910 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7da45bf-19cd-4bff-b065-e732457989f3 None admin] PATH_INFO: `/v3/domains` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:37:25.736713 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7da45bf-19cd-4bff-b065-e732457989f3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87935) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:37:25.737678 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7da45bf-19cd-4bff-b065-e732457989f3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:37:25.739308 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7da45bf-19cd-4bff-b065-e732457989f3 None admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:37:25.755590 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 538/1103] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Sep 13 19:37:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:37:25.757289 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dea45d9-e76f-4427-8d0f-4ded3fa6f100 None admin] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:37:25.869629 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dea45d9-e76f-4427-8d0f-4ded3fa6f100 None admin] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:37:25.902857 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe61cd0b-6cca-4b22-8074-72c8d0fafe72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:37:25.903482 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe61cd0b-6cca-4b22-8074-72c8d0fafe72 None admin] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:37:25.903761 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe61cd0b-6cca-4b22-8074-72c8d0fafe72 None admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:37:25.904037 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe61cd0b-6cca-4b22-8074-72c8d0fafe72 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:37:25.911240 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe61cd0b-6cca-4b22-8074-72c8d0fafe72 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:37:25.912703 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe61cd0b-6cca-4b22-8074-72c8d0fafe72 None admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:37:25.924275 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application [None req-fe61cd0b-6cca-4b22-8074-72c8d0fafe72 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 19:37:25.924275 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:37:25.924275 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:37:25.924275 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:37:25.924275 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:37:25.924275 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:37:25.924275 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:37:25.924275 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:37:25.924275 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:37:25.924275 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:37:25.924275 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:37:25.924275 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:37:25.924275 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 13 19:37:25.924275 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 13 19:37:25.924275 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 13 19:37:25.925286 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 13 19:37:25.925286 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:37:25.925286 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:37:25.925286 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:37:25.925286 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:37:25.925286 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:37:25.925286 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:37:25.925286 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:37:25.925286 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application with Lock( Sep 13 19:37:25.925286 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:37:25.925286 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:37:25.925286 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:37:25.925286 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:37:25.925286 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:37:25.925286 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:37:25.925286 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:37:25.925286 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:37:25.926436 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 13 19:37:25.926436 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 13 19:37:25.926436 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 13 19:37:25.926436 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 13 19:37:25.926436 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 13 19:37:25.926436 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 13 19:37:25.926436 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 19:37:25.926436 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application Sep 13 19:37:25.928367 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 566/1104] 10.222.0.25 () {56 vars in 1111 bytes} [Tue Sep 13 19:37:25 2022] GET /identity/v3/projects/service => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:37:25.931239 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7da45bf-19cd-4bff-b065-e732457989f3 None admin] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:37:26.031091 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7da45bf-19cd-4bff-b065-e732457989f3 None admin] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:37:26.069127 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f32a7f-4528-442b-b791-0f0deb8052a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:37:26.070140 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f32a7f-4528-442b-b791-0f0deb8052a6 None admin] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:37:26.070637 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f32a7f-4528-442b-b791-0f0deb8052a6 None admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:37:26.071129 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f32a7f-4528-442b-b791-0f0deb8052a6 None admin] PATH_INFO: `/v3/projects` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:37:26.072440 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f32a7f-4528-442b-b791-0f0deb8052a6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87935) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:37:26.072996 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f32a7f-4528-442b-b791-0f0deb8052a6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:37:26.075695 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f32a7f-4528-442b-b791-0f0deb8052a6 None admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:37:26.098134 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 539/1105] 10.222.0.25 () {56 vars in 1148 bytes} [Tue Sep 13 19:37:25 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:37:26.104073 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe61cd0b-6cca-4b22-8074-72c8d0fafe72 None admin] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:37:26.127074 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG dbcounter [-] [87934] Writing DB stats keystone:SELECT=100 {{(pid=87934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:37:26.214390 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe61cd0b-6cca-4b22-8074-72c8d0fafe72 None admin] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:37:26.250000 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ddcd48-6879-4b4f-bb0a-548d888da819 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:37:26.250641 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ddcd48-6879-4b4f-bb0a-548d888da819 None admin] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:37:26.250922 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ddcd48-6879-4b4f-bb0a-548d888da819 None admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:37:26.251192 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ddcd48-6879-4b4f-bb0a-548d888da819 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:37:26.251919 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ddcd48-6879-4b4f-bb0a-548d888da819 None admin] RBAC: Adding query filter params (role.id=14ffeae2f0594a2c9da6bfd35829457e, scope.project.id=9a10a4268f3c4cb29f4e00c292e2df62, user.id=d71fe5a8275f4ea98555afdcefc902a0) {{(pid=87934) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:37:26.252248 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ddcd48-6879-4b4f-bb0a-548d888da819 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:37:26.254702 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ddcd48-6879-4b4f-bb0a-548d888da819 None admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:37:26.261591 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 567/1106] 10.222.0.25 () {56 vars in 1374 bytes} [Tue Sep 13 19:37:26 2022] GET /identity/v3/role_assignments?user.id=d71fe5a8275f4ea98555afdcefc902a0&scope.project.id=9a10a4268f3c4cb29f4e00c292e2df62&role.id=14ffeae2f0594a2c9da6bfd35829457e => generated 608 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:37:26.777741 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd60289e-aa6f-4268-a816-ef7fc0b6436f None None] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:37:26.778023 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd60289e-aa6f-4268-a816-ef7fc0b6436f None None] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:37:26.778286 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd60289e-aa6f-4268-a816-ef7fc0b6436f None None] PATH_INFO: `/` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:37:26.779629 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 540/1107] 10.222.0.25 () {54 vars in 927 bytes} [Tue Sep 13 19:37:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:37:26.785304 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e24ae3-01a4-4313-910e-f49234e52030 None None] REQUEST_METHOD: `POST` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:37:26.785586 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e24ae3-01a4-4313-910e-f49234e52030 None None] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:37:26.785856 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e24ae3-01a4-4313-910e-f49234e52030 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:37:26.804779 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.auth.core [None req-29e24ae3-01a4-4313-910e-f49234e52030 None None] MFA Rules not processed for user `7b0aed92d02344acb92a0e4aa67c3068`. Rule list: `[]` (Enabled: `True`). {{(pid=87934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:37:26.805967 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.fernet_utils [None req-29e24ae3-01a4-4313-910e-f49234e52030 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:37:26.878908 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 568/1108] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Sep 13 19:37:26 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 13 19:37:27.148465 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd60289e-aa6f-4268-a816-ef7fc0b6436f None None] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:37:27.183215 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG dbcounter [-] [87935] Writing DB stats keystone:SELECT=100 {{(pid=87935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:37:27.268192 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd60289e-aa6f-4268-a816-ef7fc0b6436f None None] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:37:27.305262 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1dae75-50f3-408b-9549-96d89a345a5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:37:27.305898 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1dae75-50f3-408b-9549-96d89a345a5d None admin] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:37:27.306176 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1dae75-50f3-408b-9549-96d89a345a5d None admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:37:27.306447 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1dae75-50f3-408b-9549-96d89a345a5d None admin] PATH_INFO: `/v3/domains/default` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:37:27.307570 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f1dae75-50f3-408b-9549-96d89a345a5d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:37:27.309043 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f1dae75-50f3-408b-9549-96d89a345a5d None admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:37:27.310628 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 541/1109] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Sep 13 19:37:27 2022] GET /identity/v3/domains/default => generated 199 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:37:27.316568 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e24ae3-01a4-4313-910e-f49234e52030 None None] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:37:27.332606 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG dbcounter [-] [87934] Writing DB stats keystone:SELECT=100 {{(pid=87934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:37:27.415237 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e24ae3-01a4-4313-910e-f49234e52030 None None] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:37:27.464664 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9023189-9f81-4aa9-bd9b-4f3dc03cb23d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:37:27.465273 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9023189-9f81-4aa9-bd9b-4f3dc03cb23d None admin] REQUEST_METHOD: `POST` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:37:27.465551 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9023189-9f81-4aa9-bd9b-4f3dc03cb23d None admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:37:27.465806 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9023189-9f81-4aa9-bd9b-4f3dc03cb23d None admin] PATH_INFO: `/v3/users` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:37:27.466442 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9023189-9f81-4aa9-bd9b-4f3dc03cb23d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:37:27.467857 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9023189-9f81-4aa9-bd9b-4f3dc03cb23d None admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:37:27.492006 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 569/1110] 10.222.0.25 () {60 vars in 1132 bytes} [Tue Sep 13 19:37:27 2022] POST /identity/v3/users => generated 286 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 19:37:29.690460 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41660aa-1b52-4e7f-a599-827cf77eb3eb None None] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:37:29.690968 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41660aa-1b52-4e7f-a599-827cf77eb3eb None None] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:37:29.690968 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41660aa-1b52-4e7f-a599-827cf77eb3eb None None] PATH_INFO: `/` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:37:29.692326 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 542/1111] 10.222.0.25 () {54 vars in 927 bytes} [Tue Sep 13 19:37:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:37:29.698264 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6027ad-55d0-42b4-86ac-c1b7fb8723e2 None None] REQUEST_METHOD: `POST` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:37:29.698661 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6027ad-55d0-42b4-86ac-c1b7fb8723e2 None None] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:37:29.698799 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6027ad-55d0-42b4-86ac-c1b7fb8723e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:37:29.721799 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.auth.core [None req-6d6027ad-55d0-42b4-86ac-c1b7fb8723e2 None None] MFA Rules not processed for user `7b0aed92d02344acb92a0e4aa67c3068`. Rule list: `[]` (Enabled: `True`). {{(pid=87934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:37:29.722990 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.fernet_utils [None req-6d6027ad-55d0-42b4-86ac-c1b7fb8723e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:37:29.787367 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG dbcounter [-] [87934] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:37:29.792891 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 570/1112] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Sep 13 19:37:29 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 13 19:37:30.104929 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41660aa-1b52-4e7f-a599-827cf77eb3eb None None] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:37:30.200988 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG dbcounter [-] [87935] Writing DB stats keystone:SELECT=100 {{(pid=87935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:37:30.209674 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41660aa-1b52-4e7f-a599-827cf77eb3eb None None] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:37:30.244560 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54906af6-d27d-4167-9942-505485e62428 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:37:30.245175 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54906af6-d27d-4167-9942-505485e62428 None admin] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:37:30.245452 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54906af6-d27d-4167-9942-505485e62428 None admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:37:30.245721 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54906af6-d27d-4167-9942-505485e62428 None admin] PATH_INFO: `/v3/roles/8af3d83a03144ae8bacdb82d9a108110` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:37:30.247182 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54906af6-d27d-4167-9942-505485e62428 None admin] RBAC: Authorizing `identity:get_role(role_id=8af3d83a03144ae8bacdb82d9a108110)` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:37:30.248507 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54906af6-d27d-4167-9942-505485e62428 None admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:37:30.249855 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 543/1113] 10.222.0.25 () {56 vars in 1177 bytes} [Tue Sep 13 19:37:30 2022] GET /identity/v3/roles/8af3d83a03144ae8bacdb82d9a108110 => generated 223 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:37:30.256360 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6027ad-55d0-42b4-86ac-c1b7fb8723e2 None None] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:37:30.356861 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6027ad-55d0-42b4-86ac-c1b7fb8723e2 None None] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:37:30.391870 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7910be-19ff-4067-b31a-22b38f608d76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:37:30.392524 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7910be-19ff-4067-b31a-22b38f608d76 None admin] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:37:30.392800 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7910be-19ff-4067-b31a-22b38f608d76 None admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:37:30.393095 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7910be-19ff-4067-b31a-22b38f608d76 None admin] PATH_INFO: `/v3/users/2fc4f187e0424c6ea79528d6c06120eb` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:37:30.406189 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee7910be-19ff-4067-b31a-22b38f608d76 None admin] RBAC: Authorizing `identity:get_user(user_id=2fc4f187e0424c6ea79528d6c06120eb)` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:37:30.407612 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee7910be-19ff-4067-b31a-22b38f608d76 None admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:37:30.409361 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 571/1114] 10.222.0.25 () {56 vars in 1177 bytes} [Tue Sep 13 19:37:30 2022] GET /identity/v3/users/2fc4f187e0424c6ea79528d6c06120eb => generated 286 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 19:37:30.415430 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54906af6-d27d-4167-9942-505485e62428 None admin] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:37:30.512677 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54906af6-d27d-4167-9942-505485e62428 None admin] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:37:30.545579 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adcc99f9-8a36-45a5-8756-b67c8ad9b1d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:37:30.546178 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adcc99f9-8a36-45a5-8756-b67c8ad9b1d3 None admin] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:37:30.546453 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adcc99f9-8a36-45a5-8756-b67c8ad9b1d3 None admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:37:30.546720 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adcc99f9-8a36-45a5-8756-b67c8ad9b1d3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:37:30.577938 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG dbcounter [-] [87935] Writing DB stats keystone:SELECT=100 {{(pid=87935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:37:30.619964 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adcc99f9-8a36-45a5-8756-b67c8ad9b1d3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:37:30.621375 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adcc99f9-8a36-45a5-8756-b67c8ad9b1d3 None admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:37:30.719010 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 544/1115] 10.222.0.25 () {58 vars in 1282 bytes} [Tue Sep 13 19:37:30 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 13 19:37:30.725702 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7910be-19ff-4067-b31a-22b38f608d76 None admin] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:37:30.781381 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG dbcounter [-] [87934] Writing DB stats keystone:SELECT=100 {{(pid=87934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:37:30.822512 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7910be-19ff-4067-b31a-22b38f608d76 None admin] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:37:30.856942 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7330a76-41c1-481e-92ec-6e004c428075 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:37:30.857566 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7330a76-41c1-481e-92ec-6e004c428075 None admin] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:37:30.857840 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7330a76-41c1-481e-92ec-6e004c428075 None admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:37:30.858104 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7330a76-41c1-481e-92ec-6e004c428075 None admin] PATH_INFO: `/v3/projects/d82644e39c8f487096062ea8d01a4e20` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:37:30.859202 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7330a76-41c1-481e-92ec-6e004c428075 None admin] RBAC: Authorizing `identity:get_project(project_id=d82644e39c8f487096062ea8d01a4e20)` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:37:30.860642 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7330a76-41c1-481e-92ec-6e004c428075 None admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:37:30.862863 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 572/1116] 10.222.0.25 () {56 vars in 1186 bytes} [Tue Sep 13 19:37:30 2022] GET /identity/v3/projects/d82644e39c8f487096062ea8d01a4e20 => generated 311 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:37:30.869137 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adcc99f9-8a36-45a5-8756-b67c8ad9b1d3 None admin] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:37:30.928641 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG dbcounter [-] [87935] Writing DB stats keystone:SELECT=100 {{(pid=87935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:37:30.974184 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adcc99f9-8a36-45a5-8756-b67c8ad9b1d3 None admin] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:37:31.008474 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af5e60d-2d96-44c6-8780-abb8897fd374 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:37:31.009063 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af5e60d-2d96-44c6-8780-abb8897fd374 None admin] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:37:31.009337 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af5e60d-2d96-44c6-8780-abb8897fd374 None admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:37:31.009599 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af5e60d-2d96-44c6-8780-abb8897fd374 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:37:31.010306 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af5e60d-2d96-44c6-8780-abb8897fd374 None admin] RBAC: Adding query filter params (role.id=8af3d83a03144ae8bacdb82d9a108110, scope.project.id=d82644e39c8f487096062ea8d01a4e20, user.id=2fc4f187e0424c6ea79528d6c06120eb) {{(pid=87935) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:37:31.010607 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af5e60d-2d96-44c6-8780-abb8897fd374 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:37:31.012017 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af5e60d-2d96-44c6-8780-abb8897fd374 None admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:37:31.017205 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 545/1117] 10.222.0.25 () {56 vars in 1374 bytes} [Tue Sep 13 19:37:30 2022] GET /identity/v3/role_assignments?user.id=2fc4f187e0424c6ea79528d6c06120eb&scope.project.id=d82644e39c8f487096062ea8d01a4e20&role.id=8af3d83a03144ae8bacdb82d9a108110 => generated 259 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:37:33.146036 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1730c1e-20c0-4749-804c-adfd4fb4f805 None None] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:37:33.146606 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1730c1e-20c0-4749-804c-adfd4fb4f805 None None] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:37:33.146606 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1730c1e-20c0-4749-804c-adfd4fb4f805 None None] PATH_INFO: `/` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:37:33.147883 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 573/1118] 10.222.0.25 () {54 vars in 927 bytes} [Tue Sep 13 19:37:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:37:33.153131 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64f8748-37a6-4b18-80ad-740f603c47b2 None None] REQUEST_METHOD: `POST` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:37:33.153538 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64f8748-37a6-4b18-80ad-740f603c47b2 None None] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:37:33.153672 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64f8748-37a6-4b18-80ad-740f603c47b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:37:33.171969 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.auth.core [None req-a64f8748-37a6-4b18-80ad-740f603c47b2 None None] MFA Rules not processed for user `7b0aed92d02344acb92a0e4aa67c3068`. Rule list: `[]` (Enabled: `True`). {{(pid=87935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:37:33.173171 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.fernet_utils [None req-a64f8748-37a6-4b18-80ad-740f603c47b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:37:33.238881 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 546/1119] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Sep 13 19:37:33 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 13 19:37:33.536759 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1730c1e-20c0-4749-804c-adfd4fb4f805 None None] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:37:33.641221 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1730c1e-20c0-4749-804c-adfd4fb4f805 None None] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:37:33.671289 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG dbcounter [-] [87934] Writing DB stats keystone:SELECT=100 {{(pid=87934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:37:33.680624 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0109246-e3a7-496c-8899-774e353ce0dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:37:33.681251 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0109246-e3a7-496c-8899-774e353ce0dc None admin] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:37:33.681524 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0109246-e3a7-496c-8899-774e353ce0dc None admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:37:33.681789 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0109246-e3a7-496c-8899-774e353ce0dc None admin] PATH_INFO: `/v3/roles/8af3d83a03144ae8bacdb82d9a108110` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:37:33.683149 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0109246-e3a7-496c-8899-774e353ce0dc None admin] RBAC: Authorizing `identity:get_role(role_id=8af3d83a03144ae8bacdb82d9a108110)` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:37:33.684529 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0109246-e3a7-496c-8899-774e353ce0dc None admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:37:33.685835 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 574/1120] 10.222.0.25 () {56 vars in 1177 bytes} [Tue Sep 13 19:37:33 2022] GET /identity/v3/roles/8af3d83a03144ae8bacdb82d9a108110 => generated 223 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:37:33.692296 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64f8748-37a6-4b18-80ad-740f603c47b2 None None] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:37:33.746384 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG dbcounter [-] [87935] Writing DB stats keystone:SELECT=100 {{(pid=87935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:37:33.790310 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64f8748-37a6-4b18-80ad-740f603c47b2 None None] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:37:33.823832 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca90deeb-36b9-402c-b73e-46025768f323 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:37:33.824475 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca90deeb-36b9-402c-b73e-46025768f323 None admin] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:37:33.824748 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca90deeb-36b9-402c-b73e-46025768f323 None admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:37:33.825013 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca90deeb-36b9-402c-b73e-46025768f323 None admin] PATH_INFO: `/v3/users/2fc4f187e0424c6ea79528d6c06120eb` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:37:33.826108 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca90deeb-36b9-402c-b73e-46025768f323 None admin] RBAC: Authorizing `identity:get_user(user_id=2fc4f187e0424c6ea79528d6c06120eb)` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:37:33.827517 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca90deeb-36b9-402c-b73e-46025768f323 None admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:37:33.829092 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 547/1121] 10.222.0.25 () {56 vars in 1177 bytes} [Tue Sep 13 19:37:33 2022] GET /identity/v3/users/2fc4f187e0424c6ea79528d6c06120eb => generated 286 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:37:33.835989 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0109246-e3a7-496c-8899-774e353ce0dc None admin] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:37:33.931483 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0109246-e3a7-496c-8899-774e353ce0dc None admin] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:37:33.965494 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b85d2d-bc92-41c2-b679-1257b8aaccf6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:37:33.966110 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b85d2d-bc92-41c2-b679-1257b8aaccf6 None admin] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:37:33.966382 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b85d2d-bc92-41c2-b679-1257b8aaccf6 None admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:37:33.966650 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b85d2d-bc92-41c2-b679-1257b8aaccf6 None admin] PATH_INFO: `/v3/projects/d82644e39c8f487096062ea8d01a4e20` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:37:33.967734 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b85d2d-bc92-41c2-b679-1257b8aaccf6 None admin] RBAC: Authorizing `identity:get_project(project_id=d82644e39c8f487096062ea8d01a4e20)` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:37:33.969175 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b85d2d-bc92-41c2-b679-1257b8aaccf6 None admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:37:33.970776 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 575/1122] 10.222.0.25 () {56 vars in 1186 bytes} [Tue Sep 13 19:37:33 2022] GET /identity/v3/projects/d82644e39c8f487096062ea8d01a4e20 => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:37:33.976827 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca90deeb-36b9-402c-b73e-46025768f323 None admin] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:37:34.082588 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca90deeb-36b9-402c-b73e-46025768f323 None admin] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:37:34.105088 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG dbcounter [-] [87935] Writing DB stats keystone:SELECT=100 {{(pid=87935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:37:34.116409 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed94f38-e22e-434f-967b-8afc155028e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:37:34.117063 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed94f38-e22e-434f-967b-8afc155028e5 None admin] REQUEST_METHOD: `PUT` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:37:34.117339 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed94f38-e22e-434f-967b-8afc155028e5 None admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:37:34.117607 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed94f38-e22e-434f-967b-8afc155028e5 None admin] PATH_INFO: `/v3/projects/d82644e39c8f487096062ea8d01a4e20/users/2fc4f187e0424c6ea79528d6c06120eb/roles/8af3d83a03144ae8bacdb82d9a108110` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:37:34.119752 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed94f38-e22e-434f-967b-8afc155028e5 None admin] RBAC: Authorizing `identity:create_grant(project_id=d82644e39c8f487096062ea8d01a4e20, user_id=2fc4f187e0424c6ea79528d6c06120eb, role_id=8af3d83a03144ae8bacdb82d9a108110)` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:37:34.121205 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed94f38-e22e-434f-967b-8afc155028e5 None admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:37:34.134009 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 548/1123] 10.222.0.25 () {58 vars in 1439 bytes} [Tue Sep 13 19:37:33 2022] PUT /identity/v3/projects/d82644e39c8f487096062ea8d01a4e20/users/2fc4f187e0424c6ea79528d6c06120eb/roles/8af3d83a03144ae8bacdb82d9a108110 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 19:37:36.257036 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273b08ef-03c2-41f2-ae35-517d2732f7f5 None None] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:37:36.257828 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273b08ef-03c2-41f2-ae35-517d2732f7f5 None None] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:37:36.257985 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273b08ef-03c2-41f2-ae35-517d2732f7f5 None None] PATH_INFO: `/` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:37:36.259347 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 576/1124] 10.222.0.25 () {54 vars in 927 bytes} [Tue Sep 13 19:37:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:37:36.264597 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a1e82d-e0e1-4f6a-9e8b-b04615bd1fc4 None None] REQUEST_METHOD: `POST` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:37:36.265033 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a1e82d-e0e1-4f6a-9e8b-b04615bd1fc4 None None] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:37:36.265127 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a1e82d-e0e1-4f6a-9e8b-b04615bd1fc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:37:36.283187 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.auth.core [None req-09a1e82d-e0e1-4f6a-9e8b-b04615bd1fc4 None None] MFA Rules not processed for user `7b0aed92d02344acb92a0e4aa67c3068`. Rule list: `[]` (Enabled: `True`). {{(pid=87935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:37:36.285143 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.fernet_utils [None req-09a1e82d-e0e1-4f6a-9e8b-b04615bd1fc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:37:36.353624 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 549/1125] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Sep 13 19:37:36 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 13 19:37:36.621665 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273b08ef-03c2-41f2-ae35-517d2732f7f5 None None] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:37:36.682253 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG dbcounter [-] [87934] Writing DB stats keystone:SELECT=100 {{(pid=87934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:37:36.722861 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273b08ef-03c2-41f2-ae35-517d2732f7f5 None None] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:37:36.756041 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45fefb40-2e68-4352-ad15-d57dee5c5947 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:37:36.756682 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fefb40-2e68-4352-ad15-d57dee5c5947 None admin] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:37:36.756962 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fefb40-2e68-4352-ad15-d57dee5c5947 None admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:37:36.757232 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fefb40-2e68-4352-ad15-d57dee5c5947 None admin] PATH_INFO: `/v3/roles/8af3d83a03144ae8bacdb82d9a108110` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:37:36.758595 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45fefb40-2e68-4352-ad15-d57dee5c5947 None admin] RBAC: Authorizing `identity:get_role(role_id=8af3d83a03144ae8bacdb82d9a108110)` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:37:36.759949 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45fefb40-2e68-4352-ad15-d57dee5c5947 None admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:37:36.761297 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 577/1126] 10.222.0.25 () {56 vars in 1177 bytes} [Tue Sep 13 19:37:36 2022] GET /identity/v3/roles/8af3d83a03144ae8bacdb82d9a108110 => generated 223 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:37:36.767159 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a1e82d-e0e1-4f6a-9e8b-b04615bd1fc4 None None] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:37:36.864456 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a1e82d-e0e1-4f6a-9e8b-b04615bd1fc4 None None] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:37:36.879031 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG dbcounter [-] [87935] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:37:36.901247 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea60f3d0-6283-4acf-ac0a-9e365b807367 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:37:36.901876 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea60f3d0-6283-4acf-ac0a-9e365b807367 None admin] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:37:36.902153 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea60f3d0-6283-4acf-ac0a-9e365b807367 None admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:37:36.902427 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea60f3d0-6283-4acf-ac0a-9e365b807367 None admin] PATH_INFO: `/v3/users/2fc4f187e0424c6ea79528d6c06120eb` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:37:36.903539 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea60f3d0-6283-4acf-ac0a-9e365b807367 None admin] RBAC: Authorizing `identity:get_user(user_id=2fc4f187e0424c6ea79528d6c06120eb)` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:37:36.904992 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea60f3d0-6283-4acf-ac0a-9e365b807367 None admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:37:36.906566 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 550/1127] 10.222.0.25 () {56 vars in 1177 bytes} [Tue Sep 13 19:37:36 2022] GET /identity/v3/users/2fc4f187e0424c6ea79528d6c06120eb => generated 286 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:37:36.912477 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45fefb40-2e68-4352-ad15-d57dee5c5947 None admin] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:37:37.011007 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45fefb40-2e68-4352-ad15-d57dee5c5947 None admin] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:37:37.039598 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG dbcounter [-] [87934] Writing DB stats keystone:SELECT=100 {{(pid=87934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:37:37.045977 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92558eb0-08d7-4cb3-8e73-66ebd2f3a2e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:37:37.046589 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92558eb0-08d7-4cb3-8e73-66ebd2f3a2e6 None admin] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:37:37.046865 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92558eb0-08d7-4cb3-8e73-66ebd2f3a2e6 None admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:37:37.047129 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92558eb0-08d7-4cb3-8e73-66ebd2f3a2e6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:37:37.115214 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92558eb0-08d7-4cb3-8e73-66ebd2f3a2e6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:37:37.116682 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92558eb0-08d7-4cb3-8e73-66ebd2f3a2e6 None admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:37:37.215787 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 578/1128] 10.222.0.25 () {58 vars in 1282 bytes} [Tue Sep 13 19:37:36 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 13 19:37:37.221983 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea60f3d0-6283-4acf-ac0a-9e365b807367 None admin] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:37:37.321531 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea60f3d0-6283-4acf-ac0a-9e365b807367 None admin] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:37:37.354885 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce4a9e6-67ac-4813-8db0-97ca0d345e75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:37:37.355493 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce4a9e6-67ac-4813-8db0-97ca0d345e75 None admin] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:37:37.355768 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce4a9e6-67ac-4813-8db0-97ca0d345e75 None admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:37:37.356035 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce4a9e6-67ac-4813-8db0-97ca0d345e75 None admin] PATH_INFO: `/v3/projects/d82644e39c8f487096062ea8d01a4e20` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:37:37.357163 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce4a9e6-67ac-4813-8db0-97ca0d345e75 None admin] RBAC: Authorizing `identity:get_project(project_id=d82644e39c8f487096062ea8d01a4e20)` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:37:37.358579 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce4a9e6-67ac-4813-8db0-97ca0d345e75 None admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:37:37.360192 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 551/1129] 10.222.0.25 () {56 vars in 1186 bytes} [Tue Sep 13 19:37:37 2022] GET /identity/v3/projects/d82644e39c8f487096062ea8d01a4e20 => generated 311 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:37:37.367306 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92558eb0-08d7-4cb3-8e73-66ebd2f3a2e6 None admin] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:37:37.397660 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG dbcounter [-] [87934] Writing DB stats keystone:SELECT=100 {{(pid=87934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:37:37.467711 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92558eb0-08d7-4cb3-8e73-66ebd2f3a2e6 None admin] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:37:37.501465 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76cba4e5-cc5b-4605-9ee6-4bc5726d12f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:37:37.502090 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76cba4e5-cc5b-4605-9ee6-4bc5726d12f1 None admin] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:37:37.502366 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76cba4e5-cc5b-4605-9ee6-4bc5726d12f1 None admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:37:37.502716 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76cba4e5-cc5b-4605-9ee6-4bc5726d12f1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:37:37.503430 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76cba4e5-cc5b-4605-9ee6-4bc5726d12f1 None admin] RBAC: Adding query filter params (role.id=8af3d83a03144ae8bacdb82d9a108110, scope.project.id=d82644e39c8f487096062ea8d01a4e20, user.id=2fc4f187e0424c6ea79528d6c06120eb) {{(pid=87934) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:37:37.503731 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76cba4e5-cc5b-4605-9ee6-4bc5726d12f1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:37:37.505177 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76cba4e5-cc5b-4605-9ee6-4bc5726d12f1 None admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:37:37.510703 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 579/1130] 10.222.0.25 () {56 vars in 1374 bytes} [Tue Sep 13 19:37:37 2022] GET /identity/v3/role_assignments?user.id=2fc4f187e0424c6ea79528d6c06120eb&scope.project.id=d82644e39c8f487096062ea8d01a4e20&role.id=8af3d83a03144ae8bacdb82d9a108110 => generated 608 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:37:39.768379 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8149228c-9b6c-4291-8210-148251d83c14 None None] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:37:39.769132 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8149228c-9b6c-4291-8210-148251d83c14 None None] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:37:39.769132 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8149228c-9b6c-4291-8210-148251d83c14 None None] PATH_INFO: `/` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:37:39.770267 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 552/1131] 10.222.0.25 () {54 vars in 927 bytes} [Tue Sep 13 19:37:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:37:39.776134 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9738f8-19c0-4db4-9e0c-d24d8822b88e None None] REQUEST_METHOD: `POST` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:37:39.776679 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9738f8-19c0-4db4-9e0c-d24d8822b88e None None] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:37:39.776784 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9738f8-19c0-4db4-9e0c-d24d8822b88e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:37:39.795722 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.auth.core [None req-1c9738f8-19c0-4db4-9e0c-d24d8822b88e None None] MFA Rules not processed for user `7b0aed92d02344acb92a0e4aa67c3068`. Rule list: `[]` (Enabled: `True`). {{(pid=87934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:37:39.796960 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.fernet_utils [None req-1c9738f8-19c0-4db4-9e0c-d24d8822b88e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:37:39.873066 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 580/1132] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Sep 13 19:37:39 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 13 19:37:40.145424 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8149228c-9b6c-4291-8210-148251d83c14 None None] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:37:40.198448 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG dbcounter [-] [87935] Writing DB stats keystone:SELECT=100 {{(pid=87935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:37:40.250371 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8149228c-9b6c-4291-8210-148251d83c14 None None] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:37:40.288237 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe2d2fc-eb1b-4871-99fe-ad6541fab6e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:37:40.288881 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe2d2fc-eb1b-4871-99fe-ad6541fab6e2 None admin] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:37:40.289154 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe2d2fc-eb1b-4871-99fe-ad6541fab6e2 None admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:37:40.289419 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe2d2fc-eb1b-4871-99fe-ad6541fab6e2 None admin] PATH_INFO: `/v3/domains/default` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:37:40.290533 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe2d2fc-eb1b-4871-99fe-ad6541fab6e2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:37:40.291964 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe2d2fc-eb1b-4871-99fe-ad6541fab6e2 None admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:37:40.293568 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 553/1133] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Sep 13 19:37:40 2022] GET /identity/v3/domains/default => generated 199 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 19:37:40.300769 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9738f8-19c0-4db4-9e0c-d24d8822b88e None None] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:37:40.327169 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG dbcounter [-] [87934] Writing DB stats keystone:SELECT=100 {{(pid=87934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:37:40.425305 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9738f8-19c0-4db4-9e0c-d24d8822b88e None None] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:37:40.466248 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ecdc44-4de8-4b71-ae9f-62061a009f00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:37:40.466868 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ecdc44-4de8-4b71-ae9f-62061a009f00 None admin] REQUEST_METHOD: `POST` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:37:40.467133 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ecdc44-4de8-4b71-ae9f-62061a009f00 None admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:37:40.467402 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ecdc44-4de8-4b71-ae9f-62061a009f00 None admin] PATH_INFO: `/v3/projects` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:37:40.468050 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ecdc44-4de8-4b71-ae9f-62061a009f00 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:37:40.469495 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ecdc44-4de8-4b71-ae9f-62061a009f00 None admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:37:40.496904 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 581/1134] 10.222.0.25 () {60 vars in 1141 bytes} [Tue Sep 13 19:37:40 2022] POST /identity/v3/projects => generated 311 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 19:37:42.703071 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469382ec-ebe9-4c21-8b70-aa484b193cf5 None None] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:37:42.703659 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469382ec-ebe9-4c21-8b70-aa484b193cf5 None None] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:37:42.703659 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469382ec-ebe9-4c21-8b70-aa484b193cf5 None None] PATH_INFO: `/` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:37:42.704872 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 554/1135] 10.222.0.25 () {54 vars in 927 bytes} [Tue Sep 13 19:37:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:37:42.710816 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fa2373-ba13-4eb7-88b7-d6a82fcfb2c5 None None] REQUEST_METHOD: `POST` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:37:42.711261 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fa2373-ba13-4eb7-88b7-d6a82fcfb2c5 None None] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:37:42.711356 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fa2373-ba13-4eb7-88b7-d6a82fcfb2c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:37:42.729986 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.auth.core [None req-97fa2373-ba13-4eb7-88b7-d6a82fcfb2c5 None None] MFA Rules not processed for user `7b0aed92d02344acb92a0e4aa67c3068`. Rule list: `[]` (Enabled: `True`). {{(pid=87934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:37:42.731169 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.fernet_utils [None req-97fa2373-ba13-4eb7-88b7-d6a82fcfb2c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:37:42.807336 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 582/1136] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Sep 13 19:37:42 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 13 19:37:43.076072 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469382ec-ebe9-4c21-8b70-aa484b193cf5 None None] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:37:43.179846 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469382ec-ebe9-4c21-8b70-aa484b193cf5 None None] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:37:43.198748 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG dbcounter [-] [87935] Writing DB stats keystone:SELECT=100 {{(pid=87935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:37:43.215982 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91347620-3b0c-4dc6-abff-1f36488ef960 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:37:43.216631 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91347620-3b0c-4dc6-abff-1f36488ef960 None admin] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:37:43.216903 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91347620-3b0c-4dc6-abff-1f36488ef960 None admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:37:43.217165 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91347620-3b0c-4dc6-abff-1f36488ef960 None admin] PATH_INFO: `/v3/domains/default` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:37:43.218301 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91347620-3b0c-4dc6-abff-1f36488ef960 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:37:43.219710 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91347620-3b0c-4dc6-abff-1f36488ef960 None admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:37:43.221338 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 555/1137] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Sep 13 19:37:43 2022] GET /identity/v3/domains/default => generated 199 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:37:43.227203 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97fa2373-ba13-4eb7-88b7-d6a82fcfb2c5 None None] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:37:43.235355 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG dbcounter [-] [87934] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:37:43.329475 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97fa2373-ba13-4eb7-88b7-d6a82fcfb2c5 None None] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:37:43.368895 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8615c145-963a-4cf2-9ad2-a8751f343cea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:37:43.369489 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8615c145-963a-4cf2-9ad2-a8751f343cea None admin] REQUEST_METHOD: `POST` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:37:43.369766 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8615c145-963a-4cf2-9ad2-a8751f343cea None admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:37:43.370035 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8615c145-963a-4cf2-9ad2-a8751f343cea None admin] PATH_INFO: `/v3/users` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:37:43.370679 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8615c145-963a-4cf2-9ad2-a8751f343cea None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:37:43.372098 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8615c145-963a-4cf2-9ad2-a8751f343cea None admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:37:43.393460 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 583/1138] 10.222.0.25 () {60 vars in 1132 bytes} [Tue Sep 13 19:37:43 2022] POST /identity/v3/users => generated 286 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 19:37:45.608170 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6703cb-11f0-4c56-b180-4a0ea0c2c084 None None] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:37:45.608734 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6703cb-11f0-4c56-b180-4a0ea0c2c084 None None] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:37:45.608734 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6703cb-11f0-4c56-b180-4a0ea0c2c084 None None] PATH_INFO: `/` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:37:45.609985 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 556/1139] 10.222.0.25 () {54 vars in 927 bytes} [Tue Sep 13 19:37:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:37:45.615910 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30bc350-1a31-4756-9423-93d4cedae7fc None None] REQUEST_METHOD: `POST` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:37:45.616378 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30bc350-1a31-4756-9423-93d4cedae7fc None None] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:37:45.616483 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30bc350-1a31-4756-9423-93d4cedae7fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:37:45.635776 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.auth.core [None req-e30bc350-1a31-4756-9423-93d4cedae7fc None None] MFA Rules not processed for user `7b0aed92d02344acb92a0e4aa67c3068`. Rule list: `[]` (Enabled: `True`). {{(pid=87934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:37:45.637005 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.fernet_utils [None req-e30bc350-1a31-4756-9423-93d4cedae7fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:37:45.693353 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG dbcounter [-] [87934] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:37:45.704836 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 584/1140] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Sep 13 19:37:45 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 13 19:37:45.978237 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6703cb-11f0-4c56-b180-4a0ea0c2c084 None None] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:37:46.088386 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6703cb-11f0-4c56-b180-4a0ea0c2c084 None None] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:37:46.123587 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67cfc6fe-6455-4d80-acfd-63da5b35d347 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:37:46.124234 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67cfc6fe-6455-4d80-acfd-63da5b35d347 None admin] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:37:46.124522 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67cfc6fe-6455-4d80-acfd-63da5b35d347 None admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:37:46.124788 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67cfc6fe-6455-4d80-acfd-63da5b35d347 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:37:46.135374 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67cfc6fe-6455-4d80-acfd-63da5b35d347 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 19:37:46.140201 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application [None req-67cfc6fe-6455-4d80-acfd-63da5b35d347 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 19:37:46.140201 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:37:46.140201 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:37:46.140201 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:37:46.140201 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:37:46.140201 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:37:46.140201 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:37:46.140201 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:37:46.140201 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:37:46.140201 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:37:46.140201 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:37:46.140201 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:37:46.140201 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 19:37:46.140201 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 19:37:46.140201 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 19:37:46.140201 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 19:37:46.141534 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 19:37:46.141534 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 19:37:46.141534 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 19:37:46.141534 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 19:37:46.141534 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:37:46.141534 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:37:46.141534 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:37:46.141534 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:37:46.141534 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:37:46.141534 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:37:46.141534 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:37:46.141534 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application with Lock( Sep 13 19:37:46.141534 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:37:46.141534 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:37:46.141534 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:37:46.141534 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:37:46.143446 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:37:46.143446 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:37:46.143446 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:37:46.143446 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:37:46.143446 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 19:37:46.143446 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 19:37:46.143446 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 19:37:46.143446 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 19:37:46.143446 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 19:37:46.143446 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 19:37:46.143446 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 19:37:46.143446 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application Sep 13 19:37:46.143446 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 557/1141] 10.222.0.25 () {56 vars in 1096 bytes} [Tue Sep 13 19:37:45 2022] GET /identity/v3/roles/admin => generated 83 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:37:46.148133 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30bc350-1a31-4756-9423-93d4cedae7fc None None] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:37:46.252107 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30bc350-1a31-4756-9423-93d4cedae7fc None None] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:37:46.288969 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0725c3a-5e2b-4d3a-88b4-b4d3dba4be36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:37:46.289574 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0725c3a-5e2b-4d3a-88b4-b4d3dba4be36 None admin] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:37:46.289846 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0725c3a-5e2b-4d3a-88b4-b4d3dba4be36 None admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:37:46.290136 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0725c3a-5e2b-4d3a-88b4-b4d3dba4be36 None admin] PATH_INFO: `/v3/roles` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:37:46.290778 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0725c3a-5e2b-4d3a-88b4-b4d3dba4be36 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87934) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:37:46.291069 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0725c3a-5e2b-4d3a-88b4-b4d3dba4be36 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:37:46.292536 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0725c3a-5e2b-4d3a-88b4-b4d3dba4be36 None admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:37:46.301088 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 585/1142] 10.222.0.25 () {56 vars in 1099 bytes} [Tue Sep 13 19:37:46 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 19:37:46.307062 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67cfc6fe-6455-4d80-acfd-63da5b35d347 None admin] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:37:46.357643 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG dbcounter [-] [87935] Writing DB stats keystone:SELECT=100 {{(pid=87935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:37:46.412356 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67cfc6fe-6455-4d80-acfd-63da5b35d347 None admin] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:37:46.448671 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97805052-e353-4b30-86c5-f232cd32578d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:37:46.449296 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97805052-e353-4b30-86c5-f232cd32578d None admin] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:37:46.449573 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97805052-e353-4b30-86c5-f232cd32578d None admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:37:46.449850 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97805052-e353-4b30-86c5-f232cd32578d None admin] PATH_INFO: `/v3/users/337c6e4f0a57411285dd46281f944d90` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:37:46.463992 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97805052-e353-4b30-86c5-f232cd32578d None admin] RBAC: Authorizing `identity:get_user(user_id=337c6e4f0a57411285dd46281f944d90)` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:37:46.465464 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97805052-e353-4b30-86c5-f232cd32578d None admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:37:46.467116 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 558/1143] 10.222.0.25 () {56 vars in 1177 bytes} [Tue Sep 13 19:37:46 2022] GET /identity/v3/users/337c6e4f0a57411285dd46281f944d90 => generated 286 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:37:46.473879 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0725c3a-5e2b-4d3a-88b4-b4d3dba4be36 None admin] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:37:46.548138 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG dbcounter [-] [87934] Writing DB stats keystone:SELECT=100 {{(pid=87934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:37:46.599775 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0725c3a-5e2b-4d3a-88b4-b4d3dba4be36 None admin] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:37:46.633884 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69be7d11-29b2-42d2-96c3-2aaad303079a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:37:46.634698 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69be7d11-29b2-42d2-96c3-2aaad303079a None admin] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:37:46.634858 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69be7d11-29b2-42d2-96c3-2aaad303079a None admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:37:46.635004 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69be7d11-29b2-42d2-96c3-2aaad303079a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:37:46.702735 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69be7d11-29b2-42d2-96c3-2aaad303079a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:37:46.704176 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69be7d11-29b2-42d2-96c3-2aaad303079a None admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:37:46.760364 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG dbcounter [-] [87934] Writing DB stats keystone:SELECT=100 {{(pid=87934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:37:46.805854 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 586/1144] 10.222.0.25 () {58 vars in 1282 bytes} [Tue Sep 13 19:37:46 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 13 19:37:46.812135 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97805052-e353-4b30-86c5-f232cd32578d None admin] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:37:46.929012 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97805052-e353-4b30-86c5-f232cd32578d None admin] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:37:46.932387 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG dbcounter [-] [87935] Writing DB stats keystone:SELECT=100 {{(pid=87935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:37:46.967369 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8317ee30-b2c9-4d63-b967-5b65f4a5ac0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:37:46.967993 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8317ee30-b2c9-4d63-b967-5b65f4a5ac0e None admin] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:37:46.968317 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8317ee30-b2c9-4d63-b967-5b65f4a5ac0e None admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:37:46.968586 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8317ee30-b2c9-4d63-b967-5b65f4a5ac0e None admin] PATH_INFO: `/v3/projects/dd76a8905d16493f9c5d40717dbb9815` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:37:46.969683 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8317ee30-b2c9-4d63-b967-5b65f4a5ac0e None admin] RBAC: Authorizing `identity:get_project(project_id=dd76a8905d16493f9c5d40717dbb9815)` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:37:46.971104 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8317ee30-b2c9-4d63-b967-5b65f4a5ac0e None admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:37:46.972882 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 559/1145] 10.222.0.25 () {56 vars in 1186 bytes} [Tue Sep 13 19:37:46 2022] GET /identity/v3/projects/dd76a8905d16493f9c5d40717dbb9815 => generated 311 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:37:46.979351 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69be7d11-29b2-42d2-96c3-2aaad303079a None admin] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:37:47.081247 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69be7d11-29b2-42d2-96c3-2aaad303079a None admin] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:37:47.115941 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd52e9e6-7883-4335-8400-724351f93aef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:37:47.116577 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd52e9e6-7883-4335-8400-724351f93aef None admin] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:37:47.116854 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd52e9e6-7883-4335-8400-724351f93aef None admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:37:47.117123 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd52e9e6-7883-4335-8400-724351f93aef None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:37:47.117846 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd52e9e6-7883-4335-8400-724351f93aef None admin] RBAC: Adding query filter params (role.id=6ca1d4427ff64e0a9d25d96cfb1445f6, scope.project.id=dd76a8905d16493f9c5d40717dbb9815, user.id=337c6e4f0a57411285dd46281f944d90) {{(pid=87934) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:37:47.118146 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd52e9e6-7883-4335-8400-724351f93aef None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:37:47.119598 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd52e9e6-7883-4335-8400-724351f93aef None admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:37:47.125098 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 587/1146] 10.222.0.25 () {56 vars in 1374 bytes} [Tue Sep 13 19:37:46 2022] GET /identity/v3/role_assignments?user.id=337c6e4f0a57411285dd46281f944d90&scope.project.id=dd76a8905d16493f9c5d40717dbb9815&role.id=6ca1d4427ff64e0a9d25d96cfb1445f6 => generated 259 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:37:49.315089 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964dea0d-80ea-475d-b672-090988e6986a None None] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:37:49.315645 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964dea0d-80ea-475d-b672-090988e6986a None None] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:37:49.315779 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964dea0d-80ea-475d-b672-090988e6986a None None] PATH_INFO: `/` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:37:49.317175 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 560/1147] 10.222.0.25 () {54 vars in 927 bytes} [Tue Sep 13 19:37:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:37:49.322962 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae2cbb8-ebb1-4980-996c-6f3ebba1983f None None] REQUEST_METHOD: `POST` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:37:49.323459 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae2cbb8-ebb1-4980-996c-6f3ebba1983f None None] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:37:49.323548 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae2cbb8-ebb1-4980-996c-6f3ebba1983f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:37:49.342946 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.auth.core [None req-8ae2cbb8-ebb1-4980-996c-6f3ebba1983f None None] MFA Rules not processed for user `7b0aed92d02344acb92a0e4aa67c3068`. Rule list: `[]` (Enabled: `True`). {{(pid=87934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:37:49.344142 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.fernet_utils [None req-8ae2cbb8-ebb1-4980-996c-6f3ebba1983f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:37:49.359796 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG dbcounter [-] [87934] Writing DB stats keystone:SELECT=100 {{(pid=87934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:37:49.418936 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 588/1148] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Sep 13 19:37:49 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 13 19:37:49.696756 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964dea0d-80ea-475d-b672-090988e6986a None None] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:37:49.819372 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964dea0d-80ea-475d-b672-090988e6986a None None] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:37:49.855414 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0ae4c3-acd7-49c8-bad8-49c1d6a9eb36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:37:49.856035 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0ae4c3-acd7-49c8-bad8-49c1d6a9eb36 None admin] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:37:49.856342 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0ae4c3-acd7-49c8-bad8-49c1d6a9eb36 None admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:37:49.856612 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0ae4c3-acd7-49c8-bad8-49c1d6a9eb36 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:37:49.866963 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd0ae4c3-acd7-49c8-bad8-49c1d6a9eb36 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 19:37:49.871815 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application [None req-cd0ae4c3-acd7-49c8-bad8-49c1d6a9eb36 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 19:37:49.871815 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:37:49.871815 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:37:49.871815 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:37:49.871815 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:37:49.871815 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:37:49.871815 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:37:49.871815 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:37:49.871815 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:37:49.871815 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:37:49.871815 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:37:49.871815 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:37:49.871815 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 19:37:49.871815 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 19:37:49.871815 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 19:37:49.871815 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 19:37:49.872979 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 19:37:49.872979 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 19:37:49.872979 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 19:37:49.872979 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 19:37:49.872979 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:37:49.872979 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:37:49.872979 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:37:49.872979 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:37:49.872979 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:37:49.872979 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:37:49.872979 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:37:49.872979 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application with Lock( Sep 13 19:37:49.872979 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:37:49.872979 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:37:49.872979 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:37:49.872979 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:37:49.873892 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:37:49.873892 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:37:49.873892 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:37:49.873892 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:37:49.873892 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 19:37:49.873892 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 19:37:49.873892 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 19:37:49.873892 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 19:37:49.873892 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 19:37:49.873892 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 19:37:49.873892 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 19:37:49.873892 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application Sep 13 19:37:49.873892 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 561/1149] 10.222.0.25 () {56 vars in 1096 bytes} [Tue Sep 13 19:37:49 2022] GET /identity/v3/roles/admin => generated 83 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:37:49.879770 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae2cbb8-ebb1-4980-996c-6f3ebba1983f None None] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:37:49.980559 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae2cbb8-ebb1-4980-996c-6f3ebba1983f None None] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:37:50.015161 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cbccc08-fd3f-4068-996d-38d87daa7227 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:37:50.015771 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbccc08-fd3f-4068-996d-38d87daa7227 None admin] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:37:50.016048 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbccc08-fd3f-4068-996d-38d87daa7227 None admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:37:50.016348 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbccc08-fd3f-4068-996d-38d87daa7227 None admin] PATH_INFO: `/v3/roles` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:37:50.017006 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cbccc08-fd3f-4068-996d-38d87daa7227 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87934) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:37:50.017628 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cbccc08-fd3f-4068-996d-38d87daa7227 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:37:50.019534 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cbccc08-fd3f-4068-996d-38d87daa7227 None admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:37:50.028386 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 589/1150] 10.222.0.25 () {56 vars in 1099 bytes} [Tue Sep 13 19:37:49 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:37:50.034484 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0ae4c3-acd7-49c8-bad8-49c1d6a9eb36 None admin] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:37:50.066920 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG dbcounter [-] [87935] Writing DB stats keystone:SELECT=100 {{(pid=87935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:37:50.139594 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0ae4c3-acd7-49c8-bad8-49c1d6a9eb36 None admin] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:37:50.174986 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeeea414-fbc9-493b-a66b-1fb2876780a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:37:50.175609 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeeea414-fbc9-493b-a66b-1fb2876780a0 None admin] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:37:50.175881 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeeea414-fbc9-493b-a66b-1fb2876780a0 None admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:37:50.176146 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeeea414-fbc9-493b-a66b-1fb2876780a0 None admin] PATH_INFO: `/v3/users/337c6e4f0a57411285dd46281f944d90` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:37:50.177295 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeeea414-fbc9-493b-a66b-1fb2876780a0 None admin] RBAC: Authorizing `identity:get_user(user_id=337c6e4f0a57411285dd46281f944d90)` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:37:50.178809 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeeea414-fbc9-493b-a66b-1fb2876780a0 None admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:37:50.180406 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 562/1151] 10.222.0.25 () {56 vars in 1177 bytes} [Tue Sep 13 19:37:50 2022] GET /identity/v3/users/337c6e4f0a57411285dd46281f944d90 => generated 286 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:37:50.186304 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cbccc08-fd3f-4068-996d-38d87daa7227 None admin] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:37:50.199706 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG dbcounter [-] [87934] Writing DB stats keystone:SELECT=100 {{(pid=87934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:37:50.320808 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cbccc08-fd3f-4068-996d-38d87daa7227 None admin] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:37:50.360070 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6af1f13-b1a7-453c-b330-3509f8d0b31b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:37:50.360785 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6af1f13-b1a7-453c-b330-3509f8d0b31b None admin] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:37:50.361517 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6af1f13-b1a7-453c-b330-3509f8d0b31b None admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:37:50.361786 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6af1f13-b1a7-453c-b330-3509f8d0b31b None admin] PATH_INFO: `/v3/projects/dd76a8905d16493f9c5d40717dbb9815` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:37:50.362938 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6af1f13-b1a7-453c-b330-3509f8d0b31b None admin] RBAC: Authorizing `identity:get_project(project_id=dd76a8905d16493f9c5d40717dbb9815)` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:37:50.364397 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6af1f13-b1a7-453c-b330-3509f8d0b31b None admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:37:50.366036 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 590/1152] 10.222.0.25 () {56 vars in 1186 bytes} [Tue Sep 13 19:37:50 2022] GET /identity/v3/projects/dd76a8905d16493f9c5d40717dbb9815 => generated 311 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:37:50.372294 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeeea414-fbc9-493b-a66b-1fb2876780a0 None admin] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:37:50.471149 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG dbcounter [-] [87935] Writing DB stats keystone:SELECT=100 {{(pid=87935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:37:50.474428 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeeea414-fbc9-493b-a66b-1fb2876780a0 None admin] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:37:50.511669 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37468207-dd61-4b3d-a8af-426797acd41e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:37:50.512353 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37468207-dd61-4b3d-a8af-426797acd41e None admin] REQUEST_METHOD: `PUT` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:37:50.512635 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37468207-dd61-4b3d-a8af-426797acd41e None admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:37:50.512908 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37468207-dd61-4b3d-a8af-426797acd41e None admin] PATH_INFO: `/v3/projects/dd76a8905d16493f9c5d40717dbb9815/users/337c6e4f0a57411285dd46281f944d90/roles/6ca1d4427ff64e0a9d25d96cfb1445f6` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:37:50.514857 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37468207-dd61-4b3d-a8af-426797acd41e None admin] RBAC: Authorizing `identity:create_grant(project_id=dd76a8905d16493f9c5d40717dbb9815, user_id=337c6e4f0a57411285dd46281f944d90, role_id=6ca1d4427ff64e0a9d25d96cfb1445f6)` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:37:50.516331 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37468207-dd61-4b3d-a8af-426797acd41e None admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:37:50.530604 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 563/1153] 10.222.0.25 () {58 vars in 1439 bytes} [Tue Sep 13 19:37:50 2022] PUT /identity/v3/projects/dd76a8905d16493f9c5d40717dbb9815/users/337c6e4f0a57411285dd46281f944d90/roles/6ca1d4427ff64e0a9d25d96cfb1445f6 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 19:37:52.716146 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7389d61-b67d-40b4-afd0-ea9211492c0c None None] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:37:52.716707 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7389d61-b67d-40b4-afd0-ea9211492c0c None None] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:37:52.716707 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7389d61-b67d-40b4-afd0-ea9211492c0c None None] PATH_INFO: `/` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:37:52.718048 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 591/1154] 10.222.0.25 () {54 vars in 927 bytes} [Tue Sep 13 19:37:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:37:52.724008 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4648b2-0b3b-4ff6-b548-bdb8fd1adb8c None None] REQUEST_METHOD: `POST` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:37:52.724532 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4648b2-0b3b-4ff6-b548-bdb8fd1adb8c None None] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:37:52.724725 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4648b2-0b3b-4ff6-b548-bdb8fd1adb8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:37:52.744069 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.auth.core [None req-3d4648b2-0b3b-4ff6-b548-bdb8fd1adb8c None None] MFA Rules not processed for user `7b0aed92d02344acb92a0e4aa67c3068`. Rule list: `[]` (Enabled: `True`). {{(pid=87935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:37:52.745297 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.fernet_utils [None req-3d4648b2-0b3b-4ff6-b548-bdb8fd1adb8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:37:52.816500 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 564/1155] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Sep 13 19:37:52 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 13 19:37:53.088445 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7389d61-b67d-40b4-afd0-ea9211492c0c None None] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:37:53.171198 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG dbcounter [-] [87934] Writing DB stats keystone:SELECT=100 {{(pid=87934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:37:53.195537 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7389d61-b67d-40b4-afd0-ea9211492c0c None None] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:37:53.230005 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9eac5c-5ae3-4572-9dc1-5961a36d05f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:37:53.230631 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9eac5c-5ae3-4572-9dc1-5961a36d05f2 None admin] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:37:53.230909 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9eac5c-5ae3-4572-9dc1-5961a36d05f2 None admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:37:53.231177 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9eac5c-5ae3-4572-9dc1-5961a36d05f2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:37:53.242342 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc9eac5c-5ae3-4572-9dc1-5961a36d05f2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 19:37:53.247117 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application [None req-fc9eac5c-5ae3-4572-9dc1-5961a36d05f2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 19:37:53.247117 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:37:53.247117 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:37:53.247117 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:37:53.247117 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:37:53.247117 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:37:53.247117 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:37:53.247117 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:37:53.247117 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:37:53.247117 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:37:53.247117 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:37:53.247117 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:37:53.247117 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 19:37:53.247117 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 19:37:53.247117 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 19:37:53.247117 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 19:37:53.248295 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 19:37:53.248295 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 19:37:53.248295 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 19:37:53.248295 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 19:37:53.248295 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:37:53.248295 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:37:53.248295 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:37:53.248295 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:37:53.248295 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:37:53.248295 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:37:53.248295 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:37:53.248295 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application with Lock( Sep 13 19:37:53.248295 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:37:53.248295 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:37:53.248295 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:37:53.248295 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:37:53.249149 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:37:53.249149 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:37:53.249149 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:37:53.249149 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:37:53.249149 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 19:37:53.249149 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 19:37:53.249149 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 19:37:53.249149 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 19:37:53.249149 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 19:37:53.249149 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 19:37:53.249149 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 19:37:53.249149 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application Sep 13 19:37:53.249149 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 592/1156] 10.222.0.25 () {56 vars in 1096 bytes} [Tue Sep 13 19:37:53 2022] GET /identity/v3/roles/admin => generated 83 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:37:53.255114 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4648b2-0b3b-4ff6-b548-bdb8fd1adb8c None None] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:37:53.352623 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG dbcounter [-] [87935] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:37:53.363604 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4648b2-0b3b-4ff6-b548-bdb8fd1adb8c None None] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:37:53.398825 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346ab37b-ce8d-4bd6-a2e5-45aba061abc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:37:53.399434 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346ab37b-ce8d-4bd6-a2e5-45aba061abc8 None admin] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:37:53.399709 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346ab37b-ce8d-4bd6-a2e5-45aba061abc8 None admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:37:53.399975 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346ab37b-ce8d-4bd6-a2e5-45aba061abc8 None admin] PATH_INFO: `/v3/roles` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:37:53.400668 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-346ab37b-ce8d-4bd6-a2e5-45aba061abc8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87935) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:37:53.400971 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-346ab37b-ce8d-4bd6-a2e5-45aba061abc8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:37:53.402342 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-346ab37b-ce8d-4bd6-a2e5-45aba061abc8 None admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:37:53.410959 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 565/1157] 10.222.0.25 () {56 vars in 1099 bytes} [Tue Sep 13 19:37:53 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:37:53.417612 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9eac5c-5ae3-4572-9dc1-5961a36d05f2 None admin] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:37:53.541535 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9eac5c-5ae3-4572-9dc1-5961a36d05f2 None admin] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:37:53.578498 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8076b748-25d1-4e2c-940f-261772c4df86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:37:53.579139 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8076b748-25d1-4e2c-940f-261772c4df86 None admin] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:37:53.579422 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8076b748-25d1-4e2c-940f-261772c4df86 None admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:37:53.579716 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8076b748-25d1-4e2c-940f-261772c4df86 None admin] PATH_INFO: `/v3/users/337c6e4f0a57411285dd46281f944d90` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:37:53.581281 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8076b748-25d1-4e2c-940f-261772c4df86 None admin] RBAC: Authorizing `identity:get_user(user_id=337c6e4f0a57411285dd46281f944d90)` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:37:53.583216 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8076b748-25d1-4e2c-940f-261772c4df86 None admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:37:53.585057 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 593/1158] 10.222.0.25 () {56 vars in 1177 bytes} [Tue Sep 13 19:37:53 2022] GET /identity/v3/users/337c6e4f0a57411285dd46281f944d90 => generated 286 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:37:53.591546 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346ab37b-ce8d-4bd6-a2e5-45aba061abc8 None admin] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:37:53.697670 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346ab37b-ce8d-4bd6-a2e5-45aba061abc8 None admin] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:37:53.732269 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17431bf-d975-4af9-a3c0-079e9158bfbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:37:53.732932 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17431bf-d975-4af9-a3c0-079e9158bfbd None admin] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:37:53.733134 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17431bf-d975-4af9-a3c0-079e9158bfbd None admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:37:53.733401 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17431bf-d975-4af9-a3c0-079e9158bfbd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:37:53.756022 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG dbcounter [-] [87935] Writing DB stats keystone:SELECT=100 {{(pid=87935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:37:53.804597 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f17431bf-d975-4af9-a3c0-079e9158bfbd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:37:53.806055 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f17431bf-d975-4af9-a3c0-079e9158bfbd None admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:37:53.907363 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 566/1159] 10.222.0.25 () {58 vars in 1282 bytes} [Tue Sep 13 19:37:53 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 13 19:37:53.914117 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8076b748-25d1-4e2c-940f-261772c4df86 None admin] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:37:53.924125 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG dbcounter [-] [87934] Writing DB stats keystone:SELECT=100 {{(pid=87934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:37:54.019285 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8076b748-25d1-4e2c-940f-261772c4df86 None admin] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:37:54.054892 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0d1062-1544-4954-92cd-cd34335eb970 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:37:54.055533 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0d1062-1544-4954-92cd-cd34335eb970 None admin] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:37:54.055815 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0d1062-1544-4954-92cd-cd34335eb970 None admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:37:54.056089 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0d1062-1544-4954-92cd-cd34335eb970 None admin] PATH_INFO: `/v3/projects/dd76a8905d16493f9c5d40717dbb9815` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:37:54.057252 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee0d1062-1544-4954-92cd-cd34335eb970 None admin] RBAC: Authorizing `identity:get_project(project_id=dd76a8905d16493f9c5d40717dbb9815)` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:37:54.058681 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee0d1062-1544-4954-92cd-cd34335eb970 None admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:37:54.060343 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 594/1160] 10.222.0.25 () {56 vars in 1186 bytes} [Tue Sep 13 19:37:53 2022] GET /identity/v3/projects/dd76a8905d16493f9c5d40717dbb9815 => generated 311 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:37:54.066694 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17431bf-d975-4af9-a3c0-079e9158bfbd None admin] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:37:54.120302 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG dbcounter [-] [87935] Writing DB stats keystone:SELECT=100 {{(pid=87935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:37:54.167849 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17431bf-d975-4af9-a3c0-079e9158bfbd None admin] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:37:54.202624 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb434548-6941-4f60-adf4-3d87f7b648f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:37:54.203229 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb434548-6941-4f60-adf4-3d87f7b648f5 None admin] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:37:54.203505 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb434548-6941-4f60-adf4-3d87f7b648f5 None admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:37:54.203770 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb434548-6941-4f60-adf4-3d87f7b648f5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:37:54.204521 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb434548-6941-4f60-adf4-3d87f7b648f5 None admin] RBAC: Adding query filter params (role.id=6ca1d4427ff64e0a9d25d96cfb1445f6, scope.project.id=dd76a8905d16493f9c5d40717dbb9815, user.id=337c6e4f0a57411285dd46281f944d90) {{(pid=87935) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:37:54.205387 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb434548-6941-4f60-adf4-3d87f7b648f5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:37:54.207227 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb434548-6941-4f60-adf4-3d87f7b648f5 None admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:37:54.213595 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 567/1161] 10.222.0.25 () {56 vars in 1374 bytes} [Tue Sep 13 19:37:54 2022] GET /identity/v3/role_assignments?user.id=337c6e4f0a57411285dd46281f944d90&scope.project.id=dd76a8905d16493f9c5d40717dbb9815&role.id=6ca1d4427ff64e0a9d25d96cfb1445f6 => generated 608 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:37:56.514276 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c5ded7-2ccb-4c83-a00f-b34daa6289e2 None None] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:37:56.514828 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c5ded7-2ccb-4c83-a00f-b34daa6289e2 None None] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:37:56.514828 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c5ded7-2ccb-4c83-a00f-b34daa6289e2 None None] PATH_INFO: `/` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:37:56.516128 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 595/1162] 10.222.0.25 () {54 vars in 927 bytes} [Tue Sep 13 19:37:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:37:56.521670 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf218d9-31cb-4da8-b661-b26aaef8a659 None None] REQUEST_METHOD: `POST` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:37:56.522081 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf218d9-31cb-4da8-b661-b26aaef8a659 None None] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:37:56.522214 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf218d9-31cb-4da8-b661-b26aaef8a659 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:37:56.541368 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.auth.core [None req-5bf218d9-31cb-4da8-b661-b26aaef8a659 None None] MFA Rules not processed for user `7b0aed92d02344acb92a0e4aa67c3068`. Rule list: `[]` (Enabled: `True`). {{(pid=87935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:37:56.542560 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.fernet_utils [None req-5bf218d9-31cb-4da8-b661-b26aaef8a659 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:37:56.616691 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 568/1163] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Sep 13 19:37:56 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 13 19:37:56.951120 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c5ded7-2ccb-4c83-a00f-b34daa6289e2 None None] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:37:57.036870 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG dbcounter [-] [87934] Writing DB stats keystone:SELECT=100 {{(pid=87934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:37:57.063830 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c5ded7-2ccb-4c83-a00f-b34daa6289e2 None None] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:37:57.099000 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1fe5950-184d-43d8-be9e-7744cc0e20ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:37:57.099602 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fe5950-184d-43d8-be9e-7744cc0e20ee None admin] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:37:57.099878 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fe5950-184d-43d8-be9e-7744cc0e20ee None admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:37:57.100141 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fe5950-184d-43d8-be9e-7744cc0e20ee None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:37:57.174569 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1fe5950-184d-43d8-be9e-7744cc0e20ee None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:37:57.176015 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1fe5950-184d-43d8-be9e-7744cc0e20ee None admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:37:57.256232 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG dbcounter [-] [87934] Writing DB stats keystone:SELECT=100 {{(pid=87934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:37:57.284369 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 596/1164] 10.222.0.25 () {58 vars in 1282 bytes} [Tue Sep 13 19:37:56 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 13 19:37:57.292661 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf218d9-31cb-4da8-b661-b26aaef8a659 None None] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:37:57.353513 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG dbcounter [-] [87935] Writing DB stats keystone:SELECT=100 {{(pid=87935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:37:57.419114 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf218d9-31cb-4da8-b661-b26aaef8a659 None None] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:37:57.462640 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5781219-620c-4618-87ed-e7e4616f690d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:37:57.463279 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5781219-620c-4618-87ed-e7e4616f690d None admin] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:37:57.463862 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5781219-620c-4618-87ed-e7e4616f690d None admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:37:57.464146 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5781219-620c-4618-87ed-e7e4616f690d None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:37:57.472730 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5781219-620c-4618-87ed-e7e4616f690d None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:37:57.474778 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5781219-620c-4618-87ed-e7e4616f690d None admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:37:57.491198 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application [None req-c5781219-620c-4618-87ed-e7e4616f690d None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Sep 13 19:37:57.491198 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:37:57.491198 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Sep 13 19:37:57.491198 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Sep 13 19:37:57.491198 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 13 19:37:57.491198 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 13 19:37:57.491198 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 13 19:37:57.491198 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 13 19:37:57.491198 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Sep 13 19:37:57.491198 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application Sep 13 19:37:57.491198 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 13 19:37:57.491198 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application Sep 13 19:37:57.491198 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:37:57.491198 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:37:57.491198 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:37:57.491198 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:37:57.491198 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:37:57.492605 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:37:57.492605 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:37:57.492605 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:37:57.492605 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:37:57.492605 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:37:57.492605 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:37:57.492605 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 19:37:57.492605 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 19:37:57.492605 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 19:37:57.492605 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 19:37:57.492605 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:37:57.492605 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:37:57.492605 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:37:57.492605 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:37:57.492605 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:37:57.492605 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:37:57.499375 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:37:57.499375 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application with Lock( Sep 13 19:37:57.499375 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:37:57.499375 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:37:57.499375 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:37:57.499375 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:37:57.499375 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:37:57.499375 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:37:57.499375 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:37:57.499375 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:37:57.499375 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Sep 13 19:37:57.499375 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 19:37:57.499375 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Sep 13 19:37:57.499375 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application Sep 13 19:37:57.499375 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 569/1165] 10.222.0.25 () {56 vars in 1117 bytes} [Tue Sep 13 19:37:57 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:37:57.500248 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1fe5950-184d-43d8-be9e-7744cc0e20ee None admin] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:37:57.608107 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1fe5950-184d-43d8-be9e-7744cc0e20ee None admin] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:37:57.642858 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f391bf1d-3ead-49f8-a003-3889805a24d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:37:57.643472 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f391bf1d-3ead-49f8-a003-3889805a24d7 None admin] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:37:57.643744 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f391bf1d-3ead-49f8-a003-3889805a24d7 None admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:37:57.644005 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f391bf1d-3ead-49f8-a003-3889805a24d7 None admin] PATH_INFO: `/v3/domains` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:37:57.644675 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f391bf1d-3ead-49f8-a003-3889805a24d7 None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=87934) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:37:57.644962 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f391bf1d-3ead-49f8-a003-3889805a24d7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:37:57.646306 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f391bf1d-3ead-49f8-a003-3889805a24d7 None admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:37:57.653796 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 597/1166] 10.222.0.25 () {56 vars in 1115 bytes} [Tue Sep 13 19:37:57 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 19:37:59.832451 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24914812-29de-4554-8961-98ec6a38db4d None None] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:37:59.833035 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24914812-29de-4554-8961-98ec6a38db4d None None] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:37:59.833035 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24914812-29de-4554-8961-98ec6a38db4d None None] PATH_INFO: `/` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:37:59.834380 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 570/1167] 10.222.0.25 () {54 vars in 927 bytes} [Tue Sep 13 19:37:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:37:59.841945 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74792f2-8b2c-4064-b8c7-8cc27852d96f None None] REQUEST_METHOD: `POST` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:37:59.842396 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74792f2-8b2c-4064-b8c7-8cc27852d96f None None] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:37:59.842591 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74792f2-8b2c-4064-b8c7-8cc27852d96f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:37:59.861827 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.auth.core [None req-c74792f2-8b2c-4064-b8c7-8cc27852d96f None None] MFA Rules not processed for user `7b0aed92d02344acb92a0e4aa67c3068`. Rule list: `[]` (Enabled: `True`). {{(pid=87934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:37:59.863211 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.fernet_utils [None req-c74792f2-8b2c-4064-b8c7-8cc27852d96f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:37:59.894903 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG dbcounter [-] [87934] Writing DB stats keystone:SELECT=100 {{(pid=87934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:37:59.938389 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 598/1168] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Sep 13 19:37:59 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 13 19:38:00.211643 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24914812-29de-4554-8961-98ec6a38db4d None None] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:38:00.319867 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24914812-29de-4554-8961-98ec6a38db4d None None] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:38:00.327130 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG dbcounter [-] [87935] Writing DB stats keystone:SELECT=100 {{(pid=87935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:38:00.363382 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ab4d08-2f4b-4415-858e-7f7c133d415f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:38:00.363987 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ab4d08-2f4b-4415-858e-7f7c133d415f None admin] REQUEST_METHOD: `POST` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:38:00.364292 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ab4d08-2f4b-4415-858e-7f7c133d415f None admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:38:00.364562 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ab4d08-2f4b-4415-858e-7f7c133d415f None admin] PATH_INFO: `/v3/domains` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:38:00.365240 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ab4d08-2f4b-4415-858e-7f7c133d415f None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:38:00.366602 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ab4d08-2f4b-4415-858e-7f7c133d415f None admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:38:00.384326 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 571/1169] 10.222.0.25 () {60 vars in 1138 bytes} [Tue Sep 13 19:38:00 2022] POST /identity/v3/domains => generated 267 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 19:38:02.712599 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6407bd-9b69-4204-af34-359c9ca35096 None None] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:38:02.713152 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6407bd-9b69-4204-af34-359c9ca35096 None None] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:38:02.713152 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6407bd-9b69-4204-af34-359c9ca35096 None None] PATH_INFO: `/` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:38:02.714403 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 599/1170] 10.222.0.25 () {54 vars in 927 bytes} [Tue Sep 13 19:38:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:38:02.720650 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07c80e0-4d39-4911-bd57-5fae610f49c2 None None] REQUEST_METHOD: `POST` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:38:02.721162 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07c80e0-4d39-4911-bd57-5fae610f49c2 None None] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:38:02.721162 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07c80e0-4d39-4911-bd57-5fae610f49c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:38:02.739969 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.auth.core [None req-f07c80e0-4d39-4911-bd57-5fae610f49c2 None None] MFA Rules not processed for user `7b0aed92d02344acb92a0e4aa67c3068`. Rule list: `[]` (Enabled: `True`). {{(pid=87935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:38:02.741205 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.fernet_utils [None req-f07c80e0-4d39-4911-bd57-5fae610f49c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:38:02.825403 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 572/1171] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Sep 13 19:38:02 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 13 19:38:03.097542 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6407bd-9b69-4204-af34-359c9ca35096 None None] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:38:03.202177 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6407bd-9b69-4204-af34-359c9ca35096 None None] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:38:03.241955 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61f48c3-41ae-4d50-8b35-2f7d37e4599a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:38:03.242583 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61f48c3-41ae-4d50-8b35-2f7d37e4599a None admin] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:38:03.242860 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61f48c3-41ae-4d50-8b35-2f7d37e4599a None admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:38:03.243128 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61f48c3-41ae-4d50-8b35-2f7d37e4599a None admin] PATH_INFO: `/v3/domains/b8ce632ee20a4c4da47f98d343383861` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:38:03.256792 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f61f48c3-41ae-4d50-8b35-2f7d37e4599a None admin] RBAC: Authorizing `identity:get_domain(domain_id=b8ce632ee20a4c4da47f98d343383861)` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:38:03.258249 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f61f48c3-41ae-4d50-8b35-2f7d37e4599a None admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:38:03.259920 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 600/1172] 10.222.0.25 () {56 vars in 1183 bytes} [Tue Sep 13 19:38:03 2022] GET /identity/v3/domains/b8ce632ee20a4c4da47f98d343383861 => generated 267 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 19:38:03.265882 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07c80e0-4d39-4911-bd57-5fae610f49c2 None None] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:38:03.392619 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG dbcounter [-] [87935] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:38:03.402780 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07c80e0-4d39-4911-bd57-5fae610f49c2 None None] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:38:03.445097 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ddf90a-527c-4f41-9068-cce16d249123 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:38:03.445693 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ddf90a-527c-4f41-9068-cce16d249123 None admin] REQUEST_METHOD: `POST` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:38:03.446017 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ddf90a-527c-4f41-9068-cce16d249123 None admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:38:03.446234 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ddf90a-527c-4f41-9068-cce16d249123 None admin] PATH_INFO: `/v3/projects` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:38:03.446876 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ddf90a-527c-4f41-9068-cce16d249123 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:38:03.448316 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ddf90a-527c-4f41-9068-cce16d249123 None admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:38:03.476193 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 573/1173] 10.222.0.25 () {60 vars in 1141 bytes} [Tue Sep 13 19:38:03 2022] POST /identity/v3/projects => generated 361 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 19:38:05.726149 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c222193-7f59-4e36-8b51-4861c7146a0c None None] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:38:05.726760 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c222193-7f59-4e36-8b51-4861c7146a0c None None] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:38:05.726760 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c222193-7f59-4e36-8b51-4861c7146a0c None None] PATH_INFO: `/` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:38:05.728024 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 601/1174] 10.222.0.25 () {54 vars in 927 bytes} [Tue Sep 13 19:38:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:38:05.733529 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b4895d-e9ad-4ef1-b921-9547355335f6 None None] REQUEST_METHOD: `POST` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:38:05.733941 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b4895d-e9ad-4ef1-b921-9547355335f6 None None] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:38:05.734077 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b4895d-e9ad-4ef1-b921-9547355335f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:38:05.753467 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.auth.core [None req-51b4895d-e9ad-4ef1-b921-9547355335f6 None None] MFA Rules not processed for user `7b0aed92d02344acb92a0e4aa67c3068`. Rule list: `[]` (Enabled: `True`). {{(pid=87935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:38:05.754662 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.fernet_utils [None req-51b4895d-e9ad-4ef1-b921-9547355335f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:38:05.823306 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 574/1175] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Sep 13 19:38:05 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 13 19:38:06.094421 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c222193-7f59-4e36-8b51-4861c7146a0c None None] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:38:06.123655 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG dbcounter [-] [87934] Writing DB stats keystone:SELECT=100 {{(pid=87934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:38:06.198788 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c222193-7f59-4e36-8b51-4861c7146a0c None None] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:38:06.231896 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f1663d-308e-48e9-a7fa-2b53b47896d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:38:06.232549 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f1663d-308e-48e9-a7fa-2b53b47896d7 None admin] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:38:06.232828 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f1663d-308e-48e9-a7fa-2b53b47896d7 None admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:38:06.233099 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f1663d-308e-48e9-a7fa-2b53b47896d7 None admin] PATH_INFO: `/v3/domains/b8ce632ee20a4c4da47f98d343383861` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:38:06.234225 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f1663d-308e-48e9-a7fa-2b53b47896d7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=b8ce632ee20a4c4da47f98d343383861)` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:38:06.236151 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f1663d-308e-48e9-a7fa-2b53b47896d7 None admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:38:06.237976 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 602/1176] 10.222.0.25 () {56 vars in 1183 bytes} [Tue Sep 13 19:38:06 2022] GET /identity/v3/domains/b8ce632ee20a4c4da47f98d343383861 => generated 267 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:38:06.243818 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b4895d-e9ad-4ef1-b921-9547355335f6 None None] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:38:06.322289 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG dbcounter [-] [87935] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:38:06.346967 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b4895d-e9ad-4ef1-b921-9547355335f6 None None] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:38:06.382218 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33bd207a-732c-4df7-bea3-77e9d412dd19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:38:06.382825 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33bd207a-732c-4df7-bea3-77e9d412dd19 None admin] REQUEST_METHOD: `POST` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:38:06.383103 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33bd207a-732c-4df7-bea3-77e9d412dd19 None admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:38:06.383372 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33bd207a-732c-4df7-bea3-77e9d412dd19 None admin] PATH_INFO: `/v3/users` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:38:06.384031 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33bd207a-732c-4df7-bea3-77e9d412dd19 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:38:06.385493 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33bd207a-732c-4df7-bea3-77e9d412dd19 None admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:38:06.409354 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 575/1177] 10.222.0.25 () {60 vars in 1132 bytes} [Tue Sep 13 19:38:06 2022] POST /identity/v3/users => generated 311 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 19:38:08.729724 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30713534-3f49-4f5d-874a-0ed24b60c69d None None] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:38:08.730289 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30713534-3f49-4f5d-874a-0ed24b60c69d None None] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:38:08.730289 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30713534-3f49-4f5d-874a-0ed24b60c69d None None] PATH_INFO: `/` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:38:08.731607 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 603/1178] 10.222.0.25 () {54 vars in 927 bytes} [Tue Sep 13 19:38:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:38:08.738194 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d916b2c-dad2-4cee-9175-e3621078772e None None] REQUEST_METHOD: `POST` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:38:08.738720 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d916b2c-dad2-4cee-9175-e3621078772e None None] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:38:08.738720 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d916b2c-dad2-4cee-9175-e3621078772e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:38:08.758736 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.auth.core [None req-1d916b2c-dad2-4cee-9175-e3621078772e None None] MFA Rules not processed for user `7b0aed92d02344acb92a0e4aa67c3068`. Rule list: `[]` (Enabled: `True`). {{(pid=87935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:38:08.759959 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.fernet_utils [None req-1d916b2c-dad2-4cee-9175-e3621078772e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:38:08.833277 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 576/1179] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Sep 13 19:38:08 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 13 19:38:09.110538 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30713534-3f49-4f5d-874a-0ed24b60c69d None None] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:38:09.210485 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG dbcounter [-] [87934] Writing DB stats keystone:SELECT=100 {{(pid=87934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:38:09.217727 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30713534-3f49-4f5d-874a-0ed24b60c69d None None] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:38:09.252475 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9ebf45-4e2e-4f17-b38e-ed1b3ce28155 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:38:09.253121 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9ebf45-4e2e-4f17-b38e-ed1b3ce28155 None admin] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:38:09.253521 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9ebf45-4e2e-4f17-b38e-ed1b3ce28155 None admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:38:09.253943 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9ebf45-4e2e-4f17-b38e-ed1b3ce28155 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:38:09.265080 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf9ebf45-4e2e-4f17-b38e-ed1b3ce28155 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 19:38:09.270657 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application [None req-cf9ebf45-4e2e-4f17-b38e-ed1b3ce28155 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 19:38:09.270657 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:38:09.270657 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:38:09.270657 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:38:09.270657 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:38:09.270657 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:38:09.270657 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:38:09.270657 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:38:09.270657 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:38:09.270657 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:38:09.270657 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:38:09.270657 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:38:09.270657 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 19:38:09.270657 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 19:38:09.270657 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 19:38:09.270657 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 19:38:09.271876 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 19:38:09.271876 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 19:38:09.271876 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 19:38:09.271876 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 19:38:09.271876 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:38:09.271876 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:38:09.271876 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:38:09.271876 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:38:09.271876 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:38:09.271876 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:38:09.271876 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:38:09.271876 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application with Lock( Sep 13 19:38:09.271876 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:38:09.271876 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:38:09.271876 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:38:09.271876 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:38:09.273030 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:38:09.273030 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:38:09.273030 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:38:09.273030 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:38:09.273030 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 19:38:09.273030 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 19:38:09.273030 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 19:38:09.273030 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 19:38:09.273030 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 19:38:09.273030 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 19:38:09.273030 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 19:38:09.273030 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application Sep 13 19:38:09.273030 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 604/1180] 10.222.0.25 () {56 vars in 1096 bytes} [Tue Sep 13 19:38:09 2022] GET /identity/v3/roles/admin => generated 83 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:38:09.281366 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d916b2c-dad2-4cee-9175-e3621078772e None None] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:38:09.349545 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG dbcounter [-] [87935] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:38:09.396396 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d916b2c-dad2-4cee-9175-e3621078772e None None] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:38:09.431149 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba132bf5-c2dc-4153-8ba5-f49e56f825aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:38:09.431750 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba132bf5-c2dc-4153-8ba5-f49e56f825aa None admin] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:38:09.432024 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba132bf5-c2dc-4153-8ba5-f49e56f825aa None admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:38:09.432320 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba132bf5-c2dc-4153-8ba5-f49e56f825aa None admin] PATH_INFO: `/v3/roles` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:38:09.432991 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba132bf5-c2dc-4153-8ba5-f49e56f825aa None admin] RBAC: Adding query filter params (name=admin) {{(pid=87935) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:38:09.433290 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba132bf5-c2dc-4153-8ba5-f49e56f825aa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:38:09.434651 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba132bf5-c2dc-4153-8ba5-f49e56f825aa None admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:38:09.444264 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 577/1181] 10.222.0.25 () {56 vars in 1099 bytes} [Tue Sep 13 19:38:09 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:38:09.449837 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9ebf45-4e2e-4f17-b38e-ed1b3ce28155 None admin] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:38:09.560320 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9ebf45-4e2e-4f17-b38e-ed1b3ce28155 None admin] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:38:09.595727 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba11dec-e039-4e4e-8a25-ee7006bab209 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:38:09.596389 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba11dec-e039-4e4e-8a25-ee7006bab209 None admin] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:38:09.596669 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba11dec-e039-4e4e-8a25-ee7006bab209 None admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:38:09.596938 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba11dec-e039-4e4e-8a25-ee7006bab209 None admin] PATH_INFO: `/v3/users/e84818f384454a9a88783e8bce90d5b5` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:38:09.610571 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba11dec-e039-4e4e-8a25-ee7006bab209 None admin] RBAC: Authorizing `identity:get_user(user_id=e84818f384454a9a88783e8bce90d5b5)` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:38:09.612099 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba11dec-e039-4e4e-8a25-ee7006bab209 None admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:38:09.613798 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 605/1182] 10.222.0.25 () {56 vars in 1177 bytes} [Tue Sep 13 19:38:09 2022] GET /identity/v3/users/e84818f384454a9a88783e8bce90d5b5 => generated 311 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:38:09.619710 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba132bf5-c2dc-4153-8ba5-f49e56f825aa None admin] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:38:09.723039 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba132bf5-c2dc-4153-8ba5-f49e56f825aa None admin] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:38:09.749108 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG dbcounter [-] [87935] Writing DB stats keystone:SELECT=100 {{(pid=87935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:38:09.758987 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e4624e-527e-40f3-a758-138a2a871aad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:38:09.759593 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e4624e-527e-40f3-a758-138a2a871aad None admin] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:38:09.759864 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e4624e-527e-40f3-a758-138a2a871aad None admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:38:09.760126 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e4624e-527e-40f3-a758-138a2a871aad None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:38:09.828830 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e4624e-527e-40f3-a758-138a2a871aad None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:38:09.830649 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e4624e-527e-40f3-a758-138a2a871aad None admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:38:09.931950 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 578/1183] 10.222.0.25 () {58 vars in 1282 bytes} [Tue Sep 13 19:38:09 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 13 19:38:09.938049 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba11dec-e039-4e4e-8a25-ee7006bab209 None admin] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:38:09.954712 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG dbcounter [-] [87934] Writing DB stats keystone:SELECT=100 {{(pid=87934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:38:10.041899 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba11dec-e039-4e4e-8a25-ee7006bab209 None admin] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:38:10.077266 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8411af9-70a6-4db5-9923-0ce400e76ba7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:38:10.077901 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8411af9-70a6-4db5-9923-0ce400e76ba7 None admin] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:38:10.078177 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8411af9-70a6-4db5-9923-0ce400e76ba7 None admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:38:10.078446 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8411af9-70a6-4db5-9923-0ce400e76ba7 None admin] PATH_INFO: `/v3/projects/48c83f19aaca4af4a3c001bb9fb91bc5` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:38:10.079792 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8411af9-70a6-4db5-9923-0ce400e76ba7 None admin] RBAC: Authorizing `identity:get_project(project_id=48c83f19aaca4af4a3c001bb9fb91bc5)` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:38:10.081378 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8411af9-70a6-4db5-9923-0ce400e76ba7 None admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:38:10.083307 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 606/1184] 10.222.0.25 () {56 vars in 1186 bytes} [Tue Sep 13 19:38:09 2022] GET /identity/v3/projects/48c83f19aaca4af4a3c001bb9fb91bc5 => generated 361 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:38:10.091870 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e4624e-527e-40f3-a758-138a2a871aad None admin] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:38:10.122209 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG dbcounter [-] [87935] Writing DB stats keystone:SELECT=100 {{(pid=87935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:38:10.207845 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e4624e-527e-40f3-a758-138a2a871aad None admin] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:38:10.244023 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04712c7-cb83-4ef6-a399-9f427eed0556 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:38:10.244657 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04712c7-cb83-4ef6-a399-9f427eed0556 None admin] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:38:10.244929 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04712c7-cb83-4ef6-a399-9f427eed0556 None admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:38:10.245192 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04712c7-cb83-4ef6-a399-9f427eed0556 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:38:10.245911 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a04712c7-cb83-4ef6-a399-9f427eed0556 None admin] RBAC: Adding query filter params (role.id=6ca1d4427ff64e0a9d25d96cfb1445f6, scope.project.id=48c83f19aaca4af4a3c001bb9fb91bc5, user.id=e84818f384454a9a88783e8bce90d5b5) {{(pid=87935) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:38:10.246213 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a04712c7-cb83-4ef6-a399-9f427eed0556 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:38:10.247656 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a04712c7-cb83-4ef6-a399-9f427eed0556 None admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:38:10.253661 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 579/1185] 10.222.0.25 () {56 vars in 1374 bytes} [Tue Sep 13 19:38:10 2022] GET /identity/v3/role_assignments?user.id=e84818f384454a9a88783e8bce90d5b5&scope.project.id=48c83f19aaca4af4a3c001bb9fb91bc5&role.id=6ca1d4427ff64e0a9d25d96cfb1445f6 => generated 259 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:38:12.432761 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc8f611-7d14-426c-a3d2-a1795065a854 None None] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:38:12.433294 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc8f611-7d14-426c-a3d2-a1795065a854 None None] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:38:12.433294 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc8f611-7d14-426c-a3d2-a1795065a854 None None] PATH_INFO: `/` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:38:12.434636 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 607/1186] 10.222.0.25 () {54 vars in 927 bytes} [Tue Sep 13 19:38:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:38:12.440584 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f36ccdf-cd9e-43e8-a769-fa021792e70e None None] REQUEST_METHOD: `POST` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:38:12.441085 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f36ccdf-cd9e-43e8-a769-fa021792e70e None None] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:38:12.441177 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f36ccdf-cd9e-43e8-a769-fa021792e70e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:38:12.461190 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.auth.core [None req-0f36ccdf-cd9e-43e8-a769-fa021792e70e None None] MFA Rules not processed for user `7b0aed92d02344acb92a0e4aa67c3068`. Rule list: `[]` (Enabled: `True`). {{(pid=87935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:38:12.462525 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.fernet_utils [None req-0f36ccdf-cd9e-43e8-a769-fa021792e70e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:38:12.540554 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 580/1187] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Sep 13 19:38:12 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 13 19:38:12.819456 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc8f611-7d14-426c-a3d2-a1795065a854 None None] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:38:12.906163 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG dbcounter [-] [87934] Writing DB stats keystone:SELECT=100 {{(pid=87934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:38:12.928851 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc8f611-7d14-426c-a3d2-a1795065a854 None None] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:38:12.964469 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c550310-b96b-44cc-80d2-6c6e01fa970f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:38:12.965111 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c550310-b96b-44cc-80d2-6c6e01fa970f None admin] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:38:12.965393 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c550310-b96b-44cc-80d2-6c6e01fa970f None admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:38:12.965666 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c550310-b96b-44cc-80d2-6c6e01fa970f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:38:12.976748 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c550310-b96b-44cc-80d2-6c6e01fa970f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 19:38:12.981921 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application [None req-6c550310-b96b-44cc-80d2-6c6e01fa970f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 19:38:12.981921 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:38:12.981921 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:38:12.981921 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:38:12.981921 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:38:12.981921 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:38:12.981921 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:38:12.981921 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:38:12.981921 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:38:12.981921 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:38:12.981921 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:38:12.981921 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:38:12.981921 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 19:38:12.981921 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 19:38:12.981921 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 19:38:12.981921 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 19:38:12.983088 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 19:38:12.983088 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 19:38:12.983088 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 19:38:12.983088 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 19:38:12.983088 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:38:12.983088 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:38:12.983088 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:38:12.983088 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:38:12.983088 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:38:12.983088 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:38:12.983088 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:38:12.983088 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application with Lock( Sep 13 19:38:12.983088 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:38:12.983088 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:38:12.983088 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:38:12.983088 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:38:12.984362 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:38:12.984362 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:38:12.984362 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:38:12.984362 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:38:12.984362 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 19:38:12.984362 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 19:38:12.984362 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 19:38:12.984362 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 19:38:12.984362 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 19:38:12.984362 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 19:38:12.984362 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 19:38:12.984362 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application Sep 13 19:38:12.984362 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 608/1188] 10.222.0.25 () {56 vars in 1096 bytes} [Tue Sep 13 19:38:12 2022] GET /identity/v3/roles/admin => generated 83 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:38:12.989977 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f36ccdf-cd9e-43e8-a769-fa021792e70e None None] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:38:13.011051 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG dbcounter [-] [87935] Writing DB stats keystone:SELECT=100 {{(pid=87935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:38:13.098136 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f36ccdf-cd9e-43e8-a769-fa021792e70e None None] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:38:13.132836 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79892dc5-1f32-4105-88b9-2f7633705971 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:38:13.133439 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79892dc5-1f32-4105-88b9-2f7633705971 None admin] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:38:13.133713 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79892dc5-1f32-4105-88b9-2f7633705971 None admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:38:13.133977 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79892dc5-1f32-4105-88b9-2f7633705971 None admin] PATH_INFO: `/v3/roles` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:38:13.134632 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79892dc5-1f32-4105-88b9-2f7633705971 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87935) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:38:13.134926 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79892dc5-1f32-4105-88b9-2f7633705971 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:38:13.136315 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79892dc5-1f32-4105-88b9-2f7633705971 None admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:38:13.145625 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 581/1189] 10.222.0.25 () {56 vars in 1099 bytes} [Tue Sep 13 19:38:12 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:38:13.152155 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c550310-b96b-44cc-80d2-6c6e01fa970f None admin] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:38:13.262521 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c550310-b96b-44cc-80d2-6c6e01fa970f None admin] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:38:13.296801 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a23748f-d888-4068-8d7c-0ab553c94b59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:38:13.297511 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a23748f-d888-4068-8d7c-0ab553c94b59 None admin] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:38:13.297904 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a23748f-d888-4068-8d7c-0ab553c94b59 None admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:38:13.298324 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a23748f-d888-4068-8d7c-0ab553c94b59 None admin] PATH_INFO: `/v3/users/e84818f384454a9a88783e8bce90d5b5` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:38:13.299605 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a23748f-d888-4068-8d7c-0ab553c94b59 None admin] RBAC: Authorizing `identity:get_user(user_id=e84818f384454a9a88783e8bce90d5b5)` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:38:13.301070 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a23748f-d888-4068-8d7c-0ab553c94b59 None admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:38:13.302657 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 609/1190] 10.222.0.25 () {56 vars in 1177 bytes} [Tue Sep 13 19:38:13 2022] GET /identity/v3/users/e84818f384454a9a88783e8bce90d5b5 => generated 311 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:38:13.308759 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79892dc5-1f32-4105-88b9-2f7633705971 None admin] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:38:13.395289 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG dbcounter [-] [87935] Writing DB stats keystone:SELECT=100 {{(pid=87935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:38:13.421203 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79892dc5-1f32-4105-88b9-2f7633705971 None admin] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:38:13.461502 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad175aea-1241-4607-b765-8b1cd1288549 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:38:13.462196 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad175aea-1241-4607-b765-8b1cd1288549 None admin] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:38:13.462396 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad175aea-1241-4607-b765-8b1cd1288549 None admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:38:13.462667 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad175aea-1241-4607-b765-8b1cd1288549 None admin] PATH_INFO: `/v3/projects/48c83f19aaca4af4a3c001bb9fb91bc5` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:38:13.463781 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad175aea-1241-4607-b765-8b1cd1288549 None admin] RBAC: Authorizing `identity:get_project(project_id=48c83f19aaca4af4a3c001bb9fb91bc5)` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:38:13.465239 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad175aea-1241-4607-b765-8b1cd1288549 None admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:38:13.466874 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 582/1191] 10.222.0.25 () {56 vars in 1186 bytes} [Tue Sep 13 19:38:13 2022] GET /identity/v3/projects/48c83f19aaca4af4a3c001bb9fb91bc5 => generated 361 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:38:13.473088 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a23748f-d888-4068-8d7c-0ab553c94b59 None admin] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:38:13.489361 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG dbcounter [-] [87934] Writing DB stats keystone:SELECT=100 {{(pid=87934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:38:13.591621 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a23748f-d888-4068-8d7c-0ab553c94b59 None admin] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:38:13.628045 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c793e0b-50c7-4d35-87e9-f5cce97942c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:38:13.628746 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c793e0b-50c7-4d35-87e9-f5cce97942c9 None admin] REQUEST_METHOD: `PUT` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:38:13.629019 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c793e0b-50c7-4d35-87e9-f5cce97942c9 None admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:38:13.629284 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c793e0b-50c7-4d35-87e9-f5cce97942c9 None admin] PATH_INFO: `/v3/projects/48c83f19aaca4af4a3c001bb9fb91bc5/users/e84818f384454a9a88783e8bce90d5b5/roles/6ca1d4427ff64e0a9d25d96cfb1445f6` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:38:13.631159 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c793e0b-50c7-4d35-87e9-f5cce97942c9 None admin] RBAC: Authorizing `identity:create_grant(project_id=48c83f19aaca4af4a3c001bb9fb91bc5, user_id=e84818f384454a9a88783e8bce90d5b5, role_id=6ca1d4427ff64e0a9d25d96cfb1445f6)` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:38:13.632616 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c793e0b-50c7-4d35-87e9-f5cce97942c9 None admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:38:13.646534 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 610/1192] 10.222.0.25 () {58 vars in 1439 bytes} [Tue Sep 13 19:38:13 2022] PUT /identity/v3/projects/48c83f19aaca4af4a3c001bb9fb91bc5/users/e84818f384454a9a88783e8bce90d5b5/roles/6ca1d4427ff64e0a9d25d96cfb1445f6 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 19:38:15.951108 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0ce238-9a5a-43db-b22b-c87948c5435a None None] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:38:15.951681 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0ce238-9a5a-43db-b22b-c87948c5435a None None] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:38:15.951681 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0ce238-9a5a-43db-b22b-c87948c5435a None None] PATH_INFO: `/` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:38:15.953038 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 583/1193] 10.222.0.25 () {54 vars in 927 bytes} [Tue Sep 13 19:38:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:38:15.959422 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b92970b-08b2-41dd-9a18-6557ddb052ba None None] REQUEST_METHOD: `POST` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:38:15.959937 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b92970b-08b2-41dd-9a18-6557ddb052ba None None] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:38:15.960047 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b92970b-08b2-41dd-9a18-6557ddb052ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:38:15.978043 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.auth.core [None req-3b92970b-08b2-41dd-9a18-6557ddb052ba None None] MFA Rules not processed for user `7b0aed92d02344acb92a0e4aa67c3068`. Rule list: `[]` (Enabled: `True`). {{(pid=87934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:38:15.979236 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.fernet_utils [None req-3b92970b-08b2-41dd-9a18-6557ddb052ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:38:16.042432 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG dbcounter [-] [87934] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:38:16.048520 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 611/1194] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Sep 13 19:38:15 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 13 19:38:16.333782 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0ce238-9a5a-43db-b22b-c87948c5435a None None] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:38:16.441126 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0ce238-9a5a-43db-b22b-c87948c5435a None None] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:38:16.479404 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7cdc16-9834-4be3-8200-45b05fba9621 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:38:16.480040 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7cdc16-9834-4be3-8200-45b05fba9621 None admin] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:38:16.480347 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7cdc16-9834-4be3-8200-45b05fba9621 None admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:38:16.480617 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7cdc16-9834-4be3-8200-45b05fba9621 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:38:16.491697 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c7cdc16-9834-4be3-8200-45b05fba9621 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 19:38:16.496524 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application [None req-9c7cdc16-9834-4be3-8200-45b05fba9621 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 19:38:16.496524 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:38:16.496524 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:38:16.496524 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:38:16.496524 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:38:16.496524 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:38:16.496524 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:38:16.496524 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:38:16.496524 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:38:16.496524 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:38:16.496524 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:38:16.496524 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:38:16.496524 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 19:38:16.496524 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 19:38:16.496524 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 19:38:16.496524 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 19:38:16.497615 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 19:38:16.497615 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 19:38:16.497615 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 19:38:16.497615 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 19:38:16.497615 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:38:16.497615 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:38:16.497615 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:38:16.497615 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:38:16.497615 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:38:16.497615 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:38:16.497615 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:38:16.497615 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application with Lock( Sep 13 19:38:16.497615 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:38:16.497615 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:38:16.497615 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:38:16.497615 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:38:16.498661 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:38:16.498661 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:38:16.498661 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:38:16.498661 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:38:16.498661 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 19:38:16.498661 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 19:38:16.498661 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 19:38:16.498661 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 19:38:16.498661 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 19:38:16.498661 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 19:38:16.498661 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 19:38:16.498661 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application Sep 13 19:38:16.498661 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 584/1195] 10.222.0.25 () {56 vars in 1096 bytes} [Tue Sep 13 19:38:16 2022] GET /identity/v3/roles/admin => generated 83 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:38:16.504609 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b92970b-08b2-41dd-9a18-6557ddb052ba None None] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:38:16.606224 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b92970b-08b2-41dd-9a18-6557ddb052ba None None] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:38:16.642428 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07ad3bf-5095-4f4e-80ac-91b556d87155 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:38:16.643038 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07ad3bf-5095-4f4e-80ac-91b556d87155 None admin] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:38:16.643315 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07ad3bf-5095-4f4e-80ac-91b556d87155 None admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:38:16.643582 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07ad3bf-5095-4f4e-80ac-91b556d87155 None admin] PATH_INFO: `/v3/roles` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:38:16.645262 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c07ad3bf-5095-4f4e-80ac-91b556d87155 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87934) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:38:16.645262 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c07ad3bf-5095-4f4e-80ac-91b556d87155 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:38:16.645928 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c07ad3bf-5095-4f4e-80ac-91b556d87155 None admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:38:16.654824 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 612/1196] 10.222.0.25 () {56 vars in 1099 bytes} [Tue Sep 13 19:38:16 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:38:16.661224 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7cdc16-9834-4be3-8200-45b05fba9621 None admin] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:38:16.674884 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG dbcounter [-] [87935] Writing DB stats keystone:SELECT=100 {{(pid=87935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:38:16.780324 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7cdc16-9834-4be3-8200-45b05fba9621 None admin] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:38:16.815748 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1aac924-4efb-4db4-8aa5-4375720fd207 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:38:16.816397 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1aac924-4efb-4db4-8aa5-4375720fd207 None admin] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:38:16.816672 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1aac924-4efb-4db4-8aa5-4375720fd207 None admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:38:16.817218 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1aac924-4efb-4db4-8aa5-4375720fd207 None admin] PATH_INFO: `/v3/users/e84818f384454a9a88783e8bce90d5b5` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:38:16.818362 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1aac924-4efb-4db4-8aa5-4375720fd207 None admin] RBAC: Authorizing `identity:get_user(user_id=e84818f384454a9a88783e8bce90d5b5)` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:38:16.819787 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1aac924-4efb-4db4-8aa5-4375720fd207 None admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:38:16.822714 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 585/1197] 10.222.0.25 () {56 vars in 1177 bytes} [Tue Sep 13 19:38:16 2022] GET /identity/v3/users/e84818f384454a9a88783e8bce90d5b5 => generated 311 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:38:16.827756 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07ad3bf-5095-4f4e-80ac-91b556d87155 None admin] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:38:16.889860 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG dbcounter [-] [87934] Writing DB stats keystone:SELECT=100 {{(pid=87934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:38:16.930110 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07ad3bf-5095-4f4e-80ac-91b556d87155 None admin] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:38:16.967492 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434f5a79-345e-4298-b0bf-c8f96848f4bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:38:16.968291 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434f5a79-345e-4298-b0bf-c8f96848f4bb None admin] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:38:16.968532 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434f5a79-345e-4298-b0bf-c8f96848f4bb None admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:38:16.968801 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434f5a79-345e-4298-b0bf-c8f96848f4bb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:38:17.040913 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-434f5a79-345e-4298-b0bf-c8f96848f4bb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:38:17.042348 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-434f5a79-345e-4298-b0bf-c8f96848f4bb None admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:38:17.102583 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG dbcounter [-] [87934] Writing DB stats keystone:SELECT=100 {{(pid=87934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:38:17.143318 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 613/1198] 10.222.0.25 () {58 vars in 1282 bytes} [Tue Sep 13 19:38:16 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 13 19:38:17.149542 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1aac924-4efb-4db4-8aa5-4375720fd207 None admin] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:38:17.244050 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG dbcounter [-] [87935] Writing DB stats keystone:SELECT=100 {{(pid=87935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:38:17.267929 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1aac924-4efb-4db4-8aa5-4375720fd207 None admin] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:38:17.305541 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ebf1b1f-c995-408b-b3e3-03558e2d87a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:38:17.306275 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebf1b1f-c995-408b-b3e3-03558e2d87a6 None admin] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:38:17.306556 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebf1b1f-c995-408b-b3e3-03558e2d87a6 None admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:38:17.306828 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebf1b1f-c995-408b-b3e3-03558e2d87a6 None admin] PATH_INFO: `/v3/projects/48c83f19aaca4af4a3c001bb9fb91bc5` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:38:17.307957 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ebf1b1f-c995-408b-b3e3-03558e2d87a6 None admin] RBAC: Authorizing `identity:get_project(project_id=48c83f19aaca4af4a3c001bb9fb91bc5)` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:38:17.309450 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ebf1b1f-c995-408b-b3e3-03558e2d87a6 None admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:38:17.311318 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 586/1199] 10.222.0.25 () {56 vars in 1186 bytes} [Tue Sep 13 19:38:17 2022] GET /identity/v3/projects/48c83f19aaca4af4a3c001bb9fb91bc5 => generated 361 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:38:17.320650 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434f5a79-345e-4298-b0bf-c8f96848f4bb None admin] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:38:17.427203 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434f5a79-345e-4298-b0bf-c8f96848f4bb None admin] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:38:17.463194 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7ccde8-f542-4aa9-b82a-2411478b87af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:38:17.463799 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7ccde8-f542-4aa9-b82a-2411478b87af None admin] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:38:17.464075 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7ccde8-f542-4aa9-b82a-2411478b87af None admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:38:17.464375 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7ccde8-f542-4aa9-b82a-2411478b87af None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:38:17.465110 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e7ccde8-f542-4aa9-b82a-2411478b87af None admin] RBAC: Adding query filter params (role.id=6ca1d4427ff64e0a9d25d96cfb1445f6, scope.project.id=48c83f19aaca4af4a3c001bb9fb91bc5, user.id=e84818f384454a9a88783e8bce90d5b5) {{(pid=87934) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:38:17.465416 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e7ccde8-f542-4aa9-b82a-2411478b87af None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:38:17.466845 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e7ccde8-f542-4aa9-b82a-2411478b87af None admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:38:17.473163 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 614/1200] 10.222.0.25 () {56 vars in 1374 bytes} [Tue Sep 13 19:38:17 2022] GET /identity/v3/role_assignments?user.id=e84818f384454a9a88783e8bce90d5b5&scope.project.id=48c83f19aaca4af4a3c001bb9fb91bc5&role.id=6ca1d4427ff64e0a9d25d96cfb1445f6 => generated 608 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:38:27.300021 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG dbcounter [-] [87935] Writing DB stats keystone:SELECT=27 {{(pid=87935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:38:27.470503 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG dbcounter [-] [87934] Writing DB stats keystone:SELECT=87 {{(pid=87934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:39:14.624300 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b049d679-c22d-4f70-9f31-f34be3409719 None None] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:39:14.624300 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b049d679-c22d-4f70-9f31-f34be3409719 None None] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:39:14.624300 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b049d679-c22d-4f70-9f31-f34be3409719 None None] PATH_INFO: `/` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:39:14.624300 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 587/1201] 10.222.0.25 () {54 vars in 927 bytes} [Tue Sep 13 19:39:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:39:14.636252 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1afba70-0d8e-4937-a625-f6a44087f840 None None] REQUEST_METHOD: `POST` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:39:14.636252 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1afba70-0d8e-4937-a625-f6a44087f840 None None] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:39:14.636252 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1afba70-0d8e-4937-a625-f6a44087f840 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:39:14.656999 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.auth.core [None req-e1afba70-0d8e-4937-a625-f6a44087f840 None None] MFA Rules not processed for user `7b0aed92d02344acb92a0e4aa67c3068`. Rule list: `[]` (Enabled: `True`). {{(pid=87934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:39:14.659503 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.fernet_utils [None req-e1afba70-0d8e-4937-a625-f6a44087f840 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:39:14.772411 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 615/1202] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Sep 13 19:39:14 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 13 19:39:15.051570 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b049d679-c22d-4f70-9f31-f34be3409719 None None] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:39:15.201249 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b049d679-c22d-4f70-9f31-f34be3409719 None None] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:39:15.261060 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b06b999-27cd-47f2-bf88-bb78343f8ba8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:39:15.262172 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b06b999-27cd-47f2-bf88-bb78343f8ba8 None admin] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:39:15.262691 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b06b999-27cd-47f2-bf88-bb78343f8ba8 None admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:39:15.263219 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b06b999-27cd-47f2-bf88-bb78343f8ba8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:39:15.276236 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b06b999-27cd-47f2-bf88-bb78343f8ba8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:39:15.278088 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b06b999-27cd-47f2-bf88-bb78343f8ba8 None admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:39:15.306699 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application [None req-6b06b999-27cd-47f2-bf88-bb78343f8ba8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 19:39:15.306699 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:39:15.306699 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:39:15.306699 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:39:15.306699 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:39:15.306699 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:39:15.306699 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:39:15.306699 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:39:15.306699 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:39:15.306699 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:39:15.306699 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:39:15.306699 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:39:15.306699 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 19:39:15.306699 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 19:39:15.306699 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 19:39:15.306699 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 19:39:15.308005 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:39:15.308005 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:39:15.308005 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:39:15.308005 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:39:15.308005 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:39:15.308005 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:39:15.308005 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:39:15.308005 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application with Lock( Sep 13 19:39:15.308005 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:39:15.308005 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:39:15.308005 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:39:15.308005 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:39:15.308005 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:39:15.308005 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:39:15.308005 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:39:15.308005 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:39:15.308005 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 19:39:15.309038 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 19:39:15.309038 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 19:39:15.309038 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application Sep 13 19:39:15.309038 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 588/1203] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Sep 13 19:39:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 257 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:39:15.315608 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1afba70-0d8e-4937-a625-f6a44087f840 None None] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:39:15.464126 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1afba70-0d8e-4937-a625-f6a44087f840 None None] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:39:15.511871 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG dbcounter [-] [87934] Writing DB stats keystone:SELECT=100 {{(pid=87934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:39:15.520252 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035f78b2-18c7-4359-a1b5-0c9fb3446cc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:39:15.521048 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035f78b2-18c7-4359-a1b5-0c9fb3446cc0 None admin] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:39:15.521433 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035f78b2-18c7-4359-a1b5-0c9fb3446cc0 None admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:39:15.521726 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035f78b2-18c7-4359-a1b5-0c9fb3446cc0 None admin] PATH_INFO: `/v3/domains` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:39:15.522360 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-035f78b2-18c7-4359-a1b5-0c9fb3446cc0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87934) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:39:15.522822 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-035f78b2-18c7-4359-a1b5-0c9fb3446cc0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:39:15.524200 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-035f78b2-18c7-4359-a1b5-0c9fb3446cc0 None admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:39:15.550137 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 616/1204] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Sep 13 19:39:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:39:15.556981 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b06b999-27cd-47f2-bf88-bb78343f8ba8 None admin] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:39:15.626252 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG dbcounter [-] [87935] Writing DB stats keystone:SELECT=100 {{(pid=87935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:39:15.693966 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b06b999-27cd-47f2-bf88-bb78343f8ba8 None admin] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:39:15.737345 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22bbacba-ac1a-42f2-99f1-05e18c71f900 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:39:15.738160 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bbacba-ac1a-42f2-99f1-05e18c71f900 None admin] REQUEST_METHOD: `POST` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:39:15.738483 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bbacba-ac1a-42f2-99f1-05e18c71f900 None admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:39:15.738830 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bbacba-ac1a-42f2-99f1-05e18c71f900 None admin] PATH_INFO: `/v3/users` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:39:15.739585 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22bbacba-ac1a-42f2-99f1-05e18c71f900 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:39:15.741565 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22bbacba-ac1a-42f2-99f1-05e18c71f900 None admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:39:15.768974 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 589/1205] 10.222.0.25 () {60 vars in 1132 bytes} [Tue Sep 13 19:39:15 2022] POST /identity/v3/users => generated 251 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 13 19:39:18.342163 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c073d962-b787-4cee-a407-3cc4922fde3d None None] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:39:18.343263 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c073d962-b787-4cee-a407-3cc4922fde3d None None] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:39:18.343415 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c073d962-b787-4cee-a407-3cc4922fde3d None None] PATH_INFO: `/` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:39:18.345380 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 617/1206] 10.222.0.25 () {54 vars in 927 bytes} [Tue Sep 13 19:39:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:39:18.351272 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d66aa8c-7b4a-4ff9-a0c5-b460951830bf None None] REQUEST_METHOD: `POST` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:39:18.351844 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d66aa8c-7b4a-4ff9-a0c5-b460951830bf None None] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:39:18.351844 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d66aa8c-7b4a-4ff9-a0c5-b460951830bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:39:18.373412 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.auth.core [None req-5d66aa8c-7b4a-4ff9-a0c5-b460951830bf None None] MFA Rules not processed for user `7b0aed92d02344acb92a0e4aa67c3068`. Rule list: `[]` (Enabled: `True`). {{(pid=87935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:39:18.374656 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.fernet_utils [None req-5d66aa8c-7b4a-4ff9-a0c5-b460951830bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:39:18.453904 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 590/1207] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Sep 13 19:39:18 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 13 19:39:18.731056 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c073d962-b787-4cee-a407-3cc4922fde3d None None] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:39:18.874675 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c073d962-b787-4cee-a407-3cc4922fde3d None None] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:39:18.914070 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a426a7df-fb07-4d6c-ae0e-58d241b2fbbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:39:18.914647 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a426a7df-fb07-4d6c-ae0e-58d241b2fbbf None admin] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:39:18.914933 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a426a7df-fb07-4d6c-ae0e-58d241b2fbbf None admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:39:18.915205 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a426a7df-fb07-4d6c-ae0e-58d241b2fbbf None admin] PATH_INFO: `/v3/roles/service` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:39:18.928036 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a426a7df-fb07-4d6c-ae0e-58d241b2fbbf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 19:39:18.933246 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application [None req-a426a7df-fb07-4d6c-ae0e-58d241b2fbbf None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 13 19:39:18.933246 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:39:18.933246 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:39:18.933246 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:39:18.933246 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:39:18.933246 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:39:18.933246 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:39:18.933246 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:39:18.933246 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:39:18.933246 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:39:18.933246 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:39:18.933246 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:39:18.933246 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 19:39:18.933246 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 19:39:18.933246 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 19:39:18.933246 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 19:39:18.934254 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 19:39:18.934254 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 19:39:18.934254 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 19:39:18.934254 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 19:39:18.934254 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:39:18.934254 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:39:18.934254 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:39:18.934254 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:39:18.934254 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:39:18.934254 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:39:18.934254 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:39:18.934254 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application with Lock( Sep 13 19:39:18.934254 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:39:18.934254 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:39:18.934254 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:39:18.934254 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:39:18.935762 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:39:18.935762 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:39:18.935762 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:39:18.935762 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:39:18.935762 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 19:39:18.935762 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 19:39:18.935762 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 19:39:18.935762 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 19:39:18.935762 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 19:39:18.935762 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 19:39:18.935762 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 13 19:39:18.935762 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application Sep 13 19:39:18.935762 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 618/1208] 10.222.0.25 () {56 vars in 1102 bytes} [Tue Sep 13 19:39:18 2022] GET /identity/v3/roles/service => generated 85 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:39:18.941685 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d66aa8c-7b4a-4ff9-a0c5-b460951830bf None None] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:39:18.986633 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG dbcounter [-] [87935] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:39:19.063885 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d66aa8c-7b4a-4ff9-a0c5-b460951830bf None None] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:39:19.101415 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981f2e1c-f948-4a8b-ac82-121e86a1c1d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:39:19.102045 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981f2e1c-f948-4a8b-ac82-121e86a1c1d5 None admin] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:39:19.102302 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981f2e1c-f948-4a8b-ac82-121e86a1c1d5 None admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:39:19.102569 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981f2e1c-f948-4a8b-ac82-121e86a1c1d5 None admin] PATH_INFO: `/v3/roles` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:39:19.103227 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-981f2e1c-f948-4a8b-ac82-121e86a1c1d5 None admin] RBAC: Adding query filter params (name=service) {{(pid=87935) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:39:19.103533 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-981f2e1c-f948-4a8b-ac82-121e86a1c1d5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:39:19.104926 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-981f2e1c-f948-4a8b-ac82-121e86a1c1d5 None admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:39:19.119388 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 591/1209] 10.222.0.25 () {56 vars in 1103 bytes} [Tue Sep 13 19:39:18 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:39:19.120694 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a426a7df-fb07-4d6c-ae0e-58d241b2fbbf None admin] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:39:19.178583 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG dbcounter [-] [87934] Writing DB stats keystone:SELECT=100 {{(pid=87934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:39:19.238319 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a426a7df-fb07-4d6c-ae0e-58d241b2fbbf None admin] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:39:19.278468 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81999e13-60a5-42ea-8358-402280cf2b5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:39:19.279102 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81999e13-60a5-42ea-8358-402280cf2b5b None admin] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:39:19.279391 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81999e13-60a5-42ea-8358-402280cf2b5b None admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:39:19.279627 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81999e13-60a5-42ea-8358-402280cf2b5b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:39:19.291226 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81999e13-60a5-42ea-8358-402280cf2b5b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:39:19.292954 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81999e13-60a5-42ea-8358-402280cf2b5b None admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:39:19.309218 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application [None req-81999e13-60a5-42ea-8358-402280cf2b5b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 19:39:19.309218 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:39:19.309218 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:39:19.309218 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:39:19.309218 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:39:19.309218 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:39:19.309218 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:39:19.309218 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:39:19.309218 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:39:19.309218 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:39:19.309218 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:39:19.309218 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:39:19.309218 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 19:39:19.309218 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 19:39:19.309218 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 19:39:19.309218 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 19:39:19.310270 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:39:19.310270 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:39:19.310270 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:39:19.310270 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:39:19.310270 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:39:19.310270 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:39:19.310270 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:39:19.310270 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application with Lock( Sep 13 19:39:19.310270 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:39:19.310270 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:39:19.310270 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:39:19.310270 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:39:19.310270 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:39:19.310270 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:39:19.310270 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:39:19.310270 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:39:19.310270 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 19:39:19.311741 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 19:39:19.311741 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 19:39:19.311741 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application Sep 13 19:39:19.316053 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 619/1210] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Sep 13 19:39:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:39:19.317083 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981f2e1c-f948-4a8b-ac82-121e86a1c1d5 None admin] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:39:19.431449 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG dbcounter [-] [87935] Writing DB stats keystone:SELECT=100 {{(pid=87935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:39:19.434583 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981f2e1c-f948-4a8b-ac82-121e86a1c1d5 None admin] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:39:19.473773 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d504f4-58b9-4baf-bc95-d5477219d64b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:39:19.475073 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d504f4-58b9-4baf-bc95-d5477219d64b None admin] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:39:19.475307 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d504f4-58b9-4baf-bc95-d5477219d64b None admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:39:19.475773 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d504f4-58b9-4baf-bc95-d5477219d64b None admin] PATH_INFO: `/v3/domains` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:39:19.476695 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d504f4-58b9-4baf-bc95-d5477219d64b None admin] RBAC: Adding query filter params (name=Default) {{(pid=87935) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:39:19.478284 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d504f4-58b9-4baf-bc95-d5477219d64b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:39:19.478418 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d504f4-58b9-4baf-bc95-d5477219d64b None admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:39:19.497245 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 592/1211] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Sep 13 19:39:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 19:39:19.498485 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81999e13-60a5-42ea-8358-402280cf2b5b None admin] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:39:19.614827 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81999e13-60a5-42ea-8358-402280cf2b5b None admin] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:39:19.616645 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG dbcounter [-] [87934] Writing DB stats keystone:SELECT=100 {{(pid=87934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:39:19.655117 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898ba8f1-c5d6-4a82-9d65-56603e91bec6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:39:19.656301 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898ba8f1-c5d6-4a82-9d65-56603e91bec6 None admin] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:39:19.656753 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898ba8f1-c5d6-4a82-9d65-56603e91bec6 None admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:39:19.657082 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898ba8f1-c5d6-4a82-9d65-56603e91bec6 None admin] PATH_INFO: `/v3/users/placement` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:39:19.666717 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-898ba8f1-c5d6-4a82-9d65-56603e91bec6 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:39:19.668357 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-898ba8f1-c5d6-4a82-9d65-56603e91bec6 None admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:39:19.683040 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application [None req-898ba8f1-c5d6-4a82-9d65-56603e91bec6 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 13 19:39:19.683040 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:39:19.683040 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:39:19.683040 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:39:19.683040 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:39:19.683040 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:39:19.683040 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:39:19.683040 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:39:19.683040 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:39:19.683040 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:39:19.683040 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:39:19.683040 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:39:19.683040 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 13 19:39:19.683040 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 13 19:39:19.683040 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 13 19:39:19.683040 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 13 19:39:19.689826 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:39:19.689826 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:39:19.689826 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 13 19:39:19.689826 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 19:39:19.689826 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 13 19:39:19.689826 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 19:39:19.689826 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:39:19.689826 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:39:19.689826 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:39:19.689826 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:39:19.689826 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:39:19.689826 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application with Lock( Sep 13 19:39:19.689826 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:39:19.689826 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:39:19.689826 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:39:19.689826 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:39:19.689826 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:39:19.689826 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:39:19.691178 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:39:19.691178 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:39:19.691178 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 13 19:39:19.691178 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 13 19:39:19.691178 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 13 19:39:19.691178 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 13 19:39:19.691178 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 13 19:39:19.691178 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 13 19:39:19.691178 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 13 19:39:19.691178 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application Sep 13 19:39:19.691178 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 620/1212] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Sep 13 19:39:19 2022] GET /identity/v3/users/placement => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:39:19.691968 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d504f4-58b9-4baf-bc95-d5477219d64b None admin] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:39:19.824109 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d504f4-58b9-4baf-bc95-d5477219d64b None admin] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:39:19.867051 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3369ced-58bf-425b-ab75-27e26045630f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:39:19.867753 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3369ced-58bf-425b-ab75-27e26045630f None admin] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:39:19.868034 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3369ced-58bf-425b-ab75-27e26045630f None admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:39:19.868332 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3369ced-58bf-425b-ab75-27e26045630f None admin] PATH_INFO: `/v3/users` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:39:19.869185 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3369ced-58bf-425b-ab75-27e26045630f None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=87935) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:39:19.869517 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3369ced-58bf-425b-ab75-27e26045630f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:39:19.871243 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3369ced-58bf-425b-ab75-27e26045630f None admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:39:19.897961 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 593/1213] 10.222.0.25 () {56 vars in 1143 bytes} [Tue Sep 13 19:39:19 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:39:19.899372 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898ba8f1-c5d6-4a82-9d65-56603e91bec6 None admin] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:39:20.016158 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898ba8f1-c5d6-4a82-9d65-56603e91bec6 None admin] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:39:20.055047 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f33f2a-68ec-4d08-b2e2-df7093c1720b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:39:20.055853 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f33f2a-68ec-4d08-b2e2-df7093c1720b None admin] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:39:20.056249 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f33f2a-68ec-4d08-b2e2-df7093c1720b None admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:39:20.056630 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f33f2a-68ec-4d08-b2e2-df7093c1720b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:39:20.094726 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG dbcounter [-] [87934] Writing DB stats keystone:SELECT=100 {{(pid=87934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:39:20.146510 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f33f2a-68ec-4d08-b2e2-df7093c1720b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:39:20.148839 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f33f2a-68ec-4d08-b2e2-df7093c1720b None admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:39:20.271850 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 621/1214] 10.222.0.25 () {58 vars in 1282 bytes} [Tue Sep 13 19:39:19 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 13 19:39:20.280613 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3369ced-58bf-425b-ab75-27e26045630f None admin] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:39:20.305288 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG dbcounter [-] [87935] Writing DB stats keystone:SELECT=100 {{(pid=87935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:39:20.406762 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3369ced-58bf-425b-ab75-27e26045630f None admin] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:39:20.452234 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08708c5a-b0cc-45cc-ad60-463896e94e02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:39:20.453098 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08708c5a-b0cc-45cc-ad60-463896e94e02 None admin] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:39:20.453353 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08708c5a-b0cc-45cc-ad60-463896e94e02 None admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:39:20.453622 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08708c5a-b0cc-45cc-ad60-463896e94e02 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:39:20.466353 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08708c5a-b0cc-45cc-ad60-463896e94e02 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:39:20.468539 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08708c5a-b0cc-45cc-ad60-463896e94e02 None admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:39:20.483713 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application [None req-08708c5a-b0cc-45cc-ad60-463896e94e02 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 19:39:20.483713 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:39:20.483713 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:39:20.483713 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:39:20.483713 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:39:20.483713 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:39:20.483713 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:39:20.483713 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:39:20.483713 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:39:20.483713 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:39:20.483713 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:39:20.483713 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:39:20.483713 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 19:39:20.483713 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 19:39:20.483713 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 19:39:20.483713 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 19:39:20.489688 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:39:20.489688 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:39:20.489688 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:39:20.489688 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:39:20.489688 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:39:20.489688 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:39:20.489688 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:39:20.489688 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application with Lock( Sep 13 19:39:20.489688 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:39:20.489688 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:39:20.489688 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:39:20.489688 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:39:20.489688 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:39:20.489688 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:39:20.489688 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:39:20.489688 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:39:20.489688 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 19:39:20.490610 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 19:39:20.490610 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 19:39:20.490610 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application Sep 13 19:39:20.490610 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 594/1215] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Sep 13 19:39:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 13 19:39:20.490852 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f33f2a-68ec-4d08-b2e2-df7093c1720b None admin] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:39:20.564533 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG dbcounter [-] [87934] Writing DB stats keystone:SELECT=100 {{(pid=87934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:39:20.611125 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f33f2a-68ec-4d08-b2e2-df7093c1720b None admin] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:39:20.660563 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c50d4f8-f4b2-492a-b378-c3e5428c3a43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:39:20.661126 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c50d4f8-f4b2-492a-b378-c3e5428c3a43 None admin] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:39:20.661418 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c50d4f8-f4b2-492a-b378-c3e5428c3a43 None admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:39:20.661732 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c50d4f8-f4b2-492a-b378-c3e5428c3a43 None admin] PATH_INFO: `/v3/domains` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:39:20.662426 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c50d4f8-f4b2-492a-b378-c3e5428c3a43 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87934) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:39:20.662748 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c50d4f8-f4b2-492a-b378-c3e5428c3a43 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:39:20.664450 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c50d4f8-f4b2-492a-b378-c3e5428c3a43 None admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:39:20.678982 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 622/1216] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Sep 13 19:39:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:39:20.686018 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08708c5a-b0cc-45cc-ad60-463896e94e02 None admin] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:39:20.777735 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG dbcounter [-] [87935] Writing DB stats keystone:SELECT=100 {{(pid=87935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:39:20.820537 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08708c5a-b0cc-45cc-ad60-463896e94e02 None admin] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:39:20.866096 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b07148-8b4d-49e7-b883-4312d8fe8525 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:39:20.867130 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b07148-8b4d-49e7-b883-4312d8fe8525 None admin] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:39:20.867569 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b07148-8b4d-49e7-b883-4312d8fe8525 None admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:39:20.867919 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b07148-8b4d-49e7-b883-4312d8fe8525 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:39:20.877775 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b07148-8b4d-49e7-b883-4312d8fe8525 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:39:20.879352 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b07148-8b4d-49e7-b883-4312d8fe8525 None admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:39:20.895258 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application [None req-c8b07148-8b4d-49e7-b883-4312d8fe8525 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 19:39:20.895258 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:39:20.895258 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:39:20.895258 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:39:20.895258 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:39:20.895258 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:39:20.895258 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:39:20.895258 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:39:20.895258 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:39:20.895258 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:39:20.895258 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:39:20.895258 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:39:20.895258 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 13 19:39:20.895258 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 13 19:39:20.895258 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 13 19:39:20.896468 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 13 19:39:20.896468 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:39:20.896468 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:39:20.896468 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:39:20.896468 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:39:20.896468 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:39:20.896468 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:39:20.896468 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:39:20.896468 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application with Lock( Sep 13 19:39:20.896468 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:39:20.896468 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:39:20.896468 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:39:20.896468 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:39:20.896468 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:39:20.896468 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:39:20.896468 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:39:20.896468 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:39:20.897550 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 13 19:39:20.897550 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 13 19:39:20.897550 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 13 19:39:20.897550 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 13 19:39:20.897550 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 13 19:39:20.897550 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 13 19:39:20.897550 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 19:39:20.897550 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application Sep 13 19:39:20.897550 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 595/1217] 10.222.0.25 () {56 vars in 1111 bytes} [Tue Sep 13 19:39:20 2022] GET /identity/v3/projects/service => generated 88 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:39:20.902709 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c50d4f8-f4b2-492a-b378-c3e5428c3a43 None admin] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:39:21.019047 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c50d4f8-f4b2-492a-b378-c3e5428c3a43 None admin] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:39:21.043443 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG dbcounter [-] [87934] Writing DB stats keystone:SELECT=100 {{(pid=87934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:39:21.056366 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3ea2e0-7393-4538-82a1-31f5e53662e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:39:21.057042 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3ea2e0-7393-4538-82a1-31f5e53662e6 None admin] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:39:21.057271 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3ea2e0-7393-4538-82a1-31f5e53662e6 None admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:39:21.057528 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3ea2e0-7393-4538-82a1-31f5e53662e6 None admin] PATH_INFO: `/v3/projects` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:39:21.058227 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e3ea2e0-7393-4538-82a1-31f5e53662e6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87934) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:39:21.058530 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e3ea2e0-7393-4538-82a1-31f5e53662e6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:39:21.059961 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e3ea2e0-7393-4538-82a1-31f5e53662e6 None admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:39:21.072978 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 623/1218] 10.222.0.25 () {56 vars in 1148 bytes} [Tue Sep 13 19:39:20 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:39:21.079669 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b07148-8b4d-49e7-b883-4312d8fe8525 None admin] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:39:21.197864 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b07148-8b4d-49e7-b883-4312d8fe8525 None admin] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:39:21.235128 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG dbcounter [-] [87935] Writing DB stats keystone:SELECT=100 {{(pid=87935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:39:21.242886 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7029d1db-15a9-4da0-9d3a-36c0ef9e5d09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:39:21.243587 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7029d1db-15a9-4da0-9d3a-36c0ef9e5d09 None admin] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:39:21.243887 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7029d1db-15a9-4da0-9d3a-36c0ef9e5d09 None admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:39:21.244171 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7029d1db-15a9-4da0-9d3a-36c0ef9e5d09 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:39:21.244975 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7029d1db-15a9-4da0-9d3a-36c0ef9e5d09 None admin] RBAC: Adding query filter params (role.id=60f5ecbf9ce84814968607f126a85a5a, scope.project.id=9a10a4268f3c4cb29f4e00c292e2df62, user.id=02eb3d3173c1476cb83a72add0e878e2) {{(pid=87935) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:39:21.245284 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7029d1db-15a9-4da0-9d3a-36c0ef9e5d09 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:39:21.247741 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7029d1db-15a9-4da0-9d3a-36c0ef9e5d09 None admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:39:21.255358 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 596/1219] 10.222.0.25 () {56 vars in 1374 bytes} [Tue Sep 13 19:39:21 2022] GET /identity/v3/role_assignments?user.id=02eb3d3173c1476cb83a72add0e878e2&scope.project.id=9a10a4268f3c4cb29f4e00c292e2df62&role.id=60f5ecbf9ce84814968607f126a85a5a => generated 259 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:39:23.491430 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f77cb2d-d524-47e8-a72b-347633f8b638 None None] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:39:23.492431 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f77cb2d-d524-47e8-a72b-347633f8b638 None None] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:39:23.492431 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f77cb2d-d524-47e8-a72b-347633f8b638 None None] PATH_INFO: `/` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:39:23.493289 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 624/1220] 10.222.0.25 () {54 vars in 927 bytes} [Tue Sep 13 19:39:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:39:23.498668 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f04b7b-2a3d-4fa1-a947-31824eb3a8d8 None None] REQUEST_METHOD: `POST` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:39:23.499271 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f04b7b-2a3d-4fa1-a947-31824eb3a8d8 None None] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:39:23.499271 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f04b7b-2a3d-4fa1-a947-31824eb3a8d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:39:23.517766 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.auth.core [None req-30f04b7b-2a3d-4fa1-a947-31824eb3a8d8 None None] MFA Rules not processed for user `7b0aed92d02344acb92a0e4aa67c3068`. Rule list: `[]` (Enabled: `True`). {{(pid=87935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:39:23.518948 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.fernet_utils [None req-30f04b7b-2a3d-4fa1-a947-31824eb3a8d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:39:23.591719 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 597/1221] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Sep 13 19:39:23 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 13 19:39:23.879140 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f77cb2d-d524-47e8-a72b-347633f8b638 None None] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:39:24.011136 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f77cb2d-d524-47e8-a72b-347633f8b638 None None] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:39:24.053514 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cac7676-2b96-409e-ae36-5daf0429ce6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:39:24.054158 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cac7676-2b96-409e-ae36-5daf0429ce6e None admin] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:39:24.054439 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cac7676-2b96-409e-ae36-5daf0429ce6e None admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:39:24.054712 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cac7676-2b96-409e-ae36-5daf0429ce6e None admin] PATH_INFO: `/v3/roles/service` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:39:24.071646 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cac7676-2b96-409e-ae36-5daf0429ce6e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 19:39:24.077065 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application [None req-3cac7676-2b96-409e-ae36-5daf0429ce6e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 13 19:39:24.077065 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:39:24.077065 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:39:24.077065 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:39:24.077065 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:39:24.077065 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:39:24.077065 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:39:24.077065 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:39:24.077065 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:39:24.077065 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:39:24.077065 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:39:24.077065 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:39:24.077065 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 19:39:24.077065 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 19:39:24.077065 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 19:39:24.077065 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 19:39:24.078939 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 19:39:24.078939 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 19:39:24.078939 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 19:39:24.078939 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 19:39:24.078939 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:39:24.078939 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:39:24.078939 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:39:24.078939 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:39:24.078939 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:39:24.078939 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:39:24.078939 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:39:24.078939 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application with Lock( Sep 13 19:39:24.078939 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:39:24.078939 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:39:24.078939 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:39:24.078939 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:39:24.080791 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:39:24.080791 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:39:24.080791 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:39:24.080791 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:39:24.080791 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 19:39:24.080791 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 19:39:24.080791 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 19:39:24.080791 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 19:39:24.080791 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 19:39:24.080791 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 19:39:24.080791 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 13 19:39:24.080791 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application Sep 13 19:39:24.080791 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 625/1222] 10.222.0.25 () {56 vars in 1102 bytes} [Tue Sep 13 19:39:23 2022] GET /identity/v3/roles/service => generated 85 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:39:24.084944 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f04b7b-2a3d-4fa1-a947-31824eb3a8d8 None None] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:39:24.217844 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f04b7b-2a3d-4fa1-a947-31824eb3a8d8 None None] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:39:24.246925 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG dbcounter [-] [87935] Writing DB stats keystone:SELECT=100 {{(pid=87935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:39:24.262307 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c656b72f-b770-4ebc-a17a-93e4b88a585b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:39:24.262909 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c656b72f-b770-4ebc-a17a-93e4b88a585b None admin] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:39:24.263181 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c656b72f-b770-4ebc-a17a-93e4b88a585b None admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:39:24.263446 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c656b72f-b770-4ebc-a17a-93e4b88a585b None admin] PATH_INFO: `/v3/roles` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:39:24.264133 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c656b72f-b770-4ebc-a17a-93e4b88a585b None admin] RBAC: Adding query filter params (name=service) {{(pid=87935) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:39:24.264459 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c656b72f-b770-4ebc-a17a-93e4b88a585b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:39:24.265832 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c656b72f-b770-4ebc-a17a-93e4b88a585b None admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:39:24.274615 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 598/1223] 10.222.0.25 () {56 vars in 1103 bytes} [Tue Sep 13 19:39:24 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 19:39:24.286069 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cac7676-2b96-409e-ae36-5daf0429ce6e None admin] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:39:24.355525 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG dbcounter [-] [87934] Writing DB stats keystone:SELECT=100 {{(pid=87934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:39:24.423864 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cac7676-2b96-409e-ae36-5daf0429ce6e None admin] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:39:24.472607 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9b5dd8-9f84-4910-a288-b32963e44a43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:39:24.473231 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9b5dd8-9f84-4910-a288-b32963e44a43 None admin] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:39:24.473619 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9b5dd8-9f84-4910-a288-b32963e44a43 None admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:39:24.473931 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9b5dd8-9f84-4910-a288-b32963e44a43 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:39:24.488367 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d9b5dd8-9f84-4910-a288-b32963e44a43 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:39:24.490150 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d9b5dd8-9f84-4910-a288-b32963e44a43 None admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:39:24.511507 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application [None req-1d9b5dd8-9f84-4910-a288-b32963e44a43 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 19:39:24.511507 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:39:24.511507 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:39:24.511507 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:39:24.511507 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:39:24.511507 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:39:24.511507 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:39:24.511507 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:39:24.511507 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:39:24.511507 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:39:24.511507 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:39:24.511507 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:39:24.511507 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 19:39:24.511507 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 19:39:24.511507 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 19:39:24.511507 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 19:39:24.513203 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:39:24.513203 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:39:24.513203 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:39:24.513203 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:39:24.513203 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:39:24.513203 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:39:24.513203 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:39:24.513203 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application with Lock( Sep 13 19:39:24.513203 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:39:24.513203 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:39:24.513203 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:39:24.513203 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:39:24.513203 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:39:24.513203 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:39:24.513203 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:39:24.513203 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:39:24.513203 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 19:39:24.514420 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 19:39:24.514420 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 19:39:24.514420 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application Sep 13 19:39:24.514420 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 626/1224] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Sep 13 19:39:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:39:24.519602 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c656b72f-b770-4ebc-a17a-93e4b88a585b None admin] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:39:24.630466 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c656b72f-b770-4ebc-a17a-93e4b88a585b None admin] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:39:24.672583 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785bac78-c5be-4f4c-a5df-25a97a2f1e85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:39:24.673346 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785bac78-c5be-4f4c-a5df-25a97a2f1e85 None admin] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:39:24.673676 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785bac78-c5be-4f4c-a5df-25a97a2f1e85 None admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:39:24.673976 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785bac78-c5be-4f4c-a5df-25a97a2f1e85 None admin] PATH_INFO: `/v3/domains` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:39:24.674652 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-785bac78-c5be-4f4c-a5df-25a97a2f1e85 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87935) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:39:24.674990 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-785bac78-c5be-4f4c-a5df-25a97a2f1e85 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:39:24.676744 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-785bac78-c5be-4f4c-a5df-25a97a2f1e85 None admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:39:24.692727 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 599/1225] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Sep 13 19:39:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 19:39:24.698689 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9b5dd8-9f84-4910-a288-b32963e44a43 None admin] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:39:24.809857 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG dbcounter [-] [87934] Writing DB stats keystone:SELECT=100 {{(pid=87934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:39:24.818190 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9b5dd8-9f84-4910-a288-b32963e44a43 None admin] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:39:24.856389 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6313051-9fd0-404d-9d8b-83a6f2c203bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:39:24.857026 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6313051-9fd0-404d-9d8b-83a6f2c203bf None admin] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:39:24.857302 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6313051-9fd0-404d-9d8b-83a6f2c203bf None admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:39:24.857574 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6313051-9fd0-404d-9d8b-83a6f2c203bf None admin] PATH_INFO: `/v3/users/placement` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:39:24.865893 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6313051-9fd0-404d-9d8b-83a6f2c203bf None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:39:24.867339 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6313051-9fd0-404d-9d8b-83a6f2c203bf None admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:39:24.879960 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application [None req-e6313051-9fd0-404d-9d8b-83a6f2c203bf None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 13 19:39:24.879960 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:39:24.879960 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:39:24.879960 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:39:24.879960 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:39:24.879960 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:39:24.879960 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:39:24.879960 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:39:24.879960 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:39:24.879960 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:39:24.879960 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:39:24.879960 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:39:24.879960 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 13 19:39:24.879960 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 13 19:39:24.879960 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 13 19:39:24.879960 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 13 19:39:24.881195 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:39:24.881195 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:39:24.881195 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 13 19:39:24.881195 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 19:39:24.881195 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 13 19:39:24.881195 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 19:39:24.881195 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:39:24.881195 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:39:24.881195 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:39:24.881195 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:39:24.881195 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:39:24.881195 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application with Lock( Sep 13 19:39:24.881195 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:39:24.881195 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:39:24.881195 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:39:24.881195 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:39:24.881195 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:39:24.881195 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:39:24.882268 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:39:24.882268 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:39:24.882268 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 13 19:39:24.882268 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 13 19:39:24.882268 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 13 19:39:24.882268 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 13 19:39:24.882268 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 13 19:39:24.882268 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 13 19:39:24.882268 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 13 19:39:24.882268 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application Sep 13 19:39:24.882268 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 627/1226] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Sep 13 19:39:24 2022] GET /identity/v3/users/placement => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 13 19:39:24.887274 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785bac78-c5be-4f4c-a5df-25a97a2f1e85 None admin] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:39:24.936596 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG dbcounter [-] [87935] Writing DB stats keystone:SELECT=100 {{(pid=87935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:39:25.000145 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785bac78-c5be-4f4c-a5df-25a97a2f1e85 None admin] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:39:25.039372 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd82757c-9cea-4adc-b2fb-4616f0cf5d9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:39:25.039982 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd82757c-9cea-4adc-b2fb-4616f0cf5d9a None admin] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:39:25.040315 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd82757c-9cea-4adc-b2fb-4616f0cf5d9a None admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:39:25.040593 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd82757c-9cea-4adc-b2fb-4616f0cf5d9a None admin] PATH_INFO: `/v3/users` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:39:25.041365 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd82757c-9cea-4adc-b2fb-4616f0cf5d9a None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=87935) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:39:25.041770 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd82757c-9cea-4adc-b2fb-4616f0cf5d9a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:39:25.043329 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd82757c-9cea-4adc-b2fb-4616f0cf5d9a None admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:39:25.062930 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 600/1227] 10.222.0.25 () {56 vars in 1143 bytes} [Tue Sep 13 19:39:24 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:39:25.068745 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6313051-9fd0-404d-9d8b-83a6f2c203bf None admin] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:39:25.181267 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6313051-9fd0-404d-9d8b-83a6f2c203bf None admin] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:39:25.219548 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72476cd-04b4-4d10-9efb-a5efd6c3006f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:39:25.220182 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72476cd-04b4-4d10-9efb-a5efd6c3006f None admin] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:39:25.220490 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72476cd-04b4-4d10-9efb-a5efd6c3006f None admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:39:25.220765 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72476cd-04b4-4d10-9efb-a5efd6c3006f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:39:25.232145 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f72476cd-04b4-4d10-9efb-a5efd6c3006f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:39:25.233865 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f72476cd-04b4-4d10-9efb-a5efd6c3006f None admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:39:25.250291 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application [None req-f72476cd-04b4-4d10-9efb-a5efd6c3006f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 19:39:25.250291 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:39:25.250291 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:39:25.250291 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:39:25.250291 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:39:25.250291 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:39:25.250291 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:39:25.250291 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:39:25.250291 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:39:25.250291 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:39:25.250291 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:39:25.250291 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:39:25.250291 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 19:39:25.250291 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 19:39:25.250291 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 19:39:25.250291 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 19:39:25.251969 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:39:25.251969 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:39:25.251969 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:39:25.251969 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:39:25.251969 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:39:25.251969 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:39:25.251969 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:39:25.251969 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application with Lock( Sep 13 19:39:25.251969 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:39:25.251969 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:39:25.251969 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:39:25.251969 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:39:25.251969 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:39:25.251969 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:39:25.251969 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:39:25.251969 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:39:25.251969 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 19:39:25.253165 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 19:39:25.253165 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 19:39:25.253165 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application Sep 13 19:39:25.253165 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 628/1228] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Sep 13 19:39:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:39:25.257468 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd82757c-9cea-4adc-b2fb-4616f0cf5d9a None admin] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:39:25.375816 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd82757c-9cea-4adc-b2fb-4616f0cf5d9a None admin] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:39:25.378634 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG dbcounter [-] [87935] Writing DB stats keystone:SELECT=100 {{(pid=87935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:39:25.417428 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b0b4ea-9f50-4895-960f-148ba11a2233 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:39:25.418084 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b0b4ea-9f50-4895-960f-148ba11a2233 None admin] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:39:25.418394 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b0b4ea-9f50-4895-960f-148ba11a2233 None admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:39:25.418689 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b0b4ea-9f50-4895-960f-148ba11a2233 None admin] PATH_INFO: `/v3/domains` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:39:25.419394 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b0b4ea-9f50-4895-960f-148ba11a2233 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87935) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:39:25.419692 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b0b4ea-9f50-4895-960f-148ba11a2233 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:39:25.421911 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b0b4ea-9f50-4895-960f-148ba11a2233 None admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:39:25.435561 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 601/1229] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Sep 13 19:39:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:39:25.441832 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72476cd-04b4-4d10-9efb-a5efd6c3006f None admin] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:39:25.453081 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG dbcounter [-] [87934] Writing DB stats keystone:SELECT=100 {{(pid=87934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:39:25.564920 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72476cd-04b4-4d10-9efb-a5efd6c3006f None admin] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:39:25.602893 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6385e8f8-8d61-493a-9f81-4bb43bb9319f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:39:25.603528 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6385e8f8-8d61-493a-9f81-4bb43bb9319f None admin] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:39:25.603803 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6385e8f8-8d61-493a-9f81-4bb43bb9319f None admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:39:25.604071 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6385e8f8-8d61-493a-9f81-4bb43bb9319f None admin] PATH_INFO: `/v3/projects/service` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:39:25.611926 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6385e8f8-8d61-493a-9f81-4bb43bb9319f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:39:25.613466 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6385e8f8-8d61-493a-9f81-4bb43bb9319f None admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:39:25.626890 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application [None req-6385e8f8-8d61-493a-9f81-4bb43bb9319f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 19:39:25.626890 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:39:25.626890 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:39:25.626890 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:39:25.626890 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:39:25.626890 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:39:25.626890 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:39:25.626890 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:39:25.626890 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:39:25.626890 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:39:25.626890 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:39:25.626890 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:39:25.626890 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 13 19:39:25.626890 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 13 19:39:25.626890 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 13 19:39:25.628196 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 13 19:39:25.628196 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:39:25.628196 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:39:25.628196 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:39:25.628196 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:39:25.628196 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:39:25.628196 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:39:25.628196 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:39:25.628196 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application with Lock( Sep 13 19:39:25.628196 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:39:25.628196 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:39:25.628196 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:39:25.628196 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:39:25.628196 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:39:25.628196 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:39:25.628196 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:39:25.628196 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:39:25.629528 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 13 19:39:25.629528 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 13 19:39:25.629528 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 13 19:39:25.629528 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 13 19:39:25.629528 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 13 19:39:25.629528 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 13 19:39:25.629528 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 19:39:25.629528 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application Sep 13 19:39:25.633192 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 629/1230] 10.222.0.25 () {56 vars in 1111 bytes} [Tue Sep 13 19:39:25 2022] GET /identity/v3/projects/service => generated 88 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:39:25.634658 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b0b4ea-9f50-4895-960f-148ba11a2233 None admin] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:39:25.774986 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b0b4ea-9f50-4895-960f-148ba11a2233 None admin] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:39:25.818737 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd77173-263d-4a7a-a1ee-9d88701fa943 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:39:25.819520 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd77173-263d-4a7a-a1ee-9d88701fa943 None admin] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:39:25.820034 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd77173-263d-4a7a-a1ee-9d88701fa943 None admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:39:25.820648 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd77173-263d-4a7a-a1ee-9d88701fa943 None admin] PATH_INFO: `/v3/projects` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:39:25.821738 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd77173-263d-4a7a-a1ee-9d88701fa943 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87935) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:39:25.822270 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd77173-263d-4a7a-a1ee-9d88701fa943 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:39:25.824968 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd77173-263d-4a7a-a1ee-9d88701fa943 None admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:39:25.847646 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 602/1231] 10.222.0.25 () {56 vars in 1148 bytes} [Tue Sep 13 19:39:25 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:39:25.855554 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6385e8f8-8d61-493a-9f81-4bb43bb9319f None admin] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:39:25.972816 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG dbcounter [-] [87934] Writing DB stats keystone:SELECT=100 {{(pid=87934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:39:26.018734 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6385e8f8-8d61-493a-9f81-4bb43bb9319f None admin] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:39:26.056487 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8ab0fc-91fb-4acb-b1ca-719733f23094 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:39:26.057215 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8ab0fc-91fb-4acb-b1ca-719733f23094 None admin] REQUEST_METHOD: `PUT` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:39:26.057610 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8ab0fc-91fb-4acb-b1ca-719733f23094 None admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:39:26.057817 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8ab0fc-91fb-4acb-b1ca-719733f23094 None admin] PATH_INFO: `/v3/projects/9a10a4268f3c4cb29f4e00c292e2df62/users/02eb3d3173c1476cb83a72add0e878e2/roles/60f5ecbf9ce84814968607f126a85a5a` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:39:26.075183 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc8ab0fc-91fb-4acb-b1ca-719733f23094 None admin] RBAC: Authorizing `identity:create_grant(project_id=9a10a4268f3c4cb29f4e00c292e2df62, user_id=02eb3d3173c1476cb83a72add0e878e2, role_id=60f5ecbf9ce84814968607f126a85a5a)` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:39:26.076786 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc8ab0fc-91fb-4acb-b1ca-719733f23094 None admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:39:26.094160 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 630/1232] 10.222.0.25 () {58 vars in 1439 bytes} [Tue Sep 13 19:39:25 2022] PUT /identity/v3/projects/9a10a4268f3c4cb29f4e00c292e2df62/users/02eb3d3173c1476cb83a72add0e878e2/roles/60f5ecbf9ce84814968607f126a85a5a => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 19:39:28.372610 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2c6840-62b5-414b-a082-fff6f0fbe779 None None] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:39:28.373166 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2c6840-62b5-414b-a082-fff6f0fbe779 None None] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:39:28.373166 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2c6840-62b5-414b-a082-fff6f0fbe779 None None] PATH_INFO: `/` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:39:28.374783 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 603/1233] 10.222.0.25 () {54 vars in 927 bytes} [Tue Sep 13 19:39:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:39:28.380755 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509b039b-7534-4fb9-a0e1-4fa95d0843e0 None None] REQUEST_METHOD: `POST` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:39:28.381242 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509b039b-7534-4fb9-a0e1-4fa95d0843e0 None None] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:39:28.381340 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509b039b-7534-4fb9-a0e1-4fa95d0843e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:39:28.400694 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.auth.core [None req-509b039b-7534-4fb9-a0e1-4fa95d0843e0 None None] MFA Rules not processed for user `7b0aed92d02344acb92a0e4aa67c3068`. Rule list: `[]` (Enabled: `True`). {{(pid=87934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:39:28.401916 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.fernet_utils [None req-509b039b-7534-4fb9-a0e1-4fa95d0843e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:39:28.486541 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 631/1234] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Sep 13 19:39:28 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 13 19:39:28.780834 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2c6840-62b5-414b-a082-fff6f0fbe779 None None] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:39:28.810176 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG dbcounter [-] [87935] Writing DB stats keystone:SELECT=100 {{(pid=87935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:39:28.919512 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2c6840-62b5-414b-a082-fff6f0fbe779 None None] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:39:28.966849 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e7d6cf-74ca-44b5-adab-952dd27a9c09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:39:28.967974 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e7d6cf-74ca-44b5-adab-952dd27a9c09 None admin] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:39:28.968445 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e7d6cf-74ca-44b5-adab-952dd27a9c09 None admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:39:28.968949 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e7d6cf-74ca-44b5-adab-952dd27a9c09 None admin] PATH_INFO: `/v3/roles/service` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:39:28.987026 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e7d6cf-74ca-44b5-adab-952dd27a9c09 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 19:39:28.991191 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application [None req-73e7d6cf-74ca-44b5-adab-952dd27a9c09 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 13 19:39:28.991191 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:39:28.991191 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:39:28.991191 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:39:28.991191 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:39:28.991191 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:39:28.991191 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:39:28.991191 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:39:28.991191 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:39:28.991191 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:39:28.991191 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:39:28.991191 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:39:28.991191 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 19:39:28.991191 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 19:39:28.991191 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 19:39:28.991191 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 19:39:28.992244 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 19:39:28.992244 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 19:39:28.992244 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 19:39:28.992244 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 19:39:28.992244 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:39:28.992244 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:39:28.992244 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:39:28.992244 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:39:28.992244 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:39:28.992244 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:39:28.992244 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:39:28.992244 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application with Lock( Sep 13 19:39:28.992244 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:39:28.992244 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:39:28.992244 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:39:28.992244 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:39:28.993413 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:39:28.993413 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:39:28.993413 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:39:28.993413 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:39:28.993413 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 19:39:28.993413 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 19:39:28.993413 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 19:39:28.993413 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 19:39:28.993413 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 19:39:28.993413 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 19:39:28.993413 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 13 19:39:28.993413 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application Sep 13 19:39:28.999422 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 604/1235] 10.222.0.25 () {56 vars in 1102 bytes} [Tue Sep 13 19:39:28 2022] GET /identity/v3/roles/service => generated 85 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:39:29.000695 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509b039b-7534-4fb9-a0e1-4fa95d0843e0 None None] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:39:29.055770 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG dbcounter [-] [87934] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:39:29.115222 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509b039b-7534-4fb9-a0e1-4fa95d0843e0 None None] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:39:29.157991 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b962f97d-50a7-444a-8520-f6303db30d01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:39:29.158596 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b962f97d-50a7-444a-8520-f6303db30d01 None admin] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:39:29.158869 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b962f97d-50a7-444a-8520-f6303db30d01 None admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:39:29.159133 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b962f97d-50a7-444a-8520-f6303db30d01 None admin] PATH_INFO: `/v3/roles` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:39:29.159793 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b962f97d-50a7-444a-8520-f6303db30d01 None admin] RBAC: Adding query filter params (name=service) {{(pid=87934) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:39:29.160089 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b962f97d-50a7-444a-8520-f6303db30d01 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:39:29.161477 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b962f97d-50a7-444a-8520-f6303db30d01 None admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:39:29.169575 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 632/1236] 10.222.0.25 () {56 vars in 1103 bytes} [Tue Sep 13 19:39:28 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:39:29.176094 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e7d6cf-74ca-44b5-adab-952dd27a9c09 None admin] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:39:29.288111 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG dbcounter [-] [87935] Writing DB stats keystone:SELECT=100 {{(pid=87935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:39:29.309533 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e7d6cf-74ca-44b5-adab-952dd27a9c09 None admin] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:39:29.363196 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555d51ac-71fc-4033-9ce8-6d90a4c160bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:39:29.363846 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555d51ac-71fc-4033-9ce8-6d90a4c160bb None admin] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:39:29.364124 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555d51ac-71fc-4033-9ce8-6d90a4c160bb None admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:39:29.364422 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555d51ac-71fc-4033-9ce8-6d90a4c160bb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:39:29.376398 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-555d51ac-71fc-4033-9ce8-6d90a4c160bb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:39:29.377849 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-555d51ac-71fc-4033-9ce8-6d90a4c160bb None admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:39:29.395166 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application [None req-555d51ac-71fc-4033-9ce8-6d90a4c160bb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 19:39:29.395166 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:39:29.395166 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:39:29.395166 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:39:29.395166 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:39:29.395166 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:39:29.395166 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:39:29.395166 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:39:29.395166 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:39:29.395166 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:39:29.395166 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:39:29.395166 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:39:29.395166 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 19:39:29.395166 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 19:39:29.395166 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 19:39:29.395166 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 19:39:29.396398 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:39:29.396398 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:39:29.396398 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:39:29.396398 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:39:29.396398 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:39:29.396398 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:39:29.396398 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:39:29.396398 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application with Lock( Sep 13 19:39:29.396398 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:39:29.396398 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:39:29.396398 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:39:29.396398 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:39:29.396398 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:39:29.396398 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:39:29.396398 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:39:29.396398 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:39:29.396398 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 19:39:29.403429 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 19:39:29.403429 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 19:39:29.403429 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application Sep 13 19:39:29.403429 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 605/1237] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Sep 13 19:39:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:39:29.403691 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b962f97d-50a7-444a-8520-f6303db30d01 None admin] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:39:29.528746 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b962f97d-50a7-444a-8520-f6303db30d01 None admin] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:39:29.539332 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG dbcounter [-] [87934] Writing DB stats keystone:SELECT=100 {{(pid=87934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:39:29.572703 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5530d87e-7521-4bc1-8193-28943814f743 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:39:29.573331 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5530d87e-7521-4bc1-8193-28943814f743 None admin] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:39:29.573747 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5530d87e-7521-4bc1-8193-28943814f743 None admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:39:29.574198 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5530d87e-7521-4bc1-8193-28943814f743 None admin] PATH_INFO: `/v3/domains` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:39:29.575327 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5530d87e-7521-4bc1-8193-28943814f743 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87934) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:39:29.575670 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5530d87e-7521-4bc1-8193-28943814f743 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:39:29.578662 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5530d87e-7521-4bc1-8193-28943814f743 None admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:39:29.595999 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 633/1238] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Sep 13 19:39:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:39:29.603458 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555d51ac-71fc-4033-9ce8-6d90a4c160bb None admin] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:39:29.737482 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555d51ac-71fc-4033-9ce8-6d90a4c160bb None admin] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:39:29.777093 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1717c45-dfa1-4531-a857-7cd585667a00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:39:29.777724 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1717c45-dfa1-4531-a857-7cd585667a00 None admin] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:39:29.778003 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1717c45-dfa1-4531-a857-7cd585667a00 None admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:39:29.778296 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1717c45-dfa1-4531-a857-7cd585667a00 None admin] PATH_INFO: `/v3/users/placement` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:39:29.782270 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG dbcounter [-] [87935] Writing DB stats keystone:SELECT=100 {{(pid=87935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:39:29.787936 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1717c45-dfa1-4531-a857-7cd585667a00 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:39:29.789586 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1717c45-dfa1-4531-a857-7cd585667a00 None admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:39:29.801290 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application [None req-e1717c45-dfa1-4531-a857-7cd585667a00 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 13 19:39:29.801290 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:39:29.801290 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:39:29.801290 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:39:29.801290 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:39:29.801290 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:39:29.801290 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:39:29.801290 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:39:29.801290 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:39:29.801290 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:39:29.801290 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:39:29.801290 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:39:29.801290 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 13 19:39:29.801290 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 13 19:39:29.801290 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 13 19:39:29.801290 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 13 19:39:29.802462 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:39:29.802462 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:39:29.802462 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 13 19:39:29.802462 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 19:39:29.802462 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 13 19:39:29.802462 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 19:39:29.802462 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:39:29.802462 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:39:29.802462 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:39:29.802462 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:39:29.802462 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:39:29.802462 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application with Lock( Sep 13 19:39:29.802462 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:39:29.802462 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:39:29.802462 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:39:29.802462 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:39:29.802462 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:39:29.802462 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:39:29.803945 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:39:29.803945 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:39:29.803945 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 13 19:39:29.803945 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 13 19:39:29.803945 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 13 19:39:29.803945 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 13 19:39:29.803945 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 13 19:39:29.803945 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 13 19:39:29.803945 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 13 19:39:29.803945 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application Sep 13 19:39:29.803945 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 606/1239] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Sep 13 19:39:29 2022] GET /identity/v3/users/placement => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:39:29.808827 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5530d87e-7521-4bc1-8193-28943814f743 None admin] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:39:29.928676 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5530d87e-7521-4bc1-8193-28943814f743 None admin] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:39:29.966184 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd37fbdc-38f5-4e84-ba33-7f1c21f89421 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:39:29.966739 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd37fbdc-38f5-4e84-ba33-7f1c21f89421 None admin] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:39:29.967088 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd37fbdc-38f5-4e84-ba33-7f1c21f89421 None admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:39:29.967884 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd37fbdc-38f5-4e84-ba33-7f1c21f89421 None admin] PATH_INFO: `/v3/users` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:39:29.968803 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd37fbdc-38f5-4e84-ba33-7f1c21f89421 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=87934) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:39:29.969106 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd37fbdc-38f5-4e84-ba33-7f1c21f89421 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:39:29.970529 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd37fbdc-38f5-4e84-ba33-7f1c21f89421 None admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:39:29.992586 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 634/1240] 10.222.0.25 () {56 vars in 1143 bytes} [Tue Sep 13 19:39:29 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:39:29.999076 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1717c45-dfa1-4531-a857-7cd585667a00 None admin] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:39:30.112065 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1717c45-dfa1-4531-a857-7cd585667a00 None admin] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:39:30.154615 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a239802f-cd85-42b5-9226-e3aed0ae7413 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:39:30.155371 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a239802f-cd85-42b5-9226-e3aed0ae7413 None admin] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:39:30.155654 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a239802f-cd85-42b5-9226-e3aed0ae7413 None admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:39:30.155914 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a239802f-cd85-42b5-9226-e3aed0ae7413 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:39:30.224932 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG dbcounter [-] [87935] Writing DB stats keystone:SELECT=100 {{(pid=87935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:39:30.231735 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a239802f-cd85-42b5-9226-e3aed0ae7413 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:39:30.233307 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a239802f-cd85-42b5-9226-e3aed0ae7413 None admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:39:30.359768 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 607/1241] 10.222.0.25 () {58 vars in 1282 bytes} [Tue Sep 13 19:39:29 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 362 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 13 19:39:30.366006 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd37fbdc-38f5-4e84-ba33-7f1c21f89421 None admin] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:39:30.396710 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG dbcounter [-] [87934] Writing DB stats keystone:SELECT=100 {{(pid=87934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:39:30.498895 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd37fbdc-38f5-4e84-ba33-7f1c21f89421 None admin] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:39:30.540557 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54016c73-d20b-4af4-9c1f-06a42a09b299 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:39:30.541844 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54016c73-d20b-4af4-9c1f-06a42a09b299 None admin] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:39:30.541844 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54016c73-d20b-4af4-9c1f-06a42a09b299 None admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:39:30.542038 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54016c73-d20b-4af4-9c1f-06a42a09b299 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:39:30.555055 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54016c73-d20b-4af4-9c1f-06a42a09b299 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:39:30.556895 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54016c73-d20b-4af4-9c1f-06a42a09b299 None admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:39:30.576445 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application [None req-54016c73-d20b-4af4-9c1f-06a42a09b299 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 19:39:30.576445 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:39:30.576445 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:39:30.576445 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:39:30.576445 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:39:30.576445 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:39:30.576445 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:39:30.576445 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:39:30.576445 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:39:30.576445 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:39:30.576445 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:39:30.576445 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:39:30.576445 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 19:39:30.576445 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 19:39:30.576445 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 19:39:30.576445 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 19:39:30.577511 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:39:30.577511 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:39:30.577511 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:39:30.577511 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:39:30.577511 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:39:30.577511 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:39:30.577511 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:39:30.577511 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application with Lock( Sep 13 19:39:30.577511 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:39:30.577511 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:39:30.577511 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:39:30.577511 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:39:30.577511 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:39:30.577511 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:39:30.577511 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:39:30.577511 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:39:30.577511 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 19:39:30.578546 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 19:39:30.578546 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 19:39:30.578546 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application Sep 13 19:39:30.578546 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 635/1242] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Sep 13 19:39:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:39:30.584620 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a239802f-cd85-42b5-9226-e3aed0ae7413 None admin] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:39:30.702713 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG dbcounter [-] [87935] Writing DB stats keystone:SELECT=100 {{(pid=87935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:39:30.712100 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a239802f-cd85-42b5-9226-e3aed0ae7413 None admin] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:39:30.759536 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db25f635-fc07-4433-b732-596419988f44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:39:30.760176 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db25f635-fc07-4433-b732-596419988f44 None admin] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:39:30.760523 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db25f635-fc07-4433-b732-596419988f44 None admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:39:30.760820 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db25f635-fc07-4433-b732-596419988f44 None admin] PATH_INFO: `/v3/domains` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:39:30.761535 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db25f635-fc07-4433-b732-596419988f44 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87935) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:39:30.761909 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db25f635-fc07-4433-b732-596419988f44 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:39:30.763491 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db25f635-fc07-4433-b732-596419988f44 None admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:39:30.777275 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 608/1243] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Sep 13 19:39:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:39:30.784314 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54016c73-d20b-4af4-9c1f-06a42a09b299 None admin] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:39:30.891474 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG dbcounter [-] [87934] Writing DB stats keystone:SELECT=100 {{(pid=87934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:39:30.914094 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54016c73-d20b-4af4-9c1f-06a42a09b299 None admin] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:39:30.952111 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8cf3b9-4a46-4257-a390-66a995dca79b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:39:30.952943 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8cf3b9-4a46-4257-a390-66a995dca79b None admin] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:39:30.953218 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8cf3b9-4a46-4257-a390-66a995dca79b None admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:39:30.953482 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8cf3b9-4a46-4257-a390-66a995dca79b None admin] PATH_INFO: `/v3/projects/service` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:39:30.961804 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e8cf3b9-4a46-4257-a390-66a995dca79b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:39:30.963245 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e8cf3b9-4a46-4257-a390-66a995dca79b None admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:39:30.978044 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application [None req-7e8cf3b9-4a46-4257-a390-66a995dca79b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 19:39:30.978044 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:39:30.978044 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:39:30.978044 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:39:30.978044 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:39:30.978044 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:39:30.978044 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:39:30.978044 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:39:30.978044 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:39:30.978044 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:39:30.978044 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:39:30.978044 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:39:30.978044 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 13 19:39:30.978044 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 13 19:39:30.978044 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 13 19:39:30.979146 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 13 19:39:30.979146 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:39:30.979146 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:39:30.979146 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:39:30.979146 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:39:30.979146 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:39:30.979146 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:39:30.979146 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:39:30.979146 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application with Lock( Sep 13 19:39:30.979146 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:39:30.979146 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:39:30.979146 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:39:30.979146 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:39:30.979146 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:39:30.979146 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:39:30.979146 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:39:30.979146 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:39:30.980112 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 13 19:39:30.980112 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 13 19:39:30.980112 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 13 19:39:30.980112 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 13 19:39:30.980112 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 13 19:39:30.980112 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 13 19:39:30.980112 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 19:39:30.980112 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application Sep 13 19:39:30.980112 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 636/1244] 10.222.0.25 () {56 vars in 1111 bytes} [Tue Sep 13 19:39:30 2022] GET /identity/v3/projects/service => generated 88 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:39:30.989914 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db25f635-fc07-4433-b732-596419988f44 None admin] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:39:31.120550 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db25f635-fc07-4433-b732-596419988f44 None admin] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:39:31.169370 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39cd9560-ae7c-46b4-a9b1-ae6dc0846e80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:39:31.170659 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39cd9560-ae7c-46b4-a9b1-ae6dc0846e80 None admin] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:39:31.171223 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39cd9560-ae7c-46b4-a9b1-ae6dc0846e80 None admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:39:31.171709 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39cd9560-ae7c-46b4-a9b1-ae6dc0846e80 None admin] PATH_INFO: `/v3/projects` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:39:31.172988 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39cd9560-ae7c-46b4-a9b1-ae6dc0846e80 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87935) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:39:31.173604 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39cd9560-ae7c-46b4-a9b1-ae6dc0846e80 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:39:31.176691 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39cd9560-ae7c-46b4-a9b1-ae6dc0846e80 None admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:39:31.193235 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 609/1245] 10.222.0.25 () {56 vars in 1148 bytes} [Tue Sep 13 19:39:30 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:39:31.200808 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8cf3b9-4a46-4257-a390-66a995dca79b None admin] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:39:31.331013 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8cf3b9-4a46-4257-a390-66a995dca79b None admin] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:39:31.370445 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f1e8c0-c5e3-47ce-ba96-8c5cf2eb35a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:39:31.371094 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f1e8c0-c5e3-47ce-ba96-8c5cf2eb35a2 None admin] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:39:31.371310 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f1e8c0-c5e3-47ce-ba96-8c5cf2eb35a2 None admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:39:31.371573 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f1e8c0-c5e3-47ce-ba96-8c5cf2eb35a2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:39:31.372323 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f1e8c0-c5e3-47ce-ba96-8c5cf2eb35a2 None admin] RBAC: Adding query filter params (role.id=60f5ecbf9ce84814968607f126a85a5a, scope.project.id=9a10a4268f3c4cb29f4e00c292e2df62, user.id=02eb3d3173c1476cb83a72add0e878e2) {{(pid=87934) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:39:31.372626 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f1e8c0-c5e3-47ce-ba96-8c5cf2eb35a2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:39:31.374196 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f1e8c0-c5e3-47ce-ba96-8c5cf2eb35a2 None admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:39:31.380593 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 637/1246] 10.222.0.25 () {56 vars in 1374 bytes} [Tue Sep 13 19:39:31 2022] GET /identity/v3/role_assignments?user.id=02eb3d3173c1476cb83a72add0e878e2&scope.project.id=9a10a4268f3c4cb29f4e00c292e2df62&role.id=60f5ecbf9ce84814968607f126a85a5a => generated 608 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:39:33.715627 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ef4d6f-0a95-471c-b526-ab7b4a8d1ba9 None None] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:39:33.716261 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ef4d6f-0a95-471c-b526-ab7b4a8d1ba9 None None] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:39:33.716261 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ef4d6f-0a95-471c-b526-ab7b4a8d1ba9 None None] PATH_INFO: `/` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:39:33.718423 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 610/1247] 10.222.0.25 () {54 vars in 927 bytes} [Tue Sep 13 19:39:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:39:33.724174 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05e3eac-2e80-4e5a-998b-1f704da4c448 None None] REQUEST_METHOD: `POST` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:39:33.726114 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05e3eac-2e80-4e5a-998b-1f704da4c448 None None] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:39:33.726114 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05e3eac-2e80-4e5a-998b-1f704da4c448 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:39:33.731539 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG dbcounter [-] [87934] Writing DB stats keystone:SELECT=100 {{(pid=87934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:39:33.748091 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.auth.core [None req-d05e3eac-2e80-4e5a-998b-1f704da4c448 None None] MFA Rules not processed for user `7b0aed92d02344acb92a0e4aa67c3068`. Rule list: `[]` (Enabled: `True`). {{(pid=87934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:39:33.749831 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.fernet_utils [None req-d05e3eac-2e80-4e5a-998b-1f704da4c448 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:39:33.821121 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 638/1248] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Sep 13 19:39:33 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 13 19:39:34.095021 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ef4d6f-0a95-471c-b526-ab7b4a8d1ba9 None None] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:39:34.115271 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG dbcounter [-] [87935] Writing DB stats keystone:SELECT=100 {{(pid=87935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:39:34.212470 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ef4d6f-0a95-471c-b526-ab7b4a8d1ba9 None None] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:39:34.254650 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37711329-8316-42d1-9fb3-e1eaa39c8c5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:39:34.255346 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37711329-8316-42d1-9fb3-e1eaa39c8c5c None admin] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:39:34.255646 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37711329-8316-42d1-9fb3-e1eaa39c8c5c None admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:39:34.255939 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37711329-8316-42d1-9fb3-e1eaa39c8c5c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:39:34.267887 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37711329-8316-42d1-9fb3-e1eaa39c8c5c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 19:39:34.272986 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application [None req-37711329-8316-42d1-9fb3-e1eaa39c8c5c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 19:39:34.272986 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:39:34.272986 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:39:34.272986 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:39:34.272986 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:39:34.272986 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:39:34.272986 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:39:34.272986 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:39:34.272986 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:39:34.272986 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:39:34.272986 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:39:34.272986 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:39:34.272986 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 19:39:34.272986 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 19:39:34.272986 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 19:39:34.272986 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 19:39:34.274221 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 19:39:34.274221 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 19:39:34.274221 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 19:39:34.274221 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 19:39:34.274221 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:39:34.274221 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:39:34.274221 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:39:34.274221 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:39:34.274221 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:39:34.274221 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:39:34.274221 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:39:34.274221 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application with Lock( Sep 13 19:39:34.274221 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:39:34.274221 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:39:34.274221 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:39:34.274221 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:39:34.275267 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:39:34.275267 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:39:34.275267 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:39:34.275267 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:39:34.275267 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 19:39:34.275267 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 19:39:34.275267 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 19:39:34.275267 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 19:39:34.275267 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 19:39:34.275267 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 19:39:34.275267 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 19:39:34.275267 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application Sep 13 19:39:34.275267 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 611/1249] 10.222.0.25 () {56 vars in 1096 bytes} [Tue Sep 13 19:39:34 2022] GET /identity/v3/roles/admin => generated 83 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:39:34.280644 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05e3eac-2e80-4e5a-998b-1f704da4c448 None None] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:39:34.403105 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05e3eac-2e80-4e5a-998b-1f704da4c448 None None] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:39:34.436492 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG dbcounter [-] [87934] Writing DB stats keystone:SELECT=100 {{(pid=87934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:39:34.442145 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94214cb-8753-4038-ac6d-8c886f448221 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:39:34.442764 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94214cb-8753-4038-ac6d-8c886f448221 None admin] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:39:34.443037 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94214cb-8753-4038-ac6d-8c886f448221 None admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:39:34.443335 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94214cb-8753-4038-ac6d-8c886f448221 None admin] PATH_INFO: `/v3/roles` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:39:34.443994 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c94214cb-8753-4038-ac6d-8c886f448221 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87934) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:39:34.444332 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c94214cb-8753-4038-ac6d-8c886f448221 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:39:34.445690 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c94214cb-8753-4038-ac6d-8c886f448221 None admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:39:34.455449 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 639/1250] 10.222.0.25 () {56 vars in 1099 bytes} [Tue Sep 13 19:39:34 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 19:39:34.462261 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37711329-8316-42d1-9fb3-e1eaa39c8c5c None admin] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:39:34.555389 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG dbcounter [-] [87935] Writing DB stats keystone:SELECT=100 {{(pid=87935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:39:34.582095 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37711329-8316-42d1-9fb3-e1eaa39c8c5c None admin] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:39:34.618235 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3bfa622-2c6d-4b64-8758-56cd61192ac5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:39:34.618923 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bfa622-2c6d-4b64-8758-56cd61192ac5 None admin] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:39:34.619212 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bfa622-2c6d-4b64-8758-56cd61192ac5 None admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:39:34.619522 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bfa622-2c6d-4b64-8758-56cd61192ac5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:39:34.631126 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3bfa622-2c6d-4b64-8758-56cd61192ac5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:39:34.633013 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3bfa622-2c6d-4b64-8758-56cd61192ac5 None admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:39:34.651335 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application [None req-a3bfa622-2c6d-4b64-8758-56cd61192ac5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 19:39:34.651335 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:39:34.651335 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:39:34.651335 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:39:34.651335 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:39:34.651335 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:39:34.651335 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:39:34.651335 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:39:34.651335 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:39:34.651335 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:39:34.651335 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:39:34.651335 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:39:34.651335 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 19:39:34.651335 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 19:39:34.651335 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 19:39:34.651335 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 19:39:34.652761 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:39:34.652761 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:39:34.652761 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:39:34.652761 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:39:34.652761 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:39:34.652761 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:39:34.652761 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:39:34.652761 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application with Lock( Sep 13 19:39:34.652761 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:39:34.652761 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:39:34.652761 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:39:34.652761 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:39:34.652761 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:39:34.652761 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:39:34.652761 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:39:34.652761 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:39:34.652761 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 19:39:34.655101 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 19:39:34.655101 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 19:39:34.655101 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application Sep 13 19:39:34.660245 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 612/1251] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Sep 13 19:39:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:39:34.660741 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94214cb-8753-4038-ac6d-8c886f448221 None admin] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:39:34.796311 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94214cb-8753-4038-ac6d-8c886f448221 None admin] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:39:34.833734 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85a0b2f-e848-4901-be74-c58d294abba6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:39:34.834422 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85a0b2f-e848-4901-be74-c58d294abba6 None admin] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:39:34.834773 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85a0b2f-e848-4901-be74-c58d294abba6 None admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:39:34.835072 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85a0b2f-e848-4901-be74-c58d294abba6 None admin] PATH_INFO: `/v3/domains` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:39:34.835960 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c85a0b2f-e848-4901-be74-c58d294abba6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87934) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:39:34.836486 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c85a0b2f-e848-4901-be74-c58d294abba6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:39:34.838140 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c85a0b2f-e848-4901-be74-c58d294abba6 None admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:39:34.852526 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 640/1252] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Sep 13 19:39:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:39:34.860302 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3bfa622-2c6d-4b64-8758-56cd61192ac5 None admin] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:39:34.981253 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3bfa622-2c6d-4b64-8758-56cd61192ac5 None admin] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:39:35.015567 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG dbcounter [-] [87935] Writing DB stats keystone:SELECT=100 {{(pid=87935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:39:35.026392 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f17c8d-1e0b-4e77-969c-006f8a8a952e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:39:35.027031 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f17c8d-1e0b-4e77-969c-006f8a8a952e None admin] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:39:35.027300 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f17c8d-1e0b-4e77-969c-006f8a8a952e None admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:39:35.027563 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f17c8d-1e0b-4e77-969c-006f8a8a952e None admin] PATH_INFO: `/v3/users/placement` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:39:35.037237 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f17c8d-1e0b-4e77-969c-006f8a8a952e None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:39:35.038808 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f17c8d-1e0b-4e77-969c-006f8a8a952e None admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:39:35.052429 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application [None req-68f17c8d-1e0b-4e77-969c-006f8a8a952e None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 13 19:39:35.052429 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:39:35.052429 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:39:35.052429 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:39:35.052429 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:39:35.052429 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:39:35.052429 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:39:35.052429 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:39:35.052429 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:39:35.052429 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:39:35.052429 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:39:35.052429 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:39:35.052429 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 13 19:39:35.052429 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 13 19:39:35.052429 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 13 19:39:35.052429 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 13 19:39:35.053621 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:39:35.053621 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:39:35.053621 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 13 19:39:35.053621 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 19:39:35.053621 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 13 19:39:35.053621 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 19:39:35.053621 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:39:35.053621 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:39:35.053621 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:39:35.053621 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:39:35.053621 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:39:35.053621 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application with Lock( Sep 13 19:39:35.053621 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:39:35.053621 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:39:35.053621 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:39:35.053621 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:39:35.053621 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:39:35.053621 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:39:35.054938 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:39:35.054938 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:39:35.054938 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 13 19:39:35.054938 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 13 19:39:35.054938 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 13 19:39:35.054938 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 13 19:39:35.054938 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 13 19:39:35.054938 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 13 19:39:35.054938 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 13 19:39:35.054938 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application Sep 13 19:39:35.054938 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 613/1253] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Sep 13 19:39:34 2022] GET /identity/v3/users/placement => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:39:35.063287 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85a0b2f-e848-4901-be74-c58d294abba6 None admin] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:39:35.127583 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG dbcounter [-] [87934] Writing DB stats keystone:SELECT=100 {{(pid=87934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:39:35.197127 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85a0b2f-e848-4901-be74-c58d294abba6 None admin] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:39:35.235359 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6accf65-73b7-425f-8769-56cd5e9bd08a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:39:35.235904 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6accf65-73b7-425f-8769-56cd5e9bd08a None admin] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:39:35.236181 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6accf65-73b7-425f-8769-56cd5e9bd08a None admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:39:35.236480 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6accf65-73b7-425f-8769-56cd5e9bd08a None admin] PATH_INFO: `/v3/users` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:39:35.237254 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6accf65-73b7-425f-8769-56cd5e9bd08a None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=87934) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:39:35.237604 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6accf65-73b7-425f-8769-56cd5e9bd08a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:39:35.239097 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6accf65-73b7-425f-8769-56cd5e9bd08a None admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:39:35.260397 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 641/1254] 10.222.0.25 () {56 vars in 1143 bytes} [Tue Sep 13 19:39:35 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:39:35.266692 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f17c8d-1e0b-4e77-969c-006f8a8a952e None admin] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:39:35.377727 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f17c8d-1e0b-4e77-969c-006f8a8a952e None admin] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:39:35.418242 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f714e62-816b-46eb-8b4d-3e02ada3d539 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:39:35.418865 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f714e62-816b-46eb-8b4d-3e02ada3d539 None admin] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:39:35.419208 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f714e62-816b-46eb-8b4d-3e02ada3d539 None admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:39:35.419581 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f714e62-816b-46eb-8b4d-3e02ada3d539 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:39:35.492796 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG dbcounter [-] [87935] Writing DB stats keystone:SELECT=100 {{(pid=87935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:39:35.506304 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f714e62-816b-46eb-8b4d-3e02ada3d539 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:39:35.508198 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f714e62-816b-46eb-8b4d-3e02ada3d539 None admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:39:35.625113 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 614/1255] 10.222.0.25 () {58 vars in 1282 bytes} [Tue Sep 13 19:39:35 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 359 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 13 19:39:35.631265 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6accf65-73b7-425f-8769-56cd5e9bd08a None admin] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:39:35.756466 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6accf65-73b7-425f-8769-56cd5e9bd08a None admin] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:39:35.771405 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG dbcounter [-] [87934] Writing DB stats keystone:SELECT=100 {{(pid=87934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:39:35.795064 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54eec15c-e8db-4837-b6bd-335999eac611 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:39:35.795731 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54eec15c-e8db-4837-b6bd-335999eac611 None admin] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:39:35.796005 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54eec15c-e8db-4837-b6bd-335999eac611 None admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:39:35.796310 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54eec15c-e8db-4837-b6bd-335999eac611 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:39:35.807547 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54eec15c-e8db-4837-b6bd-335999eac611 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:39:35.809036 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54eec15c-e8db-4837-b6bd-335999eac611 None admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:39:35.826681 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application [None req-54eec15c-e8db-4837-b6bd-335999eac611 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 19:39:35.826681 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:39:35.826681 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:39:35.826681 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:39:35.826681 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:39:35.826681 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:39:35.826681 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:39:35.826681 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:39:35.826681 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:39:35.826681 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:39:35.826681 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:39:35.826681 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:39:35.826681 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 19:39:35.826681 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 19:39:35.826681 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 19:39:35.826681 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 19:39:35.827905 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:39:35.827905 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:39:35.827905 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:39:35.827905 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:39:35.827905 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:39:35.827905 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:39:35.827905 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:39:35.827905 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application with Lock( Sep 13 19:39:35.827905 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:39:35.827905 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:39:35.827905 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:39:35.827905 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:39:35.827905 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:39:35.827905 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:39:35.827905 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:39:35.827905 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:39:35.827905 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 19:39:35.828914 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 19:39:35.828914 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 19:39:35.828914 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application Sep 13 19:39:35.832394 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 642/1256] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Sep 13 19:39:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:39:35.834224 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f714e62-816b-46eb-8b4d-3e02ada3d539 None admin] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:39:35.930421 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG dbcounter [-] [87935] Writing DB stats keystone:SELECT=100 {{(pid=87935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:39:35.943733 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f714e62-816b-46eb-8b4d-3e02ada3d539 None admin] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:39:35.983368 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d31ac4-413a-4aaa-8f85-5a46a25e7492 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:39:35.984078 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d31ac4-413a-4aaa-8f85-5a46a25e7492 None admin] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:39:35.984394 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d31ac4-413a-4aaa-8f85-5a46a25e7492 None admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:39:35.984660 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d31ac4-413a-4aaa-8f85-5a46a25e7492 None admin] PATH_INFO: `/v3/domains` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:39:35.985326 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d31ac4-413a-4aaa-8f85-5a46a25e7492 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87935) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:39:35.985628 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d31ac4-413a-4aaa-8f85-5a46a25e7492 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:39:35.987027 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d31ac4-413a-4aaa-8f85-5a46a25e7492 None admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:39:36.000580 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 615/1257] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Sep 13 19:39:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:39:36.006186 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54eec15c-e8db-4837-b6bd-335999eac611 None admin] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:39:36.110826 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54eec15c-e8db-4837-b6bd-335999eac611 None admin] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:39:36.146330 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61176c5-928c-4a66-975e-ed64babd458c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:39:36.146964 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61176c5-928c-4a66-975e-ed64babd458c None admin] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:39:36.147239 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61176c5-928c-4a66-975e-ed64babd458c None admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:39:36.148073 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61176c5-928c-4a66-975e-ed64babd458c None admin] PATH_INFO: `/v3/projects/service` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:39:36.154652 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d61176c5-928c-4a66-975e-ed64babd458c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:39:36.156080 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d61176c5-928c-4a66-975e-ed64babd458c None admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:39:36.167635 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application [None req-d61176c5-928c-4a66-975e-ed64babd458c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 19:39:36.167635 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:39:36.167635 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:39:36.167635 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:39:36.167635 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:39:36.167635 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:39:36.167635 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:39:36.167635 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:39:36.167635 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:39:36.167635 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:39:36.167635 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:39:36.167635 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:39:36.167635 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 13 19:39:36.167635 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 13 19:39:36.167635 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 13 19:39:36.168879 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 13 19:39:36.168879 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:39:36.168879 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:39:36.168879 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:39:36.168879 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:39:36.168879 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:39:36.168879 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:39:36.168879 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:39:36.168879 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application with Lock( Sep 13 19:39:36.168879 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:39:36.168879 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:39:36.168879 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:39:36.168879 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:39:36.168879 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:39:36.168879 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:39:36.168879 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:39:36.168879 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:39:36.170285 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 13 19:39:36.170285 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 13 19:39:36.170285 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 13 19:39:36.170285 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 13 19:39:36.170285 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 13 19:39:36.170285 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 13 19:39:36.170285 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 19:39:36.170285 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application Sep 13 19:39:36.170285 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 643/1258] 10.222.0.25 () {56 vars in 1111 bytes} [Tue Sep 13 19:39:36 2022] GET /identity/v3/projects/service => generated 88 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:39:36.174912 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d31ac4-413a-4aaa-8f85-5a46a25e7492 None admin] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:39:36.294724 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d31ac4-413a-4aaa-8f85-5a46a25e7492 None admin] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:39:36.332117 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c008273c-2dce-4244-965c-978216fb9eb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:39:36.332752 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c008273c-2dce-4244-965c-978216fb9eb0 None admin] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:39:36.333028 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c008273c-2dce-4244-965c-978216fb9eb0 None admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:39:36.333291 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c008273c-2dce-4244-965c-978216fb9eb0 None admin] PATH_INFO: `/v3/projects` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:39:36.333968 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c008273c-2dce-4244-965c-978216fb9eb0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87935) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:39:36.334272 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c008273c-2dce-4244-965c-978216fb9eb0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:39:36.335681 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c008273c-2dce-4244-965c-978216fb9eb0 None admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:39:36.348003 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 616/1259] 10.222.0.25 () {56 vars in 1148 bytes} [Tue Sep 13 19:39:36 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:39:36.354098 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61176c5-928c-4a66-975e-ed64babd458c None admin] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:39:36.380155 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG dbcounter [-] [87934] Writing DB stats keystone:SELECT=100 {{(pid=87934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:39:36.455785 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61176c5-928c-4a66-975e-ed64babd458c None admin] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:39:36.491148 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220e58bc-c042-49c1-a8c3-185f90f43cc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:39:36.491754 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220e58bc-c042-49c1-a8c3-185f90f43cc1 None admin] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:39:36.492033 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220e58bc-c042-49c1-a8c3-185f90f43cc1 None admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:39:36.492333 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220e58bc-c042-49c1-a8c3-185f90f43cc1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:39:36.493058 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-220e58bc-c042-49c1-a8c3-185f90f43cc1 None admin] RBAC: Adding query filter params (role.id=6ca1d4427ff64e0a9d25d96cfb1445f6, scope.project.id=9a10a4268f3c4cb29f4e00c292e2df62, user.id=02eb3d3173c1476cb83a72add0e878e2) {{(pid=87934) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:39:36.493364 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-220e58bc-c042-49c1-a8c3-185f90f43cc1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:39:36.494799 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-220e58bc-c042-49c1-a8c3-185f90f43cc1 None admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:39:36.500601 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 644/1260] 10.222.0.25 () {56 vars in 1374 bytes} [Tue Sep 13 19:39:36 2022] GET /identity/v3/role_assignments?user.id=02eb3d3173c1476cb83a72add0e878e2&scope.project.id=9a10a4268f3c4cb29f4e00c292e2df62&role.id=6ca1d4427ff64e0a9d25d96cfb1445f6 => generated 259 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:39:38.809637 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5fed86-3db4-499a-8118-e8508f31b566 None None] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:39:38.810216 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5fed86-3db4-499a-8118-e8508f31b566 None None] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:39:38.810216 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5fed86-3db4-499a-8118-e8508f31b566 None None] PATH_INFO: `/` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:39:38.811716 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 617/1261] 10.222.0.25 () {54 vars in 927 bytes} [Tue Sep 13 19:39:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:39:38.817041 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884017ab-26f0-4163-9db4-4f9075ed885f None None] REQUEST_METHOD: `POST` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:39:38.817471 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884017ab-26f0-4163-9db4-4f9075ed885f None None] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:39:38.817578 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884017ab-26f0-4163-9db4-4f9075ed885f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:39:38.836695 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.auth.core [None req-884017ab-26f0-4163-9db4-4f9075ed885f None None] MFA Rules not processed for user `7b0aed92d02344acb92a0e4aa67c3068`. Rule list: `[]` (Enabled: `True`). {{(pid=87934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:39:38.837882 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.fernet_utils [None req-884017ab-26f0-4163-9db4-4f9075ed885f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:39:38.906917 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 645/1262] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Sep 13 19:39:38 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 13 19:39:39.180541 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5fed86-3db4-499a-8118-e8508f31b566 None None] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:39:39.192423 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG dbcounter [-] [87935] Writing DB stats keystone:SELECT=100 {{(pid=87935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:39:39.284550 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5fed86-3db4-499a-8118-e8508f31b566 None None] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:39:39.319602 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1acf5752-dbfa-4af7-8703-7f7c00d0648b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:39:39.320226 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acf5752-dbfa-4af7-8703-7f7c00d0648b None admin] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:39:39.320521 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acf5752-dbfa-4af7-8703-7f7c00d0648b None admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:39:39.320791 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acf5752-dbfa-4af7-8703-7f7c00d0648b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:39:39.331580 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1acf5752-dbfa-4af7-8703-7f7c00d0648b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 19:39:39.336651 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application [None req-1acf5752-dbfa-4af7-8703-7f7c00d0648b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 19:39:39.336651 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:39:39.336651 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:39:39.336651 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:39:39.336651 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:39:39.336651 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:39:39.336651 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:39:39.336651 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:39:39.336651 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:39:39.336651 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:39:39.336651 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:39:39.336651 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:39:39.336651 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 19:39:39.336651 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 19:39:39.336651 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 19:39:39.336651 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 19:39:39.337787 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 19:39:39.337787 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 19:39:39.337787 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 19:39:39.337787 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 19:39:39.337787 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:39:39.337787 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:39:39.337787 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:39:39.337787 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:39:39.337787 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:39:39.337787 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:39:39.337787 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:39:39.337787 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application with Lock( Sep 13 19:39:39.337787 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:39:39.337787 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:39:39.337787 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:39:39.337787 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:39:39.338677 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:39:39.338677 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:39:39.338677 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:39:39.338677 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:39:39.338677 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 19:39:39.338677 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 19:39:39.338677 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 19:39:39.338677 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 19:39:39.338677 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 19:39:39.338677 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 19:39:39.338677 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 19:39:39.338677 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application Sep 13 19:39:39.338677 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 618/1263] 10.222.0.25 () {56 vars in 1096 bytes} [Tue Sep 13 19:39:39 2022] GET /identity/v3/roles/admin => generated 83 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:39:39.344577 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884017ab-26f0-4163-9db4-4f9075ed885f None None] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:39:39.372901 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG dbcounter [-] [87934] Writing DB stats keystone:SELECT=100 {{(pid=87934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:39:39.452683 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884017ab-26f0-4163-9db4-4f9075ed885f None None] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:39:39.485918 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5610d01-b754-4824-81a6-d25b66e7af76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:39:39.486518 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5610d01-b754-4824-81a6-d25b66e7af76 None admin] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:39:39.486794 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5610d01-b754-4824-81a6-d25b66e7af76 None admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:39:39.487059 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5610d01-b754-4824-81a6-d25b66e7af76 None admin] PATH_INFO: `/v3/roles` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:39:39.487713 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5610d01-b754-4824-81a6-d25b66e7af76 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87934) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:39:39.488098 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5610d01-b754-4824-81a6-d25b66e7af76 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:39:39.489481 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5610d01-b754-4824-81a6-d25b66e7af76 None admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:39:39.497500 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 646/1264] 10.222.0.25 () {56 vars in 1099 bytes} [Tue Sep 13 19:39:39 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:39:39.504254 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1acf5752-dbfa-4af7-8703-7f7c00d0648b None admin] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:39:39.571722 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG dbcounter [-] [87935] Writing DB stats keystone:SELECT=100 {{(pid=87935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:39:39.606030 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1acf5752-dbfa-4af7-8703-7f7c00d0648b None admin] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:39:39.646129 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21994984-6edf-47cf-b93b-c4b43a71e88a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:39:39.647051 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21994984-6edf-47cf-b93b-c4b43a71e88a None admin] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:39:39.647334 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21994984-6edf-47cf-b93b-c4b43a71e88a None admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:39:39.647604 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21994984-6edf-47cf-b93b-c4b43a71e88a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:39:39.660574 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21994984-6edf-47cf-b93b-c4b43a71e88a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:39:39.662281 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21994984-6edf-47cf-b93b-c4b43a71e88a None admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:39:39.679869 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application [None req-21994984-6edf-47cf-b93b-c4b43a71e88a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 19:39:39.679869 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:39:39.679869 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:39:39.679869 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:39:39.679869 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:39:39.679869 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:39:39.679869 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:39:39.679869 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:39:39.679869 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:39:39.679869 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:39:39.679869 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:39:39.679869 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:39:39.679869 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 19:39:39.679869 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 19:39:39.679869 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 19:39:39.679869 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 19:39:39.680966 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:39:39.680966 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:39:39.680966 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:39:39.680966 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:39:39.680966 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:39:39.680966 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:39:39.680966 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:39:39.680966 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application with Lock( Sep 13 19:39:39.680966 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:39:39.680966 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:39:39.680966 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:39:39.680966 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:39:39.680966 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:39:39.680966 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:39:39.680966 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:39:39.680966 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:39:39.680966 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 19:39:39.681870 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 19:39:39.681870 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 19:39:39.681870 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application Sep 13 19:39:39.681870 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 619/1265] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Sep 13 19:39:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:39:39.687897 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5610d01-b754-4824-81a6-d25b66e7af76 None admin] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:39:39.772106 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG dbcounter [-] [87934] Writing DB stats keystone:SELECT=100 {{(pid=87934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:39:39.790881 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5610d01-b754-4824-81a6-d25b66e7af76 None admin] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:39:39.824655 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045472af-7b55-405f-9d0a-a92b43d6bec5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:39:39.825282 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045472af-7b55-405f-9d0a-a92b43d6bec5 None admin] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:39:39.825521 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045472af-7b55-405f-9d0a-a92b43d6bec5 None admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:39:39.825790 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045472af-7b55-405f-9d0a-a92b43d6bec5 None admin] PATH_INFO: `/v3/domains` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:39:39.826969 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-045472af-7b55-405f-9d0a-a92b43d6bec5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87934) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:39:39.827383 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-045472af-7b55-405f-9d0a-a92b43d6bec5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:39:39.828851 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-045472af-7b55-405f-9d0a-a92b43d6bec5 None admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:39:39.841595 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 647/1266] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Sep 13 19:39:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:39:39.847579 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21994984-6edf-47cf-b93b-c4b43a71e88a None admin] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:39:39.946013 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21994984-6edf-47cf-b93b-c4b43a71e88a None admin] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:39:39.966768 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG dbcounter [-] [87935] Writing DB stats keystone:SELECT=100 {{(pid=87935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:39:39.980934 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79577ace-94b0-4992-aae6-514b40ce506e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:39:39.981555 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79577ace-94b0-4992-aae6-514b40ce506e None admin] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:39:39.981827 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79577ace-94b0-4992-aae6-514b40ce506e None admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:39:39.982098 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79577ace-94b0-4992-aae6-514b40ce506e None admin] PATH_INFO: `/v3/users/placement` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:39:39.989880 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79577ace-94b0-4992-aae6-514b40ce506e None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:39:39.991308 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79577ace-94b0-4992-aae6-514b40ce506e None admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:39:40.002888 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application [None req-79577ace-94b0-4992-aae6-514b40ce506e None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 13 19:39:40.002888 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:39:40.002888 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:39:40.002888 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:39:40.002888 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:39:40.002888 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:39:40.002888 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:39:40.002888 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:39:40.002888 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:39:40.002888 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:39:40.002888 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:39:40.002888 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:39:40.002888 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 13 19:39:40.002888 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 13 19:39:40.002888 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 13 19:39:40.002888 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 13 19:39:40.004024 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:39:40.004024 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:39:40.004024 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 13 19:39:40.004024 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 19:39:40.004024 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 13 19:39:40.004024 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 19:39:40.004024 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:39:40.004024 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:39:40.004024 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:39:40.004024 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:39:40.004024 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:39:40.004024 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application with Lock( Sep 13 19:39:40.004024 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:39:40.004024 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:39:40.004024 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:39:40.004024 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:39:40.004024 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:39:40.004024 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:39:40.005241 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:39:40.005241 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:39:40.005241 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 13 19:39:40.005241 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 13 19:39:40.005241 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 13 19:39:40.005241 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 13 19:39:40.005241 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 13 19:39:40.005241 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 13 19:39:40.005241 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 13 19:39:40.005241 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application Sep 13 19:39:40.005241 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 620/1267] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Sep 13 19:39:39 2022] GET /identity/v3/users/placement => generated 87 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:39:40.011968 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045472af-7b55-405f-9d0a-a92b43d6bec5 None admin] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:39:40.113781 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045472af-7b55-405f-9d0a-a92b43d6bec5 None admin] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:39:40.147192 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5231da80-d14b-4fa5-8926-eeebc94ab2fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:39:40.147798 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5231da80-d14b-4fa5-8926-eeebc94ab2fb None admin] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:39:40.148073 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5231da80-d14b-4fa5-8926-eeebc94ab2fb None admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:39:40.148370 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5231da80-d14b-4fa5-8926-eeebc94ab2fb None admin] PATH_INFO: `/v3/users` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:39:40.149091 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5231da80-d14b-4fa5-8926-eeebc94ab2fb None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=87934) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:39:40.149393 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5231da80-d14b-4fa5-8926-eeebc94ab2fb None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:39:40.150806 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5231da80-d14b-4fa5-8926-eeebc94ab2fb None admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:39:40.159668 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG dbcounter [-] [87934] Writing DB stats keystone:SELECT=100 {{(pid=87934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:39:40.168259 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 648/1268] 10.222.0.25 () {56 vars in 1143 bytes} [Tue Sep 13 19:39:40 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:39:40.174795 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79577ace-94b0-4992-aae6-514b40ce506e None admin] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:39:40.275692 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79577ace-94b0-4992-aae6-514b40ce506e None admin] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:39:40.309152 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc939632-9d09-4794-b4c0-fe949d9c692f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:39:40.309779 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc939632-9d09-4794-b4c0-fe949d9c692f None admin] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:39:40.310058 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc939632-9d09-4794-b4c0-fe949d9c692f None admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:39:40.310328 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc939632-9d09-4794-b4c0-fe949d9c692f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:39:40.321533 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc939632-9d09-4794-b4c0-fe949d9c692f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:39:40.323006 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc939632-9d09-4794-b4c0-fe949d9c692f None admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:39:40.337057 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application [None req-cc939632-9d09-4794-b4c0-fe949d9c692f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 19:39:40.337057 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:39:40.337057 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:39:40.337057 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:39:40.337057 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:39:40.337057 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:39:40.337057 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:39:40.337057 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:39:40.337057 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:39:40.337057 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:39:40.337057 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:39:40.337057 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:39:40.337057 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 19:39:40.337057 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 19:39:40.337057 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 19:39:40.337057 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 19:39:40.338196 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:39:40.338196 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:39:40.338196 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:39:40.338196 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:39:40.338196 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:39:40.338196 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:39:40.338196 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:39:40.338196 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application with Lock( Sep 13 19:39:40.338196 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:39:40.338196 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:39:40.338196 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:39:40.338196 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:39:40.338196 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:39:40.338196 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:39:40.338196 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:39:40.338196 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:39:40.338196 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 19:39:40.339294 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 19:39:40.339294 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 19:39:40.339294 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application Sep 13 19:39:40.339294 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 621/1269] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Sep 13 19:39:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:39:40.344063 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5231da80-d14b-4fa5-8926-eeebc94ab2fb None admin] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:39:40.441500 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5231da80-d14b-4fa5-8926-eeebc94ab2fb None admin] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:39:40.474818 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a39a67-6a39-474e-acdf-29a721b700ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:39:40.475401 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a39a67-6a39-474e-acdf-29a721b700ef None admin] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:39:40.475680 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a39a67-6a39-474e-acdf-29a721b700ef None admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:39:40.475948 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a39a67-6a39-474e-acdf-29a721b700ef None admin] PATH_INFO: `/v3/domains` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:39:40.476610 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a39a67-6a39-474e-acdf-29a721b700ef None admin] RBAC: Adding query filter params (name=Default) {{(pid=87934) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:39:40.476910 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a39a67-6a39-474e-acdf-29a721b700ef None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:39:40.478259 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a39a67-6a39-474e-acdf-29a721b700ef None admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:39:40.489670 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 649/1270] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Sep 13 19:39:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:39:40.495331 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc939632-9d09-4794-b4c0-fe949d9c692f None admin] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:39:40.526707 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG dbcounter [-] [87935] Writing DB stats keystone:SELECT=100 {{(pid=87935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:39:40.597397 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc939632-9d09-4794-b4c0-fe949d9c692f None admin] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:39:40.631514 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18959ec-75a1-4e18-aee0-35061e163fde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:39:40.632131 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18959ec-75a1-4e18-aee0-35061e163fde None admin] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:39:40.632441 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18959ec-75a1-4e18-aee0-35061e163fde None admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:39:40.632711 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18959ec-75a1-4e18-aee0-35061e163fde None admin] PATH_INFO: `/v3/projects/service` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:39:40.639341 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d18959ec-75a1-4e18-aee0-35061e163fde None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:39:40.640803 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d18959ec-75a1-4e18-aee0-35061e163fde None admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:39:40.652383 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application [None req-d18959ec-75a1-4e18-aee0-35061e163fde None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 19:39:40.652383 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:39:40.652383 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:39:40.652383 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:39:40.652383 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:39:40.652383 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:39:40.652383 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:39:40.652383 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:39:40.652383 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:39:40.652383 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:39:40.652383 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:39:40.652383 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:39:40.652383 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 13 19:39:40.652383 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 13 19:39:40.652383 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 13 19:39:40.653417 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 13 19:39:40.653417 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:39:40.653417 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:39:40.653417 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:39:40.653417 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:39:40.653417 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:39:40.653417 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:39:40.653417 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:39:40.653417 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application with Lock( Sep 13 19:39:40.653417 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:39:40.653417 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:39:40.653417 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:39:40.653417 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:39:40.653417 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:39:40.653417 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:39:40.653417 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:39:40.653417 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:39:40.654890 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 13 19:39:40.654890 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 13 19:39:40.654890 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 13 19:39:40.654890 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 13 19:39:40.654890 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 13 19:39:40.654890 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 13 19:39:40.654890 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 19:39:40.654890 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application Sep 13 19:39:40.654890 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 622/1271] 10.222.0.25 () {56 vars in 1111 bytes} [Tue Sep 13 19:39:40 2022] GET /identity/v3/projects/service => generated 88 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:39:40.660981 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a39a67-6a39-474e-acdf-29a721b700ef None admin] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:39:40.725699 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG dbcounter [-] [87934] Writing DB stats keystone:SELECT=100 {{(pid=87934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:39:40.768376 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a39a67-6a39-474e-acdf-29a721b700ef None admin] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:39:40.803291 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52789438-8cad-4616-b34c-cf5d4a6879b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:39:40.803893 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52789438-8cad-4616-b34c-cf5d4a6879b5 None admin] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:39:40.804172 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52789438-8cad-4616-b34c-cf5d4a6879b5 None admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:39:40.804477 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52789438-8cad-4616-b34c-cf5d4a6879b5 None admin] PATH_INFO: `/v3/projects` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:39:40.805165 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52789438-8cad-4616-b34c-cf5d4a6879b5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87934) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:39:40.805470 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52789438-8cad-4616-b34c-cf5d4a6879b5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:39:40.806897 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52789438-8cad-4616-b34c-cf5d4a6879b5 None admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:39:40.818882 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 650/1272] 10.222.0.25 () {56 vars in 1148 bytes} [Tue Sep 13 19:39:40 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:39:40.824927 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18959ec-75a1-4e18-aee0-35061e163fde None admin] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:39:40.918689 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG dbcounter [-] [87935] Writing DB stats keystone:SELECT=100 {{(pid=87935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:39:40.928131 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18959ec-75a1-4e18-aee0-35061e163fde None admin] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:39:40.961891 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca13a290-af9d-4732-b7a3-67259f344877 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:39:40.962533 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca13a290-af9d-4732-b7a3-67259f344877 None admin] REQUEST_METHOD: `PUT` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:39:40.962807 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca13a290-af9d-4732-b7a3-67259f344877 None admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:39:40.963076 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca13a290-af9d-4732-b7a3-67259f344877 None admin] PATH_INFO: `/v3/projects/9a10a4268f3c4cb29f4e00c292e2df62/users/02eb3d3173c1476cb83a72add0e878e2/roles/6ca1d4427ff64e0a9d25d96cfb1445f6` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:39:40.964959 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca13a290-af9d-4732-b7a3-67259f344877 None admin] RBAC: Authorizing `identity:create_grant(project_id=9a10a4268f3c4cb29f4e00c292e2df62, user_id=02eb3d3173c1476cb83a72add0e878e2, role_id=6ca1d4427ff64e0a9d25d96cfb1445f6)` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:39:40.966377 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca13a290-af9d-4732-b7a3-67259f344877 None admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:39:40.982688 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 623/1273] 10.222.0.25 () {58 vars in 1439 bytes} [Tue Sep 13 19:39:40 2022] PUT /identity/v3/projects/9a10a4268f3c4cb29f4e00c292e2df62/users/02eb3d3173c1476cb83a72add0e878e2/roles/6ca1d4427ff64e0a9d25d96cfb1445f6 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 19:39:43.130902 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821bea5e-013f-4f54-b4fa-9a3e67e23f49 None None] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:39:43.131501 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821bea5e-013f-4f54-b4fa-9a3e67e23f49 None None] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:39:43.131501 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821bea5e-013f-4f54-b4fa-9a3e67e23f49 None None] PATH_INFO: `/` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:39:43.132797 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 651/1274] 10.222.0.25 () {54 vars in 927 bytes} [Tue Sep 13 19:39:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:39:43.137820 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b8ffd7-838f-4c9a-b6f1-9719b951098d None None] REQUEST_METHOD: `POST` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:39:43.138215 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b8ffd7-838f-4c9a-b6f1-9719b951098d None None] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:39:43.138350 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b8ffd7-838f-4c9a-b6f1-9719b951098d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:39:43.157266 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.auth.core [None req-80b8ffd7-838f-4c9a-b6f1-9719b951098d None None] MFA Rules not processed for user `7b0aed92d02344acb92a0e4aa67c3068`. Rule list: `[]` (Enabled: `True`). {{(pid=87935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:39:43.158439 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.fernet_utils [None req-80b8ffd7-838f-4c9a-b6f1-9719b951098d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:39:43.229031 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 624/1275] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Sep 13 19:39:43 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 13 19:39:43.495134 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821bea5e-013f-4f54-b4fa-9a3e67e23f49 None None] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:39:43.596019 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821bea5e-013f-4f54-b4fa-9a3e67e23f49 None None] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:39:43.620737 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG dbcounter [-] [87934] Writing DB stats keystone:SELECT=100 {{(pid=87934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:39:43.637985 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d395fb0-cef9-4819-9f2c-4d96f62e38fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:39:43.638611 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d395fb0-cef9-4819-9f2c-4d96f62e38fc None admin] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:39:43.638886 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d395fb0-cef9-4819-9f2c-4d96f62e38fc None admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:39:43.639150 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d395fb0-cef9-4819-9f2c-4d96f62e38fc None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:39:43.650043 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d395fb0-cef9-4819-9f2c-4d96f62e38fc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 19:39:43.655828 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application [None req-7d395fb0-cef9-4819-9f2c-4d96f62e38fc None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 19:39:43.655828 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:39:43.655828 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:39:43.655828 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:39:43.655828 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:39:43.655828 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:39:43.655828 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:39:43.655828 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:39:43.655828 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:39:43.655828 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:39:43.655828 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:39:43.655828 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:39:43.655828 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 19:39:43.655828 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 19:39:43.655828 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 19:39:43.655828 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 19:39:43.656982 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 19:39:43.656982 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 19:39:43.656982 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 19:39:43.656982 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 19:39:43.656982 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:39:43.656982 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:39:43.656982 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:39:43.656982 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:39:43.656982 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:39:43.656982 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:39:43.656982 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:39:43.656982 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application with Lock( Sep 13 19:39:43.656982 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:39:43.656982 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:39:43.656982 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:39:43.656982 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:39:43.657908 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:39:43.657908 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:39:43.657908 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:39:43.657908 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:39:43.657908 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 19:39:43.657908 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 19:39:43.657908 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 19:39:43.657908 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 19:39:43.657908 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 19:39:43.657908 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 19:39:43.657908 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 19:39:43.657908 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application Sep 13 19:39:43.657908 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 652/1276] 10.222.0.25 () {56 vars in 1096 bytes} [Tue Sep 13 19:39:43 2022] GET /identity/v3/roles/admin => generated 83 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:39:43.665047 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b8ffd7-838f-4c9a-b6f1-9719b951098d None None] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:39:43.775903 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG dbcounter [-] [87935] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:39:43.804993 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b8ffd7-838f-4c9a-b6f1-9719b951098d None None] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:39:43.839508 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81be5a83-0932-477e-88dd-f9a2a07f1798 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:39:43.840108 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81be5a83-0932-477e-88dd-f9a2a07f1798 None admin] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:39:43.840419 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81be5a83-0932-477e-88dd-f9a2a07f1798 None admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:39:43.840689 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81be5a83-0932-477e-88dd-f9a2a07f1798 None admin] PATH_INFO: `/v3/roles` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:39:43.841360 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81be5a83-0932-477e-88dd-f9a2a07f1798 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87935) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:39:43.842186 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81be5a83-0932-477e-88dd-f9a2a07f1798 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:39:43.843643 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81be5a83-0932-477e-88dd-f9a2a07f1798 None admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:39:43.851910 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 625/1277] 10.222.0.25 () {56 vars in 1099 bytes} [Tue Sep 13 19:39:43 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 19:39:43.858587 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d395fb0-cef9-4819-9f2c-4d96f62e38fc None admin] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:39:43.957611 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d395fb0-cef9-4819-9f2c-4d96f62e38fc None admin] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:39:43.993685 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b89e0ea-3019-428d-873b-7f0365c8afde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:39:43.994322 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b89e0ea-3019-428d-873b-7f0365c8afde None admin] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:39:43.994593 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b89e0ea-3019-428d-873b-7f0365c8afde None admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:39:43.994857 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b89e0ea-3019-428d-873b-7f0365c8afde None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:39:44.005922 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b89e0ea-3019-428d-873b-7f0365c8afde None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:39:44.007359 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b89e0ea-3019-428d-873b-7f0365c8afde None admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:39:44.022977 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application [None req-5b89e0ea-3019-428d-873b-7f0365c8afde None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 19:39:44.022977 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:39:44.022977 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:39:44.022977 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:39:44.022977 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:39:44.022977 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:39:44.022977 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:39:44.022977 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:39:44.022977 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:39:44.022977 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:39:44.022977 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:39:44.022977 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:39:44.022977 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 19:39:44.022977 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 19:39:44.022977 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 19:39:44.022977 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 19:39:44.024241 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:39:44.024241 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:39:44.024241 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:39:44.024241 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:39:44.024241 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:39:44.024241 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:39:44.024241 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:39:44.024241 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application with Lock( Sep 13 19:39:44.024241 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:39:44.024241 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:39:44.024241 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:39:44.024241 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:39:44.024241 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:39:44.024241 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:39:44.024241 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:39:44.024241 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:39:44.024241 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 19:39:44.025569 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 19:39:44.025569 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 19:39:44.025569 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application Sep 13 19:39:44.025569 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 653/1278] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Sep 13 19:39:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 13 19:39:44.030995 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81be5a83-0932-477e-88dd-f9a2a07f1798 None admin] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:39:44.134624 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81be5a83-0932-477e-88dd-f9a2a07f1798 None admin] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:39:44.167823 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68561c0-447e-4246-a06b-5fa402cd935e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:39:44.168481 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68561c0-447e-4246-a06b-5fa402cd935e None admin] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:39:44.168708 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68561c0-447e-4246-a06b-5fa402cd935e None admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:39:44.168976 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68561c0-447e-4246-a06b-5fa402cd935e None admin] PATH_INFO: `/v3/domains` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:39:44.169605 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e68561c0-447e-4246-a06b-5fa402cd935e None admin] RBAC: Adding query filter params (name=Default) {{(pid=87935) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:39:44.169976 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e68561c0-447e-4246-a06b-5fa402cd935e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:39:44.171338 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e68561c0-447e-4246-a06b-5fa402cd935e None admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:39:44.183005 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 626/1279] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Sep 13 19:39:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:39:44.191201 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b89e0ea-3019-428d-873b-7f0365c8afde None admin] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:39:44.224351 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG dbcounter [-] [87934] Writing DB stats keystone:SELECT=100 {{(pid=87934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:39:44.296889 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b89e0ea-3019-428d-873b-7f0365c8afde None admin] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:39:44.330767 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96cef27-9bcb-4ad2-9af1-b9016c22ddc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:39:44.331385 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96cef27-9bcb-4ad2-9af1-b9016c22ddc2 None admin] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:39:44.331906 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96cef27-9bcb-4ad2-9af1-b9016c22ddc2 None admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:39:44.332182 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96cef27-9bcb-4ad2-9af1-b9016c22ddc2 None admin] PATH_INFO: `/v3/users/placement` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:39:44.339451 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b96cef27-9bcb-4ad2-9af1-b9016c22ddc2 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:39:44.340930 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b96cef27-9bcb-4ad2-9af1-b9016c22ddc2 None admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:39:44.352201 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application [None req-b96cef27-9bcb-4ad2-9af1-b9016c22ddc2 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 13 19:39:44.352201 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:39:44.352201 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:39:44.352201 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:39:44.352201 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:39:44.352201 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:39:44.352201 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:39:44.352201 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:39:44.352201 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:39:44.352201 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:39:44.352201 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:39:44.352201 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:39:44.352201 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 13 19:39:44.352201 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 13 19:39:44.352201 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 13 19:39:44.352201 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 13 19:39:44.353337 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:39:44.353337 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:39:44.353337 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 13 19:39:44.353337 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 19:39:44.353337 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 13 19:39:44.353337 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 19:39:44.353337 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:39:44.353337 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:39:44.353337 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:39:44.353337 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:39:44.353337 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:39:44.353337 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application with Lock( Sep 13 19:39:44.353337 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:39:44.353337 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:39:44.353337 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:39:44.353337 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:39:44.353337 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:39:44.353337 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:39:44.354491 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:39:44.354491 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:39:44.354491 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 13 19:39:44.354491 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 13 19:39:44.354491 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 13 19:39:44.354491 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 13 19:39:44.354491 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 13 19:39:44.354491 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 13 19:39:44.354491 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 13 19:39:44.354491 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application Sep 13 19:39:44.354491 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 654/1280] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Sep 13 19:39:44 2022] GET /identity/v3/users/placement => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:39:44.359138 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68561c0-447e-4246-a06b-5fa402cd935e None admin] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:39:44.362901 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG dbcounter [-] [87935] Writing DB stats keystone:SELECT=100 {{(pid=87935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:39:44.463049 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68561c0-447e-4246-a06b-5fa402cd935e None admin] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:39:44.497025 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65fe5cd-f0b7-44a7-b173-3b52b4720969 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:39:44.497658 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65fe5cd-f0b7-44a7-b173-3b52b4720969 None admin] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:39:44.498695 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65fe5cd-f0b7-44a7-b173-3b52b4720969 None admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:39:44.499019 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65fe5cd-f0b7-44a7-b173-3b52b4720969 None admin] PATH_INFO: `/v3/users` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:39:44.499775 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a65fe5cd-f0b7-44a7-b173-3b52b4720969 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=87935) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:39:44.500084 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a65fe5cd-f0b7-44a7-b173-3b52b4720969 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:39:44.501571 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a65fe5cd-f0b7-44a7-b173-3b52b4720969 None admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:39:44.521063 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 627/1281] 10.222.0.25 () {56 vars in 1143 bytes} [Tue Sep 13 19:39:44 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:39:44.527097 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96cef27-9bcb-4ad2-9af1-b9016c22ddc2 None admin] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:39:44.617166 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG dbcounter [-] [87934] Writing DB stats keystone:SELECT=100 {{(pid=87934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:39:44.627868 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96cef27-9bcb-4ad2-9af1-b9016c22ddc2 None admin] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:39:44.661813 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b165d1a2-4e45-4487-a8a6-6bb4e6acab3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:39:44.662576 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b165d1a2-4e45-4487-a8a6-6bb4e6acab3d None admin] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:39:44.662859 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b165d1a2-4e45-4487-a8a6-6bb4e6acab3d None admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:39:44.663271 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b165d1a2-4e45-4487-a8a6-6bb4e6acab3d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:39:44.730776 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b165d1a2-4e45-4487-a8a6-6bb4e6acab3d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:39:44.732802 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b165d1a2-4e45-4487-a8a6-6bb4e6acab3d None admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:39:44.817892 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG dbcounter [-] [87934] Writing DB stats keystone:SELECT=100 {{(pid=87934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:39:44.828332 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 655/1282] 10.222.0.25 () {58 vars in 1282 bytes} [Tue Sep 13 19:39:44 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 13 19:39:44.834514 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65fe5cd-f0b7-44a7-b173-3b52b4720969 None admin] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:39:44.912252 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG dbcounter [-] [87935] Writing DB stats keystone:SELECT=100 {{(pid=87935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:39:44.951518 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65fe5cd-f0b7-44a7-b173-3b52b4720969 None admin] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:39:44.984858 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e018d7d-cba5-4656-bbab-7c093bcf38c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:39:44.985496 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e018d7d-cba5-4656-bbab-7c093bcf38c7 None admin] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:39:44.985772 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e018d7d-cba5-4656-bbab-7c093bcf38c7 None admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:39:44.986038 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e018d7d-cba5-4656-bbab-7c093bcf38c7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:39:44.995707 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e018d7d-cba5-4656-bbab-7c093bcf38c7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:39:44.997162 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e018d7d-cba5-4656-bbab-7c093bcf38c7 None admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:39:45.011936 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application [None req-2e018d7d-cba5-4656-bbab-7c093bcf38c7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 19:39:45.011936 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:39:45.011936 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:39:45.011936 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:39:45.011936 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:39:45.011936 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:39:45.011936 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:39:45.011936 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:39:45.011936 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:39:45.011936 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:39:45.011936 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:39:45.011936 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:39:45.011936 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 19:39:45.011936 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 19:39:45.011936 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 19:39:45.011936 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 19:39:45.013221 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:39:45.013221 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:39:45.013221 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:39:45.013221 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:39:45.013221 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:39:45.013221 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:39:45.013221 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:39:45.013221 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application with Lock( Sep 13 19:39:45.013221 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:39:45.013221 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:39:45.013221 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:39:45.013221 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:39:45.013221 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:39:45.013221 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:39:45.013221 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:39:45.013221 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:39:45.013221 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 19:39:45.014317 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 19:39:45.014317 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 19:39:45.014317 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application Sep 13 19:39:45.014317 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 628/1283] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Sep 13 19:39:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:39:45.019054 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b165d1a2-4e45-4487-a8a6-6bb4e6acab3d None admin] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:39:45.116363 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b165d1a2-4e45-4487-a8a6-6bb4e6acab3d None admin] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:39:45.149523 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde12353-5723-47d8-92e3-7c6a6c068fe9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:39:45.150116 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde12353-5723-47d8-92e3-7c6a6c068fe9 None admin] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:39:45.150391 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde12353-5723-47d8-92e3-7c6a6c068fe9 None admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:39:45.150658 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde12353-5723-47d8-92e3-7c6a6c068fe9 None admin] PATH_INFO: `/v3/domains` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:39:45.151286 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde12353-5723-47d8-92e3-7c6a6c068fe9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87934) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:39:45.151585 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde12353-5723-47d8-92e3-7c6a6c068fe9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:39:45.152958 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde12353-5723-47d8-92e3-7c6a6c068fe9 None admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:39:45.164322 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 656/1284] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Sep 13 19:39:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:39:45.170573 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e018d7d-cba5-4656-bbab-7c093bcf38c7 None admin] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:39:45.289331 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e018d7d-cba5-4656-bbab-7c093bcf38c7 None admin] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:39:45.303834 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG dbcounter [-] [87935] Writing DB stats keystone:SELECT=100 {{(pid=87935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:39:45.324454 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd29f13-16dd-4c69-9e3f-39cda0866c2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:39:45.325081 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd29f13-16dd-4c69-9e3f-39cda0866c2f None admin] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:39:45.325357 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd29f13-16dd-4c69-9e3f-39cda0866c2f None admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:39:45.325629 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd29f13-16dd-4c69-9e3f-39cda0866c2f None admin] PATH_INFO: `/v3/projects/service` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:39:45.332724 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd29f13-16dd-4c69-9e3f-39cda0866c2f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:39:45.334156 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd29f13-16dd-4c69-9e3f-39cda0866c2f None admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:39:45.345855 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application [None req-5bd29f13-16dd-4c69-9e3f-39cda0866c2f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 19:39:45.345855 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:39:45.345855 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:39:45.345855 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:39:45.345855 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:39:45.345855 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:39:45.345855 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:39:45.345855 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:39:45.345855 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:39:45.345855 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:39:45.345855 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:39:45.345855 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:39:45.345855 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 13 19:39:45.345855 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 13 19:39:45.345855 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 13 19:39:45.346939 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 13 19:39:45.346939 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:39:45.346939 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:39:45.346939 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:39:45.346939 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:39:45.346939 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:39:45.346939 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:39:45.346939 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:39:45.346939 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application with Lock( Sep 13 19:39:45.346939 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:39:45.346939 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:39:45.346939 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:39:45.346939 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:39:45.346939 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:39:45.346939 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:39:45.346939 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:39:45.346939 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:39:45.348065 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 13 19:39:45.348065 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 13 19:39:45.348065 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 13 19:39:45.348065 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 13 19:39:45.348065 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 13 19:39:45.348065 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 13 19:39:45.348065 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 19:39:45.348065 dv-cinder-828805-6-smb devstack@keystone.service[87935]: ERROR keystone.server.flask.application Sep 13 19:39:45.348065 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 629/1285] 10.222.0.25 () {56 vars in 1111 bytes} [Tue Sep 13 19:39:45 2022] GET /identity/v3/projects/service => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:39:45.352815 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde12353-5723-47d8-92e3-7c6a6c068fe9 None admin] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:39:45.402763 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG dbcounter [-] [87934] Writing DB stats keystone:SELECT=100 {{(pid=87934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:39:45.451876 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde12353-5723-47d8-92e3-7c6a6c068fe9 None admin] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:39:45.484528 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55a05d2-b693-4bd8-962d-ac6c863b6ba1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:39:45.485124 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55a05d2-b693-4bd8-962d-ac6c863b6ba1 None admin] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:39:45.485401 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55a05d2-b693-4bd8-962d-ac6c863b6ba1 None admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:39:45.485668 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55a05d2-b693-4bd8-962d-ac6c863b6ba1 None admin] PATH_INFO: `/v3/projects` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:39:45.486347 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d55a05d2-b693-4bd8-962d-ac6c863b6ba1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87934) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:39:45.486648 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d55a05d2-b693-4bd8-962d-ac6c863b6ba1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:39:45.488064 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d55a05d2-b693-4bd8-962d-ac6c863b6ba1 None admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:39:45.499703 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 657/1286] 10.222.0.25 () {56 vars in 1148 bytes} [Tue Sep 13 19:39:45 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:39:45.505828 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd29f13-16dd-4c69-9e3f-39cda0866c2f None admin] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:39:45.609752 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd29f13-16dd-4c69-9e3f-39cda0866c2f None admin] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:39:45.647763 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3090d65f-9fac-4455-848d-1833e2f59bf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:39:45.648676 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3090d65f-9fac-4455-848d-1833e2f59bf7 None admin] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:39:45.649122 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3090d65f-9fac-4455-848d-1833e2f59bf7 None admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:39:45.649540 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3090d65f-9fac-4455-848d-1833e2f59bf7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:39:45.650426 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3090d65f-9fac-4455-848d-1833e2f59bf7 None admin] RBAC: Adding query filter params (role.id=6ca1d4427ff64e0a9d25d96cfb1445f6, scope.project.id=9a10a4268f3c4cb29f4e00c292e2df62, user.id=02eb3d3173c1476cb83a72add0e878e2) {{(pid=87935) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:39:45.650733 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3090d65f-9fac-4455-848d-1833e2f59bf7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:39:45.652181 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3090d65f-9fac-4455-848d-1833e2f59bf7 None admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:39:45.659586 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 630/1287] 10.222.0.25 () {56 vars in 1374 bytes} [Tue Sep 13 19:39:45 2022] GET /identity/v3/role_assignments?user.id=02eb3d3173c1476cb83a72add0e878e2&scope.project.id=9a10a4268f3c4cb29f4e00c292e2df62&role.id=6ca1d4427ff64e0a9d25d96cfb1445f6 => generated 608 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:39:47.845661 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac12208-9e08-45fe-b10b-f58994341b8f None None] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:39:47.846230 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac12208-9e08-45fe-b10b-f58994341b8f None None] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:39:47.846230 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac12208-9e08-45fe-b10b-f58994341b8f None None] PATH_INFO: `/` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:39:47.847526 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 658/1288] 10.222.0.25 () {54 vars in 927 bytes} [Tue Sep 13 19:39:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:39:47.852876 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d736f5a-6805-4ffe-9528-8ac8a7182235 None None] REQUEST_METHOD: `POST` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:39:47.853297 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d736f5a-6805-4ffe-9528-8ac8a7182235 None None] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:39:47.853415 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d736f5a-6805-4ffe-9528-8ac8a7182235 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:39:47.873450 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.auth.core [None req-0d736f5a-6805-4ffe-9528-8ac8a7182235 None None] MFA Rules not processed for user `7b0aed92d02344acb92a0e4aa67c3068`. Rule list: `[]` (Enabled: `True`). {{(pid=87935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:39:47.874962 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.fernet_utils [None req-0d736f5a-6805-4ffe-9528-8ac8a7182235 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:39:47.906280 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG dbcounter [-] [87935] Writing DB stats keystone:SELECT=100 {{(pid=87935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:39:47.944284 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 631/1289] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Sep 13 19:39:47 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 13 19:39:48.211988 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac12208-9e08-45fe-b10b-f58994341b8f None None] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:39:48.315542 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac12208-9e08-45fe-b10b-f58994341b8f None None] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:39:48.328436 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG dbcounter [-] [87934] Writing DB stats keystone:SELECT=100 {{(pid=87934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:39:48.354761 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b350e119-5547-4421-bb55-7e5b4311fbf8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:39:48.355395 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b350e119-5547-4421-bb55-7e5b4311fbf8 None admin] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:39:48.355665 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b350e119-5547-4421-bb55-7e5b4311fbf8 None admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:39:48.355930 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b350e119-5547-4421-bb55-7e5b4311fbf8 None admin] PATH_INFO: `/v3/services/placement` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:39:48.356538 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b350e119-5547-4421-bb55-7e5b4311fbf8 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:39:48.358684 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b350e119-5547-4421-bb55-7e5b4311fbf8 None admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:39:48.371555 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application [None req-b350e119-5547-4421-bb55-7e5b4311fbf8 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Sep 13 19:39:48.371555 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:39:48.371555 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 13 19:39:48.371555 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 13 19:39:48.371555 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 13 19:39:48.371555 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 13 19:39:48.371555 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 13 19:39:48.371555 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 19:39:48.371555 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 13 19:39:48.371555 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application Sep 13 19:39:48.371555 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 13 19:39:48.371555 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application Sep 13 19:39:48.371555 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:39:48.371555 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:39:48.371555 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:39:48.371555 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:39:48.371555 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:39:48.373476 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:39:48.373476 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:39:48.373476 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:39:48.373476 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:39:48.373476 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:39:48.373476 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:39:48.373476 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 13 19:39:48.373476 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 13 19:39:48.373476 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 13 19:39:48.373476 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 13 19:39:48.373476 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:39:48.373476 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:39:48.373476 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:39:48.373476 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:39:48.373476 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:39:48.373476 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:39:48.374461 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:39:48.374461 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application with Lock( Sep 13 19:39:48.374461 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:39:48.374461 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:39:48.374461 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:39:48.374461 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:39:48.374461 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:39:48.374461 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:39:48.374461 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:39:48.374461 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:39:48.374461 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 13 19:39:48.374461 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 19:39:48.374461 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 13 19:39:48.374461 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application Sep 13 19:39:48.374461 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 659/1290] 10.222.0.25 () {56 vars in 1117 bytes} [Tue Sep 13 19:39:48 2022] GET /identity/v3/services/placement => generated 90 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:39:48.379347 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d736f5a-6805-4ffe-9528-8ac8a7182235 None None] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:39:48.476927 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d736f5a-6805-4ffe-9528-8ac8a7182235 None None] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:39:48.511809 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4253b411-0a7a-4e6c-ad7b-77527ee2afd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:39:48.512431 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4253b411-0a7a-4e6c-ad7b-77527ee2afd1 None admin] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:39:48.512708 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4253b411-0a7a-4e6c-ad7b-77527ee2afd1 None admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:39:48.512974 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4253b411-0a7a-4e6c-ad7b-77527ee2afd1 None admin] PATH_INFO: `/v3/services` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:39:48.513618 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4253b411-0a7a-4e6c-ad7b-77527ee2afd1 None admin] RBAC: Adding query filter params (name=placement) {{(pid=87935) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:39:48.513915 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4253b411-0a7a-4e6c-ad7b-77527ee2afd1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:39:48.515268 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4253b411-0a7a-4e6c-ad7b-77527ee2afd1 None admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:39:48.519944 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 632/1291] 10.222.0.25 () {56 vars in 1116 bytes} [Tue Sep 13 19:39:48 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:39:48.525753 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b350e119-5547-4421-bb55-7e5b4311fbf8 None admin] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:39:48.624768 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b350e119-5547-4421-bb55-7e5b4311fbf8 None admin] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:39:48.657249 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86fd346a-112a-4d09-90d7-62c7ceedd67e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:39:48.657640 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fd346a-112a-4d09-90d7-62c7ceedd67e None admin] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:39:48.657824 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fd346a-112a-4d09-90d7-62c7ceedd67e None admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:39:48.658092 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fd346a-112a-4d09-90d7-62c7ceedd67e None admin] PATH_INFO: `/v3/services` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:39:48.658737 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86fd346a-112a-4d09-90d7-62c7ceedd67e None admin] RBAC: Adding query filter params (type=placement) {{(pid=87934) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:39:48.659019 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86fd346a-112a-4d09-90d7-62c7ceedd67e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:39:48.660406 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86fd346a-112a-4d09-90d7-62c7ceedd67e None admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:39:48.665514 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 660/1292] 10.222.0.25 () {56 vars in 1116 bytes} [Tue Sep 13 19:39:48 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:39:50.810777 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8af4d92-706e-4d4f-8bcf-310932fac438 None None] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:39:50.811313 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8af4d92-706e-4d4f-8bcf-310932fac438 None None] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:39:50.811313 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8af4d92-706e-4d4f-8bcf-310932fac438 None None] PATH_INFO: `/` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:39:50.812677 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 633/1293] 10.222.0.25 () {54 vars in 927 bytes} [Tue Sep 13 19:39:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:39:50.817937 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc69854-82df-4274-9f7d-16bb7ff8b8ac None None] REQUEST_METHOD: `POST` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:39:50.818374 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc69854-82df-4274-9f7d-16bb7ff8b8ac None None] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:39:50.818470 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc69854-82df-4274-9f7d-16bb7ff8b8ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:39:50.837194 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.auth.core [None req-ffc69854-82df-4274-9f7d-16bb7ff8b8ac None None] MFA Rules not processed for user `7b0aed92d02344acb92a0e4aa67c3068`. Rule list: `[]` (Enabled: `True`). {{(pid=87934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:39:50.838370 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.fernet_utils [None req-ffc69854-82df-4274-9f7d-16bb7ff8b8ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:39:50.868367 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG dbcounter [-] [87934] Writing DB stats keystone:SELECT=100 {{(pid=87934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:39:50.906349 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 661/1294] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Sep 13 19:39:50 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 13 19:39:51.174973 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8af4d92-706e-4d4f-8bcf-310932fac438 None None] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:39:51.207666 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG dbcounter [-] [87935] Writing DB stats keystone:SELECT=100 {{(pid=87935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:39:51.280337 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8af4d92-706e-4d4f-8bcf-310932fac438 None None] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:39:51.315397 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a5b1cc-27dc-42df-b28e-e3dc247bdcd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:39:51.316022 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a5b1cc-27dc-42df-b28e-e3dc247bdcd3 None admin] REQUEST_METHOD: `POST` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:39:51.316336 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a5b1cc-27dc-42df-b28e-e3dc247bdcd3 None admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:39:51.316604 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a5b1cc-27dc-42df-b28e-e3dc247bdcd3 None admin] PATH_INFO: `/v3/services` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:39:51.317276 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a5b1cc-27dc-42df-b28e-e3dc247bdcd3 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:39:51.318682 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a5b1cc-27dc-42df-b28e-e3dc247bdcd3 None admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:39:51.334977 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 634/1295] 10.222.0.25 () {60 vars in 1141 bytes} [Tue Sep 13 19:39:51 2022] POST /identity/v3/services => generated 246 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 19:39:53.541699 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf6e300-dd6d-4b7b-9642-98d971adca75 None None] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:39:53.542270 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf6e300-dd6d-4b7b-9642-98d971adca75 None None] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:39:53.542270 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf6e300-dd6d-4b7b-9642-98d971adca75 None None] PATH_INFO: `/` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:39:53.543575 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 662/1296] 10.222.0.25 () {54 vars in 927 bytes} [Tue Sep 13 19:39:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:39:53.550263 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e78d0c-319a-4394-aadd-fd4a7646e36a None None] REQUEST_METHOD: `POST` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:39:53.550902 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e78d0c-319a-4394-aadd-fd4a7646e36a None None] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:39:53.550902 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e78d0c-319a-4394-aadd-fd4a7646e36a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:39:53.570809 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.auth.core [None req-18e78d0c-319a-4394-aadd-fd4a7646e36a None None] MFA Rules not processed for user `7b0aed92d02344acb92a0e4aa67c3068`. Rule list: `[]` (Enabled: `True`). {{(pid=87935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:39:53.572174 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.fernet_utils [None req-18e78d0c-319a-4394-aadd-fd4a7646e36a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:39:53.652054 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 635/1297] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Sep 13 19:39:53 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 13 19:39:53.934651 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf6e300-dd6d-4b7b-9642-98d971adca75 None None] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:39:54.037942 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf6e300-dd6d-4b7b-9642-98d971adca75 None None] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:39:54.077227 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b711ca3b-7c4f-4631-8493-2f003a581e2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:39:54.078032 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b711ca3b-7c4f-4631-8493-2f003a581e2e None admin] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:39:54.078488 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b711ca3b-7c4f-4631-8493-2f003a581e2e None admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:39:54.078955 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b711ca3b-7c4f-4631-8493-2f003a581e2e None admin] PATH_INFO: `/v3/services/placement` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:39:54.079933 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b711ca3b-7c4f-4631-8493-2f003a581e2e None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:39:54.081966 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b711ca3b-7c4f-4631-8493-2f003a581e2e None admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:39:54.092006 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application [None req-b711ca3b-7c4f-4631-8493-2f003a581e2e None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Sep 13 19:39:54.092006 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:39:54.092006 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 13 19:39:54.092006 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 13 19:39:54.092006 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 13 19:39:54.092006 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 13 19:39:54.092006 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 13 19:39:54.092006 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 19:39:54.092006 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 13 19:39:54.092006 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application Sep 13 19:39:54.092006 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 13 19:39:54.092006 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application Sep 13 19:39:54.092006 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:39:54.092006 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:39:54.092006 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:39:54.092006 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:39:54.092006 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:39:54.093319 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:39:54.093319 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:39:54.093319 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:39:54.093319 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:39:54.093319 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:39:54.093319 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:39:54.093319 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 13 19:39:54.093319 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 13 19:39:54.093319 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 13 19:39:54.093319 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 13 19:39:54.093319 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:39:54.093319 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:39:54.093319 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:39:54.093319 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:39:54.093319 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:39:54.093319 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:39:54.094685 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:39:54.094685 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application with Lock( Sep 13 19:39:54.094685 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:39:54.094685 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:39:54.094685 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:39:54.094685 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:39:54.094685 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:39:54.094685 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:39:54.094685 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:39:54.094685 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:39:54.094685 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 13 19:39:54.094685 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 19:39:54.094685 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 13 19:39:54.094685 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application Sep 13 19:39:54.094685 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 663/1298] 10.222.0.25 () {56 vars in 1117 bytes} [Tue Sep 13 19:39:53 2022] GET /identity/v3/services/placement => generated 90 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:39:54.099616 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e78d0c-319a-4394-aadd-fd4a7646e36a None None] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:39:54.122045 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG dbcounter [-] [87935] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:39:54.210961 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e78d0c-319a-4394-aadd-fd4a7646e36a None None] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:39:54.246790 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f74951-1b57-4ff7-9945-6532a6fd4f16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:39:54.247400 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f74951-1b57-4ff7-9945-6532a6fd4f16 None admin] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:39:54.247821 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f74951-1b57-4ff7-9945-6532a6fd4f16 None admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:39:54.248194 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f74951-1b57-4ff7-9945-6532a6fd4f16 None admin] PATH_INFO: `/v3/services` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:39:54.249011 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f74951-1b57-4ff7-9945-6532a6fd4f16 None admin] RBAC: Adding query filter params (name=placement) {{(pid=87935) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:39:54.249308 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f74951-1b57-4ff7-9945-6532a6fd4f16 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:39:54.250697 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f74951-1b57-4ff7-9945-6532a6fd4f16 None admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:39:54.256613 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 636/1299] 10.222.0.25 () {56 vars in 1116 bytes} [Tue Sep 13 19:39:54 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:39:54.264986 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b711ca3b-7c4f-4631-8493-2f003a581e2e None admin] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:39:54.298834 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG dbcounter [-] [87934] Writing DB stats keystone:SELECT=100 {{(pid=87934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:39:54.368596 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b711ca3b-7c4f-4631-8493-2f003a581e2e None admin] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:39:54.403010 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e98659-a43a-4c94-baad-eeeeb24d2991 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:39:54.403612 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e98659-a43a-4c94-baad-eeeeb24d2991 None admin] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:39:54.404477 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e98659-a43a-4c94-baad-eeeeb24d2991 None admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:39:54.404858 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e98659-a43a-4c94-baad-eeeeb24d2991 None admin] PATH_INFO: `/v3/endpoints` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:39:54.405674 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e98659-a43a-4c94-baad-eeeeb24d2991 None admin] RBAC: Adding query filter params (interface=public, service_id=4068c1f014954b81a8aa6214edb47b85, region_id=RegionOne) {{(pid=87934) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:39:54.405979 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e98659-a43a-4c94-baad-eeeeb24d2991 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:39:54.407328 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e98659-a43a-4c94-baad-eeeeb24d2991 None admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:39:54.412398 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 664/1300] 10.222.0.25 () {56 vars in 1251 bytes} [Tue Sep 13 19:39:54 2022] GET /identity/v3/endpoints?service_id=4068c1f014954b81a8aa6214edb47b85&interface=public®ion_id=RegionOne => generated 194 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:39:54.418372 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f74951-1b57-4ff7-9945-6532a6fd4f16 None admin] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:39:54.507911 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG dbcounter [-] [87935] Writing DB stats keystone:SELECT=100 {{(pid=87935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:39:54.530938 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f74951-1b57-4ff7-9945-6532a6fd4f16 None admin] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:39:54.564765 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c494e806-8601-4d7e-906b-b8362d8f8eaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:39:54.565408 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c494e806-8601-4d7e-906b-b8362d8f8eaa None admin] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:39:54.565623 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c494e806-8601-4d7e-906b-b8362d8f8eaa None admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:39:54.565895 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c494e806-8601-4d7e-906b-b8362d8f8eaa None admin] PATH_INFO: `/v3/services` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:39:54.566492 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c494e806-8601-4d7e-906b-b8362d8f8eaa None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:39:54.567855 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c494e806-8601-4d7e-906b-b8362d8f8eaa None admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:39:54.574870 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 637/1301] 10.222.0.25 () {56 vars in 1087 bytes} [Tue Sep 13 19:39:54 2022] GET /identity/v3/services => generated 2191 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 19:39:56.731049 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8e854c-0c96-413b-ac46-2f27cd129fb7 None None] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:39:56.731616 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8e854c-0c96-413b-ac46-2f27cd129fb7 None None] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:39:56.731616 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8e854c-0c96-413b-ac46-2f27cd129fb7 None None] PATH_INFO: `/` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:39:56.733802 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 665/1302] 10.222.0.25 () {54 vars in 927 bytes} [Tue Sep 13 19:39:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:39:56.739175 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83d11a0-601b-4426-a391-2486fc104bd9 None None] REQUEST_METHOD: `POST` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:39:56.739624 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83d11a0-601b-4426-a391-2486fc104bd9 None None] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:39:56.739718 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83d11a0-601b-4426-a391-2486fc104bd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:39:56.758904 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.auth.core [None req-d83d11a0-601b-4426-a391-2486fc104bd9 None None] MFA Rules not processed for user `7b0aed92d02344acb92a0e4aa67c3068`. Rule list: `[]` (Enabled: `True`). {{(pid=87935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:39:56.760121 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.fernet_utils [None req-d83d11a0-601b-4426-a391-2486fc104bd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:39:56.835363 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 638/1303] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Sep 13 19:39:56 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 13 19:39:57.107717 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8e854c-0c96-413b-ac46-2f27cd129fb7 None None] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:39:57.202107 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG dbcounter [-] [87934] Writing DB stats keystone:SELECT=100 {{(pid=87934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:39:57.209674 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8e854c-0c96-413b-ac46-2f27cd129fb7 None None] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:39:57.243899 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9495cb5-ba87-4c72-8a24-b33659a80b54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:39:57.244546 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9495cb5-ba87-4c72-8a24-b33659a80b54 None admin] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:39:57.244827 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9495cb5-ba87-4c72-8a24-b33659a80b54 None admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:39:57.245094 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9495cb5-ba87-4c72-8a24-b33659a80b54 None admin] PATH_INFO: `/v3/services/placement` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:39:57.245669 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9495cb5-ba87-4c72-8a24-b33659a80b54 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:39:57.247027 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9495cb5-ba87-4c72-8a24-b33659a80b54 None admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:39:57.257592 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application [None req-e9495cb5-ba87-4c72-8a24-b33659a80b54 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Sep 13 19:39:57.257592 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:39:57.257592 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 13 19:39:57.257592 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 13 19:39:57.257592 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 13 19:39:57.257592 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 13 19:39:57.257592 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 13 19:39:57.257592 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 19:39:57.257592 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 13 19:39:57.257592 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application Sep 13 19:39:57.257592 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 13 19:39:57.257592 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application Sep 13 19:39:57.257592 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:39:57.257592 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:39:57.257592 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:39:57.257592 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:39:57.257592 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:39:57.258872 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:39:57.258872 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:39:57.258872 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:39:57.258872 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:39:57.258872 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:39:57.258872 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:39:57.258872 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 13 19:39:57.258872 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 13 19:39:57.258872 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 13 19:39:57.258872 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 13 19:39:57.258872 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:39:57.258872 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:39:57.258872 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:39:57.258872 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:39:57.258872 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:39:57.258872 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:39:57.259991 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:39:57.259991 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application with Lock( Sep 13 19:39:57.259991 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:39:57.259991 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:39:57.259991 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:39:57.259991 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:39:57.259991 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:39:57.259991 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:39:57.259991 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:39:57.259991 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:39:57.259991 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 13 19:39:57.259991 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 19:39:57.259991 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 13 19:39:57.259991 dv-cinder-828805-6-smb devstack@keystone.service[87934]: ERROR keystone.server.flask.application Sep 13 19:39:57.259991 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 666/1304] 10.222.0.25 () {56 vars in 1117 bytes} [Tue Sep 13 19:39:57 2022] GET /identity/v3/services/placement => generated 90 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:39:57.265181 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83d11a0-601b-4426-a391-2486fc104bd9 None None] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:39:57.340164 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG dbcounter [-] [87935] Writing DB stats keystone:SELECT=100 {{(pid=87935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:39:57.364051 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83d11a0-601b-4426-a391-2486fc104bd9 None None] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:39:57.400720 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b005ff-f1e7-4c68-a592-7d44a3e217bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:39:57.401327 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b005ff-f1e7-4c68-a592-7d44a3e217bb None admin] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:39:57.401604 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b005ff-f1e7-4c68-a592-7d44a3e217bb None admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:39:57.401871 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b005ff-f1e7-4c68-a592-7d44a3e217bb None admin] PATH_INFO: `/v3/services` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:39:57.402500 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b005ff-f1e7-4c68-a592-7d44a3e217bb None admin] RBAC: Adding query filter params (name=placement) {{(pid=87935) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:39:57.402799 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b005ff-f1e7-4c68-a592-7d44a3e217bb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:39:57.404770 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b005ff-f1e7-4c68-a592-7d44a3e217bb None admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:39:57.409847 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 639/1305] 10.222.0.25 () {56 vars in 1116 bytes} [Tue Sep 13 19:39:57 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:39:57.415680 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9495cb5-ba87-4c72-8a24-b33659a80b54 None admin] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:39:57.520696 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9495cb5-ba87-4c72-8a24-b33659a80b54 None admin] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:39:57.555601 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddab57bc-8085-4fa0-bc66-9de76ece3c5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:39:57.556202 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddab57bc-8085-4fa0-bc66-9de76ece3c5c None admin] REQUEST_METHOD: `POST` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:39:57.556507 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddab57bc-8085-4fa0-bc66-9de76ece3c5c None admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:39:57.556777 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddab57bc-8085-4fa0-bc66-9de76ece3c5c None admin] PATH_INFO: `/v3/endpoints` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:39:57.557456 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddab57bc-8085-4fa0-bc66-9de76ece3c5c None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:39:57.558826 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddab57bc-8085-4fa0-bc66-9de76ece3c5c None admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:39:57.579162 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 667/1306] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Sep 13 19:39:57 2022] POST /identity/v3/endpoints => generated 331 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 19:40:07.406825 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG dbcounter [-] [87935] Writing DB stats keystone:SELECT=30 {{(pid=87935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:40:07.574612 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG dbcounter [-] [87934] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=87934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:41:01.814935 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8bf5ce-0a79-4b57-a52f-7c965bbcfddc None None] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:41:01.815426 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8bf5ce-0a79-4b57-a52f-7c965bbcfddc None None] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:41:01.815516 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8bf5ce-0a79-4b57-a52f-7c965bbcfddc None None] PATH_INFO: `/` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:41:01.817260 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 640/1307] 10.222.0.25 () {54 vars in 927 bytes} [Tue Sep 13 19:41:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:41:01.822532 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3238d4-3d0b-48c2-85d4-c78713501685 None None] REQUEST_METHOD: `POST` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:41:01.822947 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3238d4-3d0b-48c2-85d4-c78713501685 None None] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:41:01.823169 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3238d4-3d0b-48c2-85d4-c78713501685 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:41:02.005154 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.auth.core [None req-4a3238d4-3d0b-48c2-85d4-c78713501685 None None] MFA Rules not processed for user `7b0aed92d02344acb92a0e4aa67c3068`. Rule list: `[]` (Enabled: `True`). {{(pid=87934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:41:02.008823 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.fernet_utils [None req-4a3238d4-3d0b-48c2-85d4-c78713501685 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:41:02.222282 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 668/1308] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Sep 13 19:41:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 400 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 19:41:02.562362 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4119c0c-995d-412f-a1fb-1fd438606188 None None] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:41:02.563046 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4119c0c-995d-412f-a1fb-1fd438606188 None None] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:41:02.563627 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4119c0c-995d-412f-a1fb-1fd438606188 None None] PATH_INFO: `/` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:41:02.565457 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 641/1309] 10.222.0.25 () {54 vars in 965 bytes} [Tue Sep 13 19:41:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:41:02.572339 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe13434-da73-4eeb-ac2c-7184d9d260ee None None] REQUEST_METHOD: `POST` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:41:02.573038 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe13434-da73-4eeb-ac2c-7184d9d260ee None None] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:41:02.574146 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe13434-da73-4eeb-ac2c-7184d9d260ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:41:02.686651 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.auth.core [None req-fbe13434-da73-4eeb-ac2c-7184d9d260ee None None] MFA Rules not processed for user `1196a96e4a404f559600b69f929ea9da`. Rule list: `[]` (Enabled: `True`). {{(pid=87934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:41:02.688518 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.fernet_utils [None req-fbe13434-da73-4eeb-ac2c-7184d9d260ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:41:02.722027 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG dbcounter [-] [87934] Writing DB stats keystone:SELECT=100 {{(pid=87934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:41:02.796395 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 669/1310] 10.222.0.25 () {58 vars in 1062 bytes} [Tue Sep 13 19:41:02 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 19:41:02.807148 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4119c0c-995d-412f-a1fb-1fd438606188 None None] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:41:02.809541 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.fernet_utils [None req-a4119c0c-995d-412f-a1fb-1fd438606188 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:41:02.934319 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4119c0c-995d-412f-a1fb-1fd438606188 None None] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:41:03.021049 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb70d318-cdf0-4960-a44d-481262b386dd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1196a96e4a404f559600b69f929ea9da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a10a4268f3c4cb29f4e00c292e2df62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:41:03.021686 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb70d318-cdf0-4960-a44d-481262b386dd service neutron] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:41:03.021961 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb70d318-cdf0-4960-a44d-481262b386dd service neutron] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:41:03.022225 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb70d318-cdf0-4960-a44d-481262b386dd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:41:03.023826 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.fernet_utils [None req-fb70d318-cdf0-4960-a44d-481262b386dd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:41:03.084672 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG dbcounter [-] [87935] Writing DB stats keystone:SELECT=100 {{(pid=87935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:41:03.146799 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb70d318-cdf0-4960-a44d-481262b386dd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:41:03.148503 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb70d318-cdf0-4960-a44d-481262b386dd service neutron] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:41:03.170147 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 642/1311] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Sep 13 19:41:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 363 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 19:41:05.742137 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da9e117-51c7-40ec-ba51-539b4198fd73 None None] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:41:05.742659 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da9e117-51c7-40ec-ba51-539b4198fd73 None None] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:41:05.742659 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da9e117-51c7-40ec-ba51-539b4198fd73 None None] PATH_INFO: `/` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:41:05.744002 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 670/1312] 10.222.0.25 () {54 vars in 927 bytes} [Tue Sep 13 19:41:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:41:05.749538 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30844a54-0604-4f97-8beb-3500326c83ab None None] REQUEST_METHOD: `POST` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:41:05.749994 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30844a54-0604-4f97-8beb-3500326c83ab None None] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:41:05.750091 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30844a54-0604-4f97-8beb-3500326c83ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:41:05.820569 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.auth.core [None req-30844a54-0604-4f97-8beb-3500326c83ab None None] MFA Rules not processed for user `7b0aed92d02344acb92a0e4aa67c3068`. Rule list: `[]` (Enabled: `True`). {{(pid=87935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:41:05.821678 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.fernet_utils [None req-30844a54-0604-4f97-8beb-3500326c83ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:41:05.919795 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 643/1313] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Sep 13 19:41:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 19:41:06.204458 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da9e117-51c7-40ec-ba51-539b4198fd73 None None] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:41:06.205989 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.fernet_utils [None req-2da9e117-51c7-40ec-ba51-539b4198fd73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:41:06.310337 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da9e117-51c7-40ec-ba51-539b4198fd73 None None] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:41:06.382318 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG dbcounter [-] [87934] Writing DB stats keystone:SELECT=100 {{(pid=87934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:41:06.384622 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0cee8c-e2da-4521-9d62-0ead06fef124 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1196a96e4a404f559600b69f929ea9da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a10a4268f3c4cb29f4e00c292e2df62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:41:06.385517 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0cee8c-e2da-4521-9d62-0ead06fef124 service neutron] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:41:06.386444 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0cee8c-e2da-4521-9d62-0ead06fef124 service neutron] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:41:06.386722 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0cee8c-e2da-4521-9d62-0ead06fef124 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:41:06.388571 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.fernet_utils [None req-eb0cee8c-e2da-4521-9d62-0ead06fef124 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:41:06.498598 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb0cee8c-e2da-4521-9d62-0ead06fef124 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:41:06.500020 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb0cee8c-e2da-4521-9d62-0ead06fef124 service neutron] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:41:06.517820 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 671/1314] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Sep 13 19:41:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 19:41:08.975252 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d47408c-c095-4c7d-ba20-eeabf9ba26fa None None] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:41:08.975822 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d47408c-c095-4c7d-ba20-eeabf9ba26fa None None] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:41:08.975822 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d47408c-c095-4c7d-ba20-eeabf9ba26fa None None] PATH_INFO: `/` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:41:08.977146 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 644/1315] 10.222.0.25 () {54 vars in 927 bytes} [Tue Sep 13 19:41:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:41:08.982561 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adae41a9-98e2-4256-9310-1664b3931bf0 None None] REQUEST_METHOD: `POST` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:41:08.982978 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adae41a9-98e2-4256-9310-1664b3931bf0 None None] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:41:08.983099 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adae41a9-98e2-4256-9310-1664b3931bf0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:41:09.048091 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.auth.core [None req-adae41a9-98e2-4256-9310-1664b3931bf0 None None] MFA Rules not processed for user `d2e76fe7aad644f59888b9590b97c20c`. Rule list: `[]` (Enabled: `True`). {{(pid=87934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:41:09.049326 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.fernet_utils [None req-adae41a9-98e2-4256-9310-1664b3931bf0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:41:09.104321 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG dbcounter [-] [87934] Writing DB stats keystone:SELECT=100 {{(pid=87934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:41:09.149360 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 672/1316] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Sep 13 19:41:08 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 19:41:09.437349 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d47408c-c095-4c7d-ba20-eeabf9ba26fa None None] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:41:09.438879 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.fernet_utils [None req-9d47408c-c095-4c7d-ba20-eeabf9ba26fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:41:09.449387 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG dbcounter [-] [87935] Writing DB stats keystone:SELECT=100 {{(pid=87935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:41:09.541036 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d47408c-c095-4c7d-ba20-eeabf9ba26fa None None] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:41:09.613707 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be5c60a-8f96-48bb-a793-79acccea6843 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1196a96e4a404f559600b69f929ea9da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a10a4268f3c4cb29f4e00c292e2df62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:41:09.614307 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be5c60a-8f96-48bb-a793-79acccea6843 service neutron] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:41:09.614583 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be5c60a-8f96-48bb-a793-79acccea6843 service neutron] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:41:09.614849 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be5c60a-8f96-48bb-a793-79acccea6843 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:41:09.616472 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.fernet_utils [None req-5be5c60a-8f96-48bb-a793-79acccea6843 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:41:09.677900 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG dbcounter [-] [87935] Writing DB stats keystone:SELECT=100 {{(pid=87935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:41:09.725142 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be5c60a-8f96-48bb-a793-79acccea6843 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:41:09.726569 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be5c60a-8f96-48bb-a793-79acccea6843 service neutron] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:41:09.744033 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 645/1317] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Sep 13 19:41:09 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 19:41:12.429646 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b1bc1f-02f5-4677-9229-9f4a4731a490 None None] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:41:12.430205 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b1bc1f-02f5-4677-9229-9f4a4731a490 None None] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:41:12.430205 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b1bc1f-02f5-4677-9229-9f4a4731a490 None None] PATH_INFO: `/` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:41:12.431548 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 673/1318] 10.222.0.25 () {54 vars in 927 bytes} [Tue Sep 13 19:41:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:41:12.437430 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135a70fc-b8d6-4db3-80a1-023dfe7b5e0d None None] REQUEST_METHOD: `POST` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:41:12.437856 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135a70fc-b8d6-4db3-80a1-023dfe7b5e0d None None] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:41:12.437970 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135a70fc-b8d6-4db3-80a1-023dfe7b5e0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:41:12.503812 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.auth.core [None req-135a70fc-b8d6-4db3-80a1-023dfe7b5e0d None None] MFA Rules not processed for user `7b0aed92d02344acb92a0e4aa67c3068`. Rule list: `[]` (Enabled: `True`). {{(pid=87935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:41:12.505021 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.fernet_utils [None req-135a70fc-b8d6-4db3-80a1-023dfe7b5e0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:41:12.600495 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 646/1319] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Sep 13 19:41:12 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 19:41:12.891184 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b1bc1f-02f5-4677-9229-9f4a4731a490 None None] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:41:12.892763 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.fernet_utils [None req-95b1bc1f-02f5-4677-9229-9f4a4731a490 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:41:12.995629 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b1bc1f-02f5-4677-9229-9f4a4731a490 None None] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:41:13.067026 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb488f7-fb9c-4ead-bde6-f8118f7cce31 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1196a96e4a404f559600b69f929ea9da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a10a4268f3c4cb29f4e00c292e2df62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:41:13.067625 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb488f7-fb9c-4ead-bde6-f8118f7cce31 service neutron] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:41:13.067902 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb488f7-fb9c-4ead-bde6-f8118f7cce31 service neutron] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:41:13.068169 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb488f7-fb9c-4ead-bde6-f8118f7cce31 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:41:13.069785 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.fernet_utils [None req-3cb488f7-fb9c-4ead-bde6-f8118f7cce31 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:41:13.076840 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG dbcounter [-] [87934] Writing DB stats keystone:SELECT=100 {{(pid=87934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:41:13.180192 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb488f7-fb9c-4ead-bde6-f8118f7cce31 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:41:13.181570 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb488f7-fb9c-4ead-bde6-f8118f7cce31 service neutron] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:41:13.200004 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 674/1320] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Sep 13 19:41:12 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 19:41:15.996838 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8870403-9286-4fb7-9721-419b6509eb0b None None] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:41:15.997478 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8870403-9286-4fb7-9721-419b6509eb0b None None] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:41:15.997478 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8870403-9286-4fb7-9721-419b6509eb0b None None] PATH_INFO: `/` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:41:15.998796 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 647/1321] 10.222.0.25 () {54 vars in 927 bytes} [Tue Sep 13 19:41:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:41:16.004303 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f2427f-5265-4a35-a470-b7d34399788b None None] REQUEST_METHOD: `POST` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:41:16.004740 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f2427f-5265-4a35-a470-b7d34399788b None None] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:41:16.004838 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f2427f-5265-4a35-a470-b7d34399788b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:41:16.077822 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.auth.core [None req-b4f2427f-5265-4a35-a470-b7d34399788b None None] MFA Rules not processed for user `7b0aed92d02344acb92a0e4aa67c3068`. Rule list: `[]` (Enabled: `True`). {{(pid=87934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:41:16.079088 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.fernet_utils [None req-b4f2427f-5265-4a35-a470-b7d34399788b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:41:16.142222 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG dbcounter [-] [87934] Writing DB stats keystone:SELECT=100 {{(pid=87934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:41:16.184605 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 675/1322] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Sep 13 19:41:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 19:41:16.466770 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8870403-9286-4fb7-9721-419b6509eb0b None None] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:41:16.468320 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.fernet_utils [None req-b8870403-9286-4fb7-9721-419b6509eb0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:41:16.489717 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG dbcounter [-] [87935] Writing DB stats keystone:SELECT=100 {{(pid=87935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:41:16.576906 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8870403-9286-4fb7-9721-419b6509eb0b None None] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:41:16.653636 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235af14c-75e8-4601-a9aa-0a069f2aee12 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1196a96e4a404f559600b69f929ea9da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a10a4268f3c4cb29f4e00c292e2df62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:41:16.654364 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235af14c-75e8-4601-a9aa-0a069f2aee12 service neutron] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:41:16.654633 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235af14c-75e8-4601-a9aa-0a069f2aee12 service neutron] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:41:16.654897 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235af14c-75e8-4601-a9aa-0a069f2aee12 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:41:16.656806 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.fernet_utils [None req-235af14c-75e8-4601-a9aa-0a069f2aee12 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:41:16.731801 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG dbcounter [-] [87935] Writing DB stats keystone:SELECT=100 {{(pid=87935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:41:16.770044 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-235af14c-75e8-4601-a9aa-0a069f2aee12 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:41:16.771506 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-235af14c-75e8-4601-a9aa-0a069f2aee12 service neutron] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:41:16.790565 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 648/1323] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Sep 13 19:41:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 19:41:19.079504 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd00f34-9031-458a-9973-0ec91188f82f None None] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:41:19.080078 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd00f34-9031-458a-9973-0ec91188f82f None None] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:41:19.080078 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd00f34-9031-458a-9973-0ec91188f82f None None] PATH_INFO: `/` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:41:19.081422 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 676/1324] 10.222.0.25 () {54 vars in 927 bytes} [Tue Sep 13 19:41:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:41:19.087267 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe79d84-becb-4689-8900-8b904f8f2e78 None None] REQUEST_METHOD: `POST` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:41:19.087763 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe79d84-becb-4689-8900-8b904f8f2e78 None None] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:41:19.087998 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe79d84-becb-4689-8900-8b904f8f2e78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:41:19.164348 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.auth.core [None req-8fe79d84-becb-4689-8900-8b904f8f2e78 None None] MFA Rules not processed for user `7b0aed92d02344acb92a0e4aa67c3068`. Rule list: `[]` (Enabled: `True`). {{(pid=87935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:41:19.165535 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.fernet_utils [None req-8fe79d84-becb-4689-8900-8b904f8f2e78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:41:19.264966 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 649/1325] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Sep 13 19:41:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 19:41:19.546732 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd00f34-9031-458a-9973-0ec91188f82f None None] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:41:19.548372 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.fernet_utils [None req-8fd00f34-9031-458a-9973-0ec91188f82f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:41:19.657565 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd00f34-9031-458a-9973-0ec91188f82f None None] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:41:19.736147 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f88226-d352-41b0-92d2-81c3808f49bb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1196a96e4a404f559600b69f929ea9da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a10a4268f3c4cb29f4e00c292e2df62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:41:19.736778 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f88226-d352-41b0-92d2-81c3808f49bb service neutron] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:41:19.737052 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f88226-d352-41b0-92d2-81c3808f49bb service neutron] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:41:19.737314 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f88226-d352-41b0-92d2-81c3808f49bb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:41:19.738894 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.fernet_utils [None req-e8f88226-d352-41b0-92d2-81c3808f49bb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:41:19.755690 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG dbcounter [-] [87934] Writing DB stats keystone:SELECT=100 {{(pid=87934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:41:19.850486 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f88226-d352-41b0-92d2-81c3808f49bb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:41:19.851821 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f88226-d352-41b0-92d2-81c3808f49bb service neutron] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:41:19.871253 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 677/1326] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Sep 13 19:41:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 19:41:22.136193 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce962dfa-67f7-4645-87c0-15ca4d9226e5 None None] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:41:22.136751 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce962dfa-67f7-4645-87c0-15ca4d9226e5 None None] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:41:22.136751 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce962dfa-67f7-4645-87c0-15ca4d9226e5 None None] PATH_INFO: `/` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:41:22.138120 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 650/1327] 10.222.0.25 () {54 vars in 927 bytes} [Tue Sep 13 19:41:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:41:22.143550 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd8cbb4-e172-49cb-8d46-c408d2a6f825 None None] REQUEST_METHOD: `POST` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:41:22.143960 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd8cbb4-e172-49cb-8d46-c408d2a6f825 None None] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:41:22.144075 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd8cbb4-e172-49cb-8d46-c408d2a6f825 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:41:22.209587 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.auth.core [None req-fcd8cbb4-e172-49cb-8d46-c408d2a6f825 None None] MFA Rules not processed for user `d2e76fe7aad644f59888b9590b97c20c`. Rule list: `[]` (Enabled: `True`). {{(pid=87934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:41:22.210781 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.fernet_utils [None req-fcd8cbb4-e172-49cb-8d46-c408d2a6f825 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:41:22.277671 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG dbcounter [-] [87934] Writing DB stats keystone:SELECT=100 {{(pid=87934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:41:22.316073 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 678/1328] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Sep 13 19:41:22 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 19:41:22.602328 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce962dfa-67f7-4645-87c0-15ca4d9226e5 None None] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:41:22.603955 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.fernet_utils [None req-ce962dfa-67f7-4645-87c0-15ca4d9226e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:41:22.635562 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG dbcounter [-] [87935] Writing DB stats keystone:SELECT=100 {{(pid=87935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:41:22.711504 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce962dfa-67f7-4645-87c0-15ca4d9226e5 None None] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:41:22.787260 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5127b10d-2a18-4476-acb2-d1f347123885 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1196a96e4a404f559600b69f929ea9da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a10a4268f3c4cb29f4e00c292e2df62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:41:22.787780 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5127b10d-2a18-4476-acb2-d1f347123885 service neutron] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:41:22.788061 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5127b10d-2a18-4476-acb2-d1f347123885 service neutron] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:41:22.788356 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5127b10d-2a18-4476-acb2-d1f347123885 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:41:22.789949 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.fernet_utils [None req-5127b10d-2a18-4476-acb2-d1f347123885 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:41:22.871151 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG dbcounter [-] [87935] Writing DB stats keystone:SELECT=100 {{(pid=87935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:41:22.904851 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5127b10d-2a18-4476-acb2-d1f347123885 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:41:22.906281 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5127b10d-2a18-4476-acb2-d1f347123885 service neutron] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:41:22.925187 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 651/1329] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Sep 13 19:41:22 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 19:41:25.307532 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf79d003-aabd-46cf-9823-e224da613499 None None] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:41:25.307959 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf79d003-aabd-46cf-9823-e224da613499 None None] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:41:25.308066 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf79d003-aabd-46cf-9823-e224da613499 None None] PATH_INFO: `/` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:41:25.309541 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 679/1330] 10.222.0.25 () {54 vars in 927 bytes} [Tue Sep 13 19:41:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:41:25.314652 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa588bfc-f9ba-46df-89d8-4ecb9a825339 None None] REQUEST_METHOD: `POST` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:41:25.315048 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa588bfc-f9ba-46df-89d8-4ecb9a825339 None None] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:41:25.315193 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa588bfc-f9ba-46df-89d8-4ecb9a825339 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:41:25.380484 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.auth.core [None req-fa588bfc-f9ba-46df-89d8-4ecb9a825339 None None] MFA Rules not processed for user `7b0aed92d02344acb92a0e4aa67c3068`. Rule list: `[]` (Enabled: `True`). {{(pid=87935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:41:25.381679 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.fernet_utils [None req-fa588bfc-f9ba-46df-89d8-4ecb9a825339 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:41:25.476983 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 652/1331] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Sep 13 19:41:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 19:41:25.758155 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf79d003-aabd-46cf-9823-e224da613499 None None] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:41:25.759686 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.fernet_utils [None req-cf79d003-aabd-46cf-9823-e224da613499 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:41:25.863705 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf79d003-aabd-46cf-9823-e224da613499 None None] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:41:25.936446 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353c5829-b9b5-4c4e-84a3-4b6a492f42c4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1196a96e4a404f559600b69f929ea9da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a10a4268f3c4cb29f4e00c292e2df62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:41:25.937046 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353c5829-b9b5-4c4e-84a3-4b6a492f42c4 service neutron] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:41:25.937322 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353c5829-b9b5-4c4e-84a3-4b6a492f42c4 service neutron] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:41:25.937590 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353c5829-b9b5-4c4e-84a3-4b6a492f42c4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:41:25.939169 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.fernet_utils [None req-353c5829-b9b5-4c4e-84a3-4b6a492f42c4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:41:25.966944 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG dbcounter [-] [87934] Writing DB stats keystone:SELECT=100 {{(pid=87934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:41:26.050615 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-353c5829-b9b5-4c4e-84a3-4b6a492f42c4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:41:26.052036 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-353c5829-b9b5-4c4e-84a3-4b6a492f42c4 service neutron] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:41:26.069983 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 680/1332] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Sep 13 19:41:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 19:41:28.261037 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae3c792-54bf-4876-a3fe-2e343df86ccd None None] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:41:28.261588 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae3c792-54bf-4876-a3fe-2e343df86ccd None None] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:41:28.261697 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae3c792-54bf-4876-a3fe-2e343df86ccd None None] PATH_INFO: `/` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:41:28.263056 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 653/1333] 10.222.0.25 () {54 vars in 927 bytes} [Tue Sep 13 19:41:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:41:28.268557 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39bc4d4-a06f-4c34-9ae4-735274d6a470 None None] REQUEST_METHOD: `POST` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:41:28.268967 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39bc4d4-a06f-4c34-9ae4-735274d6a470 None None] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:41:28.269089 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39bc4d4-a06f-4c34-9ae4-735274d6a470 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:41:28.334004 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.auth.core [None req-d39bc4d4-a06f-4c34-9ae4-735274d6a470 None None] MFA Rules not processed for user `7b0aed92d02344acb92a0e4aa67c3068`. Rule list: `[]` (Enabled: `True`). {{(pid=87934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:41:28.335205 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.fernet_utils [None req-d39bc4d4-a06f-4c34-9ae4-735274d6a470 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:41:28.409916 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG dbcounter [-] [87934] Writing DB stats keystone:SELECT=100 {{(pid=87934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:41:28.431841 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 681/1334] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Sep 13 19:41:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 19:41:28.724608 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae3c792-54bf-4876-a3fe-2e343df86ccd None None] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:41:28.726175 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.fernet_utils [None req-dae3c792-54bf-4876-a3fe-2e343df86ccd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:41:28.765749 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG dbcounter [-] [87935] Writing DB stats keystone:SELECT=100 {{(pid=87935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:41:28.829934 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae3c792-54bf-4876-a3fe-2e343df86ccd None None] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:41:28.904927 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0026ff3f-d4da-4c00-ac50-77eca43bc1d4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1196a96e4a404f559600b69f929ea9da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a10a4268f3c4cb29f4e00c292e2df62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:41:28.905516 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0026ff3f-d4da-4c00-ac50-77eca43bc1d4 service neutron] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:41:28.905786 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0026ff3f-d4da-4c00-ac50-77eca43bc1d4 service neutron] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:41:28.906046 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0026ff3f-d4da-4c00-ac50-77eca43bc1d4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:41:28.907606 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.fernet_utils [None req-0026ff3f-d4da-4c00-ac50-77eca43bc1d4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:41:28.990755 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG dbcounter [-] [87935] Writing DB stats keystone:SELECT=100 {{(pid=87935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:41:29.016990 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0026ff3f-d4da-4c00-ac50-77eca43bc1d4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:41:29.018431 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0026ff3f-d4da-4c00-ac50-77eca43bc1d4 service neutron] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:41:29.036917 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 654/1335] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Sep 13 19:41:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 19:41:31.493101 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb628ce-e2e1-44c6-857c-0e43a97389c4 None None] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:41:31.493638 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb628ce-e2e1-44c6-857c-0e43a97389c4 None None] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:41:31.493638 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb628ce-e2e1-44c6-857c-0e43a97389c4 None None] PATH_INFO: `/` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:41:31.495967 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 682/1336] 10.222.0.25 () {54 vars in 927 bytes} [Tue Sep 13 19:41:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:41:31.501474 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5da311-9276-49d4-8d5d-9b72accf7fa2 None None] REQUEST_METHOD: `POST` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:41:31.501909 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5da311-9276-49d4-8d5d-9b72accf7fa2 None None] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:41:31.502013 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5da311-9276-49d4-8d5d-9b72accf7fa2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:41:31.570444 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.auth.core [None req-2b5da311-9276-49d4-8d5d-9b72accf7fa2 None None] MFA Rules not processed for user `7b0aed92d02344acb92a0e4aa67c3068`. Rule list: `[]` (Enabled: `True`). {{(pid=87935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:41:31.571636 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.fernet_utils [None req-2b5da311-9276-49d4-8d5d-9b72accf7fa2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:41:31.667253 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 655/1337] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Sep 13 19:41:31 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 19:41:31.965707 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab412321-10aa-468e-915e-d8218ceda77e None None] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:41:31.965991 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab412321-10aa-468e-915e-d8218ceda77e None None] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:41:31.966266 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab412321-10aa-468e-915e-d8218ceda77e None None] PATH_INFO: `/` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:41:31.967594 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 683/1338] 10.222.0.25 () {54 vars in 965 bytes} [Tue Sep 13 19:41:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:41:31.973391 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1312d8-7f54-43f1-9222-5f8fb4af7dc3 None None] REQUEST_METHOD: `POST` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:41:31.973676 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1312d8-7f54-43f1-9222-5f8fb4af7dc3 None None] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:41:31.973948 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1312d8-7f54-43f1-9222-5f8fb4af7dc3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:41:32.029045 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG dbcounter [-] [87935] Writing DB stats keystone:SELECT=100 {{(pid=87935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:41:32.050789 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.auth.core [None req-bc1312d8-7f54-43f1-9222-5f8fb4af7dc3 None None] MFA Rules not processed for user `1196a96e4a404f559600b69f929ea9da`. Rule list: `[]` (Enabled: `True`). {{(pid=87935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:41:32.051980 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.fernet_utils [None req-bc1312d8-7f54-43f1-9222-5f8fb4af7dc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:41:32.130736 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 656/1339] 10.222.0.25 () {58 vars in 1062 bytes} [Tue Sep 13 19:41:31 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 19:41:32.140482 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab412321-10aa-468e-915e-d8218ceda77e None None] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:41:32.141998 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.fernet_utils [None req-ab412321-10aa-468e-915e-d8218ceda77e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:41:32.243432 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab412321-10aa-468e-915e-d8218ceda77e None None] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:41:32.316240 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7bd2c81-d8d8-427e-a502-3a4aa3d2ffe3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1196a96e4a404f559600b69f929ea9da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a10a4268f3c4cb29f4e00c292e2df62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:41:32.316859 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bd2c81-d8d8-427e-a502-3a4aa3d2ffe3 service neutron] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:41:32.317135 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bd2c81-d8d8-427e-a502-3a4aa3d2ffe3 service neutron] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:41:32.317401 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bd2c81-d8d8-427e-a502-3a4aa3d2ffe3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:41:32.318968 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.fernet_utils [None req-b7bd2c81-d8d8-427e-a502-3a4aa3d2ffe3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:41:32.354375 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG dbcounter [-] [87934] Writing DB stats keystone:SELECT=100 {{(pid=87934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:41:32.427812 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7bd2c81-d8d8-427e-a502-3a4aa3d2ffe3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:41:32.429277 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7bd2c81-d8d8-427e-a502-3a4aa3d2ffe3 service neutron] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:41:32.447895 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 684/1340] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Sep 13 19:41:32 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 19:41:37.106577 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78a779a-67cb-43ce-a3f8-04cd22465b8a None None] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:41:37.107091 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78a779a-67cb-43ce-a3f8-04cd22465b8a None None] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:41:37.107091 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78a779a-67cb-43ce-a3f8-04cd22465b8a None None] PATH_INFO: `/` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:41:37.108451 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 657/1341] 10.222.0.25 () {54 vars in 927 bytes} [Tue Sep 13 19:41:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:41:37.113854 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc8c9ac-e9a3-48e7-b89f-28f99652a5b9 None None] REQUEST_METHOD: `POST` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:41:37.114262 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc8c9ac-e9a3-48e7-b89f-28f99652a5b9 None None] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:41:37.114513 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc8c9ac-e9a3-48e7-b89f-28f99652a5b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:41:37.183527 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.auth.core [None req-5bc8c9ac-e9a3-48e7-b89f-28f99652a5b9 None None] MFA Rules not processed for user `7b0aed92d02344acb92a0e4aa67c3068`. Rule list: `[]` (Enabled: `True`). {{(pid=87934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:41:37.184681 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.fernet_utils [None req-5bc8c9ac-e9a3-48e7-b89f-28f99652a5b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:41:37.273904 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG dbcounter [-] [87934] Writing DB stats keystone:SELECT=100 {{(pid=87934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:41:37.285381 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 685/1342] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Sep 13 19:41:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 19:41:37.572844 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78a779a-67cb-43ce-a3f8-04cd22465b8a None None] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:41:37.574448 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.fernet_utils [None req-c78a779a-67cb-43ce-a3f8-04cd22465b8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:41:37.678952 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78a779a-67cb-43ce-a3f8-04cd22465b8a None None] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:41:37.718327 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG dbcounter [-] [87935] Writing DB stats keystone:SELECT=100 {{(pid=87935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:41:37.755318 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deccb25c-b0d5-4eef-b1af-01408d05af12 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1196a96e4a404f559600b69f929ea9da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a10a4268f3c4cb29f4e00c292e2df62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:41:37.755921 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deccb25c-b0d5-4eef-b1af-01408d05af12 service neutron] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:41:37.756199 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deccb25c-b0d5-4eef-b1af-01408d05af12 service neutron] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:41:37.756497 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deccb25c-b0d5-4eef-b1af-01408d05af12 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:41:37.758085 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.fernet_utils [None req-deccb25c-b0d5-4eef-b1af-01408d05af12 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:41:37.870391 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deccb25c-b0d5-4eef-b1af-01408d05af12 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:41:37.871739 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deccb25c-b0d5-4eef-b1af-01408d05af12 service neutron] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:41:37.890082 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 658/1343] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Sep 13 19:41:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 19:41:40.739130 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0201713c-d960-43eb-9de2-e3171b3a66a2 None None] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:41:40.739672 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0201713c-d960-43eb-9de2-e3171b3a66a2 None None] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:41:40.739672 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0201713c-d960-43eb-9de2-e3171b3a66a2 None None] PATH_INFO: `/` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:41:40.741055 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 686/1344] 10.222.0.25 () {54 vars in 927 bytes} [Tue Sep 13 19:41:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:41:40.747797 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e094a14d-f048-4754-8be0-1186480c5260 None None] REQUEST_METHOD: `POST` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:41:40.748249 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e094a14d-f048-4754-8be0-1186480c5260 None None] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:41:40.748506 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e094a14d-f048-4754-8be0-1186480c5260 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:41:40.815443 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.auth.core [None req-e094a14d-f048-4754-8be0-1186480c5260 None None] MFA Rules not processed for user `7b0aed92d02344acb92a0e4aa67c3068`. Rule list: `[]` (Enabled: `True`). {{(pid=87935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:41:40.816682 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.fernet_utils [None req-e094a14d-f048-4754-8be0-1186480c5260 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:41:40.836015 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG dbcounter [-] [87935] Writing DB stats keystone:SELECT=100 {{(pid=87935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:41:40.921536 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 659/1345] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Sep 13 19:41:40 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 19:41:41.204948 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0201713c-d960-43eb-9de2-e3171b3a66a2 None None] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:41:41.206771 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.fernet_utils [None req-0201713c-d960-43eb-9de2-e3171b3a66a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:41:41.320500 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0201713c-d960-43eb-9de2-e3171b3a66a2 None None] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:41:41.395322 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e998b01-a889-4d6a-8865-17d92fcf28af service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1196a96e4a404f559600b69f929ea9da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a10a4268f3c4cb29f4e00c292e2df62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:41:41.395843 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e998b01-a889-4d6a-8865-17d92fcf28af service neutron] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:41:41.396121 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e998b01-a889-4d6a-8865-17d92fcf28af service neutron] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:41:41.396482 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e998b01-a889-4d6a-8865-17d92fcf28af service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:41:41.398062 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.fernet_utils [None req-6e998b01-a889-4d6a-8865-17d92fcf28af service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:41:41.442411 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG dbcounter [-] [87934] Writing DB stats keystone:SELECT=100 {{(pid=87934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:41:41.516034 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e998b01-a889-4d6a-8865-17d92fcf28af service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:41:41.517487 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e998b01-a889-4d6a-8865-17d92fcf28af service neutron] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:41:41.536140 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 687/1346] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Sep 13 19:41:41 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 19:41:45.672938 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7bef34-7871-44fc-9745-18fb440befe4 None None] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:41:45.673429 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7bef34-7871-44fc-9745-18fb440befe4 None None] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:41:45.673524 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7bef34-7871-44fc-9745-18fb440befe4 None None] PATH_INFO: `/` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:41:45.679091 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 660/1347] 10.222.0.25 () {54 vars in 927 bytes} [Tue Sep 13 19:41:45 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:41:45.680734 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab14667-350c-4cff-8d42-c2b43b0e5b3c None None] REQUEST_METHOD: `POST` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:41:45.681299 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab14667-350c-4cff-8d42-c2b43b0e5b3c None None] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:41:45.681437 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab14667-350c-4cff-8d42-c2b43b0e5b3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:41:45.765612 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.auth.core [None req-6ab14667-350c-4cff-8d42-c2b43b0e5b3c None None] MFA Rules not processed for user `7b0aed92d02344acb92a0e4aa67c3068`. Rule list: `[]` (Enabled: `True`). {{(pid=87934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:41:45.767079 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.fernet_utils [None req-6ab14667-350c-4cff-8d42-c2b43b0e5b3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:41:45.873083 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG dbcounter [-] [87934] Writing DB stats keystone:SELECT=100 {{(pid=87934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:41:45.875618 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 688/1348] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Sep 13 19:41:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 19:41:46.163985 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7bef34-7871-44fc-9745-18fb440befe4 None None] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:41:46.165564 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.fernet_utils [None req-8e7bef34-7871-44fc-9745-18fb440befe4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:41:46.276657 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7bef34-7871-44fc-9745-18fb440befe4 None None] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:41:46.328643 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG dbcounter [-] [87935] Writing DB stats keystone:SELECT=100 {{(pid=87935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:41:46.357241 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d4f5e4-bc1c-4385-9e52-773273fd9073 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1196a96e4a404f559600b69f929ea9da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a10a4268f3c4cb29f4e00c292e2df62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:41:46.357860 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d4f5e4-bc1c-4385-9e52-773273fd9073 service neutron] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:41:46.358140 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d4f5e4-bc1c-4385-9e52-773273fd9073 service neutron] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:41:46.358412 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d4f5e4-bc1c-4385-9e52-773273fd9073 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:41:46.360023 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.fernet_utils [None req-d3d4f5e4-bc1c-4385-9e52-773273fd9073 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:41:46.468590 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d4f5e4-bc1c-4385-9e52-773273fd9073 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:41:46.470013 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d4f5e4-bc1c-4385-9e52-773273fd9073 service neutron] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:41:46.488495 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 661/1349] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Sep 13 19:41:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 19:41:51.419548 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0752aa0-542f-47c9-98d0-e281d054781a None None] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:41:51.420064 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0752aa0-542f-47c9-98d0-e281d054781a None None] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:41:51.420453 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0752aa0-542f-47c9-98d0-e281d054781a None None] PATH_INFO: `/` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:41:51.422207 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 689/1350] 10.222.0.25 () {54 vars in 921 bytes} [Tue Sep 13 19:41:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:41:51.428040 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60eaa8fe-fff5-4313-8e8f-8c653b347063 None None] REQUEST_METHOD: `POST` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:41:51.428466 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60eaa8fe-fff5-4313-8e8f-8c653b347063 None None] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:41:51.428610 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60eaa8fe-fff5-4313-8e8f-8c653b347063 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:41:51.565817 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.auth.core [None req-60eaa8fe-fff5-4313-8e8f-8c653b347063 None None] MFA Rules not processed for user `02eb3d3173c1476cb83a72add0e878e2`. Rule list: `[]` (Enabled: `True`). {{(pid=87935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:41:51.567253 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.fernet_utils [None req-60eaa8fe-fff5-4313-8e8f-8c653b347063 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:41:51.592373 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG dbcounter [-] [87935] Writing DB stats keystone:SELECT=100 {{(pid=87935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:41:51.687278 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 662/1351] 10.222.0.25 () {58 vars in 1018 bytes} [Tue Sep 13 19:41:51 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 260 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 19:41:55.881037 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80c432e-59b7-4071-8f4b-d542c3ec6e99 None None] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:41:55.882016 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80c432e-59b7-4071-8f4b-d542c3ec6e99 None None] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:41:55.882514 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80c432e-59b7-4071-8f4b-d542c3ec6e99 None None] PATH_INFO: `/` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:41:55.884458 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 690/1352] 10.222.0.25 () {54 vars in 921 bytes} [Tue Sep 13 19:41:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:41:55.893446 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d3ad04-e0b5-4597-b31d-6cd19e4d9596 None None] REQUEST_METHOD: `POST` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:41:55.894201 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d3ad04-e0b5-4597-b31d-6cd19e4d9596 None None] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:41:55.894201 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d3ad04-e0b5-4597-b31d-6cd19e4d9596 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:41:55.987976 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.auth.core [None req-85d3ad04-e0b5-4597-b31d-6cd19e4d9596 None None] MFA Rules not processed for user `02eb3d3173c1476cb83a72add0e878e2`. Rule list: `[]` (Enabled: `True`). {{(pid=87935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:41:55.989205 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.fernet_utils [None req-85d3ad04-e0b5-4597-b31d-6cd19e4d9596 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:41:56.066254 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG dbcounter [-] [87935] Writing DB stats keystone:SELECT=100 {{(pid=87935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:41:56.105775 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 663/1353] 10.222.0.25 () {58 vars in 1018 bytes} [Tue Sep 13 19:41:55 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 19:41:57.387709 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24fa66b-8c9a-4108-b0e1-8ce32cd1255d None None] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:41:57.388302 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24fa66b-8c9a-4108-b0e1-8ce32cd1255d None None] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:41:57.388884 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24fa66b-8c9a-4108-b0e1-8ce32cd1255d None None] PATH_INFO: `/` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:41:57.391415 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 691/1354] 10.222.0.25 () {54 vars in 921 bytes} [Tue Sep 13 19:41:57 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:41:57.397011 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff1967e-fc26-4008-9a32-bdf5c1d8dc20 None None] REQUEST_METHOD: `POST` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:41:57.397514 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff1967e-fc26-4008-9a32-bdf5c1d8dc20 None None] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:41:57.397638 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff1967e-fc26-4008-9a32-bdf5c1d8dc20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:41:57.474981 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.auth.core [None req-2ff1967e-fc26-4008-9a32-bdf5c1d8dc20 None None] MFA Rules not processed for user `02eb3d3173c1476cb83a72add0e878e2`. Rule list: `[]` (Enabled: `True`). {{(pid=87935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:41:57.476160 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.fernet_utils [None req-2ff1967e-fc26-4008-9a32-bdf5c1d8dc20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:41:57.585305 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 664/1355] 10.222.0.25 () {58 vars in 1018 bytes} [Tue Sep 13 19:41:57 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 19:42:01.331112 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153e0192-a254-4bdc-a960-d6deefc77d0b None None] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:42:01.332258 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153e0192-a254-4bdc-a960-d6deefc77d0b None None] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:42:01.332515 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153e0192-a254-4bdc-a960-d6deefc77d0b None None] PATH_INFO: `/` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:42:01.334027 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 692/1356] 10.222.0.25 () {54 vars in 927 bytes} [Tue Sep 13 19:42:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:42:01.340051 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f80efd-c29e-4fd0-91f1-4bd7ddb2619d None None] REQUEST_METHOD: `POST` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:42:01.340501 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f80efd-c29e-4fd0-91f1-4bd7ddb2619d None None] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:42:01.340680 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f80efd-c29e-4fd0-91f1-4bd7ddb2619d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:42:01.379923 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG dbcounter [-] [87935] Writing DB stats keystone:SELECT=100 {{(pid=87935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:42:01.418054 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.auth.core [None req-b2f80efd-c29e-4fd0-91f1-4bd7ddb2619d None None] MFA Rules not processed for user `7b0aed92d02344acb92a0e4aa67c3068`. Rule list: `[]` (Enabled: `True`). {{(pid=87935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:42:01.419173 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.fernet_utils [None req-b2f80efd-c29e-4fd0-91f1-4bd7ddb2619d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:42:01.545227 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 665/1357] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Sep 13 19:42:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 19:42:01.883569 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160bb2aa-3aee-4724-af8d-a1fe6395dc8a None None] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:42:01.884408 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160bb2aa-3aee-4724-af8d-a1fe6395dc8a None None] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:42:01.884683 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160bb2aa-3aee-4724-af8d-a1fe6395dc8a None None] PATH_INFO: `/` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:42:01.886020 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 693/1358] 10.222.0.25 () {54 vars in 962 bytes} [Tue Sep 13 19:42:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:42:01.905036 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abebde4-1ad2-4e5f-ad45-301b3308f5b5 None None] REQUEST_METHOD: `POST` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:42:01.905628 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abebde4-1ad2-4e5f-ad45-301b3308f5b5 None None] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:42:01.906074 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abebde4-1ad2-4e5f-ad45-301b3308f5b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:42:02.005353 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.auth.core [None req-7abebde4-1ad2-4e5f-ad45-301b3308f5b5 None None] MFA Rules not processed for user `d71fe5a8275f4ea98555afdcefc902a0`. Rule list: `[]` (Enabled: `True`). {{(pid=87935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:42:02.007099 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.fernet_utils [None req-7abebde4-1ad2-4e5f-ad45-301b3308f5b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:42:02.064520 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG dbcounter [-] [87935] Writing DB stats keystone:SELECT=100 {{(pid=87935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:42:02.149400 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 666/1359] 10.222.0.25 () {58 vars in 1059 bytes} [Tue Sep 13 19:42:01 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 245 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 19:42:02.159891 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160bb2aa-3aee-4724-af8d-a1fe6395dc8a None None] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:42:02.161839 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.fernet_utils [None req-160bb2aa-3aee-4724-af8d-a1fe6395dc8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:42:02.341162 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160bb2aa-3aee-4724-af8d-a1fe6395dc8a None None] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:42:02.419145 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG dbcounter [-] [87934] Writing DB stats keystone:SELECT=100 {{(pid=87934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:42:02.464086 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc6b4a1-6732-4c80-91c5-fce13d413d45 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd71fe5a8275f4ea98555afdcefc902a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a10a4268f3c4cb29f4e00c292e2df62', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:42:02.464721 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc6b4a1-6732-4c80-91c5-fce13d413d45 service nova] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:42:02.464997 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc6b4a1-6732-4c80-91c5-fce13d413d45 service nova] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:42:02.465259 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc6b4a1-6732-4c80-91c5-fce13d413d45 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:42:02.466830 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.fernet_utils [None req-8cc6b4a1-6732-4c80-91c5-fce13d413d45 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:42:02.562160 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc6b4a1-6732-4c80-91c5-fce13d413d45 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:42:02.563679 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc6b4a1-6732-4c80-91c5-fce13d413d45 service nova] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:42:02.583026 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 694/1360] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Sep 13 19:42:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 423 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 19:42:05.021380 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ebac5a-a628-441c-8d16-dc9cce2e7cf3 None None] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:42:05.022321 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ebac5a-a628-441c-8d16-dc9cce2e7cf3 None None] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:42:05.022777 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ebac5a-a628-441c-8d16-dc9cce2e7cf3 None None] PATH_INFO: `/` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:42:05.028949 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 667/1361] 10.222.0.25 () {54 vars in 927 bytes} [Tue Sep 13 19:42:05 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:42:05.030302 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa7fe05-0ad8-41c5-b368-522392815e50 None None] REQUEST_METHOD: `POST` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:42:05.030786 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa7fe05-0ad8-41c5-b368-522392815e50 None None] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:42:05.030887 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa7fe05-0ad8-41c5-b368-522392815e50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:42:05.101413 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.auth.core [None req-4fa7fe05-0ad8-41c5-b368-522392815e50 None None] MFA Rules not processed for user `7b0aed92d02344acb92a0e4aa67c3068`. Rule list: `[]` (Enabled: `True`). {{(pid=87934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:42:05.103322 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.fernet_utils [None req-4fa7fe05-0ad8-41c5-b368-522392815e50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:42:05.145137 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG dbcounter [-] [87934] Writing DB stats keystone:SELECT=100 {{(pid=87934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:42:05.213694 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 695/1362] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Sep 13 19:42:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 19:42:05.506818 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ebac5a-a628-441c-8d16-dc9cce2e7cf3 None None] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:42:05.508535 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.fernet_utils [None req-30ebac5a-a628-441c-8d16-dc9cce2e7cf3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:42:05.695307 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ebac5a-a628-441c-8d16-dc9cce2e7cf3 None None] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:42:05.714923 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG dbcounter [-] [87935] Writing DB stats keystone:SELECT=100 {{(pid=87935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:42:05.828552 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3709f0b0-9715-438a-8c88-f8e167edc78c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd71fe5a8275f4ea98555afdcefc902a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a10a4268f3c4cb29f4e00c292e2df62', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:42:05.829179 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3709f0b0-9715-438a-8c88-f8e167edc78c service nova] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:42:05.829453 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3709f0b0-9715-438a-8c88-f8e167edc78c service nova] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:42:05.829716 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3709f0b0-9715-438a-8c88-f8e167edc78c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:42:05.831550 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.fernet_utils [None req-3709f0b0-9715-438a-8c88-f8e167edc78c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:42:05.926070 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3709f0b0-9715-438a-8c88-f8e167edc78c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:42:05.927677 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3709f0b0-9715-438a-8c88-f8e167edc78c service nova] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:42:05.948745 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 668/1363] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Sep 13 19:42:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 442 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 19:42:08.507344 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc62b3a-a56e-4002-a10b-126fd1fdf018 None None] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:42:08.507879 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc62b3a-a56e-4002-a10b-126fd1fdf018 None None] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:42:08.507879 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc62b3a-a56e-4002-a10b-126fd1fdf018 None None] PATH_INFO: `/` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:42:08.509749 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 696/1364] 10.222.0.25 () {54 vars in 927 bytes} [Tue Sep 13 19:42:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:42:08.515178 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f61305a-a548-4d23-950e-b9c7f7e2e220 None None] REQUEST_METHOD: `POST` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:42:08.515604 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f61305a-a548-4d23-950e-b9c7f7e2e220 None None] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:42:08.515720 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f61305a-a548-4d23-950e-b9c7f7e2e220 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:42:08.532902 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG dbcounter [-] [87935] Writing DB stats keystone:SELECT=100 {{(pid=87935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:42:08.590942 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.auth.core [None req-5f61305a-a548-4d23-950e-b9c7f7e2e220 None None] MFA Rules not processed for user `7b0aed92d02344acb92a0e4aa67c3068`. Rule list: `[]` (Enabled: `True`). {{(pid=87935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:42:08.592112 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.fernet_utils [None req-5f61305a-a548-4d23-950e-b9c7f7e2e220 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:42:08.701472 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 669/1365] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Sep 13 19:42:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 19:42:09.005012 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71db1478-c7ad-4f09-8169-ae63a0f72612 None None] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:42:09.005432 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71db1478-c7ad-4f09-8169-ae63a0f72612 None None] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:42:09.005832 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71db1478-c7ad-4f09-8169-ae63a0f72612 None None] PATH_INFO: `/` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:42:09.007514 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 697/1366] 10.222.0.25 () {54 vars in 962 bytes} [Tue Sep 13 19:42:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:42:09.013570 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f18a2c-44fb-477b-92ba-d95b61eb4365 None None] REQUEST_METHOD: `POST` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:42:09.013856 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f18a2c-44fb-477b-92ba-d95b61eb4365 None None] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:42:09.014125 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f18a2c-44fb-477b-92ba-d95b61eb4365 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:42:09.095677 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.auth.core [None req-c8f18a2c-44fb-477b-92ba-d95b61eb4365 None None] MFA Rules not processed for user `d71fe5a8275f4ea98555afdcefc902a0`. Rule list: `[]` (Enabled: `True`). {{(pid=87935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:42:09.096905 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.fernet_utils [None req-c8f18a2c-44fb-477b-92ba-d95b61eb4365 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:42:09.134277 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG dbcounter [-] [87935] Writing DB stats keystone:SELECT=100 {{(pid=87935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:42:09.223584 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 670/1367] 10.222.0.25 () {58 vars in 1059 bytes} [Tue Sep 13 19:42:09 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 19:42:09.232103 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71db1478-c7ad-4f09-8169-ae63a0f72612 None None] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:42:09.233643 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.fernet_utils [None req-71db1478-c7ad-4f09-8169-ae63a0f72612 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:42:09.393189 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71db1478-c7ad-4f09-8169-ae63a0f72612 None None] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:42:09.417180 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG dbcounter [-] [87934] Writing DB stats keystone:SELECT=100 {{(pid=87934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:42:09.527540 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ef447d-aa91-4e36-8108-563664d5d6c2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd71fe5a8275f4ea98555afdcefc902a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a10a4268f3c4cb29f4e00c292e2df62', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:42:09.528250 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ef447d-aa91-4e36-8108-563664d5d6c2 service nova] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:42:09.528497 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ef447d-aa91-4e36-8108-563664d5d6c2 service nova] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:42:09.528694 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ef447d-aa91-4e36-8108-563664d5d6c2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:42:09.530319 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.fernet_utils [None req-54ef447d-aa91-4e36-8108-563664d5d6c2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:42:09.619154 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77e9e69-0e79-42ab-86de-cde497551937 None None] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:42:09.619691 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77e9e69-0e79-42ab-86de-cde497551937 None None] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:42:09.619819 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77e9e69-0e79-42ab-86de-cde497551937 None None] PATH_INFO: `/` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:42:09.621160 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 671/1368] 10.222.0.25 () {54 vars in 927 bytes} [Tue Sep 13 19:42:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 13 19:42:09.626277 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4de593-1a51-4605-a352-14023398eb10 None None] REQUEST_METHOD: `POST` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:42:09.626576 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4de593-1a51-4605-a352-14023398eb10 None None] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:42:09.626846 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4de593-1a51-4605-a352-14023398eb10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:42:09.637940 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ef447d-aa91-4e36-8108-563664d5d6c2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:42:09.639549 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ef447d-aa91-4e36-8108-563664d5d6c2 service nova] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:42:09.659511 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 698/1369] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Sep 13 19:42:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 428 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 19:42:09.714522 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.auth.core [None req-de4de593-1a51-4605-a352-14023398eb10 None None] MFA Rules not processed for user `7b0aed92d02344acb92a0e4aa67c3068`. Rule list: `[]` (Enabled: `True`). {{(pid=87935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:42:09.714522 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.fernet_utils [None req-de4de593-1a51-4605-a352-14023398eb10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:42:09.826819 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG dbcounter [-] [87935] Writing DB stats keystone:SELECT=100 {{(pid=87935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:42:09.838255 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 672/1370] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Sep 13 19:42:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 19:42:10.143552 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a623832-e304-4521-9b0d-26e64100260a None None] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:42:10.143837 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a623832-e304-4521-9b0d-26e64100260a None None] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:42:10.144122 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a623832-e304-4521-9b0d-26e64100260a None None] PATH_INFO: `/` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:42:10.145635 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 699/1371] 10.222.0.25 () {54 vars in 964 bytes} [Tue Sep 13 19:42:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:42:10.150830 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c621d69-3b45-4abc-ab3c-1f8e1148280b None None] REQUEST_METHOD: `POST` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:42:10.151192 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c621d69-3b45-4abc-ab3c-1f8e1148280b None None] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:42:10.151576 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c621d69-3b45-4abc-ab3c-1f8e1148280b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:42:10.235856 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.auth.core [None req-7c621d69-3b45-4abc-ab3c-1f8e1148280b None None] MFA Rules not processed for user `4cbb50c88b794a7f9f26844effde7d63`. Rule list: `[]` (Enabled: `True`). {{(pid=87935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:42:10.237190 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.fernet_utils [None req-7c621d69-3b45-4abc-ab3c-1f8e1148280b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:42:10.331628 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 673/1372] 10.222.0.25 () {58 vars in 1061 bytes} [Tue Sep 13 19:42:10 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 19:42:10.340039 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a623832-e304-4521-9b0d-26e64100260a None None] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:42:10.341586 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.fernet_utils [None req-7a623832-e304-4521-9b0d-26e64100260a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:42:10.376814 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG dbcounter [-] [87934] Writing DB stats keystone:SELECT=100 {{(pid=87934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:42:10.455913 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a623832-e304-4521-9b0d-26e64100260a None None] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:42:10.535324 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b610a6c-affe-4832-a386-6eee4b074c41 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cbb50c88b794a7f9f26844effde7d63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a10a4268f3c4cb29f4e00c292e2df62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:42:10.536012 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b610a6c-affe-4832-a386-6eee4b074c41 service cinder] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:42:10.536266 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b610a6c-affe-4832-a386-6eee4b074c41 service cinder] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:42:10.536571 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b610a6c-affe-4832-a386-6eee4b074c41 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:42:10.538099 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.fernet_utils [None req-2b610a6c-affe-4832-a386-6eee4b074c41 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:42:10.625019 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG dbcounter [-] [87934] Writing DB stats keystone:SELECT=100 {{(pid=87934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:42:10.664880 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b610a6c-affe-4832-a386-6eee4b074c41 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:42:10.666525 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b610a6c-affe-4832-a386-6eee4b074c41 service cinder] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:42:10.696535 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 700/1373] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Sep 13 19:42:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 354 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 19:42:12.026516 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecdb1b09-d18b-4f53-b505-278a7ef58419 None None] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:42:12.027093 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecdb1b09-d18b-4f53-b505-278a7ef58419 None None] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:42:12.027189 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecdb1b09-d18b-4f53-b505-278a7ef58419 None None] PATH_INFO: `/` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:42:12.028566 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 674/1374] 10.222.0.25 () {54 vars in 927 bytes} [Tue Sep 13 19:42:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:42:12.034039 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e8ec0c-d7bd-4421-b394-166347f0b6a9 None None] REQUEST_METHOD: `POST` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:42:12.034474 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e8ec0c-d7bd-4421-b394-166347f0b6a9 None None] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:42:12.034597 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e8ec0c-d7bd-4421-b394-166347f0b6a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:42:12.105240 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.auth.core [None req-09e8ec0c-d7bd-4421-b394-166347f0b6a9 None None] MFA Rules not processed for user `7b0aed92d02344acb92a0e4aa67c3068`. Rule list: `[]` (Enabled: `True`). {{(pid=87934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:42:12.106487 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.fernet_utils [None req-09e8ec0c-d7bd-4421-b394-166347f0b6a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:42:12.205347 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 701/1375] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Sep 13 19:42:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 19:42:12.499301 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecdb1b09-d18b-4f53-b505-278a7ef58419 None None] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:42:12.500853 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.fernet_utils [None req-ecdb1b09-d18b-4f53-b505-278a7ef58419 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:42:12.591226 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG dbcounter [-] [87935] Writing DB stats keystone:SELECT=100 {{(pid=87935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:42:12.661365 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecdb1b09-d18b-4f53-b505-278a7ef58419 None None] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:42:12.797503 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeeae750-9cc4-4526-8cbc-2140ad4474d0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd71fe5a8275f4ea98555afdcefc902a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a10a4268f3c4cb29f4e00c292e2df62', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:42:12.798113 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeeae750-9cc4-4526-8cbc-2140ad4474d0 service nova] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:42:12.798388 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeeae750-9cc4-4526-8cbc-2140ad4474d0 service nova] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:42:12.798652 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeeae750-9cc4-4526-8cbc-2140ad4474d0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:42:12.800264 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.fernet_utils [None req-aeeae750-9cc4-4526-8cbc-2140ad4474d0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:42:12.853949 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG dbcounter [-] [87935] Writing DB stats keystone:SELECT=100 {{(pid=87935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:42:12.901054 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeeae750-9cc4-4526-8cbc-2140ad4474d0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:42:12.902667 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeeae750-9cc4-4526-8cbc-2140ad4474d0 service nova] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:42:12.923338 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 675/1376] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Sep 13 19:42:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 424 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 19:42:15.233658 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf4d380-f115-4d70-a016-ccc8079170b0 None None] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:42:15.234317 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf4d380-f115-4d70-a016-ccc8079170b0 None None] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:42:15.234317 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf4d380-f115-4d70-a016-ccc8079170b0 None None] PATH_INFO: `/` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:42:15.235696 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 702/1377] 10.222.0.25 () {54 vars in 927 bytes} [Tue Sep 13 19:42:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:42:15.240672 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e61c3c-5e7d-41db-b5de-5ed19f0ad690 None None] REQUEST_METHOD: `POST` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:42:15.241099 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e61c3c-5e7d-41db-b5de-5ed19f0ad690 None None] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:42:15.241193 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e61c3c-5e7d-41db-b5de-5ed19f0ad690 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:42:15.320513 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.auth.core [None req-b1e61c3c-5e7d-41db-b5de-5ed19f0ad690 None None] MFA Rules not processed for user `7b0aed92d02344acb92a0e4aa67c3068`. Rule list: `[]` (Enabled: `True`). {{(pid=87935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:42:15.323033 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.fernet_utils [None req-b1e61c3c-5e7d-41db-b5de-5ed19f0ad690 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:42:15.431009 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 676/1378] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Sep 13 19:42:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 19:42:15.721811 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf4d380-f115-4d70-a016-ccc8079170b0 None None] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:42:15.723555 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.fernet_utils [None req-ccf4d380-f115-4d70-a016-ccc8079170b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:42:15.764056 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG dbcounter [-] [87934] Writing DB stats keystone:SELECT=100 {{(pid=87934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:42:15.877275 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf4d380-f115-4d70-a016-ccc8079170b0 None None] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:42:15.993573 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG dbcounter [-] [87934] Writing DB stats keystone:SELECT=100 {{(pid=87934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:42:15.999296 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f857dbdf-b764-4489-9e82-b524e442e819 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd71fe5a8275f4ea98555afdcefc902a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a10a4268f3c4cb29f4e00c292e2df62', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:42:16.000424 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f857dbdf-b764-4489-9e82-b524e442e819 service nova] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:42:16.001144 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f857dbdf-b764-4489-9e82-b524e442e819 service nova] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:42:16.001417 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f857dbdf-b764-4489-9e82-b524e442e819 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:42:16.003447 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.fernet_utils [None req-f857dbdf-b764-4489-9e82-b524e442e819 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:42:16.103305 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f857dbdf-b764-4489-9e82-b524e442e819 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:42:16.104941 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f857dbdf-b764-4489-9e82-b524e442e819 service nova] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:42:16.125332 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 703/1379] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Sep 13 19:42:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 404 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 19:42:18.343457 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde4e936-84df-4f53-b0cb-90a5d2af72fc None None] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:42:18.343958 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde4e936-84df-4f53-b0cb-90a5d2af72fc None None] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:42:18.343958 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde4e936-84df-4f53-b0cb-90a5d2af72fc None None] PATH_INFO: `/` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:42:18.345344 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 677/1380] 10.222.0.25 () {54 vars in 927 bytes} [Tue Sep 13 19:42:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:42:18.350737 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b849cc1-d369-47ef-9774-94bad9024755 None None] REQUEST_METHOD: `POST` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:42:18.351188 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b849cc1-d369-47ef-9774-94bad9024755 None None] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:42:18.351288 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b849cc1-d369-47ef-9774-94bad9024755 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:42:18.421072 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.auth.core [None req-4b849cc1-d369-47ef-9774-94bad9024755 None None] MFA Rules not processed for user `7b0aed92d02344acb92a0e4aa67c3068`. Rule list: `[]` (Enabled: `True`). {{(pid=87934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:42:18.422265 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.fernet_utils [None req-4b849cc1-d369-47ef-9774-94bad9024755 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:42:18.488752 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG dbcounter [-] [87934] Writing DB stats keystone:SELECT=100 {{(pid=87934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:42:18.525385 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 704/1381] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Sep 13 19:42:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 19:42:18.827370 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde4e936-84df-4f53-b0cb-90a5d2af72fc None None] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:42:18.828930 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.fernet_utils [None req-cde4e936-84df-4f53-b0cb-90a5d2af72fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:42:18.859175 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG dbcounter [-] [87935] Writing DB stats keystone:SELECT=100 {{(pid=87935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:42:19.015273 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde4e936-84df-4f53-b0cb-90a5d2af72fc None None] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:42:19.127181 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG dbcounter [-] [87935] Writing DB stats keystone:SELECT=100 {{(pid=87935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:42:19.145119 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135ec9e7-c484-4c25-9695-b4232bd8e6d1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd71fe5a8275f4ea98555afdcefc902a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a10a4268f3c4cb29f4e00c292e2df62', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:42:19.145842 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135ec9e7-c484-4c25-9695-b4232bd8e6d1 service nova] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:42:19.146169 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135ec9e7-c484-4c25-9695-b4232bd8e6d1 service nova] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:42:19.146408 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135ec9e7-c484-4c25-9695-b4232bd8e6d1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:42:19.148055 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.fernet_utils [None req-135ec9e7-c484-4c25-9695-b4232bd8e6d1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:42:19.253231 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-135ec9e7-c484-4c25-9695-b4232bd8e6d1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:42:19.254880 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-135ec9e7-c484-4c25-9695-b4232bd8e6d1 service nova] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:42:19.275168 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 678/1382] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Sep 13 19:42:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 448 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 19:42:22.056137 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3795200-e142-4786-a888-3534058dc4da None None] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:42:22.056697 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3795200-e142-4786-a888-3534058dc4da None None] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:42:22.056925 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3795200-e142-4786-a888-3534058dc4da None None] PATH_INFO: `/` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:42:22.058805 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 705/1383] 10.222.0.25 () {54 vars in 927 bytes} [Tue Sep 13 19:42:22 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:42:22.064869 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825719ab-db3c-402c-a273-fa143ab05c20 None None] REQUEST_METHOD: `POST` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:42:22.065379 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825719ab-db3c-402c-a273-fa143ab05c20 None None] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:42:22.065546 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825719ab-db3c-402c-a273-fa143ab05c20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:42:22.135767 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.auth.core [None req-825719ab-db3c-402c-a273-fa143ab05c20 None None] MFA Rules not processed for user `7b0aed92d02344acb92a0e4aa67c3068`. Rule list: `[]` (Enabled: `True`). {{(pid=87935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:42:22.137012 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.fernet_utils [None req-825719ab-db3c-402c-a273-fa143ab05c20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:42:22.202412 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG dbcounter [-] [87935] Writing DB stats keystone:SELECT=100 {{(pid=87935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:42:22.253757 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 679/1384] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Sep 13 19:42:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 19:42:22.542857 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3795200-e142-4786-a888-3534058dc4da None None] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:42:22.544524 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.fernet_utils [None req-d3795200-e142-4786-a888-3534058dc4da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:42:22.705563 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3795200-e142-4786-a888-3534058dc4da None None] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:42:22.762097 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG dbcounter [-] [87934] Writing DB stats keystone:SELECT=100 {{(pid=87934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:42:22.824000 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9206a68-ea4e-4488-ac03-1e2814757efb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd71fe5a8275f4ea98555afdcefc902a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a10a4268f3c4cb29f4e00c292e2df62', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:42:22.824552 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9206a68-ea4e-4488-ac03-1e2814757efb service nova] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:42:22.824847 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9206a68-ea4e-4488-ac03-1e2814757efb service nova] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:42:22.825119 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9206a68-ea4e-4488-ac03-1e2814757efb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:42:22.826774 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.fernet_utils [None req-f9206a68-ea4e-4488-ac03-1e2814757efb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:42:22.922057 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9206a68-ea4e-4488-ac03-1e2814757efb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:42:22.924085 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9206a68-ea4e-4488-ac03-1e2814757efb service nova] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:42:22.946880 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 706/1385] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Sep 13 19:42:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 404 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 19:42:25.223873 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2cdb15f-a055-4f5e-a373-20c098641472 None None] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:42:25.224563 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2cdb15f-a055-4f5e-a373-20c098641472 None None] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:42:25.224563 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2cdb15f-a055-4f5e-a373-20c098641472 None None] PATH_INFO: `/` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:42:25.225810 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 680/1386] 10.222.0.25 () {54 vars in 927 bytes} [Tue Sep 13 19:42:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:42:25.231321 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6325fa16-bb89-45e0-86b4-81f1bb9c7717 None None] REQUEST_METHOD: `POST` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:42:25.231788 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6325fa16-bb89-45e0-86b4-81f1bb9c7717 None None] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:42:25.231911 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6325fa16-bb89-45e0-86b4-81f1bb9c7717 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:42:25.299226 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.auth.core [None req-6325fa16-bb89-45e0-86b4-81f1bb9c7717 None None] MFA Rules not processed for user `7b0aed92d02344acb92a0e4aa67c3068`. Rule list: `[]` (Enabled: `True`). {{(pid=87934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:42:25.300462 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.fernet_utils [None req-6325fa16-bb89-45e0-86b4-81f1bb9c7717 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:42:25.308976 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG dbcounter [-] [87934] Writing DB stats keystone:SELECT=100 {{(pid=87934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:42:25.402423 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 707/1387] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Sep 13 19:42:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 19:42:25.692194 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2cdb15f-a055-4f5e-a373-20c098641472 None None] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:42:25.693740 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.fernet_utils [None req-e2cdb15f-a055-4f5e-a373-20c098641472 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:42:25.846704 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2cdb15f-a055-4f5e-a373-20c098641472 None None] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:42:25.894961 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG dbcounter [-] [87935] Writing DB stats keystone:SELECT=100 {{(pid=87935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:42:25.966134 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bebbe73-9cbf-4779-8762-4fe653577235 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd71fe5a8275f4ea98555afdcefc902a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a10a4268f3c4cb29f4e00c292e2df62', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:42:25.966730 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bebbe73-9cbf-4779-8762-4fe653577235 service nova] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:42:25.967005 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bebbe73-9cbf-4779-8762-4fe653577235 service nova] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:42:25.967267 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bebbe73-9cbf-4779-8762-4fe653577235 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:42:25.968883 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.fernet_utils [None req-5bebbe73-9cbf-4779-8762-4fe653577235 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:42:26.063293 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bebbe73-9cbf-4779-8762-4fe653577235 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:42:26.065128 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bebbe73-9cbf-4779-8762-4fe653577235 service nova] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:42:26.083982 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 681/1388] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Sep 13 19:42:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 392 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 19:42:26.404776 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c79ca9-2e10-4b16-b8e4-76234f631666 None None] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:42:26.405308 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c79ca9-2e10-4b16-b8e4-76234f631666 None None] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:42:26.405308 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c79ca9-2e10-4b16-b8e4-76234f631666 None None] PATH_INFO: `/` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:42:26.406714 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 708/1389] 10.222.0.25 () {54 vars in 927 bytes} [Tue Sep 13 19:42:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:42:26.412103 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b6ae9c-c88f-4a22-a6eb-d30ce41b79e0 None None] REQUEST_METHOD: `POST` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:42:26.412540 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b6ae9c-c88f-4a22-a6eb-d30ce41b79e0 None None] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:42:26.412832 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b6ae9c-c88f-4a22-a6eb-d30ce41b79e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:42:26.480306 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG dbcounter [-] [87935] Writing DB stats keystone:SELECT=100 {{(pid=87935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:42:26.482984 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.auth.core [None req-e0b6ae9c-c88f-4a22-a6eb-d30ce41b79e0 None None] MFA Rules not processed for user `7b0aed92d02344acb92a0e4aa67c3068`. Rule list: `[]` (Enabled: `True`). {{(pid=87935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:42:26.484724 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.fernet_utils [None req-e0b6ae9c-c88f-4a22-a6eb-d30ce41b79e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:42:26.580938 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 682/1390] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Sep 13 19:42:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 19:42:26.896604 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeeb10f1-b5e8-47b2-8014-dfa70d508af8 None None] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:42:26.896915 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeeb10f1-b5e8-47b2-8014-dfa70d508af8 None None] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:42:26.897322 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeeb10f1-b5e8-47b2-8014-dfa70d508af8 None None] PATH_INFO: `/` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:42:26.899394 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 709/1391] 10.222.0.25 () {54 vars in 966 bytes} [Tue Sep 13 19:42:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:42:26.905304 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a28de45-3f05-43d6-9b6b-1899aa0caef1 None None] REQUEST_METHOD: `POST` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:42:26.905611 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a28de45-3f05-43d6-9b6b-1899aa0caef1 None None] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:42:26.905890 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a28de45-3f05-43d6-9b6b-1899aa0caef1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:42:26.996482 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.auth.core [None req-5a28de45-3f05-43d6-9b6b-1899aa0caef1 None None] MFA Rules not processed for user `907d44d3b6944ccb83999d8e489871d4`. Rule list: `[]` (Enabled: `True`). {{(pid=87935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:42:26.998145 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.fernet_utils [None req-5a28de45-3f05-43d6-9b6b-1899aa0caef1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:42:27.077412 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG dbcounter [-] [87935] Writing DB stats keystone:SELECT=100 {{(pid=87935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:42:27.088406 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 683/1392] 10.222.0.25 () {58 vars in 1063 bytes} [Tue Sep 13 19:42:26 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 19:42:27.094869 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeeb10f1-b5e8-47b2-8014-dfa70d508af8 None None] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:42:27.096419 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.fernet_utils [None req-eeeb10f1-b5e8-47b2-8014-dfa70d508af8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:42:27.206509 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeeb10f1-b5e8-47b2-8014-dfa70d508af8 None None] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:42:27.244919 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG dbcounter [-] [87934] Writing DB stats keystone:SELECT=100 {{(pid=87934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:42:27.283677 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f78b51-48c6-4285-8557-29fd6b470ce4 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '907d44d3b6944ccb83999d8e489871d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a10a4268f3c4cb29f4e00c292e2df62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:42:27.284306 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f78b51-48c6-4285-8557-29fd6b470ce4 service glance] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:42:27.284583 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f78b51-48c6-4285-8557-29fd6b470ce4 service glance] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:42:27.284849 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f78b51-48c6-4285-8557-29fd6b470ce4 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:42:27.286407 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.fernet_utils [None req-f4f78b51-48c6-4285-8557-29fd6b470ce4 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:42:27.407387 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f78b51-48c6-4285-8557-29fd6b470ce4 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:42:27.408854 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f78b51-48c6-4285-8557-29fd6b470ce4 service glance] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:42:27.426486 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 710/1393] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Sep 13 19:42:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 13 19:42:28.166645 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3dda4c3-e605-4a36-b119-8f4e89f6ce7c None None] REQUEST_METHOD: `POST` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:42:28.167164 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3dda4c3-e605-4a36-b119-8f4e89f6ce7c None None] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:42:28.167164 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3dda4c3-e605-4a36-b119-8f4e89f6ce7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:42:28.244280 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.auth.core [None req-b3dda4c3-e605-4a36-b119-8f4e89f6ce7c None None] MFA Rules not processed for user `d44977a3225e43f19cdc4a84f0e170cd`. Rule list: `[]` (Enabled: `True`). {{(pid=87935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:42:28.245483 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.fernet_utils [None req-b3dda4c3-e605-4a36-b119-8f4e89f6ce7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:42:28.318265 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef8fa53-7609-45d2-9a96-fb4606444c84 None None] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:42:28.318548 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef8fa53-7609-45d2-9a96-fb4606444c84 None None] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:42:28.318823 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef8fa53-7609-45d2-9a96-fb4606444c84 None None] PATH_INFO: `/` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:42:28.320289 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 711/1394] 10.222.0.25 () {54 vars in 927 bytes} [Tue Sep 13 19:42:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 13 19:42:28.325335 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21671889-ca20-41ee-9406-4b0b7d1cddc3 None None] REQUEST_METHOD: `POST` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:42:28.325619 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21671889-ca20-41ee-9406-4b0b7d1cddc3 None None] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:42:28.325892 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21671889-ca20-41ee-9406-4b0b7d1cddc3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:42:28.336511 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 684/1395] 10.222.0.25 () {58 vars in 1009 bytes} [Tue Sep 13 19:42:28 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 19:42:28.381887 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2225296-7f36-4e65-8589-8f1210cc99ae None None] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:42:28.382174 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2225296-7f36-4e65-8589-8f1210cc99ae None None] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:42:28.382445 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2225296-7f36-4e65-8589-8f1210cc99ae None None] PATH_INFO: `/` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:42:28.384569 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 685/1396] 10.222.0.25 () {54 vars in 943 bytes} [Tue Sep 13 19:42:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 13 19:42:28.391087 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6a8783-b470-4105-9171-3a77e174d8c5 None None] REQUEST_METHOD: `POST` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:42:28.391453 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6a8783-b470-4105-9171-3a77e174d8c5 None None] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:42:28.391793 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6a8783-b470-4105-9171-3a77e174d8c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:42:28.396485 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.auth.core [None req-21671889-ca20-41ee-9406-4b0b7d1cddc3 None None] MFA Rules not processed for user `7b0aed92d02344acb92a0e4aa67c3068`. Rule list: `[]` (Enabled: `True`). {{(pid=87934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:42:28.397700 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.fernet_utils [None req-21671889-ca20-41ee-9406-4b0b7d1cddc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:42:28.417361 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG dbcounter [-] [87934] Writing DB stats keystone:SELECT=100 {{(pid=87934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:42:28.473363 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.auth.core [None req-7b6a8783-b470-4105-9171-3a77e174d8c5 None None] MFA Rules not processed for user `fb42d6ac6cdd4d97a80c3ee0c6f8e3f5`. Rule list: `[]` (Enabled: `True`). {{(pid=87935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:42:28.474573 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.fernet_utils [None req-7b6a8783-b470-4105-9171-3a77e174d8c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:42:28.500779 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 712/1397] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Sep 13 19:42:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 19:42:28.502335 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG dbcounter [-] [87935] Writing DB stats keystone:SELECT=100 {{(pid=87935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:42:28.588964 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 686/1398] 10.222.0.25 () {58 vars in 1040 bytes} [Tue Sep 13 19:42:28 2022] POST /identity/v3/auth/tokens => generated 3304 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 19:42:28.599079 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21671889-ca20-41ee-9406-4b0b7d1cddc3 None None] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:42:28.600315 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.fernet_utils [None req-21671889-ca20-41ee-9406-4b0b7d1cddc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:42:28.706251 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21671889-ca20-41ee-9406-4b0b7d1cddc3 None None] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:42:28.759678 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG dbcounter [-] [87934] Writing DB stats keystone:SELECT=100 {{(pid=87934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:42:28.795042 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6a8783-b470-4105-9171-3a77e174d8c5 None None] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:42:28.796517 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.fernet_utils [None req-7b6a8783-b470-4105-9171-3a77e174d8c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:42:28.829092 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dfb95a2-725b-42d1-ba44-3965e0e1d597 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb42d6ac6cdd4d97a80c3ee0c6f8e3f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a10a4268f3c4cb29f4e00c292e2df62', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:42:28.829699 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfb95a2-725b-42d1-ba44-3965e0e1d597 service swift] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:42:28.829969 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfb95a2-725b-42d1-ba44-3965e0e1d597 service swift] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:42:28.830232 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfb95a2-725b-42d1-ba44-3965e0e1d597 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:42:28.832098 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.fernet_utils [None req-0dfb95a2-725b-42d1-ba44-3965e0e1d597 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:42:28.900671 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6a8783-b470-4105-9171-3a77e174d8c5 None None] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:42:28.916414 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dfb95a2-725b-42d1-ba44-3965e0e1d597 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:42:28.918011 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dfb95a2-725b-42d1-ba44-3965e0e1d597 service swift] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:42:28.926256 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 713/1399] 10.222.0.25 () {60 vars in 1384 bytes} [Tue Sep 13 19:42:28 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 13 19:42:28.954145 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG dbcounter [-] [87935] Writing DB stats keystone:SELECT=100 {{(pid=87935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:42:29.029231 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4278b5-4669-432e-bb56-aca635c91b72 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd71fe5a8275f4ea98555afdcefc902a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a10a4268f3c4cb29f4e00c292e2df62', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:42:29.029844 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4278b5-4669-432e-bb56-aca635c91b72 service nova] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:42:29.030209 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4278b5-4669-432e-bb56-aca635c91b72 service nova] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:42:29.030387 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4278b5-4669-432e-bb56-aca635c91b72 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:42:29.031949 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.fernet_utils [None req-5e4278b5-4669-432e-bb56-aca635c91b72 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:42:29.137235 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e4278b5-4669-432e-bb56-aca635c91b72 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:42:29.139020 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e4278b5-4669-432e-bb56-aca635c91b72 service nova] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:42:29.158212 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 687/1400] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Sep 13 19:42:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 364 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 13 19:42:31.475547 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fffc5c-dc9c-446e-af91-232e6c75b250 None None] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:42:31.476073 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fffc5c-dc9c-446e-af91-232e6c75b250 None None] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:42:31.476073 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fffc5c-dc9c-446e-af91-232e6c75b250 None None] PATH_INFO: `/` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:42:31.478451 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 714/1401] 10.222.0.25 () {54 vars in 927 bytes} [Tue Sep 13 19:42:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:42:31.483810 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93ddcad-fde6-4075-85bf-64ba1f52409b None None] REQUEST_METHOD: `POST` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:42:31.484300 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93ddcad-fde6-4075-85bf-64ba1f52409b None None] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:42:31.484427 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93ddcad-fde6-4075-85bf-64ba1f52409b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:42:31.563598 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.auth.core [None req-e93ddcad-fde6-4075-85bf-64ba1f52409b None None] MFA Rules not processed for user `7b0aed92d02344acb92a0e4aa67c3068`. Rule list: `[]` (Enabled: `True`). {{(pid=87935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:42:31.564774 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.fernet_utils [None req-e93ddcad-fde6-4075-85bf-64ba1f52409b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:42:31.567672 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG dbcounter [-] [87935] Writing DB stats keystone:SELECT=100 {{(pid=87935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:42:31.681625 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 688/1402] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Sep 13 19:42:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 19:42:31.974642 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23fffc5c-dc9c-446e-af91-232e6c75b250 None None] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:42:31.976232 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.fernet_utils [None req-23fffc5c-dc9c-446e-af91-232e6c75b250 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:42:32.067921 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG dbcounter [-] [87934] Writing DB stats keystone:SELECT=100 {{(pid=87934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:42:32.150450 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23fffc5c-dc9c-446e-af91-232e6c75b250 None None] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:42:32.281468 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8162946-c299-4a75-ac3b-c3c642b03714 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd71fe5a8275f4ea98555afdcefc902a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a10a4268f3c4cb29f4e00c292e2df62', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:42:32.282183 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8162946-c299-4a75-ac3b-c3c642b03714 service nova] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:42:32.282460 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8162946-c299-4a75-ac3b-c3c642b03714 service nova] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:42:32.282730 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8162946-c299-4a75-ac3b-c3c642b03714 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:42:32.284425 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.fernet_utils [None req-b8162946-c299-4a75-ac3b-c3c642b03714 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:42:32.340591 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG dbcounter [-] [87934] Writing DB stats keystone:SELECT=100 {{(pid=87934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:42:32.400651 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8162946-c299-4a75-ac3b-c3c642b03714 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:42:32.402263 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8162946-c299-4a75-ac3b-c3c642b03714 service nova] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:42:32.421536 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 715/1403] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Sep 13 19:42:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 447 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 19:42:34.690108 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b677ae56-7c8b-49bc-9bd0-50e862e75126 None None] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:42:34.690663 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b677ae56-7c8b-49bc-9bd0-50e862e75126 None None] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:42:34.690663 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b677ae56-7c8b-49bc-9bd0-50e862e75126 None None] PATH_INFO: `/` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:42:34.691891 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 689/1404] 10.222.0.25 () {54 vars in 927 bytes} [Tue Sep 13 19:42:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:42:34.697449 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d00611-3a84-4a20-a3b8-268ae4bb9ca4 None None] REQUEST_METHOD: `POST` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:42:34.697934 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d00611-3a84-4a20-a3b8-268ae4bb9ca4 None None] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:42:34.698044 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d00611-3a84-4a20-a3b8-268ae4bb9ca4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:42:34.775870 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.auth.core [None req-06d00611-3a84-4a20-a3b8-268ae4bb9ca4 None None] MFA Rules not processed for user `7b0aed92d02344acb92a0e4aa67c3068`. Rule list: `[]` (Enabled: `True`). {{(pid=87934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:42:34.777198 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.fernet_utils [None req-06d00611-3a84-4a20-a3b8-268ae4bb9ca4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:42:34.888371 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 716/1405] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Sep 13 19:42:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 19:42:35.173956 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b677ae56-7c8b-49bc-9bd0-50e862e75126 None None] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:42:35.175506 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.fernet_utils [None req-b677ae56-7c8b-49bc-9bd0-50e862e75126 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:42:35.333013 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG dbcounter [-] [87935] Writing DB stats keystone:SELECT=100 {{(pid=87935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:42:35.345808 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b677ae56-7c8b-49bc-9bd0-50e862e75126 None None] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:42:35.474291 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92f2ab7-38ae-47d0-9ab8-1544bb56ed4f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd71fe5a8275f4ea98555afdcefc902a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a10a4268f3c4cb29f4e00c292e2df62', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:42:35.474920 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92f2ab7-38ae-47d0-9ab8-1544bb56ed4f service nova] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:42:35.475222 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92f2ab7-38ae-47d0-9ab8-1544bb56ed4f service nova] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:42:35.475482 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92f2ab7-38ae-47d0-9ab8-1544bb56ed4f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:42:35.477164 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.fernet_utils [None req-f92f2ab7-38ae-47d0-9ab8-1544bb56ed4f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:42:35.571820 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f92f2ab7-38ae-47d0-9ab8-1544bb56ed4f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:42:35.573580 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f92f2ab7-38ae-47d0-9ab8-1544bb56ed4f service nova] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:42:35.583368 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG dbcounter [-] [87935] Writing DB stats keystone:SELECT=100 {{(pid=87935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:42:35.594983 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 690/1406] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Sep 13 19:42:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 422 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 19:42:37.872275 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0082b72f-5212-473e-b537-eafc13b29dbc None None] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:42:37.872822 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0082b72f-5212-473e-b537-eafc13b29dbc None None] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:42:37.872822 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0082b72f-5212-473e-b537-eafc13b29dbc None None] PATH_INFO: `/` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:42:37.874224 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 717/1407] 10.222.0.25 () {54 vars in 927 bytes} [Tue Sep 13 19:42:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:42:37.879406 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c664793-6b9d-4f07-9896-9413721a3558 None None] REQUEST_METHOD: `POST` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:42:37.879851 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c664793-6b9d-4f07-9896-9413721a3558 None None] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:42:37.879944 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c664793-6b9d-4f07-9896-9413721a3558 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:42:37.955885 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.auth.core [None req-4c664793-6b9d-4f07-9896-9413721a3558 None None] MFA Rules not processed for user `7b0aed92d02344acb92a0e4aa67c3068`. Rule list: `[]` (Enabled: `True`). {{(pid=87935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:42:37.957560 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.fernet_utils [None req-4c664793-6b9d-4f07-9896-9413721a3558 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:42:38.078832 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 691/1408] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Sep 13 19:42:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 19:42:38.370648 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0082b72f-5212-473e-b537-eafc13b29dbc None None] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:42:38.372172 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.fernet_utils [None req-0082b72f-5212-473e-b537-eafc13b29dbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:42:38.395987 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG dbcounter [-] [87934] Writing DB stats keystone:SELECT=100 {{(pid=87934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:42:38.535913 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0082b72f-5212-473e-b537-eafc13b29dbc None None] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:42:38.636387 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG dbcounter [-] [87934] Writing DB stats keystone:SELECT=100 {{(pid=87934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:42:38.662750 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b06454-a86b-4c4e-940f-f8da3332fc80 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd71fe5a8275f4ea98555afdcefc902a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a10a4268f3c4cb29f4e00c292e2df62', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:42:38.663406 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b06454-a86b-4c4e-940f-f8da3332fc80 service nova] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:42:38.663755 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b06454-a86b-4c4e-940f-f8da3332fc80 service nova] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:42:38.664085 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b06454-a86b-4c4e-940f-f8da3332fc80 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:42:38.665782 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.fernet_utils [None req-d8b06454-a86b-4c4e-940f-f8da3332fc80 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:42:38.767895 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b06454-a86b-4c4e-940f-f8da3332fc80 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:42:38.769548 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b06454-a86b-4c4e-940f-f8da3332fc80 service nova] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:42:38.790155 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 718/1409] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Sep 13 19:42:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 420 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 19:42:48.069976 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG dbcounter [-] [87935] Writing DB stats keystone:SELECT=68 {{(pid=87935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:42:48.787403 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG dbcounter [-] [87934] Writing DB stats keystone:SELECT=54 {{(pid=87934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:42:51.647958 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979fda0b-35f0-4be9-b01c-6b3b2486f934 None None] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:42:51.648539 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979fda0b-35f0-4be9-b01c-6b3b2486f934 None None] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:42:51.648539 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979fda0b-35f0-4be9-b01c-6b3b2486f934 None None] PATH_INFO: `/` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:42:51.649907 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 692/1410] 10.222.0.25 () {54 vars in 918 bytes} [Tue Sep 13 19:42:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:42:51.655036 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a261d51-47f9-4ac8-8bea-f01f662a552f None None] REQUEST_METHOD: `POST` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:42:51.655437 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a261d51-47f9-4ac8-8bea-f01f662a552f None None] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:42:51.655585 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a261d51-47f9-4ac8-8bea-f01f662a552f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:42:51.731136 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.auth.core [None req-9a261d51-47f9-4ac8-8bea-f01f662a552f None None] MFA Rules not processed for user `02eb3d3173c1476cb83a72add0e878e2`. Rule list: `[]` (Enabled: `True`). {{(pid=87934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:42:51.732353 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.fernet_utils [None req-9a261d51-47f9-4ac8-8bea-f01f662a552f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:42:51.837195 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 719/1411] 10.222.0.25 () {58 vars in 1015 bytes} [Tue Sep 13 19:42:51 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 19:42:51.851237 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ddfe35-cf57-4201-b559-b4cb73b890ce None None] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:42:51.851541 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ddfe35-cf57-4201-b559-b4cb73b890ce None None] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:42:51.851814 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ddfe35-cf57-4201-b559-b4cb73b890ce None None] PATH_INFO: `/` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:42:51.853219 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 693/1412] 10.222.0.25 () {54 vars in 918 bytes} [Tue Sep 13 19:42:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:42:51.857969 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89287967-103c-4587-af20-a180bdf3a21e None None] REQUEST_METHOD: `POST` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:42:51.858268 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89287967-103c-4587-af20-a180bdf3a21e None None] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:42:51.858535 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89287967-103c-4587-af20-a180bdf3a21e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:42:51.930855 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG dbcounter [-] [87934] Writing DB stats keystone:SELECT=100 {{(pid=87934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:42:51.933910 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.auth.core [None req-89287967-103c-4587-af20-a180bdf3a21e None None] MFA Rules not processed for user `d71fe5a8275f4ea98555afdcefc902a0`. Rule list: `[]` (Enabled: `True`). {{(pid=87934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:42:51.935638 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.fernet_utils [None req-89287967-103c-4587-af20-a180bdf3a21e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:42:52.049794 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 720/1413] 10.222.0.25 () {58 vars in 1015 bytes} [Tue Sep 13 19:42:51 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 19:42:54.622773 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d282750e-c916-4b46-aa7c-389eed2b2ac3 None None] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:42:54.623313 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d282750e-c916-4b46-aa7c-389eed2b2ac3 None None] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:42:54.623313 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d282750e-c916-4b46-aa7c-389eed2b2ac3 None None] PATH_INFO: `/` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:42:54.624631 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 694/1414] 127.0.0.1 () {54 vars in 917 bytes} [Tue Sep 13 19:42:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:42:54.629813 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6b9178-e9e3-488d-b30b-50542029d048 None None] REQUEST_METHOD: `POST` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:42:54.630236 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6b9178-e9e3-488d-b30b-50542029d048 None None] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:42:54.630389 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6b9178-e9e3-488d-b30b-50542029d048 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:42:54.697459 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.auth.core [None req-6b6b9178-e9e3-488d-b30b-50542029d048 None None] MFA Rules not processed for user `7b0aed92d02344acb92a0e4aa67c3068`. Rule list: `[]` (Enabled: `True`). {{(pid=87934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:42:54.698673 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.fernet_utils [None req-6b6b9178-e9e3-488d-b30b-50542029d048 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:42:54.753285 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG dbcounter [-] [87934] Writing DB stats keystone:SELECT=100 {{(pid=87934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:42:54.794527 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 721/1415] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Sep 13 19:42:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 19:42:55.084590 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d282750e-c916-4b46-aa7c-389eed2b2ac3 None None] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:42:55.086778 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.fernet_utils [None req-d282750e-c916-4b46-aa7c-389eed2b2ac3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:42:55.234178 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d282750e-c916-4b46-aa7c-389eed2b2ac3 None None] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:42:55.306099 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG dbcounter [-] [87935] Writing DB stats keystone:SELECT=100 {{(pid=87935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:42:55.347288 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a97bb8b-7108-441d-913b-71516d699a8b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd71fe5a8275f4ea98555afdcefc902a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a10a4268f3c4cb29f4e00c292e2df62', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:42:55.347806 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a97bb8b-7108-441d-913b-71516d699a8b service nova] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:42:55.348078 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a97bb8b-7108-441d-913b-71516d699a8b service nova] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:42:55.348438 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a97bb8b-7108-441d-913b-71516d699a8b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:42:55.350026 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.fernet_utils [None req-4a97bb8b-7108-441d-913b-71516d699a8b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:42:55.437916 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a97bb8b-7108-441d-913b-71516d699a8b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:42:55.439488 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a97bb8b-7108-441d-913b-71516d699a8b service nova] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:42:55.457937 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 695/1416] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Sep 13 19:42:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 19:42:56.608441 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4831ce5-8c11-4962-a973-86f498e983b1 None None] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:42:56.608963 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4831ce5-8c11-4962-a973-86f498e983b1 None None] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:42:56.608963 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4831ce5-8c11-4962-a973-86f498e983b1 None None] PATH_INFO: `/` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:42:56.610240 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 722/1417] 127.0.0.1 () {54 vars in 901 bytes} [Tue Sep 13 19:42:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 13 19:42:56.616659 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bd7c30-6aa0-409c-8f19-615d29992cc6 None None] REQUEST_METHOD: `POST` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:42:56.617215 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bd7c30-6aa0-409c-8f19-615d29992cc6 None None] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:42:56.617323 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bd7c30-6aa0-409c-8f19-615d29992cc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:42:56.692916 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.auth.core [None req-59bd7c30-6aa0-409c-8f19-615d29992cc6 None None] MFA Rules not processed for user `7b0aed92d02344acb92a0e4aa67c3068`. Rule list: `[]` (Enabled: `True`). {{(pid=87935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:42:56.694691 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.fernet_utils [None req-59bd7c30-6aa0-409c-8f19-615d29992cc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:42:56.721999 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG dbcounter [-] [87935] Writing DB stats keystone:SELECT=100 {{(pid=87935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:42:56.793366 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 696/1418] 127.0.0.1 () {58 vars in 998 bytes} [Tue Sep 13 19:42:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 19:42:56.943924 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4831ce5-8c11-4962-a973-86f498e983b1 None None] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:42:56.946081 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.fernet_utils [None req-b4831ce5-8c11-4962-a973-86f498e983b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:42:57.093188 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4831ce5-8c11-4962-a973-86f498e983b1 None None] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:42:57.134608 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG dbcounter [-] [87934] Writing DB stats keystone:SELECT=100 {{(pid=87934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:42:57.208101 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eceba40-d925-4f83-9ab3-91bc6c1c6ff9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd71fe5a8275f4ea98555afdcefc902a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a10a4268f3c4cb29f4e00c292e2df62', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:42:57.208659 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eceba40-d925-4f83-9ab3-91bc6c1c6ff9 service nova] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:42:57.208936 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eceba40-d925-4f83-9ab3-91bc6c1c6ff9 service nova] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:42:57.209205 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eceba40-d925-4f83-9ab3-91bc6c1c6ff9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:42:57.211018 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.fernet_utils [None req-7eceba40-d925-4f83-9ab3-91bc6c1c6ff9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:42:57.299872 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eceba40-d925-4f83-9ab3-91bc6c1c6ff9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:42:57.301527 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eceba40-d925-4f83-9ab3-91bc6c1c6ff9 service nova] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:42:57.320593 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 723/1419] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Sep 13 19:42:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 19:42:58.460390 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31500dd3-40cd-4454-97b8-015cfc72e6b7 None None] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:42:58.460966 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31500dd3-40cd-4454-97b8-015cfc72e6b7 None None] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:42:58.460966 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31500dd3-40cd-4454-97b8-015cfc72e6b7 None None] PATH_INFO: `/` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:42:58.462298 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 697/1420] 127.0.0.1 () {54 vars in 901 bytes} [Tue Sep 13 19:42:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:42:58.468782 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac018c3-7bb4-433d-b588-e8c978454538 None None] REQUEST_METHOD: `POST` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:42:58.469216 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac018c3-7bb4-433d-b588-e8c978454538 None None] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:42:58.469332 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac018c3-7bb4-433d-b588-e8c978454538 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:42:58.525443 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG dbcounter [-] [87934] Writing DB stats keystone:SELECT=100 {{(pid=87934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:42:58.547828 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.auth.core [None req-dac018c3-7bb4-433d-b588-e8c978454538 None None] MFA Rules not processed for user `7b0aed92d02344acb92a0e4aa67c3068`. Rule list: `[]` (Enabled: `True`). {{(pid=87934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:42:58.549083 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.fernet_utils [None req-dac018c3-7bb4-433d-b588-e8c978454538 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:42:58.648377 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 724/1421] 127.0.0.1 () {58 vars in 998 bytes} [Tue Sep 13 19:42:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 19:42:58.801721 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31500dd3-40cd-4454-97b8-015cfc72e6b7 None None] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:42:58.803161 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.fernet_utils [None req-31500dd3-40cd-4454-97b8-015cfc72e6b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:42:58.950492 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31500dd3-40cd-4454-97b8-015cfc72e6b7 None None] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:42:58.967151 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG dbcounter [-] [87935] Writing DB stats keystone:SELECT=100 {{(pid=87935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:42:59.070938 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41effd86-4dd9-444a-91a0-0ab74572b051 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd71fe5a8275f4ea98555afdcefc902a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a10a4268f3c4cb29f4e00c292e2df62', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:42:59.071448 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41effd86-4dd9-444a-91a0-0ab74572b051 service nova] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:42:59.071720 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41effd86-4dd9-444a-91a0-0ab74572b051 service nova] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:42:59.071981 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41effd86-4dd9-444a-91a0-0ab74572b051 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:42:59.073593 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.fernet_utils [None req-41effd86-4dd9-444a-91a0-0ab74572b051 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:42:59.164012 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41effd86-4dd9-444a-91a0-0ab74572b051 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:42:59.165644 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41effd86-4dd9-444a-91a0-0ab74572b051 service nova] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:42:59.184382 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 698/1422] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Sep 13 19:42:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 383 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 19:43:00.302279 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a4a038-4ff5-4aba-8105-87d9d6a625e0 None None] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:00.302731 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a4a038-4ff5-4aba-8105-87d9d6a625e0 None None] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:00.302828 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a4a038-4ff5-4aba-8105-87d9d6a625e0 None None] PATH_INFO: `/` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:00.304236 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 725/1423] 127.0.0.1 () {54 vars in 901 bytes} [Tue Sep 13 19:43:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:43:00.310656 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0ecee9-99e0-476a-ac5f-0786a4a8e44f None None] REQUEST_METHOD: `POST` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:00.311137 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0ecee9-99e0-476a-ac5f-0786a4a8e44f None None] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:00.311286 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0ecee9-99e0-476a-ac5f-0786a4a8e44f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:00.331166 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG dbcounter [-] [87935] Writing DB stats keystone:SELECT=100 {{(pid=87935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:43:00.388944 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.auth.core [None req-1d0ecee9-99e0-476a-ac5f-0786a4a8e44f None None] MFA Rules not processed for user `7b0aed92d02344acb92a0e4aa67c3068`. Rule list: `[]` (Enabled: `True`). {{(pid=87935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:43:00.390136 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.fernet_utils [None req-1d0ecee9-99e0-476a-ac5f-0786a4a8e44f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:43:00.492720 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 699/1424] 127.0.0.1 () {58 vars in 998 bytes} [Tue Sep 13 19:43:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 19:43:00.647036 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a4a038-4ff5-4aba-8105-87d9d6a625e0 None None] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:43:00.648520 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.fernet_utils [None req-d7a4a038-4ff5-4aba-8105-87d9d6a625e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:43:00.776266 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG dbcounter [-] [87934] Writing DB stats keystone:SELECT=100 {{(pid=87934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:43:00.814890 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a4a038-4ff5-4aba-8105-87d9d6a625e0 None None] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:43:00.938803 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8cd7ffb-a256-4e19-8f5c-872fe8cd15ed service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd71fe5a8275f4ea98555afdcefc902a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a10a4268f3c4cb29f4e00c292e2df62', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:43:00.939322 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8cd7ffb-a256-4e19-8f5c-872fe8cd15ed service nova] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:00.939596 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8cd7ffb-a256-4e19-8f5c-872fe8cd15ed service nova] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:00.939864 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8cd7ffb-a256-4e19-8f5c-872fe8cd15ed service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:00.941656 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.fernet_utils [None req-a8cd7ffb-a256-4e19-8f5c-872fe8cd15ed service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:43:01.023814 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG dbcounter [-] [87934] Writing DB stats keystone:SELECT=100 {{(pid=87934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:43:01.039192 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8cd7ffb-a256-4e19-8f5c-872fe8cd15ed service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:43:01.040845 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8cd7ffb-a256-4e19-8f5c-872fe8cd15ed service nova] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:43:01.059812 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 726/1425] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Sep 13 19:43:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 413 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 19:43:02.213438 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e947b5-816d-4749-8081-f96c71b0d9c3 None None] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:02.214239 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e947b5-816d-4749-8081-f96c71b0d9c3 None None] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:02.214417 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e947b5-816d-4749-8081-f96c71b0d9c3 None None] PATH_INFO: `/` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:02.215887 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 700/1426] 127.0.0.1 () {54 vars in 901 bytes} [Tue Sep 13 19:43:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:43:02.222328 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0020ca25-10d5-4ac1-a3cb-dc75ea404949 None None] REQUEST_METHOD: `POST` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:02.222816 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0020ca25-10d5-4ac1-a3cb-dc75ea404949 None None] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:02.222931 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0020ca25-10d5-4ac1-a3cb-dc75ea404949 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:02.299022 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.auth.core [None req-0020ca25-10d5-4ac1-a3cb-dc75ea404949 None None] MFA Rules not processed for user `7b0aed92d02344acb92a0e4aa67c3068`. Rule list: `[]` (Enabled: `True`). {{(pid=87934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:43:02.300238 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.fernet_utils [None req-0020ca25-10d5-4ac1-a3cb-dc75ea404949 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:43:02.394523 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 727/1427] 127.0.0.1 () {58 vars in 998 bytes} [Tue Sep 13 19:43:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 19:43:02.549155 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e947b5-816d-4749-8081-f96c71b0d9c3 None None] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:43:02.550666 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.fernet_utils [None req-35e947b5-816d-4749-8081-f96c71b0d9c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:43:02.635641 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG dbcounter [-] [87935] Writing DB stats keystone:SELECT=100 {{(pid=87935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:43:02.697751 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e947b5-816d-4749-8081-f96c71b0d9c3 None None] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:43:02.809639 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5cc6715-52c5-47f2-ae90-8c447dba0979 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd71fe5a8275f4ea98555afdcefc902a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a10a4268f3c4cb29f4e00c292e2df62', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:43:02.810151 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5cc6715-52c5-47f2-ae90-8c447dba0979 service nova] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:02.810423 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5cc6715-52c5-47f2-ae90-8c447dba0979 service nova] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:02.810687 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5cc6715-52c5-47f2-ae90-8c447dba0979 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:02.812302 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.fernet_utils [None req-b5cc6715-52c5-47f2-ae90-8c447dba0979 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:43:02.861797 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG dbcounter [-] [87935] Writing DB stats keystone:SELECT=100 {{(pid=87935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:43:02.904022 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5cc6715-52c5-47f2-ae90-8c447dba0979 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:43:02.905694 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5cc6715-52c5-47f2-ae90-8c447dba0979 service nova] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:43:02.923469 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 701/1428] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Sep 13 19:43:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 19:43:04.008159 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b53ee4-7ed7-47f9-9bd0-2d5ee236aec9 None None] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:04.008758 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b53ee4-7ed7-47f9-9bd0-2d5ee236aec9 None None] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:04.008758 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b53ee4-7ed7-47f9-9bd0-2d5ee236aec9 None None] PATH_INFO: `/` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:04.010073 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 728/1429] 127.0.0.1 () {54 vars in 901 bytes} [Tue Sep 13 19:43:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 13 19:43:04.016800 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acbf060-7f4a-4682-99d1-a1797436494d None None] REQUEST_METHOD: `POST` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:04.017228 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acbf060-7f4a-4682-99d1-a1797436494d None None] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:04.017377 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acbf060-7f4a-4682-99d1-a1797436494d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:04.096262 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.auth.core [None req-8acbf060-7f4a-4682-99d1-a1797436494d None None] MFA Rules not processed for user `7b0aed92d02344acb92a0e4aa67c3068`. Rule list: `[]` (Enabled: `True`). {{(pid=87935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:43:04.097492 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.fernet_utils [None req-8acbf060-7f4a-4682-99d1-a1797436494d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:43:04.197171 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 702/1430] 127.0.0.1 () {58 vars in 998 bytes} [Tue Sep 13 19:43:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 19:43:04.349414 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b53ee4-7ed7-47f9-9bd0-2d5ee236aec9 None None] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:43:04.351440 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.fernet_utils [None req-71b53ee4-7ed7-47f9-9bd0-2d5ee236aec9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:43:04.399179 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG dbcounter [-] [87934] Writing DB stats keystone:SELECT=100 {{(pid=87934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:43:04.497736 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b53ee4-7ed7-47f9-9bd0-2d5ee236aec9 None None] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:43:04.610173 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b57dc3-398b-48cb-b69a-e559f736dcd6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd71fe5a8275f4ea98555afdcefc902a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a10a4268f3c4cb29f4e00c292e2df62', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:43:04.610773 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b57dc3-398b-48cb-b69a-e559f736dcd6 service nova] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:04.611048 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b57dc3-398b-48cb-b69a-e559f736dcd6 service nova] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:04.611312 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b57dc3-398b-48cb-b69a-e559f736dcd6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:04.612939 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.fernet_utils [None req-10b57dc3-398b-48cb-b69a-e559f736dcd6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:43:04.619877 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG dbcounter [-] [87934] Writing DB stats keystone:SELECT=100 {{(pid=87934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:43:04.702853 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b57dc3-398b-48cb-b69a-e559f736dcd6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:43:04.704489 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b57dc3-398b-48cb-b69a-e559f736dcd6 service nova] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:43:04.722711 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 729/1431] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Sep 13 19:43:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 19:43:05.769626 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154ce83d-75b0-471d-b1da-5bd2ea0d0afc None None] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:05.770185 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154ce83d-75b0-471d-b1da-5bd2ea0d0afc None None] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:05.770185 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154ce83d-75b0-471d-b1da-5bd2ea0d0afc None None] PATH_INFO: `/` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:05.771487 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 703/1432] 127.0.0.1 () {54 vars in 901 bytes} [Tue Sep 13 19:43:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:43:05.778376 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614846fd-743c-4852-a49d-f019997234fb None None] REQUEST_METHOD: `POST` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:05.778824 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614846fd-743c-4852-a49d-f019997234fb None None] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:05.778922 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614846fd-743c-4852-a49d-f019997234fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:05.853407 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.auth.core [None req-614846fd-743c-4852-a49d-f019997234fb None None] MFA Rules not processed for user `7b0aed92d02344acb92a0e4aa67c3068`. Rule list: `[]` (Enabled: `True`). {{(pid=87934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:43:05.854622 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.fernet_utils [None req-614846fd-743c-4852-a49d-f019997234fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:43:05.921048 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG dbcounter [-] [87934] Writing DB stats keystone:SELECT=100 {{(pid=87934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:43:05.950833 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 730/1433] 127.0.0.1 () {58 vars in 998 bytes} [Tue Sep 13 19:43:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 19:43:06.101891 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154ce83d-75b0-471d-b1da-5bd2ea0d0afc None None] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:43:06.103407 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.fernet_utils [None req-154ce83d-75b0-471d-b1da-5bd2ea0d0afc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:43:06.122236 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG dbcounter [-] [87935] Writing DB stats keystone:SELECT=100 {{(pid=87935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:43:06.252435 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154ce83d-75b0-471d-b1da-5bd2ea0d0afc None None] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:43:06.339870 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG dbcounter [-] [87935] Writing DB stats keystone:SELECT=100 {{(pid=87935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:43:06.366736 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4914f09-8df0-4eb1-9236-0c6c4a6b98d8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd71fe5a8275f4ea98555afdcefc902a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a10a4268f3c4cb29f4e00c292e2df62', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:43:06.367332 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4914f09-8df0-4eb1-9236-0c6c4a6b98d8 service nova] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:06.367602 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4914f09-8df0-4eb1-9236-0c6c4a6b98d8 service nova] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:06.367865 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4914f09-8df0-4eb1-9236-0c6c4a6b98d8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:06.369470 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.fernet_utils [None req-f4914f09-8df0-4eb1-9236-0c6c4a6b98d8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:43:06.457869 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4914f09-8df0-4eb1-9236-0c6c4a6b98d8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:43:06.459581 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4914f09-8df0-4eb1-9236-0c6c4a6b98d8 service nova] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:43:06.477661 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 704/1434] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Sep 13 19:43:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 19:43:07.538011 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3295edda-814b-4dfb-9f14-4eaa81a70e4f None None] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:07.538576 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3295edda-814b-4dfb-9f14-4eaa81a70e4f None None] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:07.538687 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3295edda-814b-4dfb-9f14-4eaa81a70e4f None None] PATH_INFO: `/` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:07.539958 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 731/1435] 127.0.0.1 () {54 vars in 901 bytes} [Tue Sep 13 19:43:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:43:07.546212 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74304570-b984-4f04-8265-0a9018b2a44b None None] REQUEST_METHOD: `POST` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:07.546613 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74304570-b984-4f04-8265-0a9018b2a44b None None] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:07.546767 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74304570-b984-4f04-8265-0a9018b2a44b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:07.624455 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.auth.core [None req-74304570-b984-4f04-8265-0a9018b2a44b None None] MFA Rules not processed for user `7b0aed92d02344acb92a0e4aa67c3068`. Rule list: `[]` (Enabled: `True`). {{(pid=87935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:43:07.625702 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.fernet_utils [None req-74304570-b984-4f04-8265-0a9018b2a44b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:43:07.668958 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG dbcounter [-] [87935] Writing DB stats keystone:SELECT=100 {{(pid=87935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:43:07.724774 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 705/1436] 127.0.0.1 () {58 vars in 998 bytes} [Tue Sep 13 19:43:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 19:43:07.875049 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3295edda-814b-4dfb-9f14-4eaa81a70e4f None None] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:43:07.876532 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.fernet_utils [None req-3295edda-814b-4dfb-9f14-4eaa81a70e4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:43:08.022581 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3295edda-814b-4dfb-9f14-4eaa81a70e4f None None] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:43:08.076800 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG dbcounter [-] [87934] Writing DB stats keystone:SELECT=100 {{(pid=87934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:43:08.138120 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d989708-f52b-42b9-953e-1e5a57e315bc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd71fe5a8275f4ea98555afdcefc902a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a10a4268f3c4cb29f4e00c292e2df62', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:43:08.145879 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d989708-f52b-42b9-953e-1e5a57e315bc service nova] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:08.146197 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d989708-f52b-42b9-953e-1e5a57e315bc service nova] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:08.147501 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d989708-f52b-42b9-953e-1e5a57e315bc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:08.149274 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.fernet_utils [None req-5d989708-f52b-42b9-953e-1e5a57e315bc service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:43:08.239180 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d989708-f52b-42b9-953e-1e5a57e315bc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:43:08.241347 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d989708-f52b-42b9-953e-1e5a57e315bc service nova] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:43:08.260929 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 732/1437] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Sep 13 19:43:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 386 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 19:43:09.322101 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a6cbe7-efa5-4492-84be-bd7b871bcd65 None None] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:09.322579 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a6cbe7-efa5-4492-84be-bd7b871bcd65 None None] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:09.322687 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a6cbe7-efa5-4492-84be-bd7b871bcd65 None None] PATH_INFO: `/` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:09.324044 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 706/1438] 127.0.0.1 () {54 vars in 901 bytes} [Tue Sep 13 19:43:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:43:09.330262 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708487dc-3256-42aa-ae35-42410133e1a0 None None] REQUEST_METHOD: `POST` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:09.330943 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708487dc-3256-42aa-ae35-42410133e1a0 None None] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:09.331091 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708487dc-3256-42aa-ae35-42410133e1a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:09.405524 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.auth.core [None req-708487dc-3256-42aa-ae35-42410133e1a0 None None] MFA Rules not processed for user `7b0aed92d02344acb92a0e4aa67c3068`. Rule list: `[]` (Enabled: `True`). {{(pid=87934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:43:09.406721 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.fernet_utils [None req-708487dc-3256-42aa-ae35-42410133e1a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:43:09.408752 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG dbcounter [-] [87934] Writing DB stats keystone:SELECT=100 {{(pid=87934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:43:09.503686 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 733/1439] 127.0.0.1 () {58 vars in 998 bytes} [Tue Sep 13 19:43:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 19:43:09.653343 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a6cbe7-efa5-4492-84be-bd7b871bcd65 None None] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:43:09.654847 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.fernet_utils [None req-44a6cbe7-efa5-4492-84be-bd7b871bcd65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:43:09.799747 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a6cbe7-efa5-4492-84be-bd7b871bcd65 None None] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:43:09.826068 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG dbcounter [-] [87935] Writing DB stats keystone:SELECT=100 {{(pid=87935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:43:09.913331 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a085590e-47dc-48f5-993b-1a619de0a448 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd71fe5a8275f4ea98555afdcefc902a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a10a4268f3c4cb29f4e00c292e2df62', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:43:09.913809 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a085590e-47dc-48f5-993b-1a619de0a448 service nova] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:09.914080 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a085590e-47dc-48f5-993b-1a619de0a448 service nova] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:09.914343 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a085590e-47dc-48f5-993b-1a619de0a448 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:09.915926 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.fernet_utils [None req-a085590e-47dc-48f5-993b-1a619de0a448 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:43:10.003332 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a085590e-47dc-48f5-993b-1a619de0a448 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:43:10.004980 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a085590e-47dc-48f5-993b-1a619de0a448 service nova] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:43:10.023273 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 707/1440] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Sep 13 19:43:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 19:43:12.095267 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6861e726-8c27-475d-82eb-634fb5be9bfb None None] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:12.095874 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6861e726-8c27-475d-82eb-634fb5be9bfb None None] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:12.095874 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6861e726-8c27-475d-82eb-634fb5be9bfb None None] PATH_INFO: `/` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:12.097211 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 734/1441] 127.0.0.1 () {54 vars in 917 bytes} [Tue Sep 13 19:43:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:43:12.103297 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edde0efb-39a2-4261-817c-39340ecbd02c None None] REQUEST_METHOD: `POST` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:12.103717 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edde0efb-39a2-4261-817c-39340ecbd02c None None] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:12.103816 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edde0efb-39a2-4261-817c-39340ecbd02c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:12.143644 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG dbcounter [-] [87935] Writing DB stats keystone:SELECT=100 {{(pid=87935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:43:12.170467 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.auth.core [None req-edde0efb-39a2-4261-817c-39340ecbd02c None None] MFA Rules not processed for user `7b0aed92d02344acb92a0e4aa67c3068`. Rule list: `[]` (Enabled: `True`). {{(pid=87935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:43:12.171666 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.fernet_utils [None req-edde0efb-39a2-4261-817c-39340ecbd02c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:43:12.272664 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 708/1442] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Sep 13 19:43:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 19:43:12.577194 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6861e726-8c27-475d-82eb-634fb5be9bfb None None] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:43:12.578751 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.fernet_utils [None req-6861e726-8c27-475d-82eb-634fb5be9bfb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:43:12.682513 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6861e726-8c27-475d-82eb-634fb5be9bfb None None] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:43:12.716405 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG dbcounter [-] [87934] Writing DB stats keystone:SELECT=100 {{(pid=87934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:43:12.759501 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b4ae2a-8792-4f57-bfe8-e77b9f051a12 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1196a96e4a404f559600b69f929ea9da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a10a4268f3c4cb29f4e00c292e2df62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:43:12.760104 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b4ae2a-8792-4f57-bfe8-e77b9f051a12 service neutron] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:12.760420 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b4ae2a-8792-4f57-bfe8-e77b9f051a12 service neutron] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:12.760692 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b4ae2a-8792-4f57-bfe8-e77b9f051a12 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:12.762299 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.fernet_utils [None req-45b4ae2a-8792-4f57-bfe8-e77b9f051a12 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:43:12.880422 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b4ae2a-8792-4f57-bfe8-e77b9f051a12 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:43:12.882444 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b4ae2a-8792-4f57-bfe8-e77b9f051a12 service neutron] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:43:12.902212 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 735/1443] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Sep 13 19:43:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 19:43:15.196402 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f37744-477d-46f0-8161-0d6da9b101e9 None None] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:15.196984 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f37744-477d-46f0-8161-0d6da9b101e9 None None] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:15.196984 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f37744-477d-46f0-8161-0d6da9b101e9 None None] PATH_INFO: `/` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:15.198263 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 709/1444] 127.0.0.1 () {54 vars in 917 bytes} [Tue Sep 13 19:43:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:43:15.203379 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c166d9ea-ab1e-4796-8ad6-4dd2945ce831 None None] REQUEST_METHOD: `POST` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:15.203807 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c166d9ea-ab1e-4796-8ad6-4dd2945ce831 None None] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:15.203987 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c166d9ea-ab1e-4796-8ad6-4dd2945ce831 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:15.273251 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.auth.core [None req-c166d9ea-ab1e-4796-8ad6-4dd2945ce831 None None] MFA Rules not processed for user `7b0aed92d02344acb92a0e4aa67c3068`. Rule list: `[]` (Enabled: `True`). {{(pid=87934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:43:15.274445 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.fernet_utils [None req-c166d9ea-ab1e-4796-8ad6-4dd2945ce831 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:43:15.286881 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG dbcounter [-] [87934] Writing DB stats keystone:SELECT=100 {{(pid=87934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:43:15.371761 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 736/1445] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Sep 13 19:43:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 19:43:15.676556 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f37744-477d-46f0-8161-0d6da9b101e9 None None] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:43:15.678839 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.fernet_utils [None req-77f37744-477d-46f0-8161-0d6da9b101e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:43:15.784308 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f37744-477d-46f0-8161-0d6da9b101e9 None None] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:43:15.798093 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG dbcounter [-] [87935] Writing DB stats keystone:SELECT=100 {{(pid=87935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:43:15.860060 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f16a5c-6830-4064-b0ba-9159c05dedfe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1196a96e4a404f559600b69f929ea9da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a10a4268f3c4cb29f4e00c292e2df62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:43:15.860690 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f16a5c-6830-4064-b0ba-9159c05dedfe service neutron] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:15.860968 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f16a5c-6830-4064-b0ba-9159c05dedfe service neutron] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:15.861242 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f16a5c-6830-4064-b0ba-9159c05dedfe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:15.862837 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.fernet_utils [None req-08f16a5c-6830-4064-b0ba-9159c05dedfe service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:43:15.972845 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f16a5c-6830-4064-b0ba-9159c05dedfe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:43:15.974304 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f16a5c-6830-4064-b0ba-9159c05dedfe service neutron] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:43:15.993317 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 710/1446] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Sep 13 19:43:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 13 19:43:18.449235 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3653f748-cf18-4798-9587-9be00bfb1783 None None] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:18.449798 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3653f748-cf18-4798-9587-9be00bfb1783 None None] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:18.449798 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3653f748-cf18-4798-9587-9be00bfb1783 None None] PATH_INFO: `/` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:18.451187 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 737/1447] 127.0.0.1 () {54 vars in 917 bytes} [Tue Sep 13 19:43:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:43:18.457014 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725a06e3-c5ce-4a13-b7dd-946fbeed7340 None None] REQUEST_METHOD: `POST` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:18.457443 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725a06e3-c5ce-4a13-b7dd-946fbeed7340 None None] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:18.457566 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725a06e3-c5ce-4a13-b7dd-946fbeed7340 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:18.506307 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG dbcounter [-] [87935] Writing DB stats keystone:SELECT=100 {{(pid=87935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:43:18.524995 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.auth.core [None req-725a06e3-c5ce-4a13-b7dd-946fbeed7340 None None] MFA Rules not processed for user `7b0aed92d02344acb92a0e4aa67c3068`. Rule list: `[]` (Enabled: `True`). {{(pid=87935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:43:18.526200 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.fernet_utils [None req-725a06e3-c5ce-4a13-b7dd-946fbeed7340 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:43:18.624695 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 711/1448] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Sep 13 19:43:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 19:43:18.915052 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3653f748-cf18-4798-9587-9be00bfb1783 None None] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:43:18.916641 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.fernet_utils [None req-3653f748-cf18-4798-9587-9be00bfb1783 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:43:19.021255 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3653f748-cf18-4798-9587-9be00bfb1783 None None] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:43:19.061025 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG dbcounter [-] [87934] Writing DB stats keystone:SELECT=100 {{(pid=87934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:43:19.095762 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92e9f44-c8e6-4840-95cb-9eb8204adc4e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1196a96e4a404f559600b69f929ea9da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a10a4268f3c4cb29f4e00c292e2df62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:43:19.096393 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92e9f44-c8e6-4840-95cb-9eb8204adc4e service neutron] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:19.096668 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92e9f44-c8e6-4840-95cb-9eb8204adc4e service neutron] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:19.096930 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92e9f44-c8e6-4840-95cb-9eb8204adc4e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:19.098496 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.fernet_utils [None req-b92e9f44-c8e6-4840-95cb-9eb8204adc4e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:43:19.208500 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b92e9f44-c8e6-4840-95cb-9eb8204adc4e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:43:19.210199 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b92e9f44-c8e6-4840-95cb-9eb8204adc4e service neutron] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:43:19.229343 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 738/1449] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Sep 13 19:43:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 19:43:21.551305 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e4074f-ba01-459b-9734-3128d04d1c37 None None] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:21.551847 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e4074f-ba01-459b-9734-3128d04d1c37 None None] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:21.551847 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e4074f-ba01-459b-9734-3128d04d1c37 None None] PATH_INFO: `/` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:21.553680 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 712/1450] 127.0.0.1 () {54 vars in 917 bytes} [Tue Sep 13 19:43:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:43:21.559090 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b218f3f-9dc5-4ade-842d-2ffa5af0ebf7 None None] REQUEST_METHOD: `POST` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:21.559543 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b218f3f-9dc5-4ade-842d-2ffa5af0ebf7 None None] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:21.559642 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b218f3f-9dc5-4ade-842d-2ffa5af0ebf7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:21.626144 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.auth.core [None req-1b218f3f-9dc5-4ade-842d-2ffa5af0ebf7 None None] MFA Rules not processed for user `7b0aed92d02344acb92a0e4aa67c3068`. Rule list: `[]` (Enabled: `True`). {{(pid=87934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:43:21.627790 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.fernet_utils [None req-1b218f3f-9dc5-4ade-842d-2ffa5af0ebf7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:43:21.650773 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG dbcounter [-] [87934] Writing DB stats keystone:SELECT=100 {{(pid=87934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:43:21.730820 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 739/1451] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Sep 13 19:43:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 19:43:22.016440 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e4074f-ba01-459b-9734-3128d04d1c37 None None] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:43:22.017979 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.fernet_utils [None req-c3e4074f-ba01-459b-9734-3128d04d1c37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:43:22.122214 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e4074f-ba01-459b-9734-3128d04d1c37 None None] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:43:22.141922 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG dbcounter [-] [87935] Writing DB stats keystone:SELECT=100 {{(pid=87935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:43:22.196471 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14b2f48-0534-4043-bcb5-9812069dcbee service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1196a96e4a404f559600b69f929ea9da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a10a4268f3c4cb29f4e00c292e2df62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:43:22.197069 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14b2f48-0534-4043-bcb5-9812069dcbee service neutron] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:22.197341 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14b2f48-0534-4043-bcb5-9812069dcbee service neutron] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:22.197604 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14b2f48-0534-4043-bcb5-9812069dcbee service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:22.199181 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.fernet_utils [None req-c14b2f48-0534-4043-bcb5-9812069dcbee service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:43:22.307912 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c14b2f48-0534-4043-bcb5-9812069dcbee service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:43:22.309399 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c14b2f48-0534-4043-bcb5-9812069dcbee service neutron] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:43:22.328004 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 713/1452] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Sep 13 19:43:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 19:43:24.551980 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26192cb2-2271-4308-9594-fb3ec660b21f None None] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:24.552642 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26192cb2-2271-4308-9594-fb3ec660b21f None None] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:24.552642 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26192cb2-2271-4308-9594-fb3ec660b21f None None] PATH_INFO: `/` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:24.554396 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 740/1453] 127.0.0.1 () {54 vars in 917 bytes} [Tue Sep 13 19:43:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:43:24.559833 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa61503-9a18-49cc-9ba6-458deff47aae None None] REQUEST_METHOD: `POST` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:24.560314 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa61503-9a18-49cc-9ba6-458deff47aae None None] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:24.560429 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa61503-9a18-49cc-9ba6-458deff47aae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:24.624281 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG dbcounter [-] [87935] Writing DB stats keystone:SELECT=100 {{(pid=87935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:43:24.627192 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.auth.core [None req-5fa61503-9a18-49cc-9ba6-458deff47aae None None] MFA Rules not processed for user `7b0aed92d02344acb92a0e4aa67c3068`. Rule list: `[]` (Enabled: `True`). {{(pid=87935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:43:24.629096 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.fernet_utils [None req-5fa61503-9a18-49cc-9ba6-458deff47aae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:43:24.725668 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 714/1454] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Sep 13 19:43:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 19:43:25.018604 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26192cb2-2271-4308-9594-fb3ec660b21f None None] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:43:25.020169 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.fernet_utils [None req-26192cb2-2271-4308-9594-fb3ec660b21f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:43:25.125163 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26192cb2-2271-4308-9594-fb3ec660b21f None None] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:43:25.175839 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG dbcounter [-] [87934] Writing DB stats keystone:SELECT=100 {{(pid=87934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:43:25.201640 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68ef53b-3b2a-4962-9f2f-eeaba22b8c9f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1196a96e4a404f559600b69f929ea9da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a10a4268f3c4cb29f4e00c292e2df62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:43:25.202245 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68ef53b-3b2a-4962-9f2f-eeaba22b8c9f service neutron] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:25.202519 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68ef53b-3b2a-4962-9f2f-eeaba22b8c9f service neutron] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:25.202784 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68ef53b-3b2a-4962-9f2f-eeaba22b8c9f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:25.204460 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.fernet_utils [None req-f68ef53b-3b2a-4962-9f2f-eeaba22b8c9f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:43:25.314141 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f68ef53b-3b2a-4962-9f2f-eeaba22b8c9f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:43:25.315588 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f68ef53b-3b2a-4962-9f2f-eeaba22b8c9f service neutron] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:43:25.335186 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 741/1455] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Sep 13 19:43:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 19:43:27.574385 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47f1ad9-8b53-4fdf-891e-4afd73f84e6a None None] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:27.574902 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47f1ad9-8b53-4fdf-891e-4afd73f84e6a None None] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:27.574902 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47f1ad9-8b53-4fdf-891e-4afd73f84e6a None None] PATH_INFO: `/` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:27.576226 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 715/1456] 127.0.0.1 () {54 vars in 917 bytes} [Tue Sep 13 19:43:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:43:27.581873 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5843066a-cb0c-4602-9861-584ed10f3154 None None] REQUEST_METHOD: `POST` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:27.582324 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5843066a-cb0c-4602-9861-584ed10f3154 None None] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:27.582431 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5843066a-cb0c-4602-9861-584ed10f3154 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:27.648259 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.auth.core [None req-5843066a-cb0c-4602-9861-584ed10f3154 None None] MFA Rules not processed for user `7b0aed92d02344acb92a0e4aa67c3068`. Rule list: `[]` (Enabled: `True`). {{(pid=87934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:43:27.649469 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.fernet_utils [None req-5843066a-cb0c-4602-9861-584ed10f3154 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:43:27.678955 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG dbcounter [-] [87934] Writing DB stats keystone:SELECT=100 {{(pid=87934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:43:27.751963 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 742/1457] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Sep 13 19:43:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 19:43:28.035204 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47f1ad9-8b53-4fdf-891e-4afd73f84e6a None None] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:43:28.036878 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.fernet_utils [None req-e47f1ad9-8b53-4fdf-891e-4afd73f84e6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:43:28.145905 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47f1ad9-8b53-4fdf-891e-4afd73f84e6a None None] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:43:28.174754 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG dbcounter [-] [87935] Writing DB stats keystone:SELECT=100 {{(pid=87935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:43:28.220790 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8da33e7-f2a0-40e4-bb51-a8e63561d719 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1196a96e4a404f559600b69f929ea9da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a10a4268f3c4cb29f4e00c292e2df62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:43:28.221381 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8da33e7-f2a0-40e4-bb51-a8e63561d719 service neutron] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:28.221659 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8da33e7-f2a0-40e4-bb51-a8e63561d719 service neutron] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:28.221928 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8da33e7-f2a0-40e4-bb51-a8e63561d719 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:28.223517 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.fernet_utils [None req-a8da33e7-f2a0-40e4-bb51-a8e63561d719 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:43:28.334214 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8da33e7-f2a0-40e4-bb51-a8e63561d719 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:43:28.335655 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8da33e7-f2a0-40e4-bb51-a8e63561d719 service neutron] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:43:28.354358 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 716/1458] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Sep 13 19:43:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 19:43:30.648248 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0628f0-740d-4d67-b1d2-bbd629721293 None None] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:30.648795 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0628f0-740d-4d67-b1d2-bbd629721293 None None] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:30.648795 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0628f0-740d-4d67-b1d2-bbd629721293 None None] PATH_INFO: `/` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:30.650074 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 743/1459] 127.0.0.1 () {54 vars in 917 bytes} [Tue Sep 13 19:43:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 13 19:43:30.655308 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce3baf1-cea2-4185-b3dd-616335c89a73 None None] REQUEST_METHOD: `POST` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:30.655688 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce3baf1-cea2-4185-b3dd-616335c89a73 None None] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:30.655850 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce3baf1-cea2-4185-b3dd-616335c89a73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:30.723019 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.auth.core [None req-1ce3baf1-cea2-4185-b3dd-616335c89a73 None None] MFA Rules not processed for user `7b0aed92d02344acb92a0e4aa67c3068`. Rule list: `[]` (Enabled: `True`). {{(pid=87935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:43:30.724760 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.fernet_utils [None req-1ce3baf1-cea2-4185-b3dd-616335c89a73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:43:30.733368 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG dbcounter [-] [87935] Writing DB stats keystone:SELECT=100 {{(pid=87935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:43:30.826919 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 717/1460] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Sep 13 19:43:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 19:43:31.116085 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0628f0-740d-4d67-b1d2-bbd629721293 None None] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:43:31.117764 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.fernet_utils [None req-4c0628f0-740d-4d67-b1d2-bbd629721293 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:43:31.222348 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0628f0-740d-4d67-b1d2-bbd629721293 None None] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:43:31.279285 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG dbcounter [-] [87934] Writing DB stats keystone:SELECT=100 {{(pid=87934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:43:31.297836 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a67347-434d-43ea-ae46-c13a044b7ae1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1196a96e4a404f559600b69f929ea9da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a10a4268f3c4cb29f4e00c292e2df62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:43:31.298455 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a67347-434d-43ea-ae46-c13a044b7ae1 service neutron] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:31.298734 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a67347-434d-43ea-ae46-c13a044b7ae1 service neutron] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:31.299006 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a67347-434d-43ea-ae46-c13a044b7ae1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:31.300656 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.fernet_utils [None req-a9a67347-434d-43ea-ae46-c13a044b7ae1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:43:31.411573 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a67347-434d-43ea-ae46-c13a044b7ae1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:43:31.413023 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a67347-434d-43ea-ae46-c13a044b7ae1 service neutron] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:43:31.430658 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 744/1461] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Sep 13 19:43:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 19:43:33.664404 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa91cbd-a406-4b95-8dbe-73c0257231d9 None None] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:33.664862 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa91cbd-a406-4b95-8dbe-73c0257231d9 None None] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:33.664969 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa91cbd-a406-4b95-8dbe-73c0257231d9 None None] PATH_INFO: `/` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:33.666300 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 718/1462] 127.0.0.1 () {54 vars in 917 bytes} [Tue Sep 13 19:43:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:43:33.671639 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8c0ff6-fcbb-4e10-a117-299361fb3cf2 None None] REQUEST_METHOD: `POST` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:33.672027 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8c0ff6-fcbb-4e10-a117-299361fb3cf2 None None] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:33.672192 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8c0ff6-fcbb-4e10-a117-299361fb3cf2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:33.854633 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.auth.core [None req-cc8c0ff6-fcbb-4e10-a117-299361fb3cf2 None None] MFA Rules not processed for user `7b0aed92d02344acb92a0e4aa67c3068`. Rule list: `[]` (Enabled: `True`). {{(pid=87934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:43:33.855827 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.fernet_utils [None req-cc8c0ff6-fcbb-4e10-a117-299361fb3cf2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:43:33.895466 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG dbcounter [-] [87934] Writing DB stats keystone:SELECT=100 {{(pid=87934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:43:33.955816 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 745/1463] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Sep 13 19:43:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 285 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 19:43:34.247553 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa91cbd-a406-4b95-8dbe-73c0257231d9 None None] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:43:34.249276 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.fernet_utils [None req-7fa91cbd-a406-4b95-8dbe-73c0257231d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:43:34.353858 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa91cbd-a406-4b95-8dbe-73c0257231d9 None None] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:43:34.392563 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG dbcounter [-] [87935] Writing DB stats keystone:SELECT=100 {{(pid=87935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:43:34.429734 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f3bb74-928d-4b62-ae9d-4ffc9ff26f64 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1196a96e4a404f559600b69f929ea9da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a10a4268f3c4cb29f4e00c292e2df62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:43:34.430467 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f3bb74-928d-4b62-ae9d-4ffc9ff26f64 service neutron] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:34.430745 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f3bb74-928d-4b62-ae9d-4ffc9ff26f64 service neutron] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:34.431007 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f3bb74-928d-4b62-ae9d-4ffc9ff26f64 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:34.432611 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.fernet_utils [None req-91f3bb74-928d-4b62-ae9d-4ffc9ff26f64 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:43:34.542150 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f3bb74-928d-4b62-ae9d-4ffc9ff26f64 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:43:34.543582 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f3bb74-928d-4b62-ae9d-4ffc9ff26f64 service neutron] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:43:34.561819 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 719/1464] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Sep 13 19:43:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 19:43:36.747584 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21549f7c-2b79-4f02-9d49-da07029b4e16 None None] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:36.748148 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21549f7c-2b79-4f02-9d49-da07029b4e16 None None] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:36.748148 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21549f7c-2b79-4f02-9d49-da07029b4e16 None None] PATH_INFO: `/` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:36.749503 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 746/1465] 127.0.0.1 () {54 vars in 917 bytes} [Tue Sep 13 19:43:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:43:36.754719 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523407f5-1e55-4d09-9696-e8a111f2e41f None None] REQUEST_METHOD: `POST` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:36.755725 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523407f5-1e55-4d09-9696-e8a111f2e41f None None] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:36.756000 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523407f5-1e55-4d09-9696-e8a111f2e41f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:36.821666 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.auth.core [None req-523407f5-1e55-4d09-9696-e8a111f2e41f None None] MFA Rules not processed for user `7b0aed92d02344acb92a0e4aa67c3068`. Rule list: `[]` (Enabled: `True`). {{(pid=87935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:43:36.822864 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.fernet_utils [None req-523407f5-1e55-4d09-9696-e8a111f2e41f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:43:36.840934 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG dbcounter [-] [87935] Writing DB stats keystone:SELECT=100 {{(pid=87935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:43:36.917766 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 720/1466] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Sep 13 19:43:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 19:43:37.205755 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21549f7c-2b79-4f02-9d49-da07029b4e16 None None] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:43:37.207275 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.fernet_utils [None req-21549f7c-2b79-4f02-9d49-da07029b4e16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:43:37.318213 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21549f7c-2b79-4f02-9d49-da07029b4e16 None None] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:43:37.385608 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG dbcounter [-] [87934] Writing DB stats keystone:SELECT=100 {{(pid=87934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:43:37.392646 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26215103-dd9c-4185-9151-5c510d410a52 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1196a96e4a404f559600b69f929ea9da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a10a4268f3c4cb29f4e00c292e2df62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:43:37.393259 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26215103-dd9c-4185-9151-5c510d410a52 service neutron] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:37.393537 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26215103-dd9c-4185-9151-5c510d410a52 service neutron] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:37.393810 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26215103-dd9c-4185-9151-5c510d410a52 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:37.395542 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.fernet_utils [None req-26215103-dd9c-4185-9151-5c510d410a52 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:43:37.506139 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26215103-dd9c-4185-9151-5c510d410a52 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:43:37.507591 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26215103-dd9c-4185-9151-5c510d410a52 service neutron] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:43:37.525816 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 747/1467] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Sep 13 19:43:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 19:43:39.736872 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240a3ab6-f749-413a-962d-253741bc30c3 None None] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:39.737429 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240a3ab6-f749-413a-962d-253741bc30c3 None None] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:39.737429 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240a3ab6-f749-413a-962d-253741bc30c3 None None] PATH_INFO: `/` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:39.738785 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 721/1468] 127.0.0.1 () {54 vars in 917 bytes} [Tue Sep 13 19:43:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:43:39.745056 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62d6746-5b04-4709-9ef8-3e2e88f9e1c7 None None] REQUEST_METHOD: `POST` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:39.745450 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62d6746-5b04-4709-9ef8-3e2e88f9e1c7 None None] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:39.745592 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62d6746-5b04-4709-9ef8-3e2e88f9e1c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:39.810170 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.auth.core [None req-a62d6746-5b04-4709-9ef8-3e2e88f9e1c7 None None] MFA Rules not processed for user `7b0aed92d02344acb92a0e4aa67c3068`. Rule list: `[]` (Enabled: `True`). {{(pid=87934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:43:39.811352 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.fernet_utils [None req-a62d6746-5b04-4709-9ef8-3e2e88f9e1c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:43:39.858900 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG dbcounter [-] [87934] Writing DB stats keystone:SELECT=100 {{(pid=87934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:43:39.907474 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 748/1469] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Sep 13 19:43:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 19:43:40.189858 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240a3ab6-f749-413a-962d-253741bc30c3 None None] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:43:40.191414 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.fernet_utils [None req-240a3ab6-f749-413a-962d-253741bc30c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:43:40.294612 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240a3ab6-f749-413a-962d-253741bc30c3 None None] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:43:40.343624 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG dbcounter [-] [87935] Writing DB stats keystone:SELECT=100 {{(pid=87935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:43:40.369630 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b392c2-57c1-4773-a3d5-3c9d38fe4560 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1196a96e4a404f559600b69f929ea9da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a10a4268f3c4cb29f4e00c292e2df62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:43:40.370226 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b392c2-57c1-4773-a3d5-3c9d38fe4560 service neutron] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:40.370501 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b392c2-57c1-4773-a3d5-3c9d38fe4560 service neutron] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:40.370769 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b392c2-57c1-4773-a3d5-3c9d38fe4560 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:40.372461 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.fernet_utils [None req-e9b392c2-57c1-4773-a3d5-3c9d38fe4560 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:43:40.479939 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b392c2-57c1-4773-a3d5-3c9d38fe4560 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:43:40.481413 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b392c2-57c1-4773-a3d5-3c9d38fe4560 service neutron] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:43:40.501153 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 722/1470] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Sep 13 19:43:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 19:43:49.905963 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG dbcounter [-] [87934] Writing DB stats keystone:SELECT=22 {{(pid=87934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:43:50.498788 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG dbcounter [-] [87935] Writing DB stats keystone:SELECT=66 {{(pid=87935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:44:00.646681 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3efeb1a-2d01-4ae8-999c-738cfdca018b None None] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:00.647212 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3efeb1a-2d01-4ae8-999c-738cfdca018b None None] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:00.647212 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3efeb1a-2d01-4ae8-999c-738cfdca018b None None] PATH_INFO: `/` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:00.648523 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 749/1471] 10.222.0.25 () {54 vars in 927 bytes} [Tue Sep 13 19:44:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:44:00.653677 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4bd25b-816f-43ef-bfbf-48eae575563a None None] REQUEST_METHOD: `POST` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:00.654122 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4bd25b-816f-43ef-bfbf-48eae575563a None None] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:00.654230 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4bd25b-816f-43ef-bfbf-48eae575563a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:00.721638 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.auth.core [None req-7e4bd25b-816f-43ef-bfbf-48eae575563a None None] MFA Rules not processed for user `7b0aed92d02344acb92a0e4aa67c3068`. Rule list: `[]` (Enabled: `True`). {{(pid=87935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:44:00.722872 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.fernet_utils [None req-7e4bd25b-816f-43ef-bfbf-48eae575563a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:44:00.821997 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 723/1472] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Sep 13 19:44:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 19:44:01.121174 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0bb93b-21a5-4148-8ed5-5efcdd502d04 None None] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:01.121458 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0bb93b-21a5-4148-8ed5-5efcdd502d04 None None] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:01.121728 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0bb93b-21a5-4148-8ed5-5efcdd502d04 None None] PATH_INFO: `/` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:01.123050 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 750/1473] 10.222.0.25 () {54 vars in 966 bytes} [Tue Sep 13 19:44:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:44:01.127836 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f05d0f-1505-4c7d-8eca-93d402a2e9c8 None None] REQUEST_METHOD: `POST` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:01.128125 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f05d0f-1505-4c7d-8eca-93d402a2e9c8 None None] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:01.128433 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f05d0f-1505-4c7d-8eca-93d402a2e9c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:01.206693 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.auth.core [None req-49f05d0f-1505-4c7d-8eca-93d402a2e9c8 None None] MFA Rules not processed for user `907d44d3b6944ccb83999d8e489871d4`. Rule list: `[]` (Enabled: `True`). {{(pid=87935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:44:01.208696 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.fernet_utils [None req-49f05d0f-1505-4c7d-8eca-93d402a2e9c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:44:01.229488 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG dbcounter [-] [87935] Writing DB stats keystone:SELECT=100 {{(pid=87935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:44:01.286167 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 724/1474] 10.222.0.25 () {58 vars in 1063 bytes} [Tue Sep 13 19:44:01 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 19:44:01.293972 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0bb93b-21a5-4148-8ed5-5efcdd502d04 None None] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:01.295476 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.fernet_utils [None req-ee0bb93b-21a5-4148-8ed5-5efcdd502d04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:44:01.397632 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0bb93b-21a5-4148-8ed5-5efcdd502d04 None None] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:01.473146 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10242b9c-8bc8-497d-986a-50ecbebeff56 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '907d44d3b6944ccb83999d8e489871d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a10a4268f3c4cb29f4e00c292e2df62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:01.473878 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10242b9c-8bc8-497d-986a-50ecbebeff56 service glance] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:01.474157 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10242b9c-8bc8-497d-986a-50ecbebeff56 service glance] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:01.474417 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10242b9c-8bc8-497d-986a-50ecbebeff56 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:01.476047 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.fernet_utils [None req-10242b9c-8bc8-497d-986a-50ecbebeff56 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:44:01.528959 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG dbcounter [-] [87934] Writing DB stats keystone:SELECT=100 {{(pid=87934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:44:01.585570 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10242b9c-8bc8-497d-986a-50ecbebeff56 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:44:01.586988 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10242b9c-8bc8-497d-986a-50ecbebeff56 service glance] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:44:01.605814 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 751/1475] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Sep 13 19:44:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 19:44:03.902983 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba4daff-9938-4b4d-8218-88a9343e28ef None None] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:03.903491 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba4daff-9938-4b4d-8218-88a9343e28ef None None] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:03.903491 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba4daff-9938-4b4d-8218-88a9343e28ef None None] PATH_INFO: `/` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:03.904811 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 725/1476] 10.222.0.25 () {54 vars in 927 bytes} [Tue Sep 13 19:44:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:44:03.910242 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbab7b52-d334-4ee9-9d9d-49e7233ef055 None None] REQUEST_METHOD: `POST` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:03.910673 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbab7b52-d334-4ee9-9d9d-49e7233ef055 None None] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:03.910813 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbab7b52-d334-4ee9-9d9d-49e7233ef055 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:03.981432 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.auth.core [None req-cbab7b52-d334-4ee9-9d9d-49e7233ef055 None None] MFA Rules not processed for user `7b0aed92d02344acb92a0e4aa67c3068`. Rule list: `[]` (Enabled: `True`). {{(pid=87934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:44:03.982641 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.fernet_utils [None req-cbab7b52-d334-4ee9-9d9d-49e7233ef055 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:44:04.078491 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 752/1477] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Sep 13 19:44:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 19:44:04.354742 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba4daff-9938-4b4d-8218-88a9343e28ef None None] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:04.356307 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.fernet_utils [None req-1ba4daff-9938-4b4d-8218-88a9343e28ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:44:04.599874 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba4daff-9938-4b4d-8218-88a9343e28ef None None] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:04.649088 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG dbcounter [-] [87935] Writing DB stats keystone:SELECT=100 {{(pid=87935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:44:04.693570 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9dafbf-e2c1-4144-823c-3a8f02232fbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:04.694164 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9dafbf-e2c1-4144-823c-3a8f02232fbe admin admin] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:04.694437 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9dafbf-e2c1-4144-823c-3a8f02232fbe admin admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:04.694697 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9dafbf-e2c1-4144-823c-3a8f02232fbe admin admin] PATH_INFO: `/v3/projects` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:04.695319 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e9dafbf-e2c1-4144-823c-3a8f02232fbe admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:44:04.697060 dv-cinder-828805-6-smb devstack@keystone.service[87935]: WARNING py.warnings [None req-1e9dafbf-e2c1-4144-823c-3a8f02232fbe admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 13 19:44:04.697060 dv-cinder-828805-6-smb devstack@keystone.service[87935]: warnings.warn(msg) Sep 13 19:44:04.697060 dv-cinder-828805-6-smb devstack@keystone.service[87935]: Sep 13 19:44:04.698177 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e9dafbf-e2c1-4144-823c-3a8f02232fbe admin admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:44:04.717186 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 726/1478] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Sep 13 19:44:04 2022] GET /identity/v3/projects => generated 2553 bytes in 363 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 19:44:06.947080 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32610801-02dc-481b-9741-858a6cbc59d8 None None] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:06.947651 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32610801-02dc-481b-9741-858a6cbc59d8 None None] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:06.947651 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32610801-02dc-481b-9741-858a6cbc59d8 None None] PATH_INFO: `/` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:06.949001 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 753/1479] 10.222.0.25 () {54 vars in 927 bytes} [Tue Sep 13 19:44:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:44:06.954439 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03f985e-b957-4ab9-ae3c-80e4aa1b1a3b None None] REQUEST_METHOD: `POST` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:06.954857 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03f985e-b957-4ab9-ae3c-80e4aa1b1a3b None None] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:06.955043 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03f985e-b957-4ab9-ae3c-80e4aa1b1a3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:07.022201 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.auth.core [None req-e03f985e-b957-4ab9-ae3c-80e4aa1b1a3b None None] MFA Rules not processed for user `7b0aed92d02344acb92a0e4aa67c3068`. Rule list: `[]` (Enabled: `True`). {{(pid=87935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:44:07.023437 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.fernet_utils [None req-e03f985e-b957-4ab9-ae3c-80e4aa1b1a3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:44:07.120191 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 727/1480] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Sep 13 19:44:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 19:44:07.420371 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32610801-02dc-481b-9741-858a6cbc59d8 None None] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:07.422017 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.fernet_utils [None req-32610801-02dc-481b-9741-858a6cbc59d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:44:07.432667 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG dbcounter [-] [87934] Writing DB stats keystone:SELECT=100 {{(pid=87934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:44:07.573955 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32610801-02dc-481b-9741-858a6cbc59d8 None None] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:07.653357 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG dbcounter [-] [87934] Writing DB stats keystone:SELECT=100 {{(pid=87934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:44:07.688393 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76874306-bed4-4edf-acda-75ec08fd2cff service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd71fe5a8275f4ea98555afdcefc902a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a10a4268f3c4cb29f4e00c292e2df62', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:07.689004 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76874306-bed4-4edf-acda-75ec08fd2cff service nova] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:07.689278 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76874306-bed4-4edf-acda-75ec08fd2cff service nova] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:07.689543 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76874306-bed4-4edf-acda-75ec08fd2cff service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:07.691955 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.fernet_utils [None req-76874306-bed4-4edf-acda-75ec08fd2cff service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:44:07.780523 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76874306-bed4-4edf-acda-75ec08fd2cff service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:44:07.782161 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76874306-bed4-4edf-acda-75ec08fd2cff service nova] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:44:07.800323 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 754/1481] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Sep 13 19:44:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 381 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 19:44:10.154341 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c6cb8d-5e68-4db7-9e42-7f07d6aa0088 None None] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:10.154909 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c6cb8d-5e68-4db7-9e42-7f07d6aa0088 None None] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:10.154909 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c6cb8d-5e68-4db7-9e42-7f07d6aa0088 None None] PATH_INFO: `/` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:10.156254 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 728/1482] 10.222.0.25 () {54 vars in 927 bytes} [Tue Sep 13 19:44:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:44:10.163349 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fbae9b-4fed-422a-8b44-373408251524 None None] REQUEST_METHOD: `POST` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:10.163792 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fbae9b-4fed-422a-8b44-373408251524 None None] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:10.163900 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fbae9b-4fed-422a-8b44-373408251524 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:10.229837 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.auth.core [None req-34fbae9b-4fed-422a-8b44-373408251524 None None] MFA Rules not processed for user `7b0aed92d02344acb92a0e4aa67c3068`. Rule list: `[]` (Enabled: `True`). {{(pid=87934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:44:10.231032 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.fernet_utils [None req-34fbae9b-4fed-422a-8b44-373408251524 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:44:10.277965 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG dbcounter [-] [87934] Writing DB stats keystone:SELECT=100 {{(pid=87934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:44:10.329424 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 755/1483] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Sep 13 19:44:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 19:44:10.621173 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c6cb8d-5e68-4db7-9e42-7f07d6aa0088 None None] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:10.622839 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.fernet_utils [None req-82c6cb8d-5e68-4db7-9e42-7f07d6aa0088 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:44:10.646944 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG dbcounter [-] [87935] Writing DB stats keystone:SELECT=100 {{(pid=87935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:44:10.729202 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c6cb8d-5e68-4db7-9e42-7f07d6aa0088 None None] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:10.807018 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71b49e5-7df9-4acb-9dc7-2f8dbe651d01 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1196a96e4a404f559600b69f929ea9da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a10a4268f3c4cb29f4e00c292e2df62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:10.807627 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71b49e5-7df9-4acb-9dc7-2f8dbe651d01 service neutron] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:10.807901 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71b49e5-7df9-4acb-9dc7-2f8dbe651d01 service neutron] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:10.808165 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71b49e5-7df9-4acb-9dc7-2f8dbe651d01 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:10.809785 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.fernet_utils [None req-d71b49e5-7df9-4acb-9dc7-2f8dbe651d01 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:44:10.884307 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG dbcounter [-] [87935] Writing DB stats keystone:SELECT=100 {{(pid=87935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:44:10.920189 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d71b49e5-7df9-4acb-9dc7-2f8dbe651d01 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:44:10.921651 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d71b49e5-7df9-4acb-9dc7-2f8dbe651d01 service neutron] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:44:10.940138 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 729/1484] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Sep 13 19:44:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 19:44:13.220382 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec91dbdf-9165-4feb-92c0-9983ea96f627 None None] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:13.220986 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec91dbdf-9165-4feb-92c0-9983ea96f627 None None] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:13.220986 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec91dbdf-9165-4feb-92c0-9983ea96f627 None None] PATH_INFO: `/` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:13.222267 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 756/1485] 10.222.0.25 () {54 vars in 927 bytes} [Tue Sep 13 19:44:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:44:13.227692 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9ba333-127d-49ef-a11b-f73c43607891 None None] REQUEST_METHOD: `POST` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:13.228131 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9ba333-127d-49ef-a11b-f73c43607891 None None] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:13.228281 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9ba333-127d-49ef-a11b-f73c43607891 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:13.294170 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.auth.core [None req-ec9ba333-127d-49ef-a11b-f73c43607891 None None] MFA Rules not processed for user `7b0aed92d02344acb92a0e4aa67c3068`. Rule list: `[]` (Enabled: `True`). {{(pid=87935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:44:13.295405 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.fernet_utils [None req-ec9ba333-127d-49ef-a11b-f73c43607891 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:44:13.391720 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 730/1486] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Sep 13 19:44:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 19:44:13.681819 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec91dbdf-9165-4feb-92c0-9983ea96f627 None None] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:13.683331 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.fernet_utils [None req-ec91dbdf-9165-4feb-92c0-9983ea96f627 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:44:13.787880 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec91dbdf-9165-4feb-92c0-9983ea96f627 None None] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:13.859850 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG dbcounter [-] [87934] Writing DB stats keystone:SELECT=100 {{(pid=87934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:44:13.861462 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67dd9698-d66d-41e9-89fc-59f4d1c16b13 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1196a96e4a404f559600b69f929ea9da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a10a4268f3c4cb29f4e00c292e2df62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:13.862153 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67dd9698-d66d-41e9-89fc-59f4d1c16b13 service neutron] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:13.862614 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67dd9698-d66d-41e9-89fc-59f4d1c16b13 service neutron] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:13.863654 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67dd9698-d66d-41e9-89fc-59f4d1c16b13 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:13.865506 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.fernet_utils [None req-67dd9698-d66d-41e9-89fc-59f4d1c16b13 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:44:13.976075 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67dd9698-d66d-41e9-89fc-59f4d1c16b13 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:44:13.977552 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67dd9698-d66d-41e9-89fc-59f4d1c16b13 service neutron] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:44:13.996025 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 757/1487] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Sep 13 19:44:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 19:44:16.230322 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ba6805-54b5-4f2a-8596-055e0a261442 None None] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:16.230886 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ba6805-54b5-4f2a-8596-055e0a261442 None None] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:16.230886 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ba6805-54b5-4f2a-8596-055e0a261442 None None] PATH_INFO: `/` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:16.232192 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 731/1488] 10.222.0.25 () {54 vars in 927 bytes} [Tue Sep 13 19:44:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:44:16.237461 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3021a506-7b4e-4154-ba3e-a86eded35931 None None] REQUEST_METHOD: `POST` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:16.237856 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3021a506-7b4e-4154-ba3e-a86eded35931 None None] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:16.237996 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3021a506-7b4e-4154-ba3e-a86eded35931 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:16.304583 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.auth.core [None req-3021a506-7b4e-4154-ba3e-a86eded35931 None None] MFA Rules not processed for user `7b0aed92d02344acb92a0e4aa67c3068`. Rule list: `[]` (Enabled: `True`). {{(pid=87934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:44:16.305788 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.fernet_utils [None req-3021a506-7b4e-4154-ba3e-a86eded35931 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:44:16.358289 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG dbcounter [-] [87934] Writing DB stats keystone:SELECT=100 {{(pid=87934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:44:16.402667 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 758/1489] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Sep 13 19:44:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 19:44:16.693318 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ba6805-54b5-4f2a-8596-055e0a261442 None None] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:16.695044 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.fernet_utils [None req-65ba6805-54b5-4f2a-8596-055e0a261442 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:44:16.730016 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG dbcounter [-] [87935] Writing DB stats keystone:SELECT=100 {{(pid=87935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:44:16.797334 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ba6805-54b5-4f2a-8596-055e0a261442 None None] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:16.872264 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7319130a-d0af-4999-8815-931ead4ac22a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1196a96e4a404f559600b69f929ea9da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a10a4268f3c4cb29f4e00c292e2df62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:16.872861 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7319130a-d0af-4999-8815-931ead4ac22a service neutron] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:16.873134 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7319130a-d0af-4999-8815-931ead4ac22a service neutron] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:16.873406 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7319130a-d0af-4999-8815-931ead4ac22a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:16.874976 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.fernet_utils [None req-7319130a-d0af-4999-8815-931ead4ac22a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:44:16.955550 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG dbcounter [-] [87935] Writing DB stats keystone:SELECT=100 {{(pid=87935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:44:16.985399 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7319130a-d0af-4999-8815-931ead4ac22a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:44:16.986839 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7319130a-d0af-4999-8815-931ead4ac22a service neutron] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:44:17.005621 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 732/1490] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Sep 13 19:44:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 19:44:19.357884 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d056cd-9bd1-429c-b839-c497638f82d2 None None] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:19.358437 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d056cd-9bd1-429c-b839-c497638f82d2 None None] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:19.358437 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d056cd-9bd1-429c-b839-c497638f82d2 None None] PATH_INFO: `/` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:19.359740 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 759/1491] 10.222.0.25 () {54 vars in 927 bytes} [Tue Sep 13 19:44:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:44:19.366022 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7ce608-f213-4702-b7c5-85965d75752b None None] REQUEST_METHOD: `POST` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:19.366487 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7ce608-f213-4702-b7c5-85965d75752b None None] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:19.366603 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7ce608-f213-4702-b7c5-85965d75752b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:19.432349 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.auth.core [None req-1f7ce608-f213-4702-b7c5-85965d75752b None None] MFA Rules not processed for user `7b0aed92d02344acb92a0e4aa67c3068`. Rule list: `[]` (Enabled: `True`). {{(pid=87935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:44:19.433553 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.fernet_utils [None req-1f7ce608-f213-4702-b7c5-85965d75752b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:44:19.529403 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 733/1492] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Sep 13 19:44:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 19:44:19.825880 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d056cd-9bd1-429c-b839-c497638f82d2 None None] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:19.827404 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.fernet_utils [None req-d3d056cd-9bd1-429c-b839-c497638f82d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:44:19.928781 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d056cd-9bd1-429c-b839-c497638f82d2 None None] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:20.002016 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2b0f17-c3ae-4690-93f2-8fa42bed838e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1196a96e4a404f559600b69f929ea9da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a10a4268f3c4cb29f4e00c292e2df62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:20.002652 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2b0f17-c3ae-4690-93f2-8fa42bed838e service neutron] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:20.002922 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2b0f17-c3ae-4690-93f2-8fa42bed838e service neutron] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:20.003184 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2b0f17-c3ae-4690-93f2-8fa42bed838e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:20.004782 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.fernet_utils [None req-ee2b0f17-c3ae-4690-93f2-8fa42bed838e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:44:20.013923 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG dbcounter [-] [87934] Writing DB stats keystone:SELECT=100 {{(pid=87934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:44:20.114162 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee2b0f17-c3ae-4690-93f2-8fa42bed838e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:44:20.115608 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee2b0f17-c3ae-4690-93f2-8fa42bed838e service neutron] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:44:20.134180 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 760/1493] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Sep 13 19:44:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 19:44:29.527854 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG dbcounter [-] [87935] Writing DB stats keystone:SELECT=82 {{(pid=87935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:44:30.132133 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG dbcounter [-] [87934] Writing DB stats keystone:SELECT=50 {{(pid=87934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:45:33.301512 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b213bba0-f1f5-47be-b79f-7c1d72011901 None None] REQUEST_METHOD: `POST` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:33.301938 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b213bba0-f1f5-47be-b79f-7c1d72011901 None None] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:33.302038 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b213bba0-f1f5-47be-b79f-7c1d72011901 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:33.378440 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.auth.core [None req-b213bba0-f1f5-47be-b79f-7c1d72011901 None None] MFA Rules not processed for user `7b0aed92d02344acb92a0e4aa67c3068`. Rule list: `[]` (Enabled: `True`). {{(pid=87935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:45:33.379644 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.fernet_utils [None req-b213bba0-f1f5-47be-b79f-7c1d72011901 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:45:33.475153 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 734/1494] 10.222.0.25 () {58 vars in 958 bytes} [Tue Sep 13 19:45:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 19:45:33.483034 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d360348-fc2f-47b0-a23d-2bbdca46dff9 None None] REQUEST_METHOD: `POST` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:33.483519 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d360348-fc2f-47b0-a23d-2bbdca46dff9 None None] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:33.483623 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d360348-fc2f-47b0-a23d-2bbdca46dff9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:33.558133 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.auth.core [None req-9d360348-fc2f-47b0-a23d-2bbdca46dff9 None None] MFA Rules not processed for user `7b0aed92d02344acb92a0e4aa67c3068`. Rule list: `[]` (Enabled: `True`). {{(pid=87934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:45:33.559248 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.fernet_utils [None req-9d360348-fc2f-47b0-a23d-2bbdca46dff9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:45:33.654642 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 761/1495] 10.222.0.25 () {58 vars in 958 bytes} [Tue Sep 13 19:45:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 19:45:33.660038 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b213bba0-f1f5-47be-b79f-7c1d72011901 None None] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:45:33.661267 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.fernet_utils [None req-b213bba0-f1f5-47be-b79f-7c1d72011901 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:45:33.672531 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b213bba0-f1f5-47be-b79f-7c1d72011901 None None] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:45:33.733579 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG dbcounter [-] [87935] Writing DB stats keystone:SELECT=100 {{(pid=87935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:45:33.767412 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39654569-1496-4071-8c2e-0c6c6b0f9316 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:45:33.768592 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39654569-1496-4071-8c2e-0c6c6b0f9316 admin admin] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:33.768866 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39654569-1496-4071-8c2e-0c6c6b0f9316 admin admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:33.769126 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39654569-1496-4071-8c2e-0c6c6b0f9316 admin admin] PATH_INFO: `/v3/domains` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:33.769760 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39654569-1496-4071-8c2e-0c6c6b0f9316 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87935) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:45:33.770055 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39654569-1496-4071-8c2e-0c6c6b0f9316 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:45:33.771059 dv-cinder-828805-6-smb devstack@keystone.service[87935]: WARNING py.warnings [None req-39654569-1496-4071-8c2e-0c6c6b0f9316 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 13 19:45:33.771059 dv-cinder-828805-6-smb devstack@keystone.service[87935]: warnings.warn(msg) Sep 13 19:45:33.771059 dv-cinder-828805-6-smb devstack@keystone.service[87935]: Sep 13 19:45:33.771930 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39654569-1496-4071-8c2e-0c6c6b0f9316 admin admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:45:33.784350 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 735/1496] 10.222.0.25 () {58 vars in 1153 bytes} [Tue Sep 13 19:45:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 19:45:33.793905 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d360348-fc2f-47b0-a23d-2bbdca46dff9 None None] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:45:33.803203 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d360348-fc2f-47b0-a23d-2bbdca46dff9 None None] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:45:33.869898 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG dbcounter [-] [87934] Writing DB stats keystone:SELECT=100 {{(pid=87934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:45:33.903460 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34471f47-5b9d-4202-a5d1-0a43b3602182 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:45:33.904061 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34471f47-5b9d-4202-a5d1-0a43b3602182 admin admin] REQUEST_METHOD: `POST` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:33.904363 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34471f47-5b9d-4202-a5d1-0a43b3602182 admin admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:33.904631 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34471f47-5b9d-4202-a5d1-0a43b3602182 admin admin] PATH_INFO: `/v3/projects` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:33.905254 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34471f47-5b9d-4202-a5d1-0a43b3602182 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:45:33.906957 dv-cinder-828805-6-smb devstack@keystone.service[87934]: WARNING py.warnings [None req-34471f47-5b9d-4202-a5d1-0a43b3602182 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 13 19:45:33.906957 dv-cinder-828805-6-smb devstack@keystone.service[87934]: warnings.warn(msg) Sep 13 19:45:33.906957 dv-cinder-828805-6-smb devstack@keystone.service[87934]: Sep 13 19:45:33.908126 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34471f47-5b9d-4202-a5d1-0a43b3602182 admin admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:45:33.964049 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 762/1497] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Sep 13 19:45:33 2022] POST /identity/v3/projects => generated 375 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 19:45:33.968550 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39654569-1496-4071-8c2e-0c6c6b0f9316 admin admin] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:45:33.970798 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.fernet_utils [None req-39654569-1496-4071-8c2e-0c6c6b0f9316 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:45:34.005546 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39654569-1496-4071-8c2e-0c6c6b0f9316 admin admin] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:45:34.100276 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e49b39-d1a8-4aae-8e94-cd5dbca4719c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:45:34.100868 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e49b39-d1a8-4aae-8e94-cd5dbca4719c admin admin] REQUEST_METHOD: `POST` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:34.101145 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e49b39-d1a8-4aae-8e94-cd5dbca4719c admin admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:34.101414 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e49b39-d1a8-4aae-8e94-cd5dbca4719c admin admin] PATH_INFO: `/v3/users` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:34.102046 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e49b39-d1a8-4aae-8e94-cd5dbca4719c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:45:34.103055 dv-cinder-828805-6-smb devstack@keystone.service[87935]: WARNING py.warnings [None req-f1e49b39-d1a8-4aae-8e94-cd5dbca4719c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 13 19:45:34.103055 dv-cinder-828805-6-smb devstack@keystone.service[87935]: warnings.warn(msg) Sep 13 19:45:34.103055 dv-cinder-828805-6-smb devstack@keystone.service[87935]: Sep 13 19:45:34.104283 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e49b39-d1a8-4aae-8e94-cd5dbca4719c admin admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:45:34.146389 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 736/1498] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Sep 13 19:45:33 2022] POST /identity/v3/users => generated 288 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 19:45:34.150558 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34471f47-5b9d-4202-a5d1-0a43b3602182 admin admin] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:45:34.152073 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.fernet_utils [None req-34471f47-5b9d-4202-a5d1-0a43b3602182 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:45:34.214310 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34471f47-5b9d-4202-a5d1-0a43b3602182 admin admin] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:45:34.304269 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG dbcounter [-] [87934] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:45:34.316464 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41ba977-64c8-44b0-bb70-dbc3fd2bd259 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:45:34.317067 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41ba977-64c8-44b0-bb70-dbc3fd2bd259 admin admin] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:34.317346 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41ba977-64c8-44b0-bb70-dbc3fd2bd259 admin admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:34.317610 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41ba977-64c8-44b0-bb70-dbc3fd2bd259 admin admin] PATH_INFO: `/v3/roles` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:34.318423 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c41ba977-64c8-44b0-bb70-dbc3fd2bd259 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:45:34.319424 dv-cinder-828805-6-smb devstack@keystone.service[87934]: WARNING py.warnings [None req-c41ba977-64c8-44b0-bb70-dbc3fd2bd259 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 13 19:45:34.319424 dv-cinder-828805-6-smb devstack@keystone.service[87934]: warnings.warn(msg) Sep 13 19:45:34.319424 dv-cinder-828805-6-smb devstack@keystone.service[87934]: Sep 13 19:45:34.320328 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c41ba977-64c8-44b0-bb70-dbc3fd2bd259 admin admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:45:34.333091 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 763/1499] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Sep 13 19:45:34 2022] GET /identity/v3/roles => generated 1420 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 19:45:34.337161 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e49b39-d1a8-4aae-8e94-cd5dbca4719c admin admin] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:45:34.338668 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.fernet_utils [None req-f1e49b39-d1a8-4aae-8e94-cd5dbca4719c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:45:34.350438 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e49b39-d1a8-4aae-8e94-cd5dbca4719c admin admin] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:45:34.375251 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG dbcounter [-] [87935] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:45:34.446078 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345d9fc5-8470-490b-86c2-0d09f3de565d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:45:34.446705 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345d9fc5-8470-490b-86c2-0d09f3de565d admin admin] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:34.446981 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345d9fc5-8470-490b-86c2-0d09f3de565d admin admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:34.447248 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345d9fc5-8470-490b-86c2-0d09f3de565d admin admin] PATH_INFO: `/v3/roles` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:34.447890 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-345d9fc5-8470-490b-86c2-0d09f3de565d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:45:34.448919 dv-cinder-828805-6-smb devstack@keystone.service[87935]: WARNING py.warnings [None req-345d9fc5-8470-490b-86c2-0d09f3de565d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 13 19:45:34.448919 dv-cinder-828805-6-smb devstack@keystone.service[87935]: warnings.warn(msg) Sep 13 19:45:34.448919 dv-cinder-828805-6-smb devstack@keystone.service[87935]: Sep 13 19:45:34.449795 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-345d9fc5-8470-490b-86c2-0d09f3de565d admin admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:45:34.462642 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 737/1500] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Sep 13 19:45:34 2022] GET /identity/v3/roles => generated 1420 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 19:45:34.466815 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41ba977-64c8-44b0-bb70-dbc3fd2bd259 admin admin] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:45:34.468384 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.fernet_utils [None req-c41ba977-64c8-44b0-bb70-dbc3fd2bd259 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:45:34.501441 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41ba977-64c8-44b0-bb70-dbc3fd2bd259 admin admin] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:45:34.596922 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ffdbc5-ce53-44f0-8eb6-34a253791a5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:45:34.597974 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ffdbc5-ce53-44f0-8eb6-34a253791a5e admin admin] REQUEST_METHOD: `PUT` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:34.598437 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ffdbc5-ce53-44f0-8eb6-34a253791a5e admin admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:34.598891 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ffdbc5-ce53-44f0-8eb6-34a253791a5e admin admin] PATH_INFO: `/v3/projects/a969a2adc0914227ae206a50235e2a99/users/20e91163a9d740d4b7480e3ae97ec8b0/roles/a259191f6d0e46fabd9f34536bb28747` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:34.628540 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ffdbc5-ce53-44f0-8eb6-34a253791a5e admin admin] RBAC: Authorizing `identity:create_grant(project_id=a969a2adc0914227ae206a50235e2a99, user_id=20e91163a9d740d4b7480e3ae97ec8b0, role_id=a259191f6d0e46fabd9f34536bb28747)` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:45:34.629482 dv-cinder-828805-6-smb devstack@keystone.service[87934]: WARNING py.warnings [None req-37ffdbc5-ce53-44f0-8eb6-34a253791a5e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 13 19:45:34.629482 dv-cinder-828805-6-smb devstack@keystone.service[87934]: warnings.warn(msg) Sep 13 19:45:34.629482 dv-cinder-828805-6-smb devstack@keystone.service[87934]: Sep 13 19:45:34.631394 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ffdbc5-ce53-44f0-8eb6-34a253791a5e admin admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:45:34.655291 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 764/1501] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Sep 13 19:45:34 2022] PUT /identity/v3/projects/a969a2adc0914227ae206a50235e2a99/users/20e91163a9d740d4b7480e3ae97ec8b0/roles/a259191f6d0e46fabd9f34536bb28747 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 19:45:34.667832 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98390205-f293-4f58-a907-f8355cd79509 None None] REQUEST_METHOD: `POST` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:34.668143 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98390205-f293-4f58-a907-f8355cd79509 None None] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:34.668450 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98390205-f293-4f58-a907-f8355cd79509 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:34.725379 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.auth.core [None req-98390205-f293-4f58-a907-f8355cd79509 None None] MFA Rules not processed for user `20e91163a9d740d4b7480e3ae97ec8b0`. Rule list: `[]` (Enabled: `True`). {{(pid=87935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:45:34.726585 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.fernet_utils [None req-98390205-f293-4f58-a907-f8355cd79509 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:45:34.804407 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 738/1502] 10.222.0.25 () {58 vars in 958 bytes} [Tue Sep 13 19:45:34 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 19:45:34.818181 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956d58d5-ce8b-48c8-9589-4f15309e3ca8 None None] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:34.818484 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956d58d5-ce8b-48c8-9589-4f15309e3ca8 None None] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:34.818756 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956d58d5-ce8b-48c8-9589-4f15309e3ca8 None None] PATH_INFO: `/` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:34.820080 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 765/1503] 10.222.0.25 () {54 vars in 964 bytes} [Tue Sep 13 19:45:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:45:34.824769 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c66e13-3f03-4d08-9f5f-14448db026f5 None None] REQUEST_METHOD: `POST` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:34.825055 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c66e13-3f03-4d08-9f5f-14448db026f5 None None] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:34.825356 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c66e13-3f03-4d08-9f5f-14448db026f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:34.857539 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG dbcounter [-] [87935] Writing DB stats keystone:SELECT=100 {{(pid=87935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:45:34.903926 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.auth.core [None req-53c66e13-3f03-4d08-9f5f-14448db026f5 None None] MFA Rules not processed for user `4cbb50c88b794a7f9f26844effde7d63`. Rule list: `[]` (Enabled: `True`). {{(pid=87935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:45:34.905106 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.fernet_utils [None req-53c66e13-3f03-4d08-9f5f-14448db026f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:45:34.985907 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 739/1504] 10.222.0.25 () {58 vars in 1061 bytes} [Tue Sep 13 19:45:34 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 19:45:34.996481 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956d58d5-ce8b-48c8-9589-4f15309e3ca8 None None] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:45:34.997990 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.fernet_utils [None req-956d58d5-ce8b-48c8-9589-4f15309e3ca8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:45:35.047979 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG dbcounter [-] [87934] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:45:35.102083 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956d58d5-ce8b-48c8-9589-4f15309e3ca8 None None] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:45:35.175325 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df003c30-e90d-465e-83d6-441b9fb1729e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cbb50c88b794a7f9f26844effde7d63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a10a4268f3c4cb29f4e00c292e2df62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:45:35.175846 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df003c30-e90d-465e-83d6-441b9fb1729e service cinder] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:35.176123 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df003c30-e90d-465e-83d6-441b9fb1729e service cinder] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:35.176421 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df003c30-e90d-465e-83d6-441b9fb1729e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:35.177997 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.fernet_utils [None req-df003c30-e90d-465e-83d6-441b9fb1729e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:45:35.284613 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df003c30-e90d-465e-83d6-441b9fb1729e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:45:35.286027 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df003c30-e90d-465e-83d6-441b9fb1729e service cinder] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:45:35.289417 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG dbcounter [-] [87934] Writing DB stats keystone:SELECT=100 {{(pid=87934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:45:35.303725 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 766/1505] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Sep 13 19:45:34 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 19:45:35.350424 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2f7757-72ce-49b5-a2a3-332b7fe74bc0 None None] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:35.350874 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2f7757-72ce-49b5-a2a3-332b7fe74bc0 None None] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:35.350980 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2f7757-72ce-49b5-a2a3-332b7fe74bc0 None None] PATH_INFO: `/` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:35.352253 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 740/1506] 10.222.0.25 () {52 vars in 830 bytes} [Tue Sep 13 19:45:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:45:35.355778 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df003c30-e90d-465e-83d6-441b9fb1729e service cinder] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:45:35.357014 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.fernet_utils [None req-df003c30-e90d-465e-83d6-441b9fb1729e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:45:35.453719 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df003c30-e90d-465e-83d6-441b9fb1729e service cinder] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:45:35.547143 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8159362b-af7a-4add-a1c2-cc0da93047ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:45:35.547762 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8159362b-af7a-4add-a1c2-cc0da93047ef admin admin] REQUEST_METHOD: `DELETE` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:35.548018 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8159362b-af7a-4add-a1c2-cc0da93047ef admin admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:35.548312 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8159362b-af7a-4add-a1c2-cc0da93047ef admin admin] PATH_INFO: `/v3/users/20e91163a9d740d4b7480e3ae97ec8b0` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:35.561031 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8159362b-af7a-4add-a1c2-cc0da93047ef admin admin] RBAC: Authorizing `identity:delete_user(user_id=20e91163a9d740d4b7480e3ae97ec8b0)` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:45:35.562037 dv-cinder-828805-6-smb devstack@keystone.service[87934]: WARNING py.warnings [None req-8159362b-af7a-4add-a1c2-cc0da93047ef admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 13 19:45:35.562037 dv-cinder-828805-6-smb devstack@keystone.service[87934]: warnings.warn(msg) Sep 13 19:45:35.562037 dv-cinder-828805-6-smb devstack@keystone.service[87934]: Sep 13 19:45:35.563231 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8159362b-af7a-4add-a1c2-cc0da93047ef admin admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:45:35.572887 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG dbcounter [-] [87934] Writing DB stats keystone:SELECT=100 {{(pid=87934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:45:35.629892 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.notifications [None req-8159362b-af7a-4add-a1c2-cc0da93047ef admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '20e91163a9d740d4b7480e3ae97ec8b0'} {{(pid=87934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:45:35.630328 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.notifications [None req-8159362b-af7a-4add-a1c2-cc0da93047ef admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '20e91163a9d740d4b7480e3ae97ec8b0'} {{(pid=87934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:45:35.630847 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.notifications [None req-8159362b-af7a-4add-a1c2-cc0da93047ef admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '20e91163a9d740d4b7480e3ae97ec8b0'} {{(pid=87934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:45:35.646485 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.notifications [None req-8159362b-af7a-4add-a1c2-cc0da93047ef admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '20e91163a9d740d4b7480e3ae97ec8b0'} {{(pid=87934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:45:35.668806 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.notifications [None req-8159362b-af7a-4add-a1c2-cc0da93047ef admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '20e91163a9d740d4b7480e3ae97ec8b0'} {{(pid=87934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:45:35.683249 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 767/1507] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Sep 13 19:45:35 2022] DELETE /identity/v3/users/20e91163a9d740d4b7480e3ae97ec8b0 => generated 0 bytes in 328 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 19:45:35.687639 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e55ae5b-85b9-49a1-993d-0f9142c300d8 None None] REQUEST_METHOD: `POST` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:35.687923 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e55ae5b-85b9-49a1-993d-0f9142c300d8 None None] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:35.688195 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e55ae5b-85b9-49a1-993d-0f9142c300d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:35.746271 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.auth.core [None req-5e55ae5b-85b9-49a1-993d-0f9142c300d8 None None] MFA Rules not processed for user `7b0aed92d02344acb92a0e4aa67c3068`. Rule list: `[]` (Enabled: `True`). {{(pid=87935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:45:35.747484 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.fernet_utils [None req-5e55ae5b-85b9-49a1-993d-0f9142c300d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:45:35.823994 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG dbcounter [-] [87935] Writing DB stats keystone:SELECT=100 {{(pid=87935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:45:35.837434 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 741/1508] 10.222.0.25 () {58 vars in 958 bytes} [Tue Sep 13 19:45:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 19:45:35.847354 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8159362b-af7a-4add-a1c2-cc0da93047ef admin admin] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:45:35.848615 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.fernet_utils [None req-8159362b-af7a-4add-a1c2-cc0da93047ef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:45:35.951751 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8159362b-af7a-4add-a1c2-cc0da93047ef admin admin] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:45:36.006968 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG dbcounter [-] [87934] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=87934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:45:36.027480 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5287bbe-4cc6-44e9-b119-6aa6de984ed6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1196a96e4a404f559600b69f929ea9da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a10a4268f3c4cb29f4e00c292e2df62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:45:36.028085 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5287bbe-4cc6-44e9-b119-6aa6de984ed6 service neutron] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:36.028389 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5287bbe-4cc6-44e9-b119-6aa6de984ed6 service neutron] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:36.028661 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5287bbe-4cc6-44e9-b119-6aa6de984ed6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:36.030228 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.fernet_utils [None req-c5287bbe-4cc6-44e9-b119-6aa6de984ed6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:45:36.139109 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5287bbe-4cc6-44e9-b119-6aa6de984ed6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:45:36.140575 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5287bbe-4cc6-44e9-b119-6aa6de984ed6 service neutron] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:45:36.158206 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 768/1509] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Sep 13 19:45:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 19:45:36.489009 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e55ae5b-85b9-49a1-993d-0f9142c300d8 None None] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:45:36.490265 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.fernet_utils [None req-5e55ae5b-85b9-49a1-993d-0f9142c300d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:45:36.502715 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e55ae5b-85b9-49a1-993d-0f9142c300d8 None None] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:45:36.599224 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9597a6f0-bb18-4d2c-ab06-2c544c9c7e0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:45:36.599765 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9597a6f0-bb18-4d2c-ab06-2c544c9c7e0b admin admin] REQUEST_METHOD: `DELETE` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:36.600036 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9597a6f0-bb18-4d2c-ab06-2c544c9c7e0b admin admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:36.600344 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9597a6f0-bb18-4d2c-ab06-2c544c9c7e0b admin admin] PATH_INFO: `/v3/projects/a969a2adc0914227ae206a50235e2a99` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:36.610027 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9597a6f0-bb18-4d2c-ab06-2c544c9c7e0b admin admin] RBAC: Authorizing `identity:delete_project(project_id=a969a2adc0914227ae206a50235e2a99)` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:45:36.611046 dv-cinder-828805-6-smb devstack@keystone.service[87935]: WARNING py.warnings [None req-9597a6f0-bb18-4d2c-ab06-2c544c9c7e0b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 13 19:45:36.611046 dv-cinder-828805-6-smb devstack@keystone.service[87935]: warnings.warn(msg) Sep 13 19:45:36.611046 dv-cinder-828805-6-smb devstack@keystone.service[87935]: Sep 13 19:45:36.613093 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9597a6f0-bb18-4d2c-ab06-2c544c9c7e0b admin admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:45:36.671749 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.notifications [None req-9597a6f0-bb18-4d2c-ab06-2c544c9c7e0b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a969a2adc0914227ae206a50235e2a99', 'request_id': 'req-9597a6f0-bb18-4d2c-ab06-2c544c9c7e0b'} {{(pid=87935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:45:36.678764 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.notifications [None req-9597a6f0-bb18-4d2c-ab06-2c544c9c7e0b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a969a2adc0914227ae206a50235e2a99', 'request_id': 'req-9597a6f0-bb18-4d2c-ab06-2c544c9c7e0b'} {{(pid=87935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:45:36.689015 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.notifications [None req-9597a6f0-bb18-4d2c-ab06-2c544c9c7e0b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a969a2adc0914227ae206a50235e2a99', 'request_id': 'req-9597a6f0-bb18-4d2c-ab06-2c544c9c7e0b'} {{(pid=87935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:45:36.719447 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.notifications [None req-9597a6f0-bb18-4d2c-ab06-2c544c9c7e0b admin admin] The token cache is being invalidate because project a969a2adc0914227ae206a50235e2a99 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87935) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 19:45:36.719734 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.notifications [None req-9597a6f0-bb18-4d2c-ab06-2c544c9c7e0b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:45:36.720165 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.notifications [None req-9597a6f0-bb18-4d2c-ab06-2c544c9c7e0b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:45:36.722400 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 742/1510] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Sep 13 19:45:36 2022] DELETE /identity/v3/projects/a969a2adc0914227ae206a50235e2a99 => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 19:45:46.155896 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG dbcounter [-] [87934] Writing DB stats keystone:SELECT=62 {{(pid=87934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:45:46.717430 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG dbcounter [-] [87935] Writing DB stats keystone:SELECT=84,keystone:DELETE=7,keystone:INSERT=1 {{(pid=87935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:47:11.917945 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785e42f2-c4b7-4fdf-a297-015e45239368 None None] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:47:11.918529 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785e42f2-c4b7-4fdf-a297-015e45239368 None None] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:47:11.918529 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785e42f2-c4b7-4fdf-a297-015e45239368 None None] PATH_INFO: `/` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:47:11.919728 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 769/1511] 127.0.0.1 () {54 vars in 901 bytes} [Tue Sep 13 19:47:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:47:11.925163 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5e1ca9-9172-44e2-b403-4d428caa2fd2 None None] REQUEST_METHOD: `POST` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:47:11.925614 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5e1ca9-9172-44e2-b403-4d428caa2fd2 None None] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:47:11.925710 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5e1ca9-9172-44e2-b403-4d428caa2fd2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:47:12.011291 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.auth.core [None req-cd5e1ca9-9172-44e2-b403-4d428caa2fd2 None None] MFA Rules not processed for user `7b0aed92d02344acb92a0e4aa67c3068`. Rule list: `[]` (Enabled: `True`). {{(pid=87935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:47:12.012542 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.fernet_utils [None req-cd5e1ca9-9172-44e2-b403-4d428caa2fd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:47:12.115740 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 743/1512] 127.0.0.1 () {58 vars in 998 bytes} [Tue Sep 13 19:47:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 19:47:12.296899 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785e42f2-c4b7-4fdf-a297-015e45239368 None None] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:47:12.298995 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.fernet_utils [None req-785e42f2-c4b7-4fdf-a297-015e45239368 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:47:12.419200 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785e42f2-c4b7-4fdf-a297-015e45239368 None None] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:47:12.424719 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd186be-3dbf-4d6b-9188-78dc0b56abfc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd71fe5a8275f4ea98555afdcefc902a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a10a4268f3c4cb29f4e00c292e2df62', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:47:12.425329 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd186be-3dbf-4d6b-9188-78dc0b56abfc service nova] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:47:12.425610 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd186be-3dbf-4d6b-9188-78dc0b56abfc service nova] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:47:12.425883 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd186be-3dbf-4d6b-9188-78dc0b56abfc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:47:12.435373 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd186be-3dbf-4d6b-9188-78dc0b56abfc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:47:12.436993 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd186be-3dbf-4d6b-9188-78dc0b56abfc service nova] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:47:12.446441 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 770/1513] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Sep 13 19:47:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 19:47:13.472046 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c77ba0d-e985-4f7f-b58c-540434b65892 None None] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:47:13.472660 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c77ba0d-e985-4f7f-b58c-540434b65892 None None] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:47:13.472660 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c77ba0d-e985-4f7f-b58c-540434b65892 None None] PATH_INFO: `/v3` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:47:13.473910 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 744/1514] 10.222.0.57 () {54 vars in 925 bytes} [Tue Sep 13 19:47:13 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:47:13.479764 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243afa40-37e3-43b3-a66e-2f9b51c8e47f None None] REQUEST_METHOD: `POST` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:47:13.480268 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243afa40-37e3-43b3-a66e-2f9b51c8e47f None None] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:47:13.480389 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243afa40-37e3-43b3-a66e-2f9b51c8e47f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:47:13.539314 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.auth.core [None req-243afa40-37e3-43b3-a66e-2f9b51c8e47f None None] MFA Rules not processed for user `02eb3d3173c1476cb83a72add0e878e2`. Rule list: `[]` (Enabled: `True`). {{(pid=87934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:47:13.540450 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.fernet_utils [None req-243afa40-37e3-43b3-a66e-2f9b51c8e47f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:47:13.555190 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4495ec22-adb6-4832-bd46-4ac98389ddaf None None] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:47:13.555474 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4495ec22-adb6-4832-bd46-4ac98389ddaf None None] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:47:13.555748 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4495ec22-adb6-4832-bd46-4ac98389ddaf None None] PATH_INFO: `/` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:47:13.557166 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 745/1515] 127.0.0.1 () {54 vars in 901 bytes} [Tue Sep 13 19:47:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 13 19:47:13.563483 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74604018-ec72-418a-aa12-0ec7979ce3a4 None None] REQUEST_METHOD: `POST` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:47:13.563769 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74604018-ec72-418a-aa12-0ec7979ce3a4 None None] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:47:13.564109 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74604018-ec72-418a-aa12-0ec7979ce3a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:47:13.584449 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.auth.core [None req-74604018-ec72-418a-aa12-0ec7979ce3a4 None None] MFA Rules not processed for user `7b0aed92d02344acb92a0e4aa67c3068`. Rule list: `[]` (Enabled: `True`). {{(pid=87935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:47:13.586260 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.fernet_utils [None req-74604018-ec72-418a-aa12-0ec7979ce3a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:47:13.594059 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 746/1516] 127.0.0.1 () {58 vars in 998 bytes} [Tue Sep 13 19:47:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 19:47:13.610322 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG dbcounter [-] [87934] Writing DB stats keystone:SELECT=100 {{(pid=87934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:47:13.615997 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 771/1517] 10.222.0.57 () {58 vars in 1015 bytes} [Tue Sep 13 19:47:13 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 19:47:13.751870 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74604018-ec72-418a-aa12-0ec7979ce3a4 None None] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:47:13.764760 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74604018-ec72-418a-aa12-0ec7979ce3a4 None None] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:47:13.770137 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8570b3c5-6601-4679-9d5d-2a706fb1f41d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd71fe5a8275f4ea98555afdcefc902a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a10a4268f3c4cb29f4e00c292e2df62', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:47:13.770728 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8570b3c5-6601-4679-9d5d-2a706fb1f41d service nova] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:47:13.771003 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8570b3c5-6601-4679-9d5d-2a706fb1f41d service nova] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:47:13.771270 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8570b3c5-6601-4679-9d5d-2a706fb1f41d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:47:13.779943 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8570b3c5-6601-4679-9d5d-2a706fb1f41d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:47:13.781550 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8570b3c5-6601-4679-9d5d-2a706fb1f41d service nova] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:47:13.790926 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 747/1518] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Sep 13 19:47:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 19:47:17.148465 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e75966-9236-4434-a527-f3bff79c2da7 None None] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:47:17.149009 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e75966-9236-4434-a527-f3bff79c2da7 None None] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:47:17.149360 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e75966-9236-4434-a527-f3bff79c2da7 None None] PATH_INFO: `/` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:47:17.150694 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 772/1519] 10.222.0.25 () {54 vars in 961 bytes} [Tue Sep 13 19:47:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:47:17.155731 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b283668-5aec-4421-8c2b-6202274e8544 None None] REQUEST_METHOD: `POST` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:47:17.156183 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b283668-5aec-4421-8c2b-6202274e8544 None None] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:47:17.156313 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b283668-5aec-4421-8c2b-6202274e8544 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:47:17.175509 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.auth.core [None req-0b283668-5aec-4421-8c2b-6202274e8544 None None] MFA Rules not processed for user `02eb3d3173c1476cb83a72add0e878e2`. Rule list: `[]` (Enabled: `True`). {{(pid=87935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:47:17.176762 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.fernet_utils [None req-0b283668-5aec-4421-8c2b-6202274e8544 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:47:17.186229 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 748/1520] 10.222.0.25 () {58 vars in 1058 bytes} [Tue Sep 13 19:47:17 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 19:47:17.193886 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e75966-9236-4434-a527-f3bff79c2da7 None None] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:47:17.207736 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e75966-9236-4434-a527-f3bff79c2da7 None None] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:47:17.212696 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42fe13db-eba8-43e4-8e03-d8a580c8aca7 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02eb3d3173c1476cb83a72add0e878e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a10a4268f3c4cb29f4e00c292e2df62', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:47:17.213307 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fe13db-eba8-43e4-8e03-d8a580c8aca7 service placement] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:47:17.213579 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fe13db-eba8-43e4-8e03-d8a580c8aca7 service placement] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:47:17.213841 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fe13db-eba8-43e4-8e03-d8a580c8aca7 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:47:17.221815 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42fe13db-eba8-43e4-8e03-d8a580c8aca7 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:47:17.223553 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42fe13db-eba8-43e4-8e03-d8a580c8aca7 service placement] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:47:17.233429 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 773/1521] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Sep 13 19:47:17 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 19:47:25.278641 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb76154a-f7a5-43c6-a2a1-68800d53bf46 None None] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:47:25.279220 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb76154a-f7a5-43c6-a2a1-68800d53bf46 None None] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:47:25.279220 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb76154a-f7a5-43c6-a2a1-68800d53bf46 None None] PATH_INFO: `/` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:47:25.280580 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 749/1522] 127.0.0.1 () {54 vars in 901 bytes} [Tue Sep 13 19:47:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:47:25.286722 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33562277-7969-47fc-812e-ca2e7e458fc3 None None] REQUEST_METHOD: `POST` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:47:25.287190 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33562277-7969-47fc-812e-ca2e7e458fc3 None None] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:47:25.287299 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33562277-7969-47fc-812e-ca2e7e458fc3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:47:25.307704 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.auth.core [None req-33562277-7969-47fc-812e-ca2e7e458fc3 None None] MFA Rules not processed for user `7b0aed92d02344acb92a0e4aa67c3068`. Rule list: `[]` (Enabled: `True`). {{(pid=87934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:47:25.308912 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.fernet_utils [None req-33562277-7969-47fc-812e-ca2e7e458fc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:47:25.316588 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 774/1523] 127.0.0.1 () {58 vars in 998 bytes} [Tue Sep 13 19:47:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 19:47:25.472693 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb76154a-f7a5-43c6-a2a1-68800d53bf46 None None] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:47:25.487783 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb76154a-f7a5-43c6-a2a1-68800d53bf46 None None] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:47:25.493220 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9dd323-f43c-4b7d-8ece-4cda6187cd46 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd71fe5a8275f4ea98555afdcefc902a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a10a4268f3c4cb29f4e00c292e2df62', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:47:25.493808 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9dd323-f43c-4b7d-8ece-4cda6187cd46 service nova] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:47:25.494082 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9dd323-f43c-4b7d-8ece-4cda6187cd46 service nova] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:47:25.494348 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9dd323-f43c-4b7d-8ece-4cda6187cd46 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:47:25.502208 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b9dd323-f43c-4b7d-8ece-4cda6187cd46 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:47:25.503759 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b9dd323-f43c-4b7d-8ece-4cda6187cd46 service nova] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:47:25.512853 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 750/1524] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Sep 13 19:47:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 19:47:26.608028 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9f217a-2f1a-4dfc-86fa-32608807d9a6 None None] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:47:26.608575 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9f217a-2f1a-4dfc-86fa-32608807d9a6 None None] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:47:26.608575 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9f217a-2f1a-4dfc-86fa-32608807d9a6 None None] PATH_INFO: `/` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:47:26.609858 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 775/1525] 127.0.0.1 () {54 vars in 901 bytes} [Tue Sep 13 19:47:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:47:26.616192 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc5c291-9590-4f11-a8dc-8267dd311044 None None] REQUEST_METHOD: `POST` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:47:26.616699 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc5c291-9590-4f11-a8dc-8267dd311044 None None] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:47:26.616803 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc5c291-9590-4f11-a8dc-8267dd311044 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:47:26.638240 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.auth.core [None req-3cc5c291-9590-4f11-a8dc-8267dd311044 None None] MFA Rules not processed for user `7b0aed92d02344acb92a0e4aa67c3068`. Rule list: `[]` (Enabled: `True`). {{(pid=87935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:47:26.639559 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.fernet_utils [None req-3cc5c291-9590-4f11-a8dc-8267dd311044 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:47:26.648644 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 751/1526] 127.0.0.1 () {58 vars in 998 bytes} [Tue Sep 13 19:47:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 19:47:26.808802 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9f217a-2f1a-4dfc-86fa-32608807d9a6 None None] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:47:26.823277 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9f217a-2f1a-4dfc-86fa-32608807d9a6 None None] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:47:26.828669 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13bb1060-8443-45c8-b145-741f4cf58829 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd71fe5a8275f4ea98555afdcefc902a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a10a4268f3c4cb29f4e00c292e2df62', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:47:26.829511 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bb1060-8443-45c8-b145-741f4cf58829 service nova] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:47:26.829786 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bb1060-8443-45c8-b145-741f4cf58829 service nova] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:47:26.830052 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bb1060-8443-45c8-b145-741f4cf58829 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:47:26.838872 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13bb1060-8443-45c8-b145-741f4cf58829 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:47:26.840511 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13bb1060-8443-45c8-b145-741f4cf58829 service nova] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:47:26.849791 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 776/1527] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Sep 13 19:47:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 19:47:31.172517 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0590cad8-fbb1-4742-a76e-93615450a6c1 None None] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:47:31.173045 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0590cad8-fbb1-4742-a76e-93615450a6c1 None None] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:47:31.173045 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0590cad8-fbb1-4742-a76e-93615450a6c1 None None] PATH_INFO: `/` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:47:31.174337 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 752/1528] 127.0.0.1 () {54 vars in 917 bytes} [Tue Sep 13 19:47:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:47:31.179565 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4355321-4363-486f-a07d-965c698a6b70 None None] REQUEST_METHOD: `POST` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:47:31.180003 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4355321-4363-486f-a07d-965c698a6b70 None None] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:47:31.180124 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4355321-4363-486f-a07d-965c698a6b70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:47:31.200835 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.auth.core [None req-d4355321-4363-486f-a07d-965c698a6b70 None None] MFA Rules not processed for user `7b0aed92d02344acb92a0e4aa67c3068`. Rule list: `[]` (Enabled: `True`). {{(pid=87934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:47:31.202039 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.fernet_utils [None req-d4355321-4363-486f-a07d-965c698a6b70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:47:31.210740 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 777/1529] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Sep 13 19:47:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 19:47:31.518628 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0590cad8-fbb1-4742-a76e-93615450a6c1 None None] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:47:31.520357 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.fernet_utils [None req-0590cad8-fbb1-4742-a76e-93615450a6c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:47:31.546174 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG dbcounter [-] [87935] Writing DB stats keystone:SELECT=100 {{(pid=87935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:47:31.599298 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0590cad8-fbb1-4742-a76e-93615450a6c1 None None] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:47:31.602888 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2bbefbb-3b1b-44cf-8e79-3295a9229e62 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1196a96e4a404f559600b69f929ea9da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a10a4268f3c4cb29f4e00c292e2df62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:47:31.603485 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bbefbb-3b1b-44cf-8e79-3295a9229e62 service neutron] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:47:31.603760 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bbefbb-3b1b-44cf-8e79-3295a9229e62 service neutron] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:47:31.604030 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bbefbb-3b1b-44cf-8e79-3295a9229e62 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:47:31.612936 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2bbefbb-3b1b-44cf-8e79-3295a9229e62 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:47:31.614356 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2bbefbb-3b1b-44cf-8e79-3295a9229e62 service neutron] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:47:31.624134 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 753/1530] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Sep 13 19:47:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 19:47:33.773240 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62be4afe-59c9-4720-8491-5fddd63c8236 None None] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:47:33.773686 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62be4afe-59c9-4720-8491-5fddd63c8236 None None] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:47:33.773804 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62be4afe-59c9-4720-8491-5fddd63c8236 None None] PATH_INFO: `/` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:47:33.775113 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 778/1531] 127.0.0.1 () {54 vars in 917 bytes} [Tue Sep 13 19:47:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:47:33.780559 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a1a24e-b9fb-4968-93ec-0fbf0fa7d285 None None] REQUEST_METHOD: `POST` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:47:33.780963 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a1a24e-b9fb-4968-93ec-0fbf0fa7d285 None None] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:47:33.781159 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a1a24e-b9fb-4968-93ec-0fbf0fa7d285 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:47:33.801299 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.auth.core [None req-e6a1a24e-b9fb-4968-93ec-0fbf0fa7d285 None None] MFA Rules not processed for user `7b0aed92d02344acb92a0e4aa67c3068`. Rule list: `[]` (Enabled: `True`). {{(pid=87935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:47:33.802508 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.fernet_utils [None req-e6a1a24e-b9fb-4968-93ec-0fbf0fa7d285 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:47:33.810449 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 754/1532] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Sep 13 19:47:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 19:47:34.102927 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62be4afe-59c9-4720-8491-5fddd63c8236 None None] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:47:34.104678 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.fernet_utils [None req-62be4afe-59c9-4720-8491-5fddd63c8236 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:47:34.117621 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62be4afe-59c9-4720-8491-5fddd63c8236 None None] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:47:34.121093 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778787aa-475c-4b9f-9509-c0216924e190 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1196a96e4a404f559600b69f929ea9da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a10a4268f3c4cb29f4e00c292e2df62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:47:34.121680 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778787aa-475c-4b9f-9509-c0216924e190 service neutron] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:47:34.121951 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778787aa-475c-4b9f-9509-c0216924e190 service neutron] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:47:34.122216 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778787aa-475c-4b9f-9509-c0216924e190 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:47:34.130898 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-778787aa-475c-4b9f-9509-c0216924e190 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:47:34.132928 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-778787aa-475c-4b9f-9509-c0216924e190 service neutron] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:47:34.141989 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 779/1533] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Sep 13 19:47:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 19:47:37.826156 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5a8806-bf81-466a-b4c6-5bfb07d45f6d None None] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:47:37.826697 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5a8806-bf81-466a-b4c6-5bfb07d45f6d None None] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:47:37.826697 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5a8806-bf81-466a-b4c6-5bfb07d45f6d None None] PATH_INFO: `/` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:47:37.828066 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 755/1534] 127.0.0.1 () {54 vars in 917 bytes} [Tue Sep 13 19:47:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:47:37.833407 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0189475e-54f3-409f-88ca-3ff0c0869d4d None None] REQUEST_METHOD: `POST` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:47:37.833833 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0189475e-54f3-409f-88ca-3ff0c0869d4d None None] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:47:37.833949 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0189475e-54f3-409f-88ca-3ff0c0869d4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:47:37.853548 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.auth.core [None req-0189475e-54f3-409f-88ca-3ff0c0869d4d None None] MFA Rules not processed for user `7b0aed92d02344acb92a0e4aa67c3068`. Rule list: `[]` (Enabled: `True`). {{(pid=87934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:47:37.854721 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.fernet_utils [None req-0189475e-54f3-409f-88ca-3ff0c0869d4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:47:37.862300 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 780/1535] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Sep 13 19:47:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 19:47:38.167857 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5a8806-bf81-466a-b4c6-5bfb07d45f6d None None] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:47:38.169546 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.fernet_utils [None req-cd5a8806-bf81-466a-b4c6-5bfb07d45f6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:47:38.248705 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5a8806-bf81-466a-b4c6-5bfb07d45f6d None None] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:47:38.252294 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33547d77-8b24-4ee8-92ac-e1bfa63ed548 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cbb50c88b794a7f9f26844effde7d63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a10a4268f3c4cb29f4e00c292e2df62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:47:38.253262 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33547d77-8b24-4ee8-92ac-e1bfa63ed548 service cinder] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:47:38.253565 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33547d77-8b24-4ee8-92ac-e1bfa63ed548 service cinder] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:47:38.253818 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33547d77-8b24-4ee8-92ac-e1bfa63ed548 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:47:38.263543 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33547d77-8b24-4ee8-92ac-e1bfa63ed548 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:47:38.265000 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33547d77-8b24-4ee8-92ac-e1bfa63ed548 service cinder] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:47:38.274301 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 756/1536] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Sep 13 19:47:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 19:47:40.414777 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b99206-3fa6-4237-a898-d2513942186f None None] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:47:40.415340 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b99206-3fa6-4237-a898-d2513942186f None None] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:47:40.415340 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b99206-3fa6-4237-a898-d2513942186f None None] PATH_INFO: `/` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:47:40.416711 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 781/1537] 127.0.0.1 () {54 vars in 917 bytes} [Tue Sep 13 19:47:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:47:40.422030 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bded6567-7dc8-4b80-bc7f-04c174aa0f31 None None] REQUEST_METHOD: `POST` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:47:40.422435 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bded6567-7dc8-4b80-bc7f-04c174aa0f31 None None] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:47:40.422567 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bded6567-7dc8-4b80-bc7f-04c174aa0f31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:47:40.442289 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.auth.core [None req-bded6567-7dc8-4b80-bc7f-04c174aa0f31 None None] MFA Rules not processed for user `7b0aed92d02344acb92a0e4aa67c3068`. Rule list: `[]` (Enabled: `True`). {{(pid=87935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:47:40.443461 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.fernet_utils [None req-bded6567-7dc8-4b80-bc7f-04c174aa0f31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:47:40.451965 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 757/1538] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Sep 13 19:47:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 19:47:40.753877 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b99206-3fa6-4237-a898-d2513942186f None None] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:47:40.755593 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.fernet_utils [None req-73b99206-3fa6-4237-a898-d2513942186f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:47:40.768306 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b99206-3fa6-4237-a898-d2513942186f None None] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:47:40.771977 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc6900f-7493-4f92-8b39-8226981d23af service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cbb50c88b794a7f9f26844effde7d63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a10a4268f3c4cb29f4e00c292e2df62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:47:40.772594 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc6900f-7493-4f92-8b39-8226981d23af service cinder] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:47:40.772869 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc6900f-7493-4f92-8b39-8226981d23af service cinder] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:47:40.773137 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc6900f-7493-4f92-8b39-8226981d23af service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:47:40.781875 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc6900f-7493-4f92-8b39-8226981d23af service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:47:40.783284 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc6900f-7493-4f92-8b39-8226981d23af service cinder] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:47:40.793088 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 782/1539] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Sep 13 19:47:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 19:47:50.437424 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG dbcounter [-] [87935] Writing DB stats keystone:SELECT=66 {{(pid=87935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:47:50.789021 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG dbcounter [-] [87934] Writing DB stats keystone:SELECT=34 {{(pid=87934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:49:10.788416 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02726d9a-388a-4a78-a07d-6f403b0d815a None None] REQUEST_METHOD: `POST` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:49:10.789617 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02726d9a-388a-4a78-a07d-6f403b0d815a None None] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:49:10.789617 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02726d9a-388a-4a78-a07d-6f403b0d815a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:49:10.816707 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.auth.core [None req-02726d9a-388a-4a78-a07d-6f403b0d815a None None] MFA Rules not processed for user `7b0aed92d02344acb92a0e4aa67c3068`. Rule list: `[]` (Enabled: `True`). {{(pid=87935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:49:10.818277 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.fernet_utils [None req-02726d9a-388a-4a78-a07d-6f403b0d815a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:49:10.832010 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 758/1540] 10.222.0.25 () {58 vars in 958 bytes} [Tue Sep 13 19:49:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 19:49:10.842070 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638d7caf-60c2-40e1-adca-3239c77ebb59 None None] REQUEST_METHOD: `POST` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:49:10.843016 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638d7caf-60c2-40e1-adca-3239c77ebb59 None None] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:49:10.843456 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638d7caf-60c2-40e1-adca-3239c77ebb59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:49:10.872135 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.auth.core [None req-638d7caf-60c2-40e1-adca-3239c77ebb59 None None] MFA Rules not processed for user `7b0aed92d02344acb92a0e4aa67c3068`. Rule list: `[]` (Enabled: `True`). {{(pid=87934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:49:10.873696 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.fernet_utils [None req-638d7caf-60c2-40e1-adca-3239c77ebb59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:49:10.887456 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 783/1541] 10.222.0.25 () {58 vars in 958 bytes} [Tue Sep 13 19:49:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 19:49:10.892959 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02726d9a-388a-4a78-a07d-6f403b0d815a None None] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:49:10.899554 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe6cd90-1c39-4fd5-be5b-b184784f9d6f None None] REQUEST_METHOD: `POST` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:49:10.900127 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe6cd90-1c39-4fd5-be5b-b184784f9d6f None None] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:49:10.900752 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe6cd90-1c39-4fd5-be5b-b184784f9d6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:49:10.911549 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02726d9a-388a-4a78-a07d-6f403b0d815a None None] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:49:10.922522 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89bffb94-7445-4c86-92f4-42b067d287d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:49:10.923488 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bffb94-7445-4c86-92f4-42b067d287d1 admin admin] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:49:10.923929 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bffb94-7445-4c86-92f4-42b067d287d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:49:10.924387 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bffb94-7445-4c86-92f4-42b067d287d1 admin admin] PATH_INFO: `/v3/domains` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:49:10.925313 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89bffb94-7445-4c86-92f4-42b067d287d1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87935) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:49:10.925828 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89bffb94-7445-4c86-92f4-42b067d287d1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:49:10.937032 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89bffb94-7445-4c86-92f4-42b067d287d1 admin admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:49:10.944816 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.auth.core [None req-6fe6cd90-1c39-4fd5-be5b-b184784f9d6f None None] MFA Rules not processed for user `7b0aed92d02344acb92a0e4aa67c3068`. Rule list: `[]` (Enabled: `True`). {{(pid=87934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:49:10.946302 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.fernet_utils [None req-6fe6cd90-1c39-4fd5-be5b-b184784f9d6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:49:10.959066 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 759/1542] 10.222.0.25 () {58 vars in 1153 bytes} [Tue Sep 13 19:49:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:49:10.962665 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 784/1543] 10.222.0.25 () {58 vars in 958 bytes} [Tue Sep 13 19:49:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 19:49:10.979385 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe6cd90-1c39-4fd5-be5b-b184784f9d6f None None] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:49:10.979693 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f0a571-0b1f-4111-b7de-4c3f13b8cfd1 None None] REQUEST_METHOD: `POST` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:49:10.980331 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f0a571-0b1f-4111-b7de-4c3f13b8cfd1 None None] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:49:10.980958 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f0a571-0b1f-4111-b7de-4c3f13b8cfd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:49:10.991130 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe6cd90-1c39-4fd5-be5b-b184784f9d6f None None] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:49:11.005683 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e27cdf1-50c0-4f0a-a681-26b59421d052 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:49:11.006563 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e27cdf1-50c0-4f0a-a681-26b59421d052 admin admin] REQUEST_METHOD: `POST` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:49:11.007026 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e27cdf1-50c0-4f0a-a681-26b59421d052 admin admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:49:11.007455 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e27cdf1-50c0-4f0a-a681-26b59421d052 admin admin] PATH_INFO: `/v3/projects` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:49:11.008304 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e27cdf1-50c0-4f0a-a681-26b59421d052 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:49:11.010378 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e27cdf1-50c0-4f0a-a681-26b59421d052 admin admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:49:11.037495 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.auth.core [None req-a5f0a571-0b1f-4111-b7de-4c3f13b8cfd1 None None] MFA Rules not processed for user `7b0aed92d02344acb92a0e4aa67c3068`. Rule list: `[]` (Enabled: `True`). {{(pid=87935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:49:11.039104 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.fernet_utils [None req-a5f0a571-0b1f-4111-b7de-4c3f13b8cfd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:49:11.071772 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 760/1544] 10.222.0.25 () {58 vars in 958 bytes} [Tue Sep 13 19:49:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 19:49:11.073674 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a50f99-a1b8-4005-adf9-c14da034e4d8 None None] REQUEST_METHOD: `POST` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:49:11.074181 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a50f99-a1b8-4005-adf9-c14da034e4d8 None None] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:49:11.074650 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a50f99-a1b8-4005-adf9-c14da034e4d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:49:11.079052 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 785/1545] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Sep 13 19:49:10 2022] POST /identity/v3/projects => generated 375 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 19:49:11.084030 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e27cdf1-50c0-4f0a-a681-26b59421d052 admin admin] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:49:11.114610 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.auth.core [None req-d5a50f99-a1b8-4005-adf9-c14da034e4d8 None None] MFA Rules not processed for user `7b0aed92d02344acb92a0e4aa67c3068`. Rule list: `[]` (Enabled: `True`). {{(pid=87935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:49:11.116030 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.fernet_utils [None req-d5a50f99-a1b8-4005-adf9-c14da034e4d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:49:11.223111 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e27cdf1-50c0-4f0a-a681-26b59421d052 admin admin] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:49:11.240926 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7daf2b07-9525-4c19-af95-78794f2d7d6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:49:11.242393 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7daf2b07-9525-4c19-af95-78794f2d7d6f admin admin] REQUEST_METHOD: `POST` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:49:11.242393 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7daf2b07-9525-4c19-af95-78794f2d7d6f admin admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:49:11.242393 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7daf2b07-9525-4c19-af95-78794f2d7d6f admin admin] PATH_INFO: `/v3/users` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:49:11.242663 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7daf2b07-9525-4c19-af95-78794f2d7d6f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:49:11.244199 dv-cinder-828805-6-smb devstack@keystone.service[87934]: WARNING py.warnings [None req-7daf2b07-9525-4c19-af95-78794f2d7d6f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 13 19:49:11.244199 dv-cinder-828805-6-smb devstack@keystone.service[87934]: warnings.warn(msg) Sep 13 19:49:11.244199 dv-cinder-828805-6-smb devstack@keystone.service[87934]: Sep 13 19:49:11.245520 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7daf2b07-9525-4c19-af95-78794f2d7d6f admin admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:49:11.278002 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 761/1546] 10.222.0.25 () {58 vars in 958 bytes} [Tue Sep 13 19:49:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 19:49:11.278886 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a50f99-a1b8-4005-adf9-c14da034e4d8 None None] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:49:11.292036 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 786/1547] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Sep 13 19:49:11 2022] POST /identity/v3/users => generated 288 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 19:49:11.293631 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593e8f10-2b70-4a13-847f-8d8ae49895bd None None] REQUEST_METHOD: `POST` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:49:11.293927 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593e8f10-2b70-4a13-847f-8d8ae49895bd None None] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:49:11.294200 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593e8f10-2b70-4a13-847f-8d8ae49895bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:49:11.304137 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a50f99-a1b8-4005-adf9-c14da034e4d8 None None] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:49:11.336069 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db5a552-40f4-4747-a13f-b26b389b1abf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:49:11.336724 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db5a552-40f4-4747-a13f-b26b389b1abf admin admin] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:49:11.337006 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db5a552-40f4-4747-a13f-b26b389b1abf admin admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:49:11.337284 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db5a552-40f4-4747-a13f-b26b389b1abf admin admin] PATH_INFO: `/v3/domains` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:49:11.338236 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db5a552-40f4-4747-a13f-b26b389b1abf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87935) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:49:11.338663 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db5a552-40f4-4747-a13f-b26b389b1abf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:49:11.340524 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db5a552-40f4-4747-a13f-b26b389b1abf admin admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:49:11.342551 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.auth.core [None req-593e8f10-2b70-4a13-847f-8d8ae49895bd None None] MFA Rules not processed for user `7b0aed92d02344acb92a0e4aa67c3068`. Rule list: `[]` (Enabled: `True`). {{(pid=87934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:49:11.343848 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.fernet_utils [None req-593e8f10-2b70-4a13-847f-8d8ae49895bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:49:11.360996 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 787/1548] 10.222.0.25 () {58 vars in 958 bytes} [Tue Sep 13 19:49:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 19:49:11.362776 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2070f1b0-1049-43f8-8fbb-7f676f3aed0c None None] REQUEST_METHOD: `POST` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:49:11.363055 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2070f1b0-1049-43f8-8fbb-7f676f3aed0c None None] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:49:11.363324 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2070f1b0-1049-43f8-8fbb-7f676f3aed0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:49:11.368330 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 762/1549] 10.222.0.25 () {58 vars in 1153 bytes} [Tue Sep 13 19:49:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:49:11.368848 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db5a552-40f4-4747-a13f-b26b389b1abf admin admin] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:49:11.385385 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db5a552-40f4-4747-a13f-b26b389b1abf admin admin] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:49:11.400067 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9bf7e4-bef6-4d44-bcfd-c20812b32a4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:49:11.400713 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9bf7e4-bef6-4d44-bcfd-c20812b32a4b admin admin] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:49:11.400994 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9bf7e4-bef6-4d44-bcfd-c20812b32a4b admin admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:49:11.401265 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9bf7e4-bef6-4d44-bcfd-c20812b32a4b admin admin] PATH_INFO: `/v3/roles` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:49:11.401907 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b9bf7e4-bef6-4d44-bcfd-c20812b32a4b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:49:11.404343 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b9bf7e4-bef6-4d44-bcfd-c20812b32a4b admin admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:49:11.406445 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.auth.core [None req-2070f1b0-1049-43f8-8fbb-7f676f3aed0c None None] MFA Rules not processed for user `7b0aed92d02344acb92a0e4aa67c3068`. Rule list: `[]` (Enabled: `True`). {{(pid=87934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:49:11.407663 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.fernet_utils [None req-2070f1b0-1049-43f8-8fbb-7f676f3aed0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:49:11.424114 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 763/1551] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Sep 13 19:49:11 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 19:49:11.424371 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 788/1551] 10.222.0.25 () {58 vars in 958 bytes} [Tue Sep 13 19:49:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 19:49:11.425555 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b9cbdd-f10c-4803-b560-317a464667be None None] REQUEST_METHOD: `POST` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:49:11.425842 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b9cbdd-f10c-4803-b560-317a464667be None None] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:49:11.426536 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7adcac0f-eaad-4a0e-aa86-851ab546f8e0 None None] REQUEST_METHOD: `POST` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:49:11.426649 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b9cbdd-f10c-4803-b560-317a464667be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:49:11.427147 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7adcac0f-eaad-4a0e-aa86-851ab546f8e0 None None] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:49:11.430505 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7adcac0f-eaad-4a0e-aa86-851ab546f8e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:49:11.449630 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.auth.core [None req-29b9cbdd-f10c-4803-b560-317a464667be None None] MFA Rules not processed for user `7b0aed92d02344acb92a0e4aa67c3068`. Rule list: `[]` (Enabled: `True`). {{(pid=87934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:49:11.450863 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.fernet_utils [None req-29b9cbdd-f10c-4803-b560-317a464667be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:49:11.453243 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.auth.core [None req-7adcac0f-eaad-4a0e-aa86-851ab546f8e0 None None] MFA Rules not processed for user `7b0aed92d02344acb92a0e4aa67c3068`. Rule list: `[]` (Enabled: `True`). {{(pid=87935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:49:11.454715 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.fernet_utils [None req-7adcac0f-eaad-4a0e-aa86-851ab546f8e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:49:11.460082 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 789/1552] 10.222.0.25 () {58 vars in 958 bytes} [Tue Sep 13 19:49:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 19:49:11.460780 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b9cbdd-f10c-4803-b560-317a464667be None None] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:49:11.466739 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 764/1553] 10.222.0.25 () {58 vars in 958 bytes} [Tue Sep 13 19:49:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 19:49:11.466739 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e520da1-bb35-47c5-9b22-4f51344fb190 None None] REQUEST_METHOD: `POST` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:49:11.466739 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e520da1-bb35-47c5-9b22-4f51344fb190 None None] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:49:11.466739 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e520da1-bb35-47c5-9b22-4f51344fb190 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:49:11.472200 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b9cbdd-f10c-4803-b560-317a464667be None None] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:49:11.478182 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2d2b67-ae3f-4917-9e81-d8a57ef299d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:49:11.478814 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2d2b67-ae3f-4917-9e81-d8a57ef299d0 admin admin] REQUEST_METHOD: `POST` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:49:11.479098 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2d2b67-ae3f-4917-9e81-d8a57ef299d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:49:11.479365 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2d2b67-ae3f-4917-9e81-d8a57ef299d0 admin admin] PATH_INFO: `/v3/projects` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:49:11.480003 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf2d2b67-ae3f-4917-9e81-d8a57ef299d0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:49:11.481974 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf2d2b67-ae3f-4917-9e81-d8a57ef299d0 admin admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:49:11.487385 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.auth.core [None req-1e520da1-bb35-47c5-9b22-4f51344fb190 None None] MFA Rules not processed for user `7b0aed92d02344acb92a0e4aa67c3068`. Rule list: `[]` (Enabled: `True`). {{(pid=87935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:49:11.489228 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.fernet_utils [None req-1e520da1-bb35-47c5-9b22-4f51344fb190 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:49:11.497721 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 765/1554] 10.222.0.25 () {58 vars in 958 bytes} [Tue Sep 13 19:49:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 19:49:11.501349 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e520da1-bb35-47c5-9b22-4f51344fb190 None None] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:49:11.514331 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e520da1-bb35-47c5-9b22-4f51344fb190 None None] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:49:11.516156 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 790/1555] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Sep 13 19:49:11 2022] POST /identity/v3/projects => generated 393 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 19:49:11.516307 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2d2b67-ae3f-4917-9e81-d8a57ef299d0 admin admin] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:49:11.577305 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a2dbc4-9eaa-44eb-96f8-45699f19a356 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:49:11.577988 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a2dbc4-9eaa-44eb-96f8-45699f19a356 admin admin] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:49:11.578268 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a2dbc4-9eaa-44eb-96f8-45699f19a356 admin admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:49:11.578537 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a2dbc4-9eaa-44eb-96f8-45699f19a356 admin admin] PATH_INFO: `/v3/domains` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:49:11.579444 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a2dbc4-9eaa-44eb-96f8-45699f19a356 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87935) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:49:11.579867 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a2dbc4-9eaa-44eb-96f8-45699f19a356 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:49:11.581548 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a2dbc4-9eaa-44eb-96f8-45699f19a356 admin admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:49:11.586109 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2d2b67-ae3f-4917-9e81-d8a57ef299d0 admin admin] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:49:11.591941 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84667a84-c1ae-4c9a-a786-c777a0fec09d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:49:11.592801 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84667a84-c1ae-4c9a-a786-c777a0fec09d admin admin] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:49:11.593299 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84667a84-c1ae-4c9a-a786-c777a0fec09d admin admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:49:11.593748 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84667a84-c1ae-4c9a-a786-c777a0fec09d admin admin] PATH_INFO: `/v3/roles` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:49:11.593888 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 766/1556] 10.222.0.25 () {58 vars in 1153 bytes} [Tue Sep 13 19:49:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:49:11.594789 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84667a84-c1ae-4c9a-a786-c777a0fec09d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:49:11.595058 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6dd688-918d-4926-9e9b-35a490dc03f6 None None] REQUEST_METHOD: `POST` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:49:11.595355 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6dd688-918d-4926-9e9b-35a490dc03f6 None None] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:49:11.595624 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6dd688-918d-4926-9e9b-35a490dc03f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:49:11.597552 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84667a84-c1ae-4c9a-a786-c777a0fec09d admin admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:49:11.604102 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG dbcounter [-] [87934] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=87934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:49:11.611396 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 791/1557] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Sep 13 19:49:11 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 19:49:11.615840 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84667a84-c1ae-4c9a-a786-c777a0fec09d admin admin] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:49:11.621106 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.auth.core [None req-2b6dd688-918d-4926-9e9b-35a490dc03f6 None None] MFA Rules not processed for user `7b0aed92d02344acb92a0e4aa67c3068`. Rule list: `[]` (Enabled: `True`). {{(pid=87935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:49:11.622317 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.fernet_utils [None req-2b6dd688-918d-4926-9e9b-35a490dc03f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:49:11.623916 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84667a84-c1ae-4c9a-a786-c777a0fec09d admin admin] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:49:11.629908 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3ac862-d27d-4955-b661-754fccc0ceec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:49:11.630690 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3ac862-d27d-4955-b661-754fccc0ceec admin admin] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:49:11.630949 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3ac862-d27d-4955-b661-754fccc0ceec admin admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:49:11.631439 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3ac862-d27d-4955-b661-754fccc0ceec admin admin] PATH_INFO: `/v3/domains` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:49:11.632798 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 767/1558] 10.222.0.25 () {58 vars in 958 bytes} [Tue Sep 13 19:49:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 19:49:11.634199 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b322be1-ced3-4bb1-a377-ee9586e0ae6b None None] REQUEST_METHOD: `POST` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:49:11.634694 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b322be1-ced3-4bb1-a377-ee9586e0ae6b None None] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:49:11.635109 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b322be1-ced3-4bb1-a377-ee9586e0ae6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:49:11.636832 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b3ac862-d27d-4955-b661-754fccc0ceec admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87934) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:49:11.637146 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b3ac862-d27d-4955-b661-754fccc0ceec admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:49:11.638177 dv-cinder-828805-6-smb devstack@keystone.service[87934]: WARNING py.warnings [None req-0b3ac862-d27d-4955-b661-754fccc0ceec admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 13 19:49:11.638177 dv-cinder-828805-6-smb devstack@keystone.service[87934]: warnings.warn(msg) Sep 13 19:49:11.638177 dv-cinder-828805-6-smb devstack@keystone.service[87934]: Sep 13 19:49:11.639059 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b3ac862-d27d-4955-b661-754fccc0ceec admin admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:49:11.652807 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 792/1559] 10.222.0.25 () {58 vars in 1153 bytes} [Tue Sep 13 19:49:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:49:11.654029 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b0144b-039c-46f5-8659-45acea72c2a5 None None] REQUEST_METHOD: `POST` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:49:11.654310 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b0144b-039c-46f5-8659-45acea72c2a5 None None] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:49:11.654578 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b0144b-039c-46f5-8659-45acea72c2a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:49:11.657167 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.auth.core [None req-7b322be1-ced3-4bb1-a377-ee9586e0ae6b None None] MFA Rules not processed for user `7b0aed92d02344acb92a0e4aa67c3068`. Rule list: `[]` (Enabled: `True`). {{(pid=87935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:49:11.658367 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.fernet_utils [None req-7b322be1-ced3-4bb1-a377-ee9586e0ae6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:49:11.669396 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 768/1560] 10.222.0.25 () {58 vars in 958 bytes} [Tue Sep 13 19:49:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 19:49:11.670141 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b322be1-ced3-4bb1-a377-ee9586e0ae6b None None] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:49:11.681820 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.auth.core [None req-c5b0144b-039c-46f5-8659-45acea72c2a5 None None] MFA Rules not processed for user `7b0aed92d02344acb92a0e4aa67c3068`. Rule list: `[]` (Enabled: `True`). {{(pid=87934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:49:11.682607 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b322be1-ced3-4bb1-a377-ee9586e0ae6b None None] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:49:11.683076 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.fernet_utils [None req-c5b0144b-039c-46f5-8659-45acea72c2a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:49:11.687312 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792c14b4-82de-4fed-bf61-1b2fe3eae306 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:49:11.687911 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792c14b4-82de-4fed-bf61-1b2fe3eae306 admin admin] REQUEST_METHOD: `POST` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:49:11.688187 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792c14b4-82de-4fed-bf61-1b2fe3eae306 admin admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:49:11.688512 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792c14b4-82de-4fed-bf61-1b2fe3eae306 admin admin] PATH_INFO: `/v3/users` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:49:11.689140 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-792c14b4-82de-4fed-bf61-1b2fe3eae306 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:49:11.691046 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-792c14b4-82de-4fed-bf61-1b2fe3eae306 admin admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:49:11.692092 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 793/1561] 10.222.0.25 () {58 vars in 958 bytes} [Tue Sep 13 19:49:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 19:49:11.693005 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b0144b-039c-46f5-8659-45acea72c2a5 None None] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:49:11.703280 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b0144b-039c-46f5-8659-45acea72c2a5 None None] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:49:11.709437 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d02d58c-36c2-4a9a-b5f7-8b6b869b262a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:49:11.710129 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d02d58c-36c2-4a9a-b5f7-8b6b869b262a admin admin] REQUEST_METHOD: `POST` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:49:11.710419 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d02d58c-36c2-4a9a-b5f7-8b6b869b262a admin admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:49:11.710559 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG dbcounter [-] [87935] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:49:11.710727 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d02d58c-36c2-4a9a-b5f7-8b6b869b262a admin admin] PATH_INFO: `/v3/projects` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:49:11.711465 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d02d58c-36c2-4a9a-b5f7-8b6b869b262a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:49:11.713887 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d02d58c-36c2-4a9a-b5f7-8b6b869b262a admin admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:49:11.720397 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 769/1562] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Sep 13 19:49:11 2022] POST /identity/v3/users => generated 297 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 19:49:11.722038 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792c14b4-82de-4fed-bf61-1b2fe3eae306 admin admin] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:49:11.734189 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792c14b4-82de-4fed-bf61-1b2fe3eae306 admin admin] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:49:11.739363 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802218fa-9e2f-4b36-8d1a-e8a215e091b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:49:11.740059 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802218fa-9e2f-4b36-8d1a-e8a215e091b0 admin admin] REQUEST_METHOD: `PUT` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:49:11.740460 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802218fa-9e2f-4b36-8d1a-e8a215e091b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:49:11.740644 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802218fa-9e2f-4b36-8d1a-e8a215e091b0 admin admin] PATH_INFO: `/v3/projects/9d568b19ca094d1e9ebc9140465fed0e/users/c8e0cf49622e49d38c9f57dcb13cf5a6/roles/a259191f6d0e46fabd9f34536bb28747` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:49:11.750473 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 794/1563] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Sep 13 19:49:11 2022] POST /identity/v3/projects => generated 373 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 19:49:11.750473 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c305b5-c367-46cc-b6b2-8fa5e3574b5b None None] REQUEST_METHOD: `POST` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:49:11.750473 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c305b5-c367-46cc-b6b2-8fa5e3574b5b None None] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:49:11.750473 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c305b5-c367-46cc-b6b2-8fa5e3574b5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:49:11.760036 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-802218fa-9e2f-4b36-8d1a-e8a215e091b0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9d568b19ca094d1e9ebc9140465fed0e, user_id=c8e0cf49622e49d38c9f57dcb13cf5a6, role_id=a259191f6d0e46fabd9f34536bb28747)` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:49:11.761125 dv-cinder-828805-6-smb devstack@keystone.service[87935]: WARNING py.warnings [None req-802218fa-9e2f-4b36-8d1a-e8a215e091b0 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 13 19:49:11.761125 dv-cinder-828805-6-smb devstack@keystone.service[87935]: warnings.warn(msg) Sep 13 19:49:11.761125 dv-cinder-828805-6-smb devstack@keystone.service[87935]: Sep 13 19:49:11.763114 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-802218fa-9e2f-4b36-8d1a-e8a215e091b0 admin admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:49:11.772127 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.auth.core [None req-16c305b5-c367-46cc-b6b2-8fa5e3574b5b None None] MFA Rules not processed for user `7b0aed92d02344acb92a0e4aa67c3068`. Rule list: `[]` (Enabled: `True`). {{(pid=87934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:49:11.773409 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.fernet_utils [None req-16c305b5-c367-46cc-b6b2-8fa5e3574b5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:49:11.777753 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 770/1564] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Sep 13 19:49:11 2022] PUT /identity/v3/projects/9d568b19ca094d1e9ebc9140465fed0e/users/c8e0cf49622e49d38c9f57dcb13cf5a6/roles/a259191f6d0e46fabd9f34536bb28747 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 19:49:11.779122 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3782e5-d449-4858-8f54-7c78c7f8ae0c None None] REQUEST_METHOD: `POST` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:49:11.779404 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3782e5-d449-4858-8f54-7c78c7f8ae0c None None] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:49:11.779673 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3782e5-d449-4858-8f54-7c78c7f8ae0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:49:11.800442 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.auth.core [None req-6b3782e5-d449-4858-8f54-7c78c7f8ae0c None None] MFA Rules not processed for user `7b0aed92d02344acb92a0e4aa67c3068`. Rule list: `[]` (Enabled: `True`). {{(pid=87935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:49:11.801676 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.fernet_utils [None req-6b3782e5-d449-4858-8f54-7c78c7f8ae0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:49:11.844129 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 795/1565] 10.222.0.25 () {58 vars in 958 bytes} [Tue Sep 13 19:49:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 19:49:11.844911 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c305b5-c367-46cc-b6b2-8fa5e3574b5b None None] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:49:11.858660 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c305b5-c367-46cc-b6b2-8fa5e3574b5b None None] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:49:11.863222 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395ce1da-fb75-4960-adc9-4ef0fd28fbda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:49:11.863825 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395ce1da-fb75-4960-adc9-4ef0fd28fbda admin admin] REQUEST_METHOD: `POST` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:49:11.864101 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395ce1da-fb75-4960-adc9-4ef0fd28fbda admin admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:49:11.864405 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395ce1da-fb75-4960-adc9-4ef0fd28fbda admin admin] PATH_INFO: `/v3/projects` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:49:11.865028 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-395ce1da-fb75-4960-adc9-4ef0fd28fbda admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:49:11.865457 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 771/1566] 10.222.0.25 () {58 vars in 958 bytes} [Tue Sep 13 19:49:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 19:49:11.866212 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3782e5-d449-4858-8f54-7c78c7f8ae0c None None] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:49:11.866940 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-395ce1da-fb75-4960-adc9-4ef0fd28fbda admin admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:49:11.876868 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3782e5-d449-4858-8f54-7c78c7f8ae0c None None] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:49:11.881770 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671d6e1a-7dc3-4b88-833c-0e3107ef464e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:49:11.882363 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671d6e1a-7dc3-4b88-833c-0e3107ef464e admin admin] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:49:11.882638 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671d6e1a-7dc3-4b88-833c-0e3107ef464e admin admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:49:11.883276 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671d6e1a-7dc3-4b88-833c-0e3107ef464e admin admin] PATH_INFO: `/v3/domains` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:49:11.883693 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-671d6e1a-7dc3-4b88-833c-0e3107ef464e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87935) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:49:11.883996 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-671d6e1a-7dc3-4b88-833c-0e3107ef464e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:49:11.885621 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-671d6e1a-7dc3-4b88-833c-0e3107ef464e admin admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:49:11.894464 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 796/1567] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Sep 13 19:49:11 2022] POST /identity/v3/projects => generated 383 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 19:49:11.896339 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395ce1da-fb75-4960-adc9-4ef0fd28fbda admin admin] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:49:11.901609 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 772/1568] 10.222.0.25 () {58 vars in 1153 bytes} [Tue Sep 13 19:49:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:49:11.902439 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671d6e1a-7dc3-4b88-833c-0e3107ef464e admin admin] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:49:11.915250 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671d6e1a-7dc3-4b88-833c-0e3107ef464e admin admin] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:49:11.965984 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395ce1da-fb75-4960-adc9-4ef0fd28fbda admin admin] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:49:11.970883 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253799bf-613e-42f2-a828-0b0c6a4adf53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:49:11.971558 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253799bf-613e-42f2-a828-0b0c6a4adf53 admin admin] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:49:11.971906 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253799bf-613e-42f2-a828-0b0c6a4adf53 admin admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:49:11.972260 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253799bf-613e-42f2-a828-0b0c6a4adf53 admin admin] PATH_INFO: `/v3/domains` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:49:11.972965 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-253799bf-613e-42f2-a828-0b0c6a4adf53 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87934) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:49:11.973272 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-253799bf-613e-42f2-a828-0b0c6a4adf53 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:49:11.974883 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-253799bf-613e-42f2-a828-0b0c6a4adf53 admin admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:49:11.978375 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69244d72-b38b-4806-adc3-0d028ebd00c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:49:11.979235 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69244d72-b38b-4806-adc3-0d028ebd00c3 admin admin] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:49:11.979650 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69244d72-b38b-4806-adc3-0d028ebd00c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:49:11.980096 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69244d72-b38b-4806-adc3-0d028ebd00c3 admin admin] PATH_INFO: `/v3/roles` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:49:11.980992 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69244d72-b38b-4806-adc3-0d028ebd00c3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:49:11.983260 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69244d72-b38b-4806-adc3-0d028ebd00c3 admin admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:49:11.988033 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 797/1569] 10.222.0.25 () {58 vars in 1153 bytes} [Tue Sep 13 19:49:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:49:11.990159 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253799bf-613e-42f2-a828-0b0c6a4adf53 admin admin] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:49:12.000815 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 773/1570] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Sep 13 19:49:11 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 19:49:12.002495 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b196d25-710d-4414-bbe5-86589433273c None None] REQUEST_METHOD: `POST` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:49:12.002874 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b196d25-710d-4414-bbe5-86589433273c None None] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:49:12.003245 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b196d25-710d-4414-bbe5-86589433273c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:49:12.004882 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253799bf-613e-42f2-a828-0b0c6a4adf53 admin admin] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:49:12.009665 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d195933-d9bb-4223-bada-2c07e21a0d8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:49:12.010275 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d195933-d9bb-4223-bada-2c07e21a0d8d admin admin] REQUEST_METHOD: `POST` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:49:12.010550 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d195933-d9bb-4223-bada-2c07e21a0d8d admin admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:49:12.010818 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d195933-d9bb-4223-bada-2c07e21a0d8d admin admin] PATH_INFO: `/v3/users` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:49:12.011462 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d195933-d9bb-4223-bada-2c07e21a0d8d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:49:12.013454 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d195933-d9bb-4223-bada-2c07e21a0d8d admin admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:49:12.034707 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.auth.core [None req-0b196d25-710d-4414-bbe5-86589433273c None None] MFA Rules not processed for user `c8e0cf49622e49d38c9f57dcb13cf5a6`. Rule list: `[]` (Enabled: `True`). {{(pid=87935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:49:12.035731 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 798/1571] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Sep 13 19:49:11 2022] POST /identity/v3/users => generated 287 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 19:49:12.035952 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.fernet_utils [None req-0b196d25-710d-4414-bbe5-86589433273c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:49:12.037058 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc4f4a3-2c23-4436-83d1-18e9e9f5cb4d None None] REQUEST_METHOD: `POST` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:49:12.037347 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc4f4a3-2c23-4436-83d1-18e9e9f5cb4d None None] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:49:12.037614 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc4f4a3-2c23-4436-83d1-18e9e9f5cb4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:49:12.057545 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.auth.core [None req-cdc4f4a3-2c23-4436-83d1-18e9e9f5cb4d None None] MFA Rules not processed for user `7b0aed92d02344acb92a0e4aa67c3068`. Rule list: `[]` (Enabled: `True`). {{(pid=87934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:49:12.058721 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.fernet_utils [None req-cdc4f4a3-2c23-4436-83d1-18e9e9f5cb4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:49:12.070883 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 799/1572] 10.222.0.25 () {58 vars in 958 bytes} [Tue Sep 13 19:49:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 19:49:12.070883 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc4f4a3-2c23-4436-83d1-18e9e9f5cb4d None None] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:49:12.077304 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc4f4a3-2c23-4436-83d1-18e9e9f5cb4d None None] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:49:12.082639 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449850dd-6438-4252-acd0-4ac0f4d7b0d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:49:12.083431 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449850dd-6438-4252-acd0-4ac0f4d7b0d0 admin admin] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:49:12.083758 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449850dd-6438-4252-acd0-4ac0f4d7b0d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:49:12.084027 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449850dd-6438-4252-acd0-4ac0f4d7b0d0 admin admin] PATH_INFO: `/v3/domains` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:49:12.084734 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-449850dd-6438-4252-acd0-4ac0f4d7b0d0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87934) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:49:12.085026 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-449850dd-6438-4252-acd0-4ac0f4d7b0d0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:49:12.086606 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-449850dd-6438-4252-acd0-4ac0f4d7b0d0 admin admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:49:12.088476 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG dbcounter [-] [87934] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=87934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:49:12.090742 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG dbcounter [-] [87935] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:49:12.109660 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 800/1573] 10.222.0.25 () {58 vars in 1153 bytes} [Tue Sep 13 19:49:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:49:12.109660 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449850dd-6438-4252-acd0-4ac0f4d7b0d0 admin admin] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:49:12.112822 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449850dd-6438-4252-acd0-4ac0f4d7b0d0 admin admin] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:49:12.118501 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca96c2c-5e59-484c-ad0e-3d57f942b5fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:49:12.119091 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca96c2c-5e59-484c-ad0e-3d57f942b5fd admin admin] REQUEST_METHOD: `POST` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:49:12.119366 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca96c2c-5e59-484c-ad0e-3d57f942b5fd admin admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:49:12.119634 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca96c2c-5e59-484c-ad0e-3d57f942b5fd admin admin] PATH_INFO: `/v3/users` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:49:12.120002 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 774/1574] 10.222.0.25 () {58 vars in 958 bytes} [Tue Sep 13 19:49:12 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 19:49:12.124938 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca96c2c-5e59-484c-ad0e-3d57f942b5fd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:49:12.125071 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b196d25-710d-4414-bbe5-86589433273c None None] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:49:12.125182 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca96c2c-5e59-484c-ad0e-3d57f942b5fd admin admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:49:12.139637 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b196d25-710d-4414-bbe5-86589433273c None None] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:49:12.146427 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e81f16-29ab-42a6-bcc5-17f558efd237 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:49:12.147204 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e81f16-29ab-42a6-bcc5-17f558efd237 admin admin] REQUEST_METHOD: `POST` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:49:12.147525 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e81f16-29ab-42a6-bcc5-17f558efd237 admin admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:49:12.147945 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e81f16-29ab-42a6-bcc5-17f558efd237 admin admin] PATH_INFO: `/v3/projects` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:49:12.148462 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 801/1575] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Sep 13 19:49:12 2022] POST /identity/v3/users => generated 292 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 19:49:12.148599 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e81f16-29ab-42a6-bcc5-17f558efd237 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:49:12.149657 dv-cinder-828805-6-smb devstack@keystone.service[87935]: WARNING py.warnings [None req-28e81f16-29ab-42a6-bcc5-17f558efd237 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 13 19:49:12.149657 dv-cinder-828805-6-smb devstack@keystone.service[87935]: warnings.warn(msg) Sep 13 19:49:12.149657 dv-cinder-828805-6-smb devstack@keystone.service[87935]: Sep 13 19:49:12.150917 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e81f16-29ab-42a6-bcc5-17f558efd237 admin admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:49:12.152100 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca96c2c-5e59-484c-ad0e-3d57f942b5fd admin admin] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:49:12.163152 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca96c2c-5e59-484c-ad0e-3d57f942b5fd admin admin] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:49:12.171705 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77594e4-2a2d-485e-8877-27801ebaef4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:49:12.172264 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77594e4-2a2d-485e-8877-27801ebaef4f admin admin] REQUEST_METHOD: `POST` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:49:12.172759 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77594e4-2a2d-485e-8877-27801ebaef4f admin admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:49:12.173145 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77594e4-2a2d-485e-8877-27801ebaef4f admin admin] PATH_INFO: `/v3/projects` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:49:12.173989 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d77594e4-2a2d-485e-8877-27801ebaef4f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:49:12.177471 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d77594e4-2a2d-485e-8877-27801ebaef4f admin admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:49:12.184484 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 775/1576] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Sep 13 19:49:12 2022] POST /identity/v3/projects => generated 379 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 19:49:12.185261 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e81f16-29ab-42a6-bcc5-17f558efd237 admin admin] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:49:12.209607 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 802/1577] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Sep 13 19:49:12 2022] POST /identity/v3/projects => generated 381 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 19:49:12.209607 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77594e4-2a2d-485e-8877-27801ebaef4f admin admin] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:49:12.253148 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e81f16-29ab-42a6-bcc5-17f558efd237 admin admin] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:49:12.271189 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77594e4-2a2d-485e-8877-27801ebaef4f admin admin] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:49:12.276096 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d83148e-86c5-472a-9d99-e4e83bedb37e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:49:12.276833 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d83148e-86c5-472a-9d99-e4e83bedb37e admin admin] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:49:12.277126 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d83148e-86c5-472a-9d99-e4e83bedb37e admin admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:49:12.277418 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d83148e-86c5-472a-9d99-e4e83bedb37e admin admin] PATH_INFO: `/v3/roles` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:49:12.278055 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d83148e-86c5-472a-9d99-e4e83bedb37e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:49:12.279657 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d83148e-86c5-472a-9d99-e4e83bedb37e admin admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:49:12.289659 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 803/1578] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Sep 13 19:49:12 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 19:49:12.290665 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d83148e-86c5-472a-9d99-e4e83bedb37e admin admin] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:49:12.304421 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d83148e-86c5-472a-9d99-e4e83bedb37e admin admin] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:49:12.309219 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec26853-a60b-4796-8767-2a13307e1b58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:49:12.309819 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec26853-a60b-4796-8767-2a13307e1b58 admin admin] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:49:12.310102 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec26853-a60b-4796-8767-2a13307e1b58 admin admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:49:12.310375 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec26853-a60b-4796-8767-2a13307e1b58 admin admin] PATH_INFO: `/v3/domains` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:49:12.311012 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec26853-a60b-4796-8767-2a13307e1b58 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87934) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:49:12.311320 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec26853-a60b-4796-8767-2a13307e1b58 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:49:12.312957 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec26853-a60b-4796-8767-2a13307e1b58 admin admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:49:12.316306 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5550d35-4912-4639-81a0-ed4890849698 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:49:12.317435 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5550d35-4912-4639-81a0-ed4890849698 admin admin] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:49:12.317709 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5550d35-4912-4639-81a0-ed4890849698 admin admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:49:12.317974 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5550d35-4912-4639-81a0-ed4890849698 admin admin] PATH_INFO: `/v3/roles` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:49:12.318611 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5550d35-4912-4639-81a0-ed4890849698 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:49:12.320183 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5550d35-4912-4639-81a0-ed4890849698 admin admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:49:12.326179 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 804/1579] 10.222.0.25 () {58 vars in 1153 bytes} [Tue Sep 13 19:49:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:49:12.326971 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec26853-a60b-4796-8767-2a13307e1b58 admin admin] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:49:12.337409 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec26853-a60b-4796-8767-2a13307e1b58 admin admin] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:49:12.338313 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 776/1580] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Sep 13 19:49:12 2022] GET /identity/v3/roles => generated 1420 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 19:49:12.340046 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cee1cfd-482f-4331-beea-dea5a8a514e6 None None] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:49:12.340395 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cee1cfd-482f-4331-beea-dea5a8a514e6 None None] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:49:12.340687 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cee1cfd-482f-4331-beea-dea5a8a514e6 None None] PATH_INFO: `/` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:49:12.342025 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 777/1581] 10.222.0.25 () {54 vars in 962 bytes} [Tue Sep 13 19:49:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:49:12.342813 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cee1cfd-482f-4331-beea-dea5a8a514e6 None None] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:49:12.344852 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5992b164-fa02-4668-9c45-15f67ff4ba33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:49:12.345450 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5992b164-fa02-4668-9c45-15f67ff4ba33 admin admin] REQUEST_METHOD: `POST` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:49:12.345732 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5992b164-fa02-4668-9c45-15f67ff4ba33 admin admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:49:12.346000 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5992b164-fa02-4668-9c45-15f67ff4ba33 admin admin] PATH_INFO: `/v3/projects` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:49:12.346627 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5992b164-fa02-4668-9c45-15f67ff4ba33 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:49:12.350095 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5992b164-fa02-4668-9c45-15f67ff4ba33 admin admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:49:12.356722 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cee1cfd-482f-4331-beea-dea5a8a514e6 None None] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:49:12.361636 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff08ef5-1ba1-4138-839f-de7209bae109 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:49:12.362238 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff08ef5-1ba1-4138-839f-de7209bae109 admin admin] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:49:12.362511 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff08ef5-1ba1-4138-839f-de7209bae109 admin admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:49:12.362776 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff08ef5-1ba1-4138-839f-de7209bae109 admin admin] PATH_INFO: `/v3/roles` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:49:12.363522 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff08ef5-1ba1-4138-839f-de7209bae109 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:49:12.365719 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff08ef5-1ba1-4138-839f-de7209bae109 admin admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:49:12.377083 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 778/1582] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Sep 13 19:49:12 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 19:49:12.380578 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff08ef5-1ba1-4138-839f-de7209bae109 admin admin] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:49:12.381553 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 805/1583] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Sep 13 19:49:12 2022] POST /identity/v3/projects => generated 387 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 19:49:12.385122 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5992b164-fa02-4668-9c45-15f67ff4ba33 admin admin] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:49:12.388773 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff08ef5-1ba1-4138-839f-de7209bae109 admin admin] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:49:12.454146 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9891e144-61f3-4b7f-8222-984c288d1fd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:49:12.454854 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9891e144-61f3-4b7f-8222-984c288d1fd8 admin admin] REQUEST_METHOD: `POST` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:49:12.455231 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9891e144-61f3-4b7f-8222-984c288d1fd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:49:12.455466 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5992b164-fa02-4668-9c45-15f67ff4ba33 admin admin] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:49:12.455777 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9891e144-61f3-4b7f-8222-984c288d1fd8 admin admin] PATH_INFO: `/v3/users` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:49:12.456518 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9891e144-61f3-4b7f-8222-984c288d1fd8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:49:12.458858 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9891e144-61f3-4b7f-8222-984c288d1fd8 admin admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:49:12.460634 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04ac793-bf88-4a34-a79c-95865319e12a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:49:12.461236 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04ac793-bf88-4a34-a79c-95865319e12a admin admin] REQUEST_METHOD: `POST` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:49:12.461514 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04ac793-bf88-4a34-a79c-95865319e12a admin admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:49:12.461810 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04ac793-bf88-4a34-a79c-95865319e12a admin admin] PATH_INFO: `/v3/users` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:49:12.462439 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f04ac793-bf88-4a34-a79c-95865319e12a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:49:12.464349 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f04ac793-bf88-4a34-a79c-95865319e12a admin admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:49:12.467078 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG dbcounter [-] [87935] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:49:12.486725 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 779/1584] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Sep 13 19:49:12 2022] POST /identity/v3/users => generated 290 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 19:49:12.486725 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9891e144-61f3-4b7f-8222-984c288d1fd8 admin admin] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:49:12.487040 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 806/1585] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Sep 13 19:49:12 2022] POST /identity/v3/users => generated 291 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 19:49:12.487687 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04ac793-bf88-4a34-a79c-95865319e12a admin admin] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:49:12.495374 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9891e144-61f3-4b7f-8222-984c288d1fd8 admin admin] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:49:12.495527 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG dbcounter [-] [87934] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=87934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:49:12.499559 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04ac793-bf88-4a34-a79c-95865319e12a admin admin] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:49:12.500450 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f0109a-ea83-4df2-a3c7-fee3db577ba2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:49:12.501048 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f0109a-ea83-4df2-a3c7-fee3db577ba2 admin admin] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:49:12.501321 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f0109a-ea83-4df2-a3c7-fee3db577ba2 admin admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:49:12.501588 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f0109a-ea83-4df2-a3c7-fee3db577ba2 admin admin] PATH_INFO: `/v3/roles` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:49:12.502229 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f0109a-ea83-4df2-a3c7-fee3db577ba2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:49:12.504061 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f0109a-ea83-4df2-a3c7-fee3db577ba2 admin admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:49:12.506752 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba99a7e-9ab0-4a70-a8e6-0fb4d4c42ab7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:49:12.507354 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba99a7e-9ab0-4a70-a8e6-0fb4d4c42ab7 admin admin] REQUEST_METHOD: `POST` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:49:12.507636 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba99a7e-9ab0-4a70-a8e6-0fb4d4c42ab7 admin admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:49:12.507935 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba99a7e-9ab0-4a70-a8e6-0fb4d4c42ab7 admin admin] PATH_INFO: `/v3/projects` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:49:12.508647 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba99a7e-9ab0-4a70-a8e6-0fb4d4c42ab7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:49:12.510729 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba99a7e-9ab0-4a70-a8e6-0fb4d4c42ab7 admin admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:49:12.516163 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 780/1586] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Sep 13 19:49:12 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 19:49:12.517001 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f0109a-ea83-4df2-a3c7-fee3db577ba2 admin admin] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:49:12.529469 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f0109a-ea83-4df2-a3c7-fee3db577ba2 admin admin] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:49:12.534868 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a49a6b-f68b-4b83-a0d9-439925f408f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:49:12.535595 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a49a6b-f68b-4b83-a0d9-439925f408f6 admin admin] REQUEST_METHOD: `PUT` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:49:12.536116 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a49a6b-f68b-4b83-a0d9-439925f408f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:49:12.536449 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a49a6b-f68b-4b83-a0d9-439925f408f6 admin admin] PATH_INFO: `/v3/projects/fe21071f015e4c33a44b401af6eada61/users/ef71a6041f2d4f7389796f0c4a491ea6/roles/a259191f6d0e46fabd9f34536bb28747` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:49:12.549466 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 807/1587] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Sep 13 19:49:12 2022] POST /identity/v3/projects => generated 383 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 19:49:12.549466 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c7d1fd-a65c-43f3-a552-411c8b245973 None None] REQUEST_METHOD: `POST` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:49:12.549466 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c7d1fd-a65c-43f3-a552-411c8b245973 None None] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:49:12.549466 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c7d1fd-a65c-43f3-a552-411c8b245973 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:49:12.553781 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a49a6b-f68b-4b83-a0d9-439925f408f6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fe21071f015e4c33a44b401af6eada61, user_id=ef71a6041f2d4f7389796f0c4a491ea6, role_id=a259191f6d0e46fabd9f34536bb28747)` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:49:12.557269 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a49a6b-f68b-4b83-a0d9-439925f408f6 admin admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:49:12.572868 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 781/1588] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Sep 13 19:49:12 2022] PUT /identity/v3/projects/fe21071f015e4c33a44b401af6eada61/users/ef71a6041f2d4f7389796f0c4a491ea6/roles/a259191f6d0e46fabd9f34536bb28747 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 19:49:12.573786 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a49a6b-f68b-4b83-a0d9-439925f408f6 admin admin] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:49:12.600640 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.auth.core [None req-10c7d1fd-a65c-43f3-a552-411c8b245973 None None] MFA Rules not processed for user `d71fe5a8275f4ea98555afdcefc902a0`. Rule list: `[]` (Enabled: `True`). {{(pid=87934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:49:12.601917 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.fernet_utils [None req-10c7d1fd-a65c-43f3-a552-411c8b245973 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:49:12.643273 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a49a6b-f68b-4b83-a0d9-439925f408f6 admin admin] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:49:12.648522 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-effa0833-6f94-4524-a82d-c89076eb9cb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:49:12.649262 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effa0833-6f94-4524-a82d-c89076eb9cb4 admin admin] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:49:12.649635 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effa0833-6f94-4524-a82d-c89076eb9cb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:49:12.650133 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effa0833-6f94-4524-a82d-c89076eb9cb4 admin admin] PATH_INFO: `/v3/roles` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:49:12.651079 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-effa0833-6f94-4524-a82d-c89076eb9cb4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:49:12.653330 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-effa0833-6f94-4524-a82d-c89076eb9cb4 admin admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:49:12.664441 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 782/1589] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Sep 13 19:49:12 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 19:49:12.665783 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-effa0833-6f94-4524-a82d-c89076eb9cb4 admin admin] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:49:12.677074 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-effa0833-6f94-4524-a82d-c89076eb9cb4 admin admin] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:49:12.681479 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 808/1590] 10.222.0.25 () {58 vars in 1059 bytes} [Tue Sep 13 19:49:12 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 19:49:12.682361 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf0c505-7376-410f-9a58-e1bbe70f943e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:49:12.682539 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c7d1fd-a65c-43f3-a552-411c8b245973 None None] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:49:12.683150 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf0c505-7376-410f-9a58-e1bbe70f943e admin admin] REQUEST_METHOD: `POST` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:49:12.683513 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf0c505-7376-410f-9a58-e1bbe70f943e admin admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:49:12.683788 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf0c505-7376-410f-9a58-e1bbe70f943e admin admin] PATH_INFO: `/v3/users` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:49:12.684572 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf0c505-7376-410f-9a58-e1bbe70f943e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:49:12.686861 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf0c505-7376-410f-9a58-e1bbe70f943e admin admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:49:12.694046 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c7d1fd-a65c-43f3-a552-411c8b245973 None None] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:49:12.699644 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf71ded5-62c8-4013-a697-eb97d7f4616b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:49:12.700343 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf71ded5-62c8-4013-a697-eb97d7f4616b admin admin] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:49:12.700665 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf71ded5-62c8-4013-a697-eb97d7f4616b admin admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:49:12.700935 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf71ded5-62c8-4013-a697-eb97d7f4616b admin admin] PATH_INFO: `/v3/roles` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:49:12.701607 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf71ded5-62c8-4013-a697-eb97d7f4616b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:49:12.703477 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf71ded5-62c8-4013-a697-eb97d7f4616b admin admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:49:12.714565 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 783/1591] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Sep 13 19:49:12 2022] POST /identity/v3/users => generated 294 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 19:49:12.715770 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf0c505-7376-410f-9a58-e1bbe70f943e admin admin] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:49:12.717508 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 809/1592] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Sep 13 19:49:12 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 19:49:12.718516 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf71ded5-62c8-4013-a697-eb97d7f4616b admin admin] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:49:12.729554 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf0c505-7376-410f-9a58-e1bbe70f943e admin admin] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:49:12.730708 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf71ded5-62c8-4013-a697-eb97d7f4616b admin admin] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:49:12.734633 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e042ad85-3e77-45fc-bd4e-ef65117dfccf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:49:12.735311 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e042ad85-3e77-45fc-bd4e-ef65117dfccf admin admin] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:49:12.735588 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e042ad85-3e77-45fc-bd4e-ef65117dfccf admin admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:49:12.735887 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e042ad85-3e77-45fc-bd4e-ef65117dfccf admin admin] PATH_INFO: `/v3/roles` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:49:12.736165 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163aeb56-0e60-4a83-8d96-ae5fd64fc67c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:49:12.736559 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e042ad85-3e77-45fc-bd4e-ef65117dfccf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:49:12.736877 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163aeb56-0e60-4a83-8d96-ae5fd64fc67c admin admin] REQUEST_METHOD: `PUT` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:49:12.737175 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163aeb56-0e60-4a83-8d96-ae5fd64fc67c admin admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:49:12.737421 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163aeb56-0e60-4a83-8d96-ae5fd64fc67c admin admin] PATH_INFO: `/v3/projects/2c5d38e44d2d46ec927e7f86b8981278/users/5075440394e547abba5b29eb627961fc/roles/a259191f6d0e46fabd9f34536bb28747` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:49:12.738316 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e042ad85-3e77-45fc-bd4e-ef65117dfccf admin admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:49:12.750464 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 784/1593] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Sep 13 19:49:12 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 19:49:12.751377 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e042ad85-3e77-45fc-bd4e-ef65117dfccf admin admin] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:49:12.757320 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-163aeb56-0e60-4a83-8d96-ae5fd64fc67c admin admin] RBAC: Authorizing `identity:create_grant(project_id=2c5d38e44d2d46ec927e7f86b8981278, user_id=5075440394e547abba5b29eb627961fc, role_id=a259191f6d0e46fabd9f34536bb28747)` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:49:12.760175 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-163aeb56-0e60-4a83-8d96-ae5fd64fc67c admin admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:49:12.762670 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e042ad85-3e77-45fc-bd4e-ef65117dfccf admin admin] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:49:12.768242 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc278601-1f8a-47e6-8bc3-b25aab2ec6f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:49:12.769622 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc278601-1f8a-47e6-8bc3-b25aab2ec6f9 admin admin] REQUEST_METHOD: `POST` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:49:12.769622 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc278601-1f8a-47e6-8bc3-b25aab2ec6f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:49:12.769622 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc278601-1f8a-47e6-8bc3-b25aab2ec6f9 admin admin] PATH_INFO: `/v3/users` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:49:12.770291 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc278601-1f8a-47e6-8bc3-b25aab2ec6f9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:49:12.772297 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc278601-1f8a-47e6-8bc3-b25aab2ec6f9 admin admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:49:12.775605 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 810/1594] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Sep 13 19:49:12 2022] PUT /identity/v3/projects/2c5d38e44d2d46ec927e7f86b8981278/users/5075440394e547abba5b29eb627961fc/roles/a259191f6d0e46fabd9f34536bb28747 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 19:49:12.777328 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e6486b-99e5-4463-891f-d24348fa8156 None None] REQUEST_METHOD: `POST` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:49:12.777720 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e6486b-99e5-4463-891f-d24348fa8156 None None] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:49:12.778058 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e6486b-99e5-4463-891f-d24348fa8156 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:49:12.802842 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.auth.core [None req-b4e6486b-99e5-4463-891f-d24348fa8156 None None] MFA Rules not processed for user `7b0aed92d02344acb92a0e4aa67c3068`. Rule list: `[]` (Enabled: `True`). {{(pid=87934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:49:12.805276 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.fernet_utils [None req-b4e6486b-99e5-4463-891f-d24348fa8156 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:49:12.805771 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 785/1595] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Sep 13 19:49:12 2022] POST /identity/v3/users => generated 292 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 19:49:12.806598 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc278601-1f8a-47e6-8bc3-b25aab2ec6f9 admin admin] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:49:12.819914 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc278601-1f8a-47e6-8bc3-b25aab2ec6f9 admin admin] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:49:12.876369 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 811/1596] 10.222.0.25 () {58 vars in 958 bytes} [Tue Sep 13 19:49:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 19:49:12.878038 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e6486b-99e5-4463-891f-d24348fa8156 None None] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:49:12.893456 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59cd78a3-8db9-4ecb-8ae7-92f4fab3485d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:49:12.894253 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59cd78a3-8db9-4ecb-8ae7-92f4fab3485d admin admin] REQUEST_METHOD: `PUT` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:49:12.894535 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59cd78a3-8db9-4ecb-8ae7-92f4fab3485d admin admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:49:12.894962 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59cd78a3-8db9-4ecb-8ae7-92f4fab3485d admin admin] PATH_INFO: `/v3/projects/32ce89bf1f0247af83e44ea1abe75410/users/a9f056d184bd4d40982d4e70889bf68d/roles/a259191f6d0e46fabd9f34536bb28747` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:49:12.904688 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG dbcounter [-] [87935] Writing DB stats keystone:INSERT=10,keystone:SELECT=90 {{(pid=87935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:49:12.914662 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59cd78a3-8db9-4ecb-8ae7-92f4fab3485d admin admin] RBAC: Authorizing `identity:create_grant(project_id=32ce89bf1f0247af83e44ea1abe75410, user_id=a9f056d184bd4d40982d4e70889bf68d, role_id=a259191f6d0e46fabd9f34536bb28747)` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:49:12.916117 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG dbcounter [-] [87934] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=87934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:49:12.918217 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59cd78a3-8db9-4ecb-8ae7-92f4fab3485d admin admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:49:12.932922 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 786/1597] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Sep 13 19:49:12 2022] PUT /identity/v3/projects/32ce89bf1f0247af83e44ea1abe75410/users/a9f056d184bd4d40982d4e70889bf68d/roles/a259191f6d0e46fabd9f34536bb28747 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 19:49:12.933889 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59cd78a3-8db9-4ecb-8ae7-92f4fab3485d admin admin] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:49:12.978981 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e6486b-99e5-4463-891f-d24348fa8156 None None] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:49:13.000037 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59cd78a3-8db9-4ecb-8ae7-92f4fab3485d admin admin] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:49:13.006717 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58cf748b-6cc1-4e37-bc05-f9c86af18088 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:49:13.007536 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58cf748b-6cc1-4e37-bc05-f9c86af18088 admin admin] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:49:13.007816 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58cf748b-6cc1-4e37-bc05-f9c86af18088 admin admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:49:13.008089 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58cf748b-6cc1-4e37-bc05-f9c86af18088 admin admin] PATH_INFO: `/v3/roles` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:49:13.008822 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58cf748b-6cc1-4e37-bc05-f9c86af18088 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:49:13.010517 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58cf748b-6cc1-4e37-bc05-f9c86af18088 admin admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:49:13.022134 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 787/1598] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Sep 13 19:49:12 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 19:49:13.022974 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58cf748b-6cc1-4e37-bc05-f9c86af18088 admin admin] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:49:13.036299 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58cf748b-6cc1-4e37-bc05-f9c86af18088 admin admin] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:49:13.041337 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0434ce79-359d-4524-95a4-0e20dc3970ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:49:13.042298 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0434ce79-359d-4524-95a4-0e20dc3970ab admin admin] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:49:13.042583 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0434ce79-359d-4524-95a4-0e20dc3970ab admin admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:49:13.042898 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0434ce79-359d-4524-95a4-0e20dc3970ab admin admin] PATH_INFO: `/v3/roles` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:49:13.043526 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0434ce79-359d-4524-95a4-0e20dc3970ab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:49:13.045311 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0434ce79-359d-4524-95a4-0e20dc3970ab admin admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:49:13.052476 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00edaf4f-7421-407c-af12-ad2ba34c49e0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd71fe5a8275f4ea98555afdcefc902a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a10a4268f3c4cb29f4e00c292e2df62', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:49:13.053139 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00edaf4f-7421-407c-af12-ad2ba34c49e0 service nova] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:49:13.053427 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00edaf4f-7421-407c-af12-ad2ba34c49e0 service nova] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:49:13.053742 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00edaf4f-7421-407c-af12-ad2ba34c49e0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:49:13.056759 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 788/1599] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Sep 13 19:49:13 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 19:49:13.057633 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0434ce79-359d-4524-95a4-0e20dc3970ab admin admin] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:49:13.070790 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0434ce79-359d-4524-95a4-0e20dc3970ab admin admin] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:49:13.076063 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff82533-3afb-45a0-ae7f-94d0ce0138ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:49:13.076762 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff82533-3afb-45a0-ae7f-94d0ce0138ff admin admin] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:49:13.077036 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff82533-3afb-45a0-ae7f-94d0ce0138ff admin admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:49:13.077300 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff82533-3afb-45a0-ae7f-94d0ce0138ff admin admin] PATH_INFO: `/v3/roles` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:49:13.078095 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff82533-3afb-45a0-ae7f-94d0ce0138ff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:49:13.079965 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff82533-3afb-45a0-ae7f-94d0ce0138ff admin admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:49:13.094858 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 789/1600] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Sep 13 19:49:13 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 19:49:13.094858 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1989e1-2271-44c7-b24c-dc4fdbfeee5f None None] REQUEST_METHOD: `POST` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:49:13.094858 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1989e1-2271-44c7-b24c-dc4fdbfeee5f None None] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:49:13.094858 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1989e1-2271-44c7-b24c-dc4fdbfeee5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:49:13.120525 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00edaf4f-7421-407c-af12-ad2ba34c49e0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:49:13.122210 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00edaf4f-7421-407c-af12-ad2ba34c49e0 service nova] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:49:13.122737 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.auth.core [None req-2f1989e1-2271-44c7-b24c-dc4fdbfeee5f None None] MFA Rules not processed for user `5075440394e547abba5b29eb627961fc`. Rule list: `[]` (Enabled: `True`). {{(pid=87935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:49:13.124001 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.fernet_utils [None req-2f1989e1-2271-44c7-b24c-dc4fdbfeee5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:49:13.132006 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 812/1601] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Sep 13 19:49:12 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 254 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 19:49:13.132867 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00edaf4f-7421-407c-af12-ad2ba34c49e0 service nova] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:49:13.144256 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00edaf4f-7421-407c-af12-ad2ba34c49e0 service nova] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:49:13.154695 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583572c5-a7e9-4967-adfb-a14eb40f27d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:49:13.155309 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583572c5-a7e9-4967-adfb-a14eb40f27d5 admin admin] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:49:13.155592 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583572c5-a7e9-4967-adfb-a14eb40f27d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:49:13.155866 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583572c5-a7e9-4967-adfb-a14eb40f27d5 admin admin] PATH_INFO: `/v3/roles` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:49:13.157188 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-583572c5-a7e9-4967-adfb-a14eb40f27d5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:49:13.158938 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-583572c5-a7e9-4967-adfb-a14eb40f27d5 admin admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:49:13.178694 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 813/1602] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Sep 13 19:49:13 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 19:49:13.178694 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583572c5-a7e9-4967-adfb-a14eb40f27d5 admin admin] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:49:13.204763 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 790/1603] 10.222.0.25 () {58 vars in 958 bytes} [Tue Sep 13 19:49:13 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 19:49:13.206090 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530c70da-7caa-4da5-bc70-bcd5e7556892 None None] REQUEST_METHOD: `POST` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:49:13.206438 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530c70da-7caa-4da5-bc70-bcd5e7556892 None None] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:49:13.206768 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530c70da-7caa-4da5-bc70-bcd5e7556892 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:49:13.247719 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.auth.core [None req-530c70da-7caa-4da5-bc70-bcd5e7556892 None None] MFA Rules not processed for user `a9f056d184bd4d40982d4e70889bf68d`. Rule list: `[]` (Enabled: `True`). {{(pid=87935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:49:13.249265 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.fernet_utils [None req-530c70da-7caa-4da5-bc70-bcd5e7556892 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:49:13.268245 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583572c5-a7e9-4967-adfb-a14eb40f27d5 admin admin] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:49:13.273988 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c15ca1-5df9-4dcc-be23-b582adea4137 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1196a96e4a404f559600b69f929ea9da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a10a4268f3c4cb29f4e00c292e2df62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:49:13.274785 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c15ca1-5df9-4dcc-be23-b582adea4137 service neutron] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:49:13.275192 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c15ca1-5df9-4dcc-be23-b582adea4137 service neutron] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:49:13.275643 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c15ca1-5df9-4dcc-be23-b582adea4137 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:49:13.283279 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG dbcounter [-] [87934] Writing DB stats keystone:SELECT=100 {{(pid=87934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:49:13.289549 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c15ca1-5df9-4dcc-be23-b582adea4137 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:49:13.290995 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c15ca1-5df9-4dcc-be23-b582adea4137 service neutron] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:49:13.303621 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG dbcounter [-] [87935] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:49:13.308420 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 814/1604] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Sep 13 19:49:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 19:49:13.310379 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c15ca1-5df9-4dcc-be23-b582adea4137 service neutron] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:49:13.327125 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c15ca1-5df9-4dcc-be23-b582adea4137 service neutron] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:49:13.333986 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd621c6-92c8-4f84-84da-7e5b85971914 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:49:13.334895 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd621c6-92c8-4f84-84da-7e5b85971914 admin admin] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:49:13.335309 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd621c6-92c8-4f84-84da-7e5b85971914 admin admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:49:13.336034 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd621c6-92c8-4f84-84da-7e5b85971914 admin admin] PATH_INFO: `/v3/roles` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:49:13.337114 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd621c6-92c8-4f84-84da-7e5b85971914 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:49:13.339048 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd621c6-92c8-4f84-84da-7e5b85971914 admin admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:49:13.344524 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 791/1605] 10.222.0.25 () {58 vars in 958 bytes} [Tue Sep 13 19:49:13 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 19:49:13.344524 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530c70da-7caa-4da5-bc70-bcd5e7556892 None None] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:49:13.355318 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 815/1606] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Sep 13 19:49:13 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 19:49:13.356499 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd621c6-92c8-4f84-84da-7e5b85971914 admin admin] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:49:13.358046 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530c70da-7caa-4da5-bc70-bcd5e7556892 None None] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:49:13.363312 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5cedab4-216e-41de-9eb7-e3c56b96ba92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:49:13.364709 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5cedab4-216e-41de-9eb7-e3c56b96ba92 admin admin] REQUEST_METHOD: `PUT` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:49:13.364996 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5cedab4-216e-41de-9eb7-e3c56b96ba92 admin admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:49:13.365268 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5cedab4-216e-41de-9eb7-e3c56b96ba92 admin admin] PATH_INFO: `/v3/projects/9ac9a2db00f74a4bbc8597b3fe1c60c2/users/1c4a47ef1eb244ac95525df0c68e7deb/roles/a259191f6d0e46fabd9f34536bb28747` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:49:13.372368 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd621c6-92c8-4f84-84da-7e5b85971914 admin admin] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:49:13.378886 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a0870b-1323-42c2-b52f-4f66981a9db6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:49:13.380725 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a0870b-1323-42c2-b52f-4f66981a9db6 admin admin] REQUEST_METHOD: `PUT` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:49:13.381714 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a0870b-1323-42c2-b52f-4f66981a9db6 admin admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:49:13.382247 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a0870b-1323-42c2-b52f-4f66981a9db6 admin admin] PATH_INFO: `/v3/projects/b5dc14d7024f4fa9a3bb7117c4421ca8/users/14be5e0e8c7145578390fc20a368200f/roles/a259191f6d0e46fabd9f34536bb28747` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:49:13.393313 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5cedab4-216e-41de-9eb7-e3c56b96ba92 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9ac9a2db00f74a4bbc8597b3fe1c60c2, user_id=1c4a47ef1eb244ac95525df0c68e7deb, role_id=a259191f6d0e46fabd9f34536bb28747)` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:49:13.396555 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5cedab4-216e-41de-9eb7-e3c56b96ba92 admin admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:49:13.407761 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a0870b-1323-42c2-b52f-4f66981a9db6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b5dc14d7024f4fa9a3bb7117c4421ca8, user_id=14be5e0e8c7145578390fc20a368200f, role_id=a259191f6d0e46fabd9f34536bb28747)` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:49:13.411361 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a0870b-1323-42c2-b52f-4f66981a9db6 admin admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:49:13.419338 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 792/1607] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Sep 13 19:49:13 2022] PUT /identity/v3/projects/9ac9a2db00f74a4bbc8597b3fe1c60c2/users/1c4a47ef1eb244ac95525df0c68e7deb/roles/a259191f6d0e46fabd9f34536bb28747 => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 19:49:13.430765 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5cedab4-216e-41de-9eb7-e3c56b96ba92 admin admin] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:49:13.450801 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 816/1608] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Sep 13 19:49:13 2022] PUT /identity/v3/projects/b5dc14d7024f4fa9a3bb7117c4421ca8/users/14be5e0e8c7145578390fc20a368200f/roles/a259191f6d0e46fabd9f34536bb28747 => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 19:49:13.450801 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a0870b-1323-42c2-b52f-4f66981a9db6 admin admin] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:49:13.529996 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5cedab4-216e-41de-9eb7-e3c56b96ba92 admin admin] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:49:13.549800 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a0870b-1323-42c2-b52f-4f66981a9db6 admin admin] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:49:13.555656 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa19dd8-55ff-4393-a6b0-f359c8637963 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:49:13.556510 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa19dd8-55ff-4393-a6b0-f359c8637963 admin admin] REQUEST_METHOD: `POST` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:49:13.556925 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa19dd8-55ff-4393-a6b0-f359c8637963 admin admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:49:13.557503 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa19dd8-55ff-4393-a6b0-f359c8637963 admin admin] PATH_INFO: `/v3/projects` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:49:13.558718 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa19dd8-55ff-4393-a6b0-f359c8637963 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:49:13.562459 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa19dd8-55ff-4393-a6b0-f359c8637963 admin admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:49:13.603328 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 817/1609] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Sep 13 19:49:13 2022] POST /identity/v3/projects => generated 373 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 19:49:13.603328 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa19dd8-55ff-4393-a6b0-f359c8637963 admin admin] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:49:13.610982 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11d53b0-dcb9-4077-beb0-14814e8db085 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:49:13.611729 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11d53b0-dcb9-4077-beb0-14814e8db085 admin admin] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:49:13.617035 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11d53b0-dcb9-4077-beb0-14814e8db085 admin admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:49:13.617035 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11d53b0-dcb9-4077-beb0-14814e8db085 admin admin] PATH_INFO: `/v3/roles` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:49:13.617035 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c11d53b0-dcb9-4077-beb0-14814e8db085 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:49:13.617698 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c11d53b0-dcb9-4077-beb0-14814e8db085 admin admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:49:13.633829 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 793/1610] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Sep 13 19:49:13 2022] GET /identity/v3/roles => generated 1420 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 19:49:13.635615 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34d3b40-d407-4c62-8b5f-bda1e881b9ef None None] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:49:13.636075 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34d3b40-d407-4c62-8b5f-bda1e881b9ef None None] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:49:13.636461 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34d3b40-d407-4c62-8b5f-bda1e881b9ef None None] PATH_INFO: `/` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:49:13.638393 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 794/1611] 10.222.0.25 () {54 vars in 962 bytes} [Tue Sep 13 19:49:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:49:13.639680 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acaf234-debc-48c7-bda9-04c04414b75d None None] REQUEST_METHOD: `POST` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:49:13.640056 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acaf234-debc-48c7-bda9-04c04414b75d None None] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:49:13.640440 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acaf234-debc-48c7-bda9-04c04414b75d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:49:13.660940 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.auth.core [None req-0acaf234-debc-48c7-bda9-04c04414b75d None None] MFA Rules not processed for user `7b0aed92d02344acb92a0e4aa67c3068`. Rule list: `[]` (Enabled: `True`). {{(pid=87935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:49:13.662162 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.fernet_utils [None req-0acaf234-debc-48c7-bda9-04c04414b75d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:49:13.682221 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa19dd8-55ff-4393-a6b0-f359c8637963 admin admin] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:49:13.690842 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd6bd03-8f32-443b-9e14-a09d06337a33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:49:13.692464 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd6bd03-8f32-443b-9e14-a09d06337a33 admin admin] REQUEST_METHOD: `PUT` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:49:13.692803 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd6bd03-8f32-443b-9e14-a09d06337a33 admin admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:49:13.693095 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd6bd03-8f32-443b-9e14-a09d06337a33 admin admin] PATH_INFO: `/v3/projects/9db7918cdffb41108d00c5c9d5a7d017/users/2658bb3ed0fd42948a1b471816e29301/roles/a259191f6d0e46fabd9f34536bb28747` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:49:13.712233 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd6bd03-8f32-443b-9e14-a09d06337a33 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9db7918cdffb41108d00c5c9d5a7d017, user_id=2658bb3ed0fd42948a1b471816e29301, role_id=a259191f6d0e46fabd9f34536bb28747)` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:49:13.715284 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd6bd03-8f32-443b-9e14-a09d06337a33 admin admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:49:13.733455 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG dbcounter [-] [87935] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:49:13.738255 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 818/1612] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Sep 13 19:49:13 2022] PUT /identity/v3/projects/9db7918cdffb41108d00c5c9d5a7d017/users/2658bb3ed0fd42948a1b471816e29301/roles/a259191f6d0e46fabd9f34536bb28747 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 19:49:13.739624 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac273cc-f6d2-47c1-be0c-e4c7ff19b56a None None] REQUEST_METHOD: `POST` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:49:13.739908 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac273cc-f6d2-47c1-be0c-e4c7ff19b56a None None] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:49:13.740180 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac273cc-f6d2-47c1-be0c-e4c7ff19b56a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:49:13.748346 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 795/1613] 10.222.0.25 () {58 vars in 958 bytes} [Tue Sep 13 19:49:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 19:49:13.749746 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2686b0e6-6547-45c0-8d13-d234b3f61feb None None] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:49:13.750038 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2686b0e6-6547-45c0-8d13-d234b3f61feb None None] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:49:13.750317 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2686b0e6-6547-45c0-8d13-d234b3f61feb None None] PATH_INFO: `/` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:49:13.751691 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 796/1614] 10.222.0.25 () {54 vars in 912 bytes} [Tue Sep 13 19:49:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:49:13.752604 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2686b0e6-6547-45c0-8d13-d234b3f61feb None None] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:49:13.782982 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.auth.core [None req-aac273cc-f6d2-47c1-be0c-e4c7ff19b56a None None] MFA Rules not processed for user `14be5e0e8c7145578390fc20a368200f`. Rule list: `[]` (Enabled: `True`). {{(pid=87934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:49:13.784887 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.fernet_utils [None req-aac273cc-f6d2-47c1-be0c-e4c7ff19b56a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:49:13.801869 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG dbcounter [-] [87934] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:49:13.834218 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2686b0e6-6547-45c0-8d13-d234b3f61feb None None] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:49:13.838928 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5494382-2209-403a-ab61-2e057232b024 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:49:13.839532 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5494382-2209-403a-ab61-2e057232b024 admin admin] REQUEST_METHOD: `POST` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:49:13.839808 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5494382-2209-403a-ab61-2e057232b024 admin admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:49:13.840071 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5494382-2209-403a-ab61-2e057232b024 admin admin] PATH_INFO: `/v3/users` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:49:13.840733 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5494382-2209-403a-ab61-2e057232b024 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:49:13.842855 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5494382-2209-403a-ab61-2e057232b024 admin admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:49:13.873382 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 819/1615] 10.222.0.25 () {58 vars in 958 bytes} [Tue Sep 13 19:49:13 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 19:49:13.874501 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac273cc-f6d2-47c1-be0c-e4c7ff19b56a None None] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:49:13.877042 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 797/1616] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Sep 13 19:49:13 2022] POST /identity/v3/users => generated 293 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 19:49:13.878618 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34f8b00-f352-4758-b46b-75d33bd728ae None None] REQUEST_METHOD: `POST` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:49:13.879679 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34f8b00-f352-4758-b46b-75d33bd728ae None None] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:49:13.880458 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34f8b00-f352-4758-b46b-75d33bd728ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:49:13.888535 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac273cc-f6d2-47c1-be0c-e4c7ff19b56a None None] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:49:13.894244 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a0af9e-a53d-45fc-afb6-cd4f7b6e1c69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:49:13.895600 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a0af9e-a53d-45fc-afb6-cd4f7b6e1c69 admin admin] REQUEST_METHOD: `PUT` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:49:13.896028 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a0af9e-a53d-45fc-afb6-cd4f7b6e1c69 admin admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:49:13.896342 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a0af9e-a53d-45fc-afb6-cd4f7b6e1c69 admin admin] PATH_INFO: `/v3/projects/88fe628e13b94b668c1eeaeb6db9afcf/users/066fb7f5f8a548ea99de513906a49cfe/roles/a259191f6d0e46fabd9f34536bb28747` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:49:13.913650 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.auth.core [None req-f34f8b00-f352-4758-b46b-75d33bd728ae None None] MFA Rules not processed for user `d71fe5a8275f4ea98555afdcefc902a0`. Rule list: `[]` (Enabled: `True`). {{(pid=87935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:49:13.914641 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.fernet_utils [None req-f34f8b00-f352-4758-b46b-75d33bd728ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:49:13.919522 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a0af9e-a53d-45fc-afb6-cd4f7b6e1c69 admin admin] RBAC: Authorizing `identity:create_grant(project_id=88fe628e13b94b668c1eeaeb6db9afcf, user_id=066fb7f5f8a548ea99de513906a49cfe, role_id=a259191f6d0e46fabd9f34536bb28747)` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:49:13.925131 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a0af9e-a53d-45fc-afb6-cd4f7b6e1c69 admin admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:49:13.948293 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 820/1617] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Sep 13 19:49:13 2022] PUT /identity/v3/projects/88fe628e13b94b668c1eeaeb6db9afcf/users/066fb7f5f8a548ea99de513906a49cfe/roles/a259191f6d0e46fabd9f34536bb28747 => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 19:49:13.949800 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d737e0a-04c7-41b8-a666-489b10104d2e None None] REQUEST_METHOD: `POST` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:49:13.951515 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d737e0a-04c7-41b8-a666-489b10104d2e None None] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:49:13.953284 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d737e0a-04c7-41b8-a666-489b10104d2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:49:13.980673 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.auth.core [None req-3d737e0a-04c7-41b8-a666-489b10104d2e None None] MFA Rules not processed for user `7b0aed92d02344acb92a0e4aa67c3068`. Rule list: `[]` (Enabled: `True`). {{(pid=87934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:49:13.981982 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.fernet_utils [None req-3d737e0a-04c7-41b8-a666-489b10104d2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:49:14.029645 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 798/1618] 10.222.0.25 () {58 vars in 1059 bytes} [Tue Sep 13 19:49:13 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 19:49:14.030988 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34f8b00-f352-4758-b46b-75d33bd728ae None None] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:49:14.075060 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 821/1619] 10.222.0.25 () {58 vars in 958 bytes} [Tue Sep 13 19:49:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 19:49:14.076523 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff156f9c-994d-4ec4-a698-1afc92c8d246 None None] REQUEST_METHOD: `POST` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:49:14.076812 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff156f9c-994d-4ec4-a698-1afc92c8d246 None None] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:49:14.077085 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff156f9c-994d-4ec4-a698-1afc92c8d246 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:49:14.099449 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.auth.core [None req-ff156f9c-994d-4ec4-a698-1afc92c8d246 None None] MFA Rules not processed for user `d71fe5a8275f4ea98555afdcefc902a0`. Rule list: `[]` (Enabled: `True`). {{(pid=87934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:49:14.101045 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.fernet_utils [None req-ff156f9c-994d-4ec4-a698-1afc92c8d246 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:49:14.112950 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34f8b00-f352-4758-b46b-75d33bd728ae None None] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:49:14.154307 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG dbcounter [-] [87935] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:49:14.177442 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169444ae-d776-4b05-8aa2-66022c46ac99 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1196a96e4a404f559600b69f929ea9da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a10a4268f3c4cb29f4e00c292e2df62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:49:14.178050 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169444ae-d776-4b05-8aa2-66022c46ac99 service neutron] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:49:14.178334 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169444ae-d776-4b05-8aa2-66022c46ac99 service neutron] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:49:14.178606 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169444ae-d776-4b05-8aa2-66022c46ac99 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:49:14.187923 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 822/1620] 10.222.0.25 () {58 vars in 1009 bytes} [Tue Sep 13 19:49:14 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 19:49:14.188830 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff156f9c-994d-4ec4-a698-1afc92c8d246 None None] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:49:14.190004 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-169444ae-d776-4b05-8aa2-66022c46ac99 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:49:14.192011 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-169444ae-d776-4b05-8aa2-66022c46ac99 service neutron] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:49:14.200133 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff156f9c-994d-4ec4-a698-1afc92c8d246 None None] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:49:14.205536 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732dae1e-2fe1-44c8-9889-49cc02ebbf47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:49:14.206334 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732dae1e-2fe1-44c8-9889-49cc02ebbf47 admin admin] REQUEST_METHOD: `POST` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:49:14.206585 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732dae1e-2fe1-44c8-9889-49cc02ebbf47 admin admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:49:14.206935 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732dae1e-2fe1-44c8-9889-49cc02ebbf47 admin admin] PATH_INFO: `/v3/projects` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:49:14.208323 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-732dae1e-2fe1-44c8-9889-49cc02ebbf47 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:49:14.210232 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-732dae1e-2fe1-44c8-9889-49cc02ebbf47 admin admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:49:14.211461 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 799/1621] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Sep 13 19:49:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 19:49:14.212029 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169444ae-d776-4b05-8aa2-66022c46ac99 service neutron] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:49:14.223528 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169444ae-d776-4b05-8aa2-66022c46ac99 service neutron] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:49:14.230016 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f52a0f4-3d03-431e-8fed-f9b920a70f03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:49:14.230972 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f52a0f4-3d03-431e-8fed-f9b920a70f03 admin admin] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:49:14.231334 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f52a0f4-3d03-431e-8fed-f9b920a70f03 admin admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:49:14.231659 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f52a0f4-3d03-431e-8fed-f9b920a70f03 admin admin] PATH_INFO: `/v3/roles` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:49:14.232453 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f52a0f4-3d03-431e-8fed-f9b920a70f03 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:49:14.234576 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f52a0f4-3d03-431e-8fed-f9b920a70f03 admin admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:49:14.251793 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 823/1622] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Sep 13 19:49:14 2022] POST /identity/v3/projects => generated 381 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 19:49:14.254126 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b89ef39-9c74-477c-bbae-f91f06bb1ae5 None None] REQUEST_METHOD: `POST` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:49:14.254931 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b89ef39-9c74-477c-bbae-f91f06bb1ae5 None None] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:49:14.255213 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b89ef39-9c74-477c-bbae-f91f06bb1ae5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:49:14.258539 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 800/1623] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Sep 13 19:49:14 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 19:49:14.263317 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f52a0f4-3d03-431e-8fed-f9b920a70f03 admin admin] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:49:14.264980 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG dbcounter [-] [87934] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=87934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:49:14.293954 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.auth.core [None req-7b89ef39-9c74-477c-bbae-f91f06bb1ae5 None None] MFA Rules not processed for user `7b0aed92d02344acb92a0e4aa67c3068`. Rule list: `[]` (Enabled: `True`). {{(pid=87934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:49:14.299156 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f52a0f4-3d03-431e-8fed-f9b920a70f03 admin admin] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:49:14.299994 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.fernet_utils [None req-7b89ef39-9c74-477c-bbae-f91f06bb1ae5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:49:14.442014 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53fc334-eac4-4e50-b376-7db8ab072d17 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd71fe5a8275f4ea98555afdcefc902a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a10a4268f3c4cb29f4e00c292e2df62', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:49:14.443346 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53fc334-eac4-4e50-b376-7db8ab072d17 service nova] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:49:14.443725 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53fc334-eac4-4e50-b376-7db8ab072d17 service nova] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:49:14.444449 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53fc334-eac4-4e50-b376-7db8ab072d17 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:49:14.447537 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 824/1624] 10.222.0.25 () {58 vars in 958 bytes} [Tue Sep 13 19:49:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 19:49:14.451776 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b89ef39-9c74-477c-bbae-f91f06bb1ae5 None None] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:49:14.541044 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e53fc334-eac4-4e50-b376-7db8ab072d17 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:49:14.542777 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e53fc334-eac4-4e50-b376-7db8ab072d17 service nova] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:49:14.554798 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 801/1625] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Sep 13 19:49:14 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 19:49:14.555854 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b89ef39-9c74-477c-bbae-f91f06bb1ae5 None None] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:49:14.556102 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53fc334-eac4-4e50-b376-7db8ab072d17 service nova] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:49:14.564131 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21a1220-0fe7-4cb1-a72c-08eaf67a11f7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1196a96e4a404f559600b69f929ea9da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a10a4268f3c4cb29f4e00c292e2df62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:49:14.565547 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21a1220-0fe7-4cb1-a72c-08eaf67a11f7 service neutron] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:49:14.565547 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21a1220-0fe7-4cb1-a72c-08eaf67a11f7 service neutron] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:49:14.565770 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21a1220-0fe7-4cb1-a72c-08eaf67a11f7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:49:14.587385 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f21a1220-0fe7-4cb1-a72c-08eaf67a11f7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:49:14.589018 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f21a1220-0fe7-4cb1-a72c-08eaf67a11f7 service neutron] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:49:14.610081 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 825/1626] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Sep 13 19:49:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 19:49:14.611362 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21a1220-0fe7-4cb1-a72c-08eaf67a11f7 service neutron] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:49:14.630235 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21a1220-0fe7-4cb1-a72c-08eaf67a11f7 service neutron] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:49:14.642840 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2812e87e-7370-47b6-9d90-c6e5d022bdab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:49:14.643588 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2812e87e-7370-47b6-9d90-c6e5d022bdab admin admin] REQUEST_METHOD: `POST` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:49:14.643991 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2812e87e-7370-47b6-9d90-c6e5d022bdab admin admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:49:14.644410 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2812e87e-7370-47b6-9d90-c6e5d022bdab admin admin] PATH_INFO: `/v3/users` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:49:14.646477 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2812e87e-7370-47b6-9d90-c6e5d022bdab admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:49:14.649526 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2812e87e-7370-47b6-9d90-c6e5d022bdab admin admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:49:14.669243 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53fc334-eac4-4e50-b376-7db8ab072d17 service nova] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:49:14.678082 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6387aae-c00c-4f5a-a2a8-3f2784e77fb7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cbb50c88b794a7f9f26844effde7d63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a10a4268f3c4cb29f4e00c292e2df62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:49:14.678373 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6387aae-c00c-4f5a-a2a8-3f2784e77fb7 service cinder] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:49:14.678791 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6387aae-c00c-4f5a-a2a8-3f2784e77fb7 service cinder] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:49:14.679113 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6387aae-c00c-4f5a-a2a8-3f2784e77fb7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:49:14.712313 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 826/1627] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Sep 13 19:49:14 2022] POST /identity/v3/users => generated 297 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 19:49:14.716427 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2812e87e-7370-47b6-9d90-c6e5d022bdab admin admin] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:49:14.716879 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6387aae-c00c-4f5a-a2a8-3f2784e77fb7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:49:14.718263 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6387aae-c00c-4f5a-a2a8-3f2784e77fb7 service cinder] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:49:14.731260 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2812e87e-7370-47b6-9d90-c6e5d022bdab admin admin] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:49:14.738032 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea710c5c-842e-4349-b30e-be6561e89247 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:49:14.740478 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea710c5c-842e-4349-b30e-be6561e89247 admin admin] REQUEST_METHOD: `PUT` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:49:14.740976 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea710c5c-842e-4349-b30e-be6561e89247 admin admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:49:14.741455 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea710c5c-842e-4349-b30e-be6561e89247 admin admin] PATH_INFO: `/v3/projects/37d96a80edd34e2cb13ccb3bda230f6a/users/7cc1bc3bcd064bc990774b06ed513912/roles/6ca1d4427ff64e0a9d25d96cfb1445f6` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:49:14.746303 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 802/1628] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Sep 13 19:49:14 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 191 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 19:49:14.759988 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6387aae-c00c-4f5a-a2a8-3f2784e77fb7 service cinder] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:49:14.768122 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea710c5c-842e-4349-b30e-be6561e89247 admin admin] RBAC: Authorizing `identity:create_grant(project_id=37d96a80edd34e2cb13ccb3bda230f6a, user_id=7cc1bc3bcd064bc990774b06ed513912, role_id=6ca1d4427ff64e0a9d25d96cfb1445f6)` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:49:14.772065 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea710c5c-842e-4349-b30e-be6561e89247 admin admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:49:14.793772 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 827/1629] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Sep 13 19:49:14 2022] PUT /identity/v3/projects/37d96a80edd34e2cb13ccb3bda230f6a/users/7cc1bc3bcd064bc990774b06ed513912/roles/6ca1d4427ff64e0a9d25d96cfb1445f6 => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 19:49:14.794872 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea710c5c-842e-4349-b30e-be6561e89247 admin admin] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:49:14.799409 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6387aae-c00c-4f5a-a2a8-3f2784e77fb7 service cinder] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:49:14.812507 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG dbcounter [-] [87935] Writing DB stats keystone:SELECT=100 {{(pid=87935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:49:14.904785 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e87d40-92fb-4810-809b-52cea6579d77 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1196a96e4a404f559600b69f929ea9da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a10a4268f3c4cb29f4e00c292e2df62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:49:14.906026 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e87d40-92fb-4810-809b-52cea6579d77 service neutron] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:49:14.906449 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e87d40-92fb-4810-809b-52cea6579d77 service neutron] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:49:14.906819 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e87d40-92fb-4810-809b-52cea6579d77 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:49:14.963372 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea710c5c-842e-4349-b30e-be6561e89247 admin admin] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:49:14.985565 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255adbe4-2ee2-43e7-9819-6c52a7efc372 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:49:14.986195 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255adbe4-2ee2-43e7-9819-6c52a7efc372 admin admin] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:49:14.986470 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255adbe4-2ee2-43e7-9819-6c52a7efc372 admin admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:49:14.986881 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255adbe4-2ee2-43e7-9819-6c52a7efc372 admin admin] PATH_INFO: `/v3/roles` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:49:14.987522 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-255adbe4-2ee2-43e7-9819-6c52a7efc372 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:49:14.989831 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-255adbe4-2ee2-43e7-9819-6c52a7efc372 admin admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:49:15.005740 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG dbcounter [-] [87934] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=87934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:49:15.018549 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 828/1630] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Sep 13 19:49:14 2022] GET /identity/v3/roles => generated 1420 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 19:49:15.020760 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255adbe4-2ee2-43e7-9819-6c52a7efc372 admin admin] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:49:15.039995 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255adbe4-2ee2-43e7-9819-6c52a7efc372 admin admin] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:49:15.058993 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce21fa6f-e976-497b-9200-96b198e31746 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:49:15.058993 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce21fa6f-e976-497b-9200-96b198e31746 admin admin] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:49:15.058993 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce21fa6f-e976-497b-9200-96b198e31746 admin admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:49:15.058993 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce21fa6f-e976-497b-9200-96b198e31746 admin admin] PATH_INFO: `/v3/roles` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:49:15.059572 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce21fa6f-e976-497b-9200-96b198e31746 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:49:15.063278 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e87d40-92fb-4810-809b-52cea6579d77 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:49:15.065432 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce21fa6f-e976-497b-9200-96b198e31746 admin admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:49:15.068454 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e87d40-92fb-4810-809b-52cea6579d77 service neutron] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:49:15.099776 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 829/1631] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Sep 13 19:49:15 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 19:49:15.105033 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 803/1632] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Sep 13 19:49:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 19:49:15.105833 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce21fa6f-e976-497b-9200-96b198e31746 admin admin] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:49:15.106373 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b928fe9b-4bcd-4568-b415-7a0335cbfedf None None] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:49:15.106656 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b928fe9b-4bcd-4568-b415-7a0335cbfedf None None] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:49:15.109906 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b928fe9b-4bcd-4568-b415-7a0335cbfedf None None] PATH_INFO: `/` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:49:15.113776 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 804/1633] 10.222.0.25 () {54 vars in 912 bytes} [Tue Sep 13 19:49:15 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:49:15.116197 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b928fe9b-4bcd-4568-b415-7a0335cbfedf None None] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:49:15.135333 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce21fa6f-e976-497b-9200-96b198e31746 admin admin] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:49:15.148110 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b928fe9b-4bcd-4568-b415-7a0335cbfedf None None] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:49:15.149810 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c09babe-ab4c-49de-b5bd-d49a8077cfbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:49:15.150503 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c09babe-ab4c-49de-b5bd-d49a8077cfbe admin admin] REQUEST_METHOD: `PUT` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:49:15.150826 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c09babe-ab4c-49de-b5bd-d49a8077cfbe admin admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:49:15.151112 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c09babe-ab4c-49de-b5bd-d49a8077cfbe admin admin] PATH_INFO: `/v3/projects/687c09cecc4b4813a9d454e105716828/users/f32c21f2f3274ec8968fc10598100ad2/roles/6ca1d4427ff64e0a9d25d96cfb1445f6` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:49:15.163596 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22220cbe-0d97-4c4f-83b9-11581c87846d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:49:15.164492 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22220cbe-0d97-4c4f-83b9-11581c87846d admin admin] REQUEST_METHOD: `PUT` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:49:15.164492 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22220cbe-0d97-4c4f-83b9-11581c87846d admin admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:49:15.164827 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22220cbe-0d97-4c4f-83b9-11581c87846d admin admin] PATH_INFO: `/v3/projects/37d96a80edd34e2cb13ccb3bda230f6a/users/7cc1bc3bcd064bc990774b06ed513912/roles/6ca1d4427ff64e0a9d25d96cfb1445f6` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:49:15.170889 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22220cbe-0d97-4c4f-83b9-11581c87846d admin admin] RBAC: Authorizing `identity:create_grant(project_id=37d96a80edd34e2cb13ccb3bda230f6a, user_id=7cc1bc3bcd064bc990774b06ed513912, role_id=6ca1d4427ff64e0a9d25d96cfb1445f6)` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:49:15.179470 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22220cbe-0d97-4c4f-83b9-11581c87846d admin admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:49:15.203552 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c09babe-ab4c-49de-b5bd-d49a8077cfbe admin admin] RBAC: Authorizing `identity:create_grant(project_id=687c09cecc4b4813a9d454e105716828, user_id=f32c21f2f3274ec8968fc10598100ad2, role_id=6ca1d4427ff64e0a9d25d96cfb1445f6)` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:49:15.207082 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c09babe-ab4c-49de-b5bd-d49a8077cfbe admin admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:49:15.214325 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 805/1634] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Sep 13 19:49:15 2022] PUT /identity/v3/projects/37d96a80edd34e2cb13ccb3bda230f6a/users/7cc1bc3bcd064bc990774b06ed513912/roles/6ca1d4427ff64e0a9d25d96cfb1445f6 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 19:49:15.216024 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a7720f-f019-431d-9daf-303841265922 None None] REQUEST_METHOD: `POST` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:49:15.216504 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a7720f-f019-431d-9daf-303841265922 None None] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:49:15.216935 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a7720f-f019-431d-9daf-303841265922 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:49:15.252074 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 830/1635] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Sep 13 19:49:15 2022] PUT /identity/v3/projects/687c09cecc4b4813a9d454e105716828/users/f32c21f2f3274ec8968fc10598100ad2/roles/6ca1d4427ff64e0a9d25d96cfb1445f6 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 19:49:15.252074 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac04225-d0f5-46cd-8634-23af18916ebc None None] REQUEST_METHOD: `POST` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:49:15.252074 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac04225-d0f5-46cd-8634-23af18916ebc None None] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:49:15.252074 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac04225-d0f5-46cd-8634-23af18916ebc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:49:15.282633 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.auth.core [None req-d8a7720f-f019-431d-9daf-303841265922 None None] MFA Rules not processed for user `d71fe5a8275f4ea98555afdcefc902a0`. Rule list: `[]` (Enabled: `True`). {{(pid=87935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:49:15.284043 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.fernet_utils [None req-d8a7720f-f019-431d-9daf-303841265922 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:49:15.322379 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.auth.core [None req-cac04225-d0f5-46cd-8634-23af18916ebc None None] MFA Rules not processed for user `7cc1bc3bcd064bc990774b06ed513912`. Rule list: `[]` (Enabled: `True`). {{(pid=87934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:49:15.329349 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.fernet_utils [None req-cac04225-d0f5-46cd-8634-23af18916ebc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:49:15.379737 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 806/1636] 10.222.0.25 () {58 vars in 1009 bytes} [Tue Sep 13 19:49:15 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 19:49:15.380836 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a7720f-f019-431d-9daf-303841265922 None None] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:49:15.455925 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG dbcounter [-] [87935] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:49:15.460965 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 831/1637] 10.222.0.25 () {58 vars in 958 bytes} [Tue Sep 13 19:49:15 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 19:49:15.465266 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac04225-d0f5-46cd-8634-23af18916ebc None None] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:49:15.490578 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a7720f-f019-431d-9daf-303841265922 None None] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:49:15.499447 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c09ffb-57f3-4fb4-85a0-cea5b3851a00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:49:15.500510 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c09ffb-57f3-4fb4-85a0-cea5b3851a00 admin admin] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:49:15.500899 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c09ffb-57f3-4fb4-85a0-cea5b3851a00 admin admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:49:15.501431 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c09ffb-57f3-4fb4-85a0-cea5b3851a00 admin admin] PATH_INFO: `/v3/roles` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:49:15.502508 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c09ffb-57f3-4fb4-85a0-cea5b3851a00 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:49:15.506863 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c09ffb-57f3-4fb4-85a0-cea5b3851a00 admin admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:49:15.526454 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 807/1638] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Sep 13 19:49:15 2022] GET /identity/v3/roles => generated 1420 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 19:49:15.528660 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c09ffb-57f3-4fb4-85a0-cea5b3851a00 admin admin] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:49:15.644312 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac04225-d0f5-46cd-8634-23af18916ebc None None] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:49:15.653683 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c09ffb-57f3-4fb4-85a0-cea5b3851a00 admin admin] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:49:15.655681 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f752050e-f28e-447a-81e3-ba3f88d278b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:49:15.661323 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f752050e-f28e-447a-81e3-ba3f88d278b8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:49:15.662904 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f752050e-f28e-447a-81e3-ba3f88d278b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:49:15.664441 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f752050e-f28e-447a-81e3-ba3f88d278b8 admin admin] PATH_INFO: `/v3/users/c8e0cf49622e49d38c9f57dcb13cf5a6` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:49:15.665918 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f752050e-f28e-447a-81e3-ba3f88d278b8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c8e0cf49622e49d38c9f57dcb13cf5a6)` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:49:15.669027 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc91b2ed-2923-4dcd-894a-c782a2797225 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cbb50c88b794a7f9f26844effde7d63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a10a4268f3c4cb29f4e00c292e2df62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:49:15.669879 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc91b2ed-2923-4dcd-894a-c782a2797225 service cinder] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:49:15.671296 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f752050e-f28e-447a-81e3-ba3f88d278b8 admin admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:49:15.671593 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc91b2ed-2923-4dcd-894a-c782a2797225 service cinder] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:49:15.671975 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc91b2ed-2923-4dcd-894a-c782a2797225 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:49:15.698599 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc91b2ed-2923-4dcd-894a-c782a2797225 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:49:15.704607 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc91b2ed-2923-4dcd-894a-c782a2797225 service cinder] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:49:15.731205 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 808/1639] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Sep 13 19:49:15 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 204 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 19:49:15.732540 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc91b2ed-2923-4dcd-894a-c782a2797225 service cinder] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:49:15.760420 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc91b2ed-2923-4dcd-894a-c782a2797225 service cinder] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:49:15.766086 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.notifications [None req-f752050e-f28e-447a-81e3-ba3f88d278b8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c8e0cf49622e49d38c9f57dcb13cf5a6'} {{(pid=87934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:49:15.766412 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314e9cb1-738f-46f4-9946-42ec47752db4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cbb50c88b794a7f9f26844effde7d63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a10a4268f3c4cb29f4e00c292e2df62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:49:15.767126 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314e9cb1-738f-46f4-9946-42ec47752db4 service cinder] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:49:15.767278 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.notifications [None req-f752050e-f28e-447a-81e3-ba3f88d278b8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c8e0cf49622e49d38c9f57dcb13cf5a6'} {{(pid=87934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:49:15.768162 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314e9cb1-738f-46f4-9946-42ec47752db4 service cinder] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:49:15.768454 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.notifications [None req-f752050e-f28e-447a-81e3-ba3f88d278b8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c8e0cf49622e49d38c9f57dcb13cf5a6'} {{(pid=87934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:49:15.768682 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314e9cb1-738f-46f4-9946-42ec47752db4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:49:15.771535 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.fernet_utils [None req-314e9cb1-738f-46f4-9946-42ec47752db4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:49:15.775736 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG dbcounter [-] [87934] Writing DB stats keystone:SELECT=92,keystone:INSERT=1,keystone:DELETE=7 {{(pid=87934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:49:15.786620 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.notifications [None req-f752050e-f28e-447a-81e3-ba3f88d278b8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c8e0cf49622e49d38c9f57dcb13cf5a6'} {{(pid=87934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:49:15.802424 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-314e9cb1-738f-46f4-9946-42ec47752db4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:49:15.803900 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-314e9cb1-738f-46f4-9946-42ec47752db4 service cinder] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:49:15.834958 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.notifications [None req-f752050e-f28e-447a-81e3-ba3f88d278b8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c8e0cf49622e49d38c9f57dcb13cf5a6'} {{(pid=87934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:49:15.844253 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 809/1640] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Sep 13 19:49:15 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 19:49:15.845147 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314e9cb1-738f-46f4-9946-42ec47752db4 service cinder] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:49:15.849174 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.fernet_utils [None req-314e9cb1-738f-46f4-9946-42ec47752db4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:49:15.858435 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 832/1641] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Sep 13 19:49:15 2022] DELETE /identity/v3/users/c8e0cf49622e49d38c9f57dcb13cf5a6 => generated 0 bytes in 395 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 19:49:15.862731 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279ec20f-884a-46fb-a6ee-d8f6e66f4672 None None] REQUEST_METHOD: `POST` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:49:15.863232 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279ec20f-884a-46fb-a6ee-d8f6e66f4672 None None] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:49:15.864726 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279ec20f-884a-46fb-a6ee-d8f6e66f4672 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:49:15.886120 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314e9cb1-738f-46f4-9946-42ec47752db4 service cinder] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:49:15.947984 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.auth.core [None req-279ec20f-884a-46fb-a6ee-d8f6e66f4672 None None] MFA Rules not processed for user `7b0aed92d02344acb92a0e4aa67c3068`. Rule list: `[]` (Enabled: `True`). {{(pid=87934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:49:15.949463 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.fernet_utils [None req-279ec20f-884a-46fb-a6ee-d8f6e66f4672 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:49:16.158949 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e664122-5c44-456b-b873-17a3b839212b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:49:16.160935 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e664122-5c44-456b-b873-17a3b839212b admin admin] REQUEST_METHOD: `PUT` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:49:16.161274 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e664122-5c44-456b-b873-17a3b839212b admin admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:49:16.161545 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e664122-5c44-456b-b873-17a3b839212b admin admin] PATH_INFO: `/v3/projects/687c09cecc4b4813a9d454e105716828/users/f32c21f2f3274ec8968fc10598100ad2/roles/6ca1d4427ff64e0a9d25d96cfb1445f6` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:49:16.167852 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e664122-5c44-456b-b873-17a3b839212b admin admin] RBAC: Authorizing `identity:create_grant(project_id=687c09cecc4b4813a9d454e105716828, user_id=f32c21f2f3274ec8968fc10598100ad2, role_id=6ca1d4427ff64e0a9d25d96cfb1445f6)` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:49:16.170552 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e664122-5c44-456b-b873-17a3b839212b admin admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:49:16.201603 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 810/1642] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Sep 13 19:49:15 2022] PUT /identity/v3/projects/687c09cecc4b4813a9d454e105716828/users/f32c21f2f3274ec8968fc10598100ad2/roles/6ca1d4427ff64e0a9d25d96cfb1445f6 => generated 0 bytes in 357 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 19:49:16.214278 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad26ffa-d5a5-420a-ad99-244e3805826f None None] REQUEST_METHOD: `POST` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:49:16.214583 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad26ffa-d5a5-420a-ad99-244e3805826f None None] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:49:16.214825 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad26ffa-d5a5-420a-ad99-244e3805826f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:49:16.218459 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 833/1643] 10.222.0.25 () {58 vars in 958 bytes} [Tue Sep 13 19:49:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 354 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 19:49:16.237342 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279ec20f-884a-46fb-a6ee-d8f6e66f4672 None None] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:49:16.240800 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.fernet_utils [None req-279ec20f-884a-46fb-a6ee-d8f6e66f4672 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:49:16.322659 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.auth.core [None req-3ad26ffa-d5a5-420a-ad99-244e3805826f None None] MFA Rules not processed for user `f32c21f2f3274ec8968fc10598100ad2`. Rule list: `[]` (Enabled: `True`). {{(pid=87935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:49:16.329335 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.fernet_utils [None req-3ad26ffa-d5a5-420a-ad99-244e3805826f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:49:16.416819 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279ec20f-884a-46fb-a6ee-d8f6e66f4672 None None] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:49:16.468137 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG dbcounter [-] [87935] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:49:16.554113 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 811/1644] 10.222.0.25 () {58 vars in 958 bytes} [Tue Sep 13 19:49:16 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 341 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 19:49:16.578976 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c25183-6111-4d60-920a-0212eae3fee8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1196a96e4a404f559600b69f929ea9da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a10a4268f3c4cb29f4e00c292e2df62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:49:16.583832 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c25183-6111-4d60-920a-0212eae3fee8 service neutron] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:49:16.583832 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c25183-6111-4d60-920a-0212eae3fee8 service neutron] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:49:16.583832 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c25183-6111-4d60-920a-0212eae3fee8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:49:16.596747 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad26ffa-d5a5-420a-ad99-244e3805826f None None] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:49:16.599021 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.fernet_utils [None req-3ad26ffa-d5a5-420a-ad99-244e3805826f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:49:16.660801 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG dbcounter [-] [87934] Writing DB stats keystone:SELECT=96,keystone:DELETE=3,keystone:INSERT=1 {{(pid=87934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:49:16.704404 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c25183-6111-4d60-920a-0212eae3fee8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:49:16.708924 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c25183-6111-4d60-920a-0212eae3fee8 service neutron] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:49:16.727279 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad26ffa-d5a5-420a-ad99-244e3805826f None None] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:49:16.737970 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 834/1645] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Sep 13 19:49:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 501 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 13 19:49:16.739529 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ba10cc-b717-4224-9afa-9ba2ad8c6a8f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cbb50c88b794a7f9f26844effde7d63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a10a4268f3c4cb29f4e00c292e2df62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:49:16.740300 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ba10cc-b717-4224-9afa-9ba2ad8c6a8f service cinder] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:49:16.740688 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ba10cc-b717-4224-9afa-9ba2ad8c6a8f service cinder] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:49:16.741321 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ba10cc-b717-4224-9afa-9ba2ad8c6a8f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:49:16.760683 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ba10cc-b717-4224-9afa-9ba2ad8c6a8f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:49:16.763773 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ba10cc-b717-4224-9afa-9ba2ad8c6a8f service cinder] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:49:16.794736 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 812/1646] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Sep 13 19:49:16 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 199 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 13 19:49:17.030674 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c25183-6111-4d60-920a-0212eae3fee8 service neutron] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:49:17.033115 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c25183-6111-4d60-920a-0212eae3fee8 service neutron] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:49:17.044274 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55aabbb2-b24d-4161-9656-fd9db7982dd4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cbb50c88b794a7f9f26844effde7d63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a10a4268f3c4cb29f4e00c292e2df62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:49:17.046257 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55aabbb2-b24d-4161-9656-fd9db7982dd4 service cinder] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:49:17.046425 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55aabbb2-b24d-4161-9656-fd9db7982dd4 service cinder] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:49:17.047844 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55aabbb2-b24d-4161-9656-fd9db7982dd4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:49:17.056577 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.fernet_utils [None req-55aabbb2-b24d-4161-9656-fd9db7982dd4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:49:17.217917 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ba10cc-b717-4224-9afa-9ba2ad8c6a8f service cinder] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:49:17.219628 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.fernet_utils [None req-72ba10cc-b717-4224-9afa-9ba2ad8c6a8f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:49:17.245034 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ba10cc-b717-4224-9afa-9ba2ad8c6a8f service cinder] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:49:17.246024 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55aabbb2-b24d-4161-9656-fd9db7982dd4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:49:17.256179 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55aabbb2-b24d-4161-9656-fd9db7982dd4 service cinder] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:49:17.267240 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f75cba-d5af-4d15-ba33-4b31fe50cfcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:49:17.267935 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f75cba-d5af-4d15-ba33-4b31fe50cfcb admin admin] REQUEST_METHOD: `DELETE` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:49:17.268300 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f75cba-d5af-4d15-ba33-4b31fe50cfcb admin admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:49:17.268548 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f75cba-d5af-4d15-ba33-4b31fe50cfcb admin admin] PATH_INFO: `/v3/users/5075440394e547abba5b29eb627961fc` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:49:17.272227 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f75cba-d5af-4d15-ba33-4b31fe50cfcb admin admin] RBAC: Authorizing `identity:delete_user(user_id=5075440394e547abba5b29eb627961fc)` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:49:17.273389 dv-cinder-828805-6-smb devstack@keystone.service[87935]: WARNING py.warnings [None req-92f75cba-d5af-4d15-ba33-4b31fe50cfcb admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 13 19:49:17.273389 dv-cinder-828805-6-smb devstack@keystone.service[87935]: warnings.warn(msg) Sep 13 19:49:17.273389 dv-cinder-828805-6-smb devstack@keystone.service[87935]: Sep 13 19:49:17.274523 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f75cba-d5af-4d15-ba33-4b31fe50cfcb admin admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:49:17.292289 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 835/1647] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Sep 13 19:49:17 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 288 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 19:49:17.455574 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.notifications [None req-92f75cba-d5af-4d15-ba33-4b31fe50cfcb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5075440394e547abba5b29eb627961fc'} {{(pid=87935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:49:17.478056 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.notifications [None req-92f75cba-d5af-4d15-ba33-4b31fe50cfcb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5075440394e547abba5b29eb627961fc'} {{(pid=87935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:49:17.545400 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.notifications [None req-92f75cba-d5af-4d15-ba33-4b31fe50cfcb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5075440394e547abba5b29eb627961fc'} {{(pid=87935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:49:17.547124 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.notifications [None req-92f75cba-d5af-4d15-ba33-4b31fe50cfcb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5075440394e547abba5b29eb627961fc'} {{(pid=87935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:49:17.550020 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.notifications [None req-92f75cba-d5af-4d15-ba33-4b31fe50cfcb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5075440394e547abba5b29eb627961fc'} {{(pid=87935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:49:17.598863 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93cadaab-1549-4edf-aa9c-dd9f5069a0f7 None None] REQUEST_METHOD: `POST` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:49:17.599388 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93cadaab-1549-4edf-aa9c-dd9f5069a0f7 None None] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:49:17.599636 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93cadaab-1549-4edf-aa9c-dd9f5069a0f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:49:17.603064 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 813/1648] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Sep 13 19:49:17 2022] DELETE /identity/v3/users/5075440394e547abba5b29eb627961fc => generated 0 bytes in 376 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 19:49:17.645273 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.auth.core [None req-93cadaab-1549-4edf-aa9c-dd9f5069a0f7 None None] MFA Rules not processed for user `7b0aed92d02344acb92a0e4aa67c3068`. Rule list: `[]` (Enabled: `True`). {{(pid=87934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:49:17.648599 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.fernet_utils [None req-93cadaab-1549-4edf-aa9c-dd9f5069a0f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:49:17.768820 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 836/1649] 10.222.0.25 () {58 vars in 958 bytes} [Tue Sep 13 19:49:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 19:49:17.803416 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f75cba-d5af-4d15-ba33-4b31fe50cfcb admin admin] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:49:17.805643 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.fernet_utils [None req-92f75cba-d5af-4d15-ba33-4b31fe50cfcb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:49:17.939538 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f75cba-d5af-4d15-ba33-4b31fe50cfcb admin admin] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:49:17.955231 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ede5b17-881d-4a59-bd25-30326fd0775b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1196a96e4a404f559600b69f929ea9da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a10a4268f3c4cb29f4e00c292e2df62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:49:17.956025 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ede5b17-881d-4a59-bd25-30326fd0775b service neutron] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:49:17.956357 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ede5b17-881d-4a59-bd25-30326fd0775b service neutron] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:49:17.956686 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ede5b17-881d-4a59-bd25-30326fd0775b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:49:17.997462 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ede5b17-881d-4a59-bd25-30326fd0775b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:49:17.999483 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ede5b17-881d-4a59-bd25-30326fd0775b service neutron] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:49:18.009811 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG dbcounter [-] [87935] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:49:18.021889 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 814/1650] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Sep 13 19:49:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 220 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 19:49:18.157128 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93cadaab-1549-4edf-aa9c-dd9f5069a0f7 None None] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:49:18.158701 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.fernet_utils [None req-93cadaab-1549-4edf-aa9c-dd9f5069a0f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:49:18.188658 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93cadaab-1549-4edf-aa9c-dd9f5069a0f7 None None] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:49:18.204081 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df22b147-7bee-49e6-a62f-a4e387edbbab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:49:18.205092 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df22b147-7bee-49e6-a62f-a4e387edbbab admin admin] REQUEST_METHOD: `DELETE` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:49:18.205596 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df22b147-7bee-49e6-a62f-a4e387edbbab admin admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:49:18.206090 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df22b147-7bee-49e6-a62f-a4e387edbbab admin admin] PATH_INFO: `/v3/projects/9d568b19ca094d1e9ebc9140465fed0e` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:49:18.224251 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df22b147-7bee-49e6-a62f-a4e387edbbab admin admin] RBAC: Authorizing `identity:delete_project(project_id=9d568b19ca094d1e9ebc9140465fed0e)` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:49:18.225668 dv-cinder-828805-6-smb devstack@keystone.service[87934]: WARNING py.warnings [None req-df22b147-7bee-49e6-a62f-a4e387edbbab admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 13 19:49:18.225668 dv-cinder-828805-6-smb devstack@keystone.service[87934]: warnings.warn(msg) Sep 13 19:49:18.225668 dv-cinder-828805-6-smb devstack@keystone.service[87934]: Sep 13 19:49:18.229934 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df22b147-7bee-49e6-a62f-a4e387edbbab admin admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:49:18.329026 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.notifications [None req-df22b147-7bee-49e6-a62f-a4e387edbbab admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9d568b19ca094d1e9ebc9140465fed0e', 'request_id': 'req-df22b147-7bee-49e6-a62f-a4e387edbbab'} {{(pid=87934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:49:18.347046 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.notifications [None req-df22b147-7bee-49e6-a62f-a4e387edbbab admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9d568b19ca094d1e9ebc9140465fed0e', 'request_id': 'req-df22b147-7bee-49e6-a62f-a4e387edbbab'} {{(pid=87934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:49:18.357945 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.notifications [None req-df22b147-7bee-49e6-a62f-a4e387edbbab admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9d568b19ca094d1e9ebc9140465fed0e', 'request_id': 'req-df22b147-7bee-49e6-a62f-a4e387edbbab'} {{(pid=87934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:49:18.370902 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG dbcounter [-] [87934] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=87934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:49:18.378050 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.notifications [None req-df22b147-7bee-49e6-a62f-a4e387edbbab admin admin] The token cache is being invalidate because project 9d568b19ca094d1e9ebc9140465fed0e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87934) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 19:49:18.378482 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.notifications [None req-df22b147-7bee-49e6-a62f-a4e387edbbab admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:49:18.381294 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.notifications [None req-df22b147-7bee-49e6-a62f-a4e387edbbab admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:49:18.385892 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 837/1651] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Sep 13 19:49:18 2022] DELETE /identity/v3/projects/9d568b19ca094d1e9ebc9140465fed0e => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 19:49:18.390804 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f487a610-1cda-430f-8376-391a641d15c1 None None] REQUEST_METHOD: `POST` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:49:18.391605 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f487a610-1cda-430f-8376-391a641d15c1 None None] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:49:18.391878 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f487a610-1cda-430f-8376-391a641d15c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:49:18.427405 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.auth.core [None req-f487a610-1cda-430f-8376-391a641d15c1 None None] MFA Rules not processed for user `7b0aed92d02344acb92a0e4aa67c3068`. Rule list: `[]` (Enabled: `True`). {{(pid=87935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:49:18.428783 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.fernet_utils [None req-f487a610-1cda-430f-8376-391a641d15c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:49:18.541568 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 815/1652] 10.222.0.25 () {58 vars in 958 bytes} [Tue Sep 13 19:49:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 19:49:18.548815 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d3e029-0b6b-4b84-9377-1274820586d6 None None] REQUEST_METHOD: `POST` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:49:18.549134 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d3e029-0b6b-4b84-9377-1274820586d6 None None] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:49:18.549467 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d3e029-0b6b-4b84-9377-1274820586d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:49:18.591033 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.auth.core [None req-e8d3e029-0b6b-4b84-9377-1274820586d6 None None] MFA Rules not processed for user `7b0aed92d02344acb92a0e4aa67c3068`. Rule list: `[]` (Enabled: `True`). {{(pid=87934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:49:18.592436 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.fernet_utils [None req-e8d3e029-0b6b-4b84-9377-1274820586d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:49:18.611379 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 838/1653] 10.222.0.25 () {58 vars in 958 bytes} [Tue Sep 13 19:49:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 19:49:18.612915 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f487a610-1cda-430f-8376-391a641d15c1 None None] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:49:18.625193 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f487a610-1cda-430f-8376-391a641d15c1 None None] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:49:18.647878 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8b34b9-db35-47fd-be7d-13bbfe794595 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:49:18.648898 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8b34b9-db35-47fd-be7d-13bbfe794595 admin admin] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:49:18.649408 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8b34b9-db35-47fd-be7d-13bbfe794595 admin admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:49:18.649870 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8b34b9-db35-47fd-be7d-13bbfe794595 admin admin] PATH_INFO: `/v3/domains` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:49:18.650848 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b8b34b9-db35-47fd-be7d-13bbfe794595 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87935) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:49:18.651688 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b8b34b9-db35-47fd-be7d-13bbfe794595 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:49:18.654909 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b8b34b9-db35-47fd-be7d-13bbfe794595 admin admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:49:18.680352 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d3e029-0b6b-4b84-9377-1274820586d6 None None] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:49:18.682752 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 816/1654] 10.222.0.25 () {58 vars in 1153 bytes} [Tue Sep 13 19:49:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:49:18.699169 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d3e029-0b6b-4b84-9377-1274820586d6 None None] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:49:18.716657 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f3a6cb-0dba-420b-9945-551b6b16840c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:49:18.718186 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f3a6cb-0dba-420b-9945-551b6b16840c admin admin] REQUEST_METHOD: `POST` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:49:18.718578 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f3a6cb-0dba-420b-9945-551b6b16840c admin admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:49:18.718955 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f3a6cb-0dba-420b-9945-551b6b16840c admin admin] PATH_INFO: `/v3/projects` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:49:18.719901 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f3a6cb-0dba-420b-9945-551b6b16840c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:49:18.726448 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f3a6cb-0dba-420b-9945-551b6b16840c admin admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:49:18.802006 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8b34b9-db35-47fd-be7d-13bbfe794595 admin admin] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:49:18.836063 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 839/1655] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Sep 13 19:49:18 2022] POST /identity/v3/projects => generated 385 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 13 19:49:18.844783 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8b34b9-db35-47fd-be7d-13bbfe794595 admin admin] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:49:18.990487 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c2e842-024d-4df8-bf95-ee34dcde9700 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:49:18.991113 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c2e842-024d-4df8-bf95-ee34dcde9700 admin admin] REQUEST_METHOD: `POST` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:49:18.991490 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c2e842-024d-4df8-bf95-ee34dcde9700 admin admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:49:18.991822 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c2e842-024d-4df8-bf95-ee34dcde9700 admin admin] PATH_INFO: `/v3/users` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:49:18.993348 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c2e842-024d-4df8-bf95-ee34dcde9700 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:49:18.997172 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c2e842-024d-4df8-bf95-ee34dcde9700 admin admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:49:19.048300 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 817/1656] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Sep 13 19:49:18 2022] POST /identity/v3/users => generated 293 bytes in 251 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 19:49:19.050127 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f3a6cb-0dba-420b-9945-551b6b16840c admin admin] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:49:19.081033 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f3a6cb-0dba-420b-9945-551b6b16840c admin admin] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:49:19.093576 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937c82b6-c2b1-4ab9-985f-b766df85b921 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:49:19.094813 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937c82b6-c2b1-4ab9-985f-b766df85b921 admin admin] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:49:19.096805 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937c82b6-c2b1-4ab9-985f-b766df85b921 admin admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:49:19.098118 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937c82b6-c2b1-4ab9-985f-b766df85b921 admin admin] PATH_INFO: `/v3/roles` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:49:19.099591 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-937c82b6-c2b1-4ab9-985f-b766df85b921 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:49:19.104719 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-937c82b6-c2b1-4ab9-985f-b766df85b921 admin admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:49:19.127309 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 840/1657] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Sep 13 19:49:19 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 19:49:19.130867 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c2e842-024d-4df8-bf95-ee34dcde9700 admin admin] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:49:19.148637 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c2e842-024d-4df8-bf95-ee34dcde9700 admin admin] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:49:19.164274 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a5de46-7977-42f1-84a6-28180ade9599 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:49:19.164902 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a5de46-7977-42f1-84a6-28180ade9599 admin admin] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:49:19.165182 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a5de46-7977-42f1-84a6-28180ade9599 admin admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:49:19.166501 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a5de46-7977-42f1-84a6-28180ade9599 admin admin] PATH_INFO: `/v3/roles` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:49:19.167166 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a5de46-7977-42f1-84a6-28180ade9599 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:49:19.169245 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a5de46-7977-42f1-84a6-28180ade9599 admin admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:49:19.218244 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 818/1658] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Sep 13 19:49:19 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 19:49:19.226442 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937c82b6-c2b1-4ab9-985f-b766df85b921 admin admin] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:49:19.254707 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937c82b6-c2b1-4ab9-985f-b766df85b921 admin admin] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:49:19.265078 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71219b6a-7572-4a47-b9a8-806c35c1d5ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:49:19.265757 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71219b6a-7572-4a47-b9a8-806c35c1d5ad admin admin] REQUEST_METHOD: `PUT` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:49:19.266040 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71219b6a-7572-4a47-b9a8-806c35c1d5ad admin admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:49:19.266449 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71219b6a-7572-4a47-b9a8-806c35c1d5ad admin admin] PATH_INFO: `/v3/projects/2ed162378af84b77a2ebed10b155b5a1/users/9926f72057964c469e51f6224cf2d0e2/roles/a259191f6d0e46fabd9f34536bb28747` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:49:19.318020 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71219b6a-7572-4a47-b9a8-806c35c1d5ad admin admin] RBAC: Authorizing `identity:create_grant(project_id=2ed162378af84b77a2ebed10b155b5a1, user_id=9926f72057964c469e51f6224cf2d0e2, role_id=a259191f6d0e46fabd9f34536bb28747)` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:49:19.322759 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71219b6a-7572-4a47-b9a8-806c35c1d5ad admin admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:49:19.353038 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 841/1659] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Sep 13 19:49:19 2022] PUT /identity/v3/projects/2ed162378af84b77a2ebed10b155b5a1/users/9926f72057964c469e51f6224cf2d0e2/roles/a259191f6d0e46fabd9f34536bb28747 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 19:49:19.366150 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0905787-84e3-4a5d-9202-26fed79a1dcb None None] REQUEST_METHOD: `POST` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:49:19.366594 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0905787-84e3-4a5d-9202-26fed79a1dcb None None] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:49:19.366967 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0905787-84e3-4a5d-9202-26fed79a1dcb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:49:19.430448 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.auth.core [None req-f0905787-84e3-4a5d-9202-26fed79a1dcb None None] MFA Rules not processed for user `9926f72057964c469e51f6224cf2d0e2`. Rule list: `[]` (Enabled: `True`). {{(pid=87935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:49:19.439106 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.fernet_utils [None req-f0905787-84e3-4a5d-9202-26fed79a1dcb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:49:19.608035 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG dbcounter [-] [87935] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:49:19.651746 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 819/1660] 10.222.0.25 () {58 vars in 958 bytes} [Tue Sep 13 19:49:19 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 287 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 19:49:19.656548 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71219b6a-7572-4a47-b9a8-806c35c1d5ad admin admin] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:49:19.777260 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71219b6a-7572-4a47-b9a8-806c35c1d5ad admin admin] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:49:19.784596 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376c3e73-09fb-4ffd-a097-5dc0dc62f03f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:49:19.786411 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376c3e73-09fb-4ffd-a097-5dc0dc62f03f admin admin] REQUEST_METHOD: `POST` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:49:19.786708 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376c3e73-09fb-4ffd-a097-5dc0dc62f03f admin admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:49:19.787090 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376c3e73-09fb-4ffd-a097-5dc0dc62f03f admin admin] PATH_INFO: `/v3/projects` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:49:19.788174 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-376c3e73-09fb-4ffd-a097-5dc0dc62f03f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:49:19.790887 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-376c3e73-09fb-4ffd-a097-5dc0dc62f03f admin admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:49:19.881786 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 842/1661] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Sep 13 19:49:19 2022] POST /identity/v3/projects => generated 387 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 19:49:19.883846 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0905787-84e3-4a5d-9202-26fed79a1dcb None None] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:49:19.905560 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0905787-84e3-4a5d-9202-26fed79a1dcb None None] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:49:20.081805 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b4a714-5592-48d0-88bf-72cc2c24ee26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:49:20.083402 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b4a714-5592-48d0-88bf-72cc2c24ee26 admin admin] REQUEST_METHOD: `POST` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:49:20.083973 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b4a714-5592-48d0-88bf-72cc2c24ee26 admin admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:49:20.089004 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b4a714-5592-48d0-88bf-72cc2c24ee26 admin admin] PATH_INFO: `/v3/users` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:49:20.091396 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b4a714-5592-48d0-88bf-72cc2c24ee26 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:49:20.099321 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b4a714-5592-48d0-88bf-72cc2c24ee26 admin admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:49:20.140727 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376c3e73-09fb-4ffd-a097-5dc0dc62f03f admin admin] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:49:20.162025 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 820/1662] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Sep 13 19:49:19 2022] POST /identity/v3/users => generated 300 bytes in 279 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 19:49:20.172993 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376c3e73-09fb-4ffd-a097-5dc0dc62f03f admin admin] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:49:20.182571 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7462fc-4702-4dbb-8d7f-41f9c5331155 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:49:20.183564 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7462fc-4702-4dbb-8d7f-41f9c5331155 admin admin] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:49:20.183848 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7462fc-4702-4dbb-8d7f-41f9c5331155 admin admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:49:20.184122 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7462fc-4702-4dbb-8d7f-41f9c5331155 admin admin] PATH_INFO: `/v3/roles` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:49:20.185311 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f7462fc-4702-4dbb-8d7f-41f9c5331155 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:49:20.187202 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f7462fc-4702-4dbb-8d7f-41f9c5331155 admin admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:49:20.220153 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b4a714-5592-48d0-88bf-72cc2c24ee26 admin admin] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:49:20.221328 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 843/1663] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Sep 13 19:49:20 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 19:49:20.235454 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7462fc-4702-4dbb-8d7f-41f9c5331155 admin admin] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:49:20.241320 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b4a714-5592-48d0-88bf-72cc2c24ee26 admin admin] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:49:20.241640 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.fernet_utils [None req-6f7462fc-4702-4dbb-8d7f-41f9c5331155 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:49:20.266088 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a4e0c1-8e13-4bc9-9892-503bf9e15060 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:49:20.268946 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a4e0c1-8e13-4bc9-9892-503bf9e15060 admin admin] REQUEST_METHOD: `PUT` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:49:20.280467 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a4e0c1-8e13-4bc9-9892-503bf9e15060 admin admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:49:20.281466 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a4e0c1-8e13-4bc9-9892-503bf9e15060 admin admin] PATH_INFO: `/v3/projects/3cc0ca3717644800b198be7afdf91b7b/users/606e065c37934df091e6f833b8810799/roles/6ca1d4427ff64e0a9d25d96cfb1445f6` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:49:20.304295 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7462fc-4702-4dbb-8d7f-41f9c5331155 admin admin] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:49:20.345367 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ebb37b-4b93-4794-9790-baf02646cade admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:49:20.350773 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ebb37b-4b93-4794-9790-baf02646cade admin admin] REQUEST_METHOD: `DELETE` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:49:20.352345 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ebb37b-4b93-4794-9790-baf02646cade admin admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:49:20.352831 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ebb37b-4b93-4794-9790-baf02646cade admin admin] PATH_INFO: `/v3/projects/2c5d38e44d2d46ec927e7f86b8981278` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:49:20.357318 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ebb37b-4b93-4794-9790-baf02646cade admin admin] RBAC: Authorizing `identity:delete_project(project_id=2c5d38e44d2d46ec927e7f86b8981278)` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:49:20.361749 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a4e0c1-8e13-4bc9-9892-503bf9e15060 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3cc0ca3717644800b198be7afdf91b7b, user_id=606e065c37934df091e6f833b8810799, role_id=6ca1d4427ff64e0a9d25d96cfb1445f6)` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:49:20.365907 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ebb37b-4b93-4794-9790-baf02646cade admin admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:49:20.373885 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a4e0c1-8e13-4bc9-9892-503bf9e15060 admin admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:49:20.450987 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 821/1664] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Sep 13 19:49:20 2022] PUT /identity/v3/projects/3cc0ca3717644800b198be7afdf91b7b/users/606e065c37934df091e6f833b8810799/roles/6ca1d4427ff64e0a9d25d96cfb1445f6 => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 19:49:20.457818 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a4e0c1-8e13-4bc9-9892-503bf9e15060 admin admin] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:49:20.524276 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.notifications [None req-a7ebb37b-4b93-4794-9790-baf02646cade admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2c5d38e44d2d46ec927e7f86b8981278', 'request_id': 'req-a7ebb37b-4b93-4794-9790-baf02646cade'} {{(pid=87934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:49:20.537809 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.notifications [None req-a7ebb37b-4b93-4794-9790-baf02646cade admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2c5d38e44d2d46ec927e7f86b8981278', 'request_id': 'req-a7ebb37b-4b93-4794-9790-baf02646cade'} {{(pid=87934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:49:20.554101 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.notifications [None req-a7ebb37b-4b93-4794-9790-baf02646cade admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2c5d38e44d2d46ec927e7f86b8981278', 'request_id': 'req-a7ebb37b-4b93-4794-9790-baf02646cade'} {{(pid=87934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:49:20.565159 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG dbcounter [-] [87934] Writing DB stats keystone:SELECT=91,keystone:INSERT=3,keystone:DELETE=6 {{(pid=87934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:49:20.593454 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.notifications [None req-a7ebb37b-4b93-4794-9790-baf02646cade admin admin] The token cache is being invalidate because project 2c5d38e44d2d46ec927e7f86b8981278 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87934) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 19:49:20.594075 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.notifications [None req-a7ebb37b-4b93-4794-9790-baf02646cade admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:49:20.596235 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.notifications [None req-a7ebb37b-4b93-4794-9790-baf02646cade admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:49:20.600524 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 844/1665] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Sep 13 19:49:20 2022] DELETE /identity/v3/projects/2c5d38e44d2d46ec927e7f86b8981278 => generated 0 bytes in 367 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 19:49:20.605141 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ebb37b-4b93-4794-9790-baf02646cade admin admin] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:49:20.608080 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.fernet_utils [None req-a7ebb37b-4b93-4794-9790-baf02646cade admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:49:20.696876 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a4e0c1-8e13-4bc9-9892-503bf9e15060 admin admin] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:49:20.834921 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00ddb69-d0e2-42a6-8eeb-b7b0e65b0011 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:49:20.835563 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00ddb69-d0e2-42a6-8eeb-b7b0e65b0011 admin admin] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:49:20.839020 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00ddb69-d0e2-42a6-8eeb-b7b0e65b0011 admin admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:49:20.839311 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00ddb69-d0e2-42a6-8eeb-b7b0e65b0011 admin admin] PATH_INFO: `/v3/roles` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:49:20.840010 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f00ddb69-d0e2-42a6-8eeb-b7b0e65b0011 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:49:20.844738 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f00ddb69-d0e2-42a6-8eeb-b7b0e65b0011 admin admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:49:20.865700 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ebb37b-4b93-4794-9790-baf02646cade admin admin] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:49:20.877598 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 822/1666] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Sep 13 19:49:20 2022] GET /identity/v3/roles => generated 1420 bytes in 421 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 19:49:20.878229 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6726bd77-48c3-449e-956b-c7630b770bc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:49:20.878905 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6726bd77-48c3-449e-956b-c7630b770bc3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:49:20.879841 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6726bd77-48c3-449e-956b-c7630b770bc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:49:20.880230 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6726bd77-48c3-449e-956b-c7630b770bc3 admin admin] PATH_INFO: `/v3/users/7cc1bc3bcd064bc990774b06ed513912` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:49:20.882654 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00ddb69-d0e2-42a6-8eeb-b7b0e65b0011 admin admin] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:49:20.883530 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6726bd77-48c3-449e-956b-c7630b770bc3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7cc1bc3bcd064bc990774b06ed513912)` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:49:20.885788 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6726bd77-48c3-449e-956b-c7630b770bc3 admin admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:49:20.887420 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.fernet_utils [None req-f00ddb69-d0e2-42a6-8eeb-b7b0e65b0011 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:49:20.913167 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG dbcounter [-] [87935] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=87935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:49:20.923309 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00ddb69-d0e2-42a6-8eeb-b7b0e65b0011 admin admin] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:49:20.936729 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1323387c-89de-4b53-b608-799a8a08c574 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:49:20.939203 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1323387c-89de-4b53-b608-799a8a08c574 admin admin] REQUEST_METHOD: `PUT` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:49:20.939568 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1323387c-89de-4b53-b608-799a8a08c574 admin admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:49:20.940937 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1323387c-89de-4b53-b608-799a8a08c574 admin admin] PATH_INFO: `/v3/projects/3cc0ca3717644800b198be7afdf91b7b/users/606e065c37934df091e6f833b8810799/roles/6ca1d4427ff64e0a9d25d96cfb1445f6` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:49:20.947485 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1323387c-89de-4b53-b608-799a8a08c574 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3cc0ca3717644800b198be7afdf91b7b, user_id=606e065c37934df091e6f833b8810799, role_id=6ca1d4427ff64e0a9d25d96cfb1445f6)` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:49:20.959093 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1323387c-89de-4b53-b608-799a8a08c574 admin admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:49:20.967051 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.notifications [None req-6726bd77-48c3-449e-956b-c7630b770bc3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7cc1bc3bcd064bc990774b06ed513912'} {{(pid=87934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:49:20.968057 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.notifications [None req-6726bd77-48c3-449e-956b-c7630b770bc3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7cc1bc3bcd064bc990774b06ed513912'} {{(pid=87934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:49:20.968924 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.notifications [None req-6726bd77-48c3-449e-956b-c7630b770bc3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7cc1bc3bcd064bc990774b06ed513912'} {{(pid=87934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:49:20.978387 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.notifications [None req-6726bd77-48c3-449e-956b-c7630b770bc3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7cc1bc3bcd064bc990774b06ed513912'} {{(pid=87934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:49:20.987858 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 823/1667] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Sep 13 19:49:20 2022] PUT /identity/v3/projects/3cc0ca3717644800b198be7afdf91b7b/users/606e065c37934df091e6f833b8810799/roles/6ca1d4427ff64e0a9d25d96cfb1445f6 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 19:49:20.993249 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.notifications [None req-6726bd77-48c3-449e-956b-c7630b770bc3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7cc1bc3bcd064bc990774b06ed513912'} {{(pid=87934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:49:21.002133 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf36879-e6f7-4c85-b32b-9b21201a1b61 None None] REQUEST_METHOD: `POST` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:49:21.002463 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf36879-e6f7-4c85-b32b-9b21201a1b61 None None] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:49:21.002686 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf36879-e6f7-4c85-b32b-9b21201a1b61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:49:21.020796 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 845/1668] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Sep 13 19:49:20 2022] DELETE /identity/v3/users/7cc1bc3bcd064bc990774b06ed513912 => generated 0 bytes in 413 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 19:49:21.039958 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.auth.core [None req-dbf36879-e6f7-4c85-b32b-9b21201a1b61 None None] MFA Rules not processed for user `606e065c37934df091e6f833b8810799`. Rule list: `[]` (Enabled: `True`). {{(pid=87935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:49:21.042131 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.fernet_utils [None req-dbf36879-e6f7-4c85-b32b-9b21201a1b61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:49:21.242710 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 824/1669] 10.222.0.25 () {58 vars in 958 bytes} [Tue Sep 13 19:49:21 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 242 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 19:49:21.269132 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6726bd77-48c3-449e-956b-c7630b770bc3 admin admin] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:49:21.271251 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.fernet_utils [None req-6726bd77-48c3-449e-956b-c7630b770bc3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:49:21.396696 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6726bd77-48c3-449e-956b-c7630b770bc3 admin admin] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:49:21.400657 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2726b91f-671c-4916-86ee-bf81d14a3252 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cbb50c88b794a7f9f26844effde7d63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a10a4268f3c4cb29f4e00c292e2df62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:49:21.401278 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2726b91f-671c-4916-86ee-bf81d14a3252 service cinder] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:49:21.401774 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2726b91f-671c-4916-86ee-bf81d14a3252 service cinder] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:49:21.402205 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2726b91f-671c-4916-86ee-bf81d14a3252 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:49:21.418696 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2726b91f-671c-4916-86ee-bf81d14a3252 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:49:21.448054 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2726b91f-671c-4916-86ee-bf81d14a3252 service cinder] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:49:21.481571 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 846/1670] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Sep 13 19:49:21 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 213 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 19:49:21.533808 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf36879-e6f7-4c85-b32b-9b21201a1b61 None None] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:49:21.536117 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.fernet_utils [None req-dbf36879-e6f7-4c85-b32b-9b21201a1b61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:49:21.717289 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf36879-e6f7-4c85-b32b-9b21201a1b61 None None] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:49:21.733993 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0e5b53-2b1d-4b5f-8c66-37aba30fac73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:49:21.734820 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0e5b53-2b1d-4b5f-8c66-37aba30fac73 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:49:21.735206 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0e5b53-2b1d-4b5f-8c66-37aba30fac73 admin admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:49:21.735605 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0e5b53-2b1d-4b5f-8c66-37aba30fac73 admin admin] PATH_INFO: `/v3/users/9926f72057964c469e51f6224cf2d0e2` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:49:21.744342 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0e5b53-2b1d-4b5f-8c66-37aba30fac73 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9926f72057964c469e51f6224cf2d0e2)` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:49:21.746737 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0e5b53-2b1d-4b5f-8c66-37aba30fac73 admin admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:49:21.874424 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.notifications [None req-ac0e5b53-2b1d-4b5f-8c66-37aba30fac73 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9926f72057964c469e51f6224cf2d0e2'} {{(pid=87935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:49:21.908659 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.notifications [None req-ac0e5b53-2b1d-4b5f-8c66-37aba30fac73 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9926f72057964c469e51f6224cf2d0e2'} {{(pid=87935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:49:21.979099 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.notifications [None req-ac0e5b53-2b1d-4b5f-8c66-37aba30fac73 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9926f72057964c469e51f6224cf2d0e2'} {{(pid=87935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:49:21.979311 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2726b91f-671c-4916-86ee-bf81d14a3252 service cinder] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:49:21.980325 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.fernet_utils [None req-2726b91f-671c-4916-86ee-bf81d14a3252 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:49:21.991035 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.notifications [None req-ac0e5b53-2b1d-4b5f-8c66-37aba30fac73 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9926f72057964c469e51f6224cf2d0e2'} {{(pid=87935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:49:21.994668 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.notifications [None req-ac0e5b53-2b1d-4b5f-8c66-37aba30fac73 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9926f72057964c469e51f6224cf2d0e2'} {{(pid=87935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:49:22.013919 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG dbcounter [-] [87935] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=87935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:49:22.015238 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2726b91f-671c-4916-86ee-bf81d14a3252 service cinder] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:49:22.034664 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3ecabb-4271-44a4-b210-377cae890cb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:49:22.038619 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3ecabb-4271-44a4-b210-377cae890cb8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:49:22.038904 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3ecabb-4271-44a4-b210-377cae890cb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:49:22.042693 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3ecabb-4271-44a4-b210-377cae890cb8 admin admin] PATH_INFO: `/v3/users/a9f056d184bd4d40982d4e70889bf68d` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:49:22.045762 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f3ecabb-4271-44a4-b210-377cae890cb8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a9f056d184bd4d40982d4e70889bf68d)` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:49:22.046222 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 825/1671] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Sep 13 19:49:21 2022] DELETE /identity/v3/users/9926f72057964c469e51f6224cf2d0e2 => generated 0 bytes in 513 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 19:49:22.048405 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f3ecabb-4271-44a4-b210-377cae890cb8 admin admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:49:22.051703 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d439a9d9-5d0e-45a1-8347-df3d5c6ab64c None None] REQUEST_METHOD: `POST` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:49:22.052037 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d439a9d9-5d0e-45a1-8347-df3d5c6ab64c None None] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:49:22.052423 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d439a9d9-5d0e-45a1-8347-df3d5c6ab64c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:49:22.067272 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG dbcounter [-] [87934] Writing DB stats keystone:INSERT=2,keystone:DELETE=11,keystone:SELECT=87 {{(pid=87934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:49:22.102882 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.auth.core [None req-d439a9d9-5d0e-45a1-8347-df3d5c6ab64c None None] MFA Rules not processed for user `7b0aed92d02344acb92a0e4aa67c3068`. Rule list: `[]` (Enabled: `True`). {{(pid=87935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:49:22.107920 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.fernet_utils [None req-d439a9d9-5d0e-45a1-8347-df3d5c6ab64c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:49:22.225755 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.notifications [None req-4f3ecabb-4271-44a4-b210-377cae890cb8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a9f056d184bd4d40982d4e70889bf68d'} {{(pid=87934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:49:22.228678 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.notifications [None req-4f3ecabb-4271-44a4-b210-377cae890cb8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a9f056d184bd4d40982d4e70889bf68d'} {{(pid=87934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:49:22.231329 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.notifications [None req-4f3ecabb-4271-44a4-b210-377cae890cb8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a9f056d184bd4d40982d4e70889bf68d'} {{(pid=87934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:49:22.276942 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.notifications [None req-4f3ecabb-4271-44a4-b210-377cae890cb8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a9f056d184bd4d40982d4e70889bf68d'} {{(pid=87934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:49:22.334781 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.notifications [None req-4f3ecabb-4271-44a4-b210-377cae890cb8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a9f056d184bd4d40982d4e70889bf68d'} {{(pid=87934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:49:22.369760 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 847/1672] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Sep 13 19:49:21 2022] DELETE /identity/v3/users/a9f056d184bd4d40982d4e70889bf68d => generated 0 bytes in 392 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 19:49:22.374604 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745b4375-c853-4c89-bee4-4f1f28b05107 None None] REQUEST_METHOD: `POST` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:49:22.374892 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745b4375-c853-4c89-bee4-4f1f28b05107 None None] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:49:22.375649 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745b4375-c853-4c89-bee4-4f1f28b05107 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:49:22.406618 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 826/1673] 10.222.0.25 () {58 vars in 958 bytes} [Tue Sep 13 19:49:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 357 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 19:49:22.443978 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.auth.core [None req-745b4375-c853-4c89-bee4-4f1f28b05107 None None] MFA Rules not processed for user `7b0aed92d02344acb92a0e4aa67c3068`. Rule list: `[]` (Enabled: `True`). {{(pid=87934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:49:22.451936 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.fernet_utils [None req-745b4375-c853-4c89-bee4-4f1f28b05107 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:49:22.459005 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d439a9d9-5d0e-45a1-8347-df3d5c6ab64c None None] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:49:22.460476 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.fernet_utils [None req-d439a9d9-5d0e-45a1-8347-df3d5c6ab64c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:49:22.612520 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 848/1674] 10.222.0.25 () {58 vars in 958 bytes} [Tue Sep 13 19:49:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 239 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 19:49:22.678865 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745b4375-c853-4c89-bee4-4f1f28b05107 None None] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:49:22.681556 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.fernet_utils [None req-745b4375-c853-4c89-bee4-4f1f28b05107 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:49:22.695150 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d439a9d9-5d0e-45a1-8347-df3d5c6ab64c None None] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:49:22.712435 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745b4375-c853-4c89-bee4-4f1f28b05107 None None] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:49:22.718796 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16522d9f-9fe4-4e1b-9b1e-ce248828f346 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:49:22.720018 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16522d9f-9fe4-4e1b-9b1e-ce248828f346 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:49:22.720547 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16522d9f-9fe4-4e1b-9b1e-ce248828f346 admin admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:49:22.721061 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16522d9f-9fe4-4e1b-9b1e-ce248828f346 admin admin] PATH_INFO: `/v3/projects/37d96a80edd34e2cb13ccb3bda230f6a` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:49:22.722670 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16522d9f-9fe4-4e1b-9b1e-ce248828f346 admin admin] RBAC: Authorizing `identity:delete_project(project_id=37d96a80edd34e2cb13ccb3bda230f6a)` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:49:22.725134 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16522d9f-9fe4-4e1b-9b1e-ce248828f346 admin admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:49:22.854922 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.notifications [None req-16522d9f-9fe4-4e1b-9b1e-ce248828f346 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '37d96a80edd34e2cb13ccb3bda230f6a', 'request_id': 'req-16522d9f-9fe4-4e1b-9b1e-ce248828f346'} {{(pid=87934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:49:22.863978 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.notifications [None req-16522d9f-9fe4-4e1b-9b1e-ce248828f346 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '37d96a80edd34e2cb13ccb3bda230f6a', 'request_id': 'req-16522d9f-9fe4-4e1b-9b1e-ce248828f346'} {{(pid=87934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:49:22.873132 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.notifications [None req-16522d9f-9fe4-4e1b-9b1e-ce248828f346 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '37d96a80edd34e2cb13ccb3bda230f6a', 'request_id': 'req-16522d9f-9fe4-4e1b-9b1e-ce248828f346'} {{(pid=87934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:49:22.897715 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.notifications [None req-16522d9f-9fe4-4e1b-9b1e-ce248828f346 admin admin] The token cache is being invalidate because project 37d96a80edd34e2cb13ccb3bda230f6a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87934) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 19:49:22.898059 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.notifications [None req-16522d9f-9fe4-4e1b-9b1e-ce248828f346 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:49:22.899359 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.notifications [None req-16522d9f-9fe4-4e1b-9b1e-ce248828f346 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:49:22.906970 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 849/1675] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Sep 13 19:49:22 2022] DELETE /identity/v3/projects/37d96a80edd34e2cb13ccb3bda230f6a => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 19:49:22.906970 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16522d9f-9fe4-4e1b-9b1e-ce248828f346 admin admin] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:49:22.910911 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.fernet_utils [None req-16522d9f-9fe4-4e1b-9b1e-ce248828f346 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:49:22.917590 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ec0b7b-55d9-4fab-99d9-b8f5a93ebea2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1196a96e4a404f559600b69f929ea9da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a10a4268f3c4cb29f4e00c292e2df62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:49:22.922356 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ec0b7b-55d9-4fab-99d9-b8f5a93ebea2 service neutron] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:49:22.923132 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ec0b7b-55d9-4fab-99d9-b8f5a93ebea2 service neutron] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:49:22.923416 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ec0b7b-55d9-4fab-99d9-b8f5a93ebea2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:49:22.930732 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.fernet_utils [None req-67ec0b7b-55d9-4fab-99d9-b8f5a93ebea2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:49:22.944693 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG dbcounter [-] [87934] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=87934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:49:23.005201 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ec0b7b-55d9-4fab-99d9-b8f5a93ebea2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:49:23.006833 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ec0b7b-55d9-4fab-99d9-b8f5a93ebea2 service neutron] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:49:23.047485 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 827/1676] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Sep 13 19:49:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 589 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 13 19:49:23.051531 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6b63d1-ddab-49b4-9b32-fd76ba6d3601 None None] REQUEST_METHOD: `POST` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:49:23.060946 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6b63d1-ddab-49b4-9b32-fd76ba6d3601 None None] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:49:23.061630 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6b63d1-ddab-49b4-9b32-fd76ba6d3601 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:49:23.134722 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.auth.core [None req-7b6b63d1-ddab-49b4-9b32-fd76ba6d3601 None None] MFA Rules not processed for user `7b0aed92d02344acb92a0e4aa67c3068`. Rule list: `[]` (Enabled: `True`). {{(pid=87935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:49:23.135962 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.fernet_utils [None req-7b6b63d1-ddab-49b4-9b32-fd76ba6d3601 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:49:23.145738 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16522d9f-9fe4-4e1b-9b1e-ce248828f346 admin admin] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:49:23.160978 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4374d9a-4b48-4f15-ae50-90f4a0223e2a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1196a96e4a404f559600b69f929ea9da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a10a4268f3c4cb29f4e00c292e2df62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:49:23.161632 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4374d9a-4b48-4f15-ae50-90f4a0223e2a service neutron] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:49:23.161963 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4374d9a-4b48-4f15-ae50-90f4a0223e2a service neutron] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:49:23.162164 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4374d9a-4b48-4f15-ae50-90f4a0223e2a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:49:23.168254 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.fernet_utils [None req-f4374d9a-4b48-4f15-ae50-90f4a0223e2a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:49:23.312244 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG dbcounter [-] [87935] Writing DB stats keystone:SELECT=100 {{(pid=87935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:49:23.377731 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 828/1677] 10.222.0.25 () {58 vars in 958 bytes} [Tue Sep 13 19:49:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 330 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 19:49:23.397129 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa59d896-2139-476a-bff6-de9627c67760 None None] REQUEST_METHOD: `POST` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:49:23.397334 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa59d896-2139-476a-bff6-de9627c67760 None None] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:49:23.397580 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa59d896-2139-476a-bff6-de9627c67760 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:49:23.433912 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4374d9a-4b48-4f15-ae50-90f4a0223e2a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:49:23.437739 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4374d9a-4b48-4f15-ae50-90f4a0223e2a service neutron] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:49:23.452290 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.auth.core [None req-aa59d896-2139-476a-bff6-de9627c67760 None None] MFA Rules not processed for user `7b0aed92d02344acb92a0e4aa67c3068`. Rule list: `[]` (Enabled: `True`). {{(pid=87935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:49:23.454156 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.fernet_utils [None req-aa59d896-2139-476a-bff6-de9627c67760 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:49:23.470681 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 850/1678] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Sep 13 19:49:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 566 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 19:49:23.492393 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 829/1679] 10.222.0.25 () {58 vars in 958 bytes} [Tue Sep 13 19:49:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 19:49:23.495393 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4374d9a-4b48-4f15-ae50-90f4a0223e2a service neutron] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:49:23.518969 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4374d9a-4b48-4f15-ae50-90f4a0223e2a service neutron] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:49:23.534308 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e671754a-139f-4a5d-81ec-22d24d85f419 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:49:23.535522 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e671754a-139f-4a5d-81ec-22d24d85f419 admin admin] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:49:23.535828 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e671754a-139f-4a5d-81ec-22d24d85f419 admin admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:49:23.537169 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e671754a-139f-4a5d-81ec-22d24d85f419 admin admin] PATH_INFO: `/v3/domains` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:49:23.537839 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e671754a-139f-4a5d-81ec-22d24d85f419 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87934) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:49:23.538160 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e671754a-139f-4a5d-81ec-22d24d85f419 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:49:23.539841 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e671754a-139f-4a5d-81ec-22d24d85f419 admin admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:49:23.555738 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 851/1680] 10.222.0.25 () {58 vars in 1153 bytes} [Tue Sep 13 19:49:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:49:23.560046 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa59d896-2139-476a-bff6-de9627c67760 None None] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:49:23.581762 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa59d896-2139-476a-bff6-de9627c67760 None None] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:49:23.602484 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63e0624-1e71-41fb-b121-9b3bf39ca8b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:49:23.603133 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63e0624-1e71-41fb-b121-9b3bf39ca8b8 admin admin] REQUEST_METHOD: `POST` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:49:23.603425 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63e0624-1e71-41fb-b121-9b3bf39ca8b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:49:23.606468 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63e0624-1e71-41fb-b121-9b3bf39ca8b8 admin admin] PATH_INFO: `/v3/projects` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:49:23.607160 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b63e0624-1e71-41fb-b121-9b3bf39ca8b8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:49:23.617021 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b63e0624-1e71-41fb-b121-9b3bf39ca8b8 admin admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:49:23.694427 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 830/1681] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Sep 13 19:49:23 2022] POST /identity/v3/projects => generated 357 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 13 19:49:23.698566 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e671754a-139f-4a5d-81ec-22d24d85f419 admin admin] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:49:23.725409 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e671754a-139f-4a5d-81ec-22d24d85f419 admin admin] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:49:23.885473 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f196f7-bccf-4ccc-99d0-a418774d24ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:49:23.886217 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f196f7-bccf-4ccc-99d0-a418774d24ca admin admin] REQUEST_METHOD: `POST` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:49:23.886503 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f196f7-bccf-4ccc-99d0-a418774d24ca admin admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:49:23.886803 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f196f7-bccf-4ccc-99d0-a418774d24ca admin admin] PATH_INFO: `/v3/users` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:49:23.887640 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f196f7-bccf-4ccc-99d0-a418774d24ca admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:49:23.890367 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f196f7-bccf-4ccc-99d0-a418774d24ca admin admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:49:23.935621 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 852/1682] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Sep 13 19:49:23 2022] POST /identity/v3/users => generated 279 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 19:49:23.939268 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63e0624-1e71-41fb-b121-9b3bf39ca8b8 admin admin] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:49:23.963280 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63e0624-1e71-41fb-b121-9b3bf39ca8b8 admin admin] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:49:23.993193 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79ccf53-6dcd-40cd-92b5-07718a72a22d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:49:23.994450 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79ccf53-6dcd-40cd-92b5-07718a72a22d admin admin] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:49:23.995088 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79ccf53-6dcd-40cd-92b5-07718a72a22d admin admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:49:23.995457 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79ccf53-6dcd-40cd-92b5-07718a72a22d admin admin] PATH_INFO: `/v3/roles` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:49:23.996686 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f79ccf53-6dcd-40cd-92b5-07718a72a22d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:49:24.000449 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f79ccf53-6dcd-40cd-92b5-07718a72a22d admin admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:49:24.037550 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 831/1683] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Sep 13 19:49:23 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 19:49:24.039780 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f196f7-bccf-4ccc-99d0-a418774d24ca admin admin] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:49:24.056276 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f196f7-bccf-4ccc-99d0-a418774d24ca admin admin] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:49:24.075706 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fbf607e-8aff-4b88-b6fe-07add59fa7b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:49:24.076373 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbf607e-8aff-4b88-b6fe-07add59fa7b1 admin admin] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:49:24.076651 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbf607e-8aff-4b88-b6fe-07add59fa7b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:49:24.076919 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbf607e-8aff-4b88-b6fe-07add59fa7b1 admin admin] PATH_INFO: `/v3/roles` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:49:24.077579 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fbf607e-8aff-4b88-b6fe-07add59fa7b1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:49:24.079513 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fbf607e-8aff-4b88-b6fe-07add59fa7b1 admin admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:49:24.126859 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 853/1684] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Sep 13 19:49:24 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 19:49:24.146473 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79ccf53-6dcd-40cd-92b5-07718a72a22d admin admin] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:49:24.162227 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79ccf53-6dcd-40cd-92b5-07718a72a22d admin admin] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:49:24.179283 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb7f0e2-62be-40a5-aa9e-919b1d534d05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:49:24.180157 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb7f0e2-62be-40a5-aa9e-919b1d534d05 admin admin] REQUEST_METHOD: `PUT` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:49:24.181357 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb7f0e2-62be-40a5-aa9e-919b1d534d05 admin admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:49:24.182921 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb7f0e2-62be-40a5-aa9e-919b1d534d05 admin admin] PATH_INFO: `/v3/projects/61c6a0e4bd314a38965cb88f821697c7/users/0aac5ce25cc84f21ae031e82da24c5d8/roles/a259191f6d0e46fabd9f34536bb28747` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:49:24.228079 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb7f0e2-62be-40a5-aa9e-919b1d534d05 admin admin] RBAC: Authorizing `identity:create_grant(project_id=61c6a0e4bd314a38965cb88f821697c7, user_id=0aac5ce25cc84f21ae031e82da24c5d8, role_id=a259191f6d0e46fabd9f34536bb28747)` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:49:24.230946 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb7f0e2-62be-40a5-aa9e-919b1d534d05 admin admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:49:24.261838 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 832/1685] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Sep 13 19:49:24 2022] PUT /identity/v3/projects/61c6a0e4bd314a38965cb88f821697c7/users/0aac5ce25cc84f21ae031e82da24c5d8/roles/a259191f6d0e46fabd9f34536bb28747 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 19:49:24.272760 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72ed6c3-6cca-4a36-9678-ddfcde09b65f None None] REQUEST_METHOD: `POST` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:49:24.273042 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72ed6c3-6cca-4a36-9678-ddfcde09b65f None None] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:49:24.273311 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72ed6c3-6cca-4a36-9678-ddfcde09b65f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:49:24.345458 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.auth.core [None req-c72ed6c3-6cca-4a36-9678-ddfcde09b65f None None] MFA Rules not processed for user `0aac5ce25cc84f21ae031e82da24c5d8`. Rule list: `[]` (Enabled: `True`). {{(pid=87934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:49:24.346688 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.fernet_utils [None req-c72ed6c3-6cca-4a36-9678-ddfcde09b65f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:49:24.393652 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG dbcounter [-] [87934] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:49:24.562505 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 854/1686] 10.222.0.25 () {58 vars in 958 bytes} [Tue Sep 13 19:49:24 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 291 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 19:49:24.564700 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb7f0e2-62be-40a5-aa9e-919b1d534d05 admin admin] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:49:24.748616 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb7f0e2-62be-40a5-aa9e-919b1d534d05 admin admin] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:49:24.761822 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3779fbea-2437-4331-91db-1e71644cdcdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:49:24.762528 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3779fbea-2437-4331-91db-1e71644cdcdb admin admin] REQUEST_METHOD: `POST` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:49:24.762880 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3779fbea-2437-4331-91db-1e71644cdcdb admin admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:49:24.763241 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3779fbea-2437-4331-91db-1e71644cdcdb admin admin] PATH_INFO: `/v3/projects` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:49:24.764148 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3779fbea-2437-4331-91db-1e71644cdcdb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:49:24.766169 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3779fbea-2437-4331-91db-1e71644cdcdb admin admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:49:24.832408 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 833/1687] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Sep 13 19:49:24 2022] POST /identity/v3/projects => generated 357 bytes in 265 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 19:49:24.834195 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72ed6c3-6cca-4a36-9678-ddfcde09b65f None None] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:49:24.865713 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72ed6c3-6cca-4a36-9678-ddfcde09b65f None None] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:49:25.101239 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b9dc32-7360-481c-9471-f4d0fc928fd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:49:25.101898 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b9dc32-7360-481c-9471-f4d0fc928fd0 admin admin] REQUEST_METHOD: `POST` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:49:25.105987 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b9dc32-7360-481c-9471-f4d0fc928fd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:49:25.106313 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b9dc32-7360-481c-9471-f4d0fc928fd0 admin admin] PATH_INFO: `/v3/users` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:49:25.107372 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b9dc32-7360-481c-9471-f4d0fc928fd0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:49:25.109740 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b9dc32-7360-481c-9471-f4d0fc928fd0 admin admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:49:25.156190 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 855/1688] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Sep 13 19:49:24 2022] POST /identity/v3/users => generated 285 bytes in 320 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 19:49:25.159644 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3779fbea-2437-4331-91db-1e71644cdcdb admin admin] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:49:25.176309 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3779fbea-2437-4331-91db-1e71644cdcdb admin admin] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:49:25.205807 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9665d9b5-6f82-45a0-ba0e-7ffaaafa2e48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:49:25.207532 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9665d9b5-6f82-45a0-ba0e-7ffaaafa2e48 admin admin] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:49:25.207930 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9665d9b5-6f82-45a0-ba0e-7ffaaafa2e48 admin admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:49:25.208230 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9665d9b5-6f82-45a0-ba0e-7ffaaafa2e48 admin admin] PATH_INFO: `/v3/roles` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:49:25.212570 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9665d9b5-6f82-45a0-ba0e-7ffaaafa2e48 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:49:25.215744 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9665d9b5-6f82-45a0-ba0e-7ffaaafa2e48 admin admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:49:25.264175 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b9dc32-7360-481c-9471-f4d0fc928fd0 admin admin] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:49:25.270336 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 834/1689] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Sep 13 19:49:25 2022] GET /identity/v3/roles => generated 1420 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 19:49:25.281717 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b9dc32-7360-481c-9471-f4d0fc928fd0 admin admin] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:49:25.310914 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642dd68d-5374-4e08-9ede-3f125fe26b74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:49:25.311784 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642dd68d-5374-4e08-9ede-3f125fe26b74 admin admin] REQUEST_METHOD: `PUT` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:49:25.312055 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642dd68d-5374-4e08-9ede-3f125fe26b74 admin admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:49:25.312549 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642dd68d-5374-4e08-9ede-3f125fe26b74 admin admin] PATH_INFO: `/v3/projects/722cf90e49ed4039a883e301618f3590/users/3be4d86a85084d72bd585f49e0733eaa/roles/6ca1d4427ff64e0a9d25d96cfb1445f6` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:49:25.358313 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-642dd68d-5374-4e08-9ede-3f125fe26b74 admin admin] RBAC: Authorizing `identity:create_grant(project_id=722cf90e49ed4039a883e301618f3590, user_id=3be4d86a85084d72bd585f49e0733eaa, role_id=6ca1d4427ff64e0a9d25d96cfb1445f6)` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:49:25.361042 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-642dd68d-5374-4e08-9ede-3f125fe26b74 admin admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:49:25.399140 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 856/1690] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Sep 13 19:49:25 2022] PUT /identity/v3/projects/722cf90e49ed4039a883e301618f3590/users/3be4d86a85084d72bd585f49e0733eaa/roles/6ca1d4427ff64e0a9d25d96cfb1445f6 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 19:49:25.403070 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9665d9b5-6f82-45a0-ba0e-7ffaaafa2e48 admin admin] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:49:25.418121 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9665d9b5-6f82-45a0-ba0e-7ffaaafa2e48 admin admin] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:49:25.630842 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e8615e-36cd-41d7-a3ef-546b0c42262b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:49:25.631698 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e8615e-36cd-41d7-a3ef-546b0c42262b admin admin] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:49:25.632846 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e8615e-36cd-41d7-a3ef-546b0c42262b admin admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:49:25.633272 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e8615e-36cd-41d7-a3ef-546b0c42262b admin admin] PATH_INFO: `/v3/roles` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:49:25.634074 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e8615e-36cd-41d7-a3ef-546b0c42262b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:49:25.636012 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e8615e-36cd-41d7-a3ef-546b0c42262b admin admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:49:25.665349 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 835/1691] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Sep 13 19:49:25 2022] GET /identity/v3/roles => generated 1420 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 19:49:25.667216 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642dd68d-5374-4e08-9ede-3f125fe26b74 admin admin] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:49:25.693986 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642dd68d-5374-4e08-9ede-3f125fe26b74 admin admin] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:49:25.707263 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de22323-9772-4fd4-8df2-20cf05f649a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:49:25.708137 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de22323-9772-4fd4-8df2-20cf05f649a8 admin admin] REQUEST_METHOD: `PUT` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:49:25.710445 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de22323-9772-4fd4-8df2-20cf05f649a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:49:25.710744 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de22323-9772-4fd4-8df2-20cf05f649a8 admin admin] PATH_INFO: `/v3/projects/722cf90e49ed4039a883e301618f3590/users/3be4d86a85084d72bd585f49e0733eaa/roles/6ca1d4427ff64e0a9d25d96cfb1445f6` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:49:25.714187 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de22323-9772-4fd4-8df2-20cf05f649a8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=722cf90e49ed4039a883e301618f3590, user_id=3be4d86a85084d72bd585f49e0733eaa, role_id=6ca1d4427ff64e0a9d25d96cfb1445f6)` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:49:25.719916 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de22323-9772-4fd4-8df2-20cf05f649a8 admin admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:49:25.759581 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 857/1692] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Sep 13 19:49:25 2022] PUT /identity/v3/projects/722cf90e49ed4039a883e301618f3590/users/3be4d86a85084d72bd585f49e0733eaa/roles/6ca1d4427ff64e0a9d25d96cfb1445f6 => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 19:49:25.760646 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffde799f-e93e-43c8-95bf-a63626bc8297 None None] REQUEST_METHOD: `POST` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:49:25.761036 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffde799f-e93e-43c8-95bf-a63626bc8297 None None] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:49:25.761564 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffde799f-e93e-43c8-95bf-a63626bc8297 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:49:25.778536 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG dbcounter [-] [87935] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:49:25.866796 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.auth.core [None req-ffde799f-e93e-43c8-95bf-a63626bc8297 None None] MFA Rules not processed for user `3be4d86a85084d72bd585f49e0733eaa`. Rule list: `[]` (Enabled: `True`). {{(pid=87935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:49:25.873639 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.fernet_utils [None req-ffde799f-e93e-43c8-95bf-a63626bc8297 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:49:25.960896 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de22323-9772-4fd4-8df2-20cf05f649a8 admin admin] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:49:25.963255 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.fernet_utils [None req-2de22323-9772-4fd4-8df2-20cf05f649a8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:49:26.117315 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 836/1693] 10.222.0.25 () {58 vars in 958 bytes} [Tue Sep 13 19:49:25 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 358 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 19:49:26.132777 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffde799f-e93e-43c8-95bf-a63626bc8297 None None] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:49:26.137255 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.fernet_utils [None req-ffde799f-e93e-43c8-95bf-a63626bc8297 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:49:26.176280 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de22323-9772-4fd4-8df2-20cf05f649a8 admin admin] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:49:26.194584 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81009368-4fb8-49f6-b8dd-40678d96a791 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:49:26.195243 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81009368-4fb8-49f6-b8dd-40678d96a791 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:49:26.195524 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81009368-4fb8-49f6-b8dd-40678d96a791 admin admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:49:26.195798 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81009368-4fb8-49f6-b8dd-40678d96a791 admin admin] PATH_INFO: `/v3/projects/32ce89bf1f0247af83e44ea1abe75410` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:49:26.197009 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81009368-4fb8-49f6-b8dd-40678d96a791 admin admin] RBAC: Authorizing `identity:delete_project(project_id=32ce89bf1f0247af83e44ea1abe75410)` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:49:26.198936 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81009368-4fb8-49f6-b8dd-40678d96a791 admin admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:49:26.222945 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG dbcounter [-] [87934] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=87934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:49:26.246739 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffde799f-e93e-43c8-95bf-a63626bc8297 None None] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:49:26.252562 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ad2310-65fc-40a7-a2c2-e9093754074a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cbb50c88b794a7f9f26844effde7d63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a10a4268f3c4cb29f4e00c292e2df62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:49:26.253475 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ad2310-65fc-40a7-a2c2-e9093754074a service cinder] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:49:26.254168 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ad2310-65fc-40a7-a2c2-e9093754074a service cinder] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:49:26.254639 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ad2310-65fc-40a7-a2c2-e9093754074a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:49:26.267053 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ad2310-65fc-40a7-a2c2-e9093754074a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:49:26.271855 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ad2310-65fc-40a7-a2c2-e9093754074a service cinder] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:49:26.293488 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 837/1694] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Sep 13 19:49:26 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 19:49:26.294668 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ad2310-65fc-40a7-a2c2-e9093754074a service cinder] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:49:26.298137 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.fernet_utils [None req-36ad2310-65fc-40a7-a2c2-e9093754074a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:49:26.318288 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ad2310-65fc-40a7-a2c2-e9093754074a service cinder] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:49:26.323150 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.notifications [None req-81009368-4fb8-49f6-b8dd-40678d96a791 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '32ce89bf1f0247af83e44ea1abe75410', 'request_id': 'req-81009368-4fb8-49f6-b8dd-40678d96a791'} {{(pid=87934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:49:26.339058 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.notifications [None req-81009368-4fb8-49f6-b8dd-40678d96a791 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '32ce89bf1f0247af83e44ea1abe75410', 'request_id': 'req-81009368-4fb8-49f6-b8dd-40678d96a791'} {{(pid=87934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:49:26.359468 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.notifications [None req-81009368-4fb8-49f6-b8dd-40678d96a791 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '32ce89bf1f0247af83e44ea1abe75410', 'request_id': 'req-81009368-4fb8-49f6-b8dd-40678d96a791'} {{(pid=87934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:49:26.388123 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.notifications [None req-81009368-4fb8-49f6-b8dd-40678d96a791 admin admin] The token cache is being invalidate because project 32ce89bf1f0247af83e44ea1abe75410 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87934) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 19:49:26.389437 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.notifications [None req-81009368-4fb8-49f6-b8dd-40678d96a791 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:49:26.390809 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.notifications [None req-81009368-4fb8-49f6-b8dd-40678d96a791 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:49:26.395315 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 858/1695] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Sep 13 19:49:25 2022] DELETE /identity/v3/projects/32ce89bf1f0247af83e44ea1abe75410 => generated 0 bytes in 435 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 19:49:26.402295 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81009368-4fb8-49f6-b8dd-40678d96a791 admin admin] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:49:26.406140 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.fernet_utils [None req-81009368-4fb8-49f6-b8dd-40678d96a791 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:49:26.476117 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c6343a-36d4-4308-8b37-f5cd42a80331 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:49:26.476982 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c6343a-36d4-4308-8b37-f5cd42a80331 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:49:26.477465 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c6343a-36d4-4308-8b37-f5cd42a80331 admin admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:49:26.477877 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c6343a-36d4-4308-8b37-f5cd42a80331 admin admin] PATH_INFO: `/v3/projects/2ed162378af84b77a2ebed10b155b5a1` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:49:26.479675 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c6343a-36d4-4308-8b37-f5cd42a80331 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2ed162378af84b77a2ebed10b155b5a1)` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:49:26.483499 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c6343a-36d4-4308-8b37-f5cd42a80331 admin admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:49:26.616351 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG dbcounter [-] [87935] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=87935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:49:26.655271 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.notifications [None req-96c6343a-36d4-4308-8b37-f5cd42a80331 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2ed162378af84b77a2ebed10b155b5a1', 'request_id': 'req-96c6343a-36d4-4308-8b37-f5cd42a80331'} {{(pid=87935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:49:26.655766 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81009368-4fb8-49f6-b8dd-40678d96a791 admin admin] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:49:26.671963 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.notifications [None req-96c6343a-36d4-4308-8b37-f5cd42a80331 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2ed162378af84b77a2ebed10b155b5a1', 'request_id': 'req-96c6343a-36d4-4308-8b37-f5cd42a80331'} {{(pid=87935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:49:26.694579 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.notifications [None req-96c6343a-36d4-4308-8b37-f5cd42a80331 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2ed162378af84b77a2ebed10b155b5a1', 'request_id': 'req-96c6343a-36d4-4308-8b37-f5cd42a80331'} {{(pid=87935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:49:26.721166 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.notifications [None req-96c6343a-36d4-4308-8b37-f5cd42a80331 admin admin] The token cache is being invalidate because project 2ed162378af84b77a2ebed10b155b5a1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87935) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 19:49:26.724969 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.notifications [None req-96c6343a-36d4-4308-8b37-f5cd42a80331 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:49:26.728469 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.notifications [None req-96c6343a-36d4-4308-8b37-f5cd42a80331 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:49:26.730886 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 838/1696] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Sep 13 19:49:26 2022] DELETE /identity/v3/projects/2ed162378af84b77a2ebed10b155b5a1 => generated 0 bytes in 436 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 19:49:26.736879 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563f705b-d8c8-4dc5-b2d2-b939fca6d7ae None None] REQUEST_METHOD: `POST` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:49:26.738644 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563f705b-d8c8-4dc5-b2d2-b939fca6d7ae None None] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:49:26.739685 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563f705b-d8c8-4dc5-b2d2-b939fca6d7ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:49:26.811078 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.auth.core [None req-563f705b-d8c8-4dc5-b2d2-b939fca6d7ae None None] MFA Rules not processed for user `7b0aed92d02344acb92a0e4aa67c3068`. Rule list: `[]` (Enabled: `True`). {{(pid=87935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:49:26.814618 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.fernet_utils [None req-563f705b-d8c8-4dc5-b2d2-b939fca6d7ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:49:26.847229 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47c0084-3710-4bad-abe8-1461e1ae421f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:49:26.850251 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47c0084-3710-4bad-abe8-1461e1ae421f admin admin] REQUEST_METHOD: `DELETE` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:49:26.861257 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47c0084-3710-4bad-abe8-1461e1ae421f admin admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:49:26.861734 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47c0084-3710-4bad-abe8-1461e1ae421f admin admin] PATH_INFO: `/v3/users/14be5e0e8c7145578390fc20a368200f` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:49:26.864773 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b47c0084-3710-4bad-abe8-1461e1ae421f admin admin] RBAC: Authorizing `identity:delete_user(user_id=14be5e0e8c7145578390fc20a368200f)` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:49:26.872224 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b47c0084-3710-4bad-abe8-1461e1ae421f admin admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:49:27.029330 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG dbcounter [-] [87934] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=87934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:49:27.047395 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.notifications [None req-b47c0084-3710-4bad-abe8-1461e1ae421f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '14be5e0e8c7145578390fc20a368200f'} {{(pid=87934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:49:27.049223 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.notifications [None req-b47c0084-3710-4bad-abe8-1461e1ae421f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '14be5e0e8c7145578390fc20a368200f'} {{(pid=87934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:49:27.050302 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.notifications [None req-b47c0084-3710-4bad-abe8-1461e1ae421f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '14be5e0e8c7145578390fc20a368200f'} {{(pid=87934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:49:27.059282 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 839/1697] 10.222.0.25 () {58 vars in 958 bytes} [Tue Sep 13 19:49:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 328 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 19:49:27.064050 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563f705b-d8c8-4dc5-b2d2-b939fca6d7ae None None] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:49:27.068157 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.fernet_utils [None req-563f705b-d8c8-4dc5-b2d2-b939fca6d7ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:49:27.074169 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.notifications [None req-b47c0084-3710-4bad-abe8-1461e1ae421f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '14be5e0e8c7145578390fc20a368200f'} {{(pid=87934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:49:27.114316 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.notifications [None req-b47c0084-3710-4bad-abe8-1461e1ae421f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '14be5e0e8c7145578390fc20a368200f'} {{(pid=87934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:49:27.149064 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 859/1698] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Sep 13 19:49:26 2022] DELETE /identity/v3/users/14be5e0e8c7145578390fc20a368200f => generated 0 bytes in 749 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 19:49:27.151705 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47c0084-3710-4bad-abe8-1461e1ae421f admin admin] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:49:27.156046 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.fernet_utils [None req-b47c0084-3710-4bad-abe8-1461e1ae421f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:49:27.241626 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563f705b-d8c8-4dc5-b2d2-b939fca6d7ae None None] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:49:27.336518 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47c0084-3710-4bad-abe8-1461e1ae421f admin admin] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:49:27.345215 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299d6f2b-0a52-40b1-97ee-7e4cc6eebf8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:49:27.346379 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299d6f2b-0a52-40b1-97ee-7e4cc6eebf8e admin admin] REQUEST_METHOD: `DELETE` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:49:27.349137 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299d6f2b-0a52-40b1-97ee-7e4cc6eebf8e admin admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:49:27.349864 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299d6f2b-0a52-40b1-97ee-7e4cc6eebf8e admin admin] PATH_INFO: `/v3/users/606e065c37934df091e6f833b8810799` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:49:27.352771 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-299d6f2b-0a52-40b1-97ee-7e4cc6eebf8e admin admin] RBAC: Authorizing `identity:delete_user(user_id=606e065c37934df091e6f833b8810799)` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:49:27.359201 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465ffa31-b792-4a3a-b651-a44a8d160402 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cbb50c88b794a7f9f26844effde7d63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a10a4268f3c4cb29f4e00c292e2df62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:49:27.359834 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465ffa31-b792-4a3a-b651-a44a8d160402 service cinder] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:49:27.360117 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465ffa31-b792-4a3a-b651-a44a8d160402 service cinder] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:49:27.360456 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465ffa31-b792-4a3a-b651-a44a8d160402 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:49:27.368003 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.fernet_utils [None req-465ffa31-b792-4a3a-b651-a44a8d160402 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:49:27.370096 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-299d6f2b-0a52-40b1-97ee-7e4cc6eebf8e admin admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:49:27.460857 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG dbcounter [-] [87935] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=87935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:49:27.496895 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.notifications [None req-299d6f2b-0a52-40b1-97ee-7e4cc6eebf8e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '606e065c37934df091e6f833b8810799'} {{(pid=87934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:49:27.497674 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.notifications [None req-299d6f2b-0a52-40b1-97ee-7e4cc6eebf8e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '606e065c37934df091e6f833b8810799'} {{(pid=87934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:49:27.498389 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.notifications [None req-299d6f2b-0a52-40b1-97ee-7e4cc6eebf8e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '606e065c37934df091e6f833b8810799'} {{(pid=87934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:49:27.513614 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.notifications [None req-299d6f2b-0a52-40b1-97ee-7e4cc6eebf8e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '606e065c37934df091e6f833b8810799'} {{(pid=87934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:49:27.536768 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.notifications [None req-299d6f2b-0a52-40b1-97ee-7e4cc6eebf8e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '606e065c37934df091e6f833b8810799'} {{(pid=87934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:49:27.542398 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-465ffa31-b792-4a3a-b651-a44a8d160402 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:49:27.552365 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-465ffa31-b792-4a3a-b651-a44a8d160402 service cinder] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:49:27.562408 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 860/1699] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Sep 13 19:49:27 2022] DELETE /identity/v3/users/606e065c37934df091e6f833b8810799 => generated 0 bytes in 413 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 19:49:27.566165 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9c3bd4-c8b1-4182-983d-d8c8ef63cc93 None None] REQUEST_METHOD: `POST` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:49:27.568895 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9c3bd4-c8b1-4182-983d-d8c8ef63cc93 None None] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:49:27.569198 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9c3bd4-c8b1-4182-983d-d8c8ef63cc93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:49:27.578142 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 840/1700] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Sep 13 19:49:27 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 518 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 19:49:27.580095 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f47e04-c93b-4215-b588-1673c6a25172 None None] REQUEST_METHOD: `POST` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:49:27.580609 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f47e04-c93b-4215-b588-1673c6a25172 None None] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:49:27.581217 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f47e04-c93b-4215-b588-1673c6a25172 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:49:27.612667 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.auth.core [None req-1e9c3bd4-c8b1-4182-983d-d8c8ef63cc93 None None] MFA Rules not processed for user `7b0aed92d02344acb92a0e4aa67c3068`. Rule list: `[]` (Enabled: `True`). {{(pid=87934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:49:27.614331 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.fernet_utils [None req-1e9c3bd4-c8b1-4182-983d-d8c8ef63cc93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:49:27.615115 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.auth.core [None req-63f47e04-c93b-4215-b588-1673c6a25172 None None] MFA Rules not processed for user `7b0aed92d02344acb92a0e4aa67c3068`. Rule list: `[]` (Enabled: `True`). {{(pid=87935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:49:27.617127 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.fernet_utils [None req-63f47e04-c93b-4215-b588-1673c6a25172 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:49:27.701607 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG dbcounter [-] [87934] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=87934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:49:27.734007 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 841/1701] 10.222.0.25 () {58 vars in 958 bytes} [Tue Sep 13 19:49:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 19:49:27.735388 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01ba45f-aed9-4575-ab37-2cbb64c27b8f None None] REQUEST_METHOD: `POST` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:49:27.737254 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01ba45f-aed9-4575-ab37-2cbb64c27b8f None None] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:49:27.737370 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01ba45f-aed9-4575-ab37-2cbb64c27b8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:49:27.759167 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 861/1702] 10.222.0.25 () {58 vars in 958 bytes} [Tue Sep 13 19:49:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 19:49:27.763998 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9c3bd4-c8b1-4182-983d-d8c8ef63cc93 None None] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:49:27.790596 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9c3bd4-c8b1-4182-983d-d8c8ef63cc93 None None] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:49:27.801773 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.auth.core [None req-c01ba45f-aed9-4575-ab37-2cbb64c27b8f None None] MFA Rules not processed for user `ef71a6041f2d4f7389796f0c4a491ea6`. Rule list: `[]` (Enabled: `True`). {{(pid=87935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:49:27.802696 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2cf5ed4-796e-48cc-a139-5e8d4ac32d8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:49:27.803019 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.fernet_utils [None req-c01ba45f-aed9-4575-ab37-2cbb64c27b8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:49:27.803750 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2cf5ed4-796e-48cc-a139-5e8d4ac32d8b admin admin] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:49:27.804718 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2cf5ed4-796e-48cc-a139-5e8d4ac32d8b admin admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:49:27.806673 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2cf5ed4-796e-48cc-a139-5e8d4ac32d8b admin admin] PATH_INFO: `/v3/domains` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:49:27.808768 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2cf5ed4-796e-48cc-a139-5e8d4ac32d8b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87934) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:49:27.809404 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2cf5ed4-796e-48cc-a139-5e8d4ac32d8b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:49:27.822423 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2cf5ed4-796e-48cc-a139-5e8d4ac32d8b admin admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:49:27.913702 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 862/1703] 10.222.0.25 () {58 vars in 1153 bytes} [Tue Sep 13 19:49:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:49:27.917915 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2cf5ed4-796e-48cc-a139-5e8d4ac32d8b admin admin] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:49:27.938868 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2cf5ed4-796e-48cc-a139-5e8d4ac32d8b admin admin] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:49:27.958742 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-decf5f49-afe8-442a-8f6b-97540af25d88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:49:27.961571 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decf5f49-afe8-442a-8f6b-97540af25d88 admin admin] REQUEST_METHOD: `POST` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:49:27.961571 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decf5f49-afe8-442a-8f6b-97540af25d88 admin admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:49:27.961571 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decf5f49-afe8-442a-8f6b-97540af25d88 admin admin] PATH_INFO: `/v3/projects` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:49:27.961571 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-decf5f49-afe8-442a-8f6b-97540af25d88 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:49:27.963125 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-decf5f49-afe8-442a-8f6b-97540af25d88 admin admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:49:28.036141 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 842/1704] 10.222.0.25 () {58 vars in 958 bytes} [Tue Sep 13 19:49:27 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 300 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 19:49:28.037944 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22d97be-c976-470e-8ce6-d6bdc29bfadd None None] REQUEST_METHOD: `POST` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:49:28.038378 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22d97be-c976-470e-8ce6-d6bdc29bfadd None None] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:49:28.038786 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22d97be-c976-470e-8ce6-d6bdc29bfadd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:49:28.065817 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 863/1705] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Sep 13 19:49:27 2022] POST /identity/v3/projects => generated 405 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 13 19:49:28.071977 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-decf5f49-afe8-442a-8f6b-97540af25d88 admin admin] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:49:28.079957 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.auth.core [None req-f22d97be-c976-470e-8ce6-d6bdc29bfadd None None] MFA Rules not processed for user `ef71a6041f2d4f7389796f0c4a491ea6`. Rule list: `[]` (Enabled: `True`). {{(pid=87935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:49:28.084641 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.fernet_utils [None req-f22d97be-c976-470e-8ce6-d6bdc29bfadd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:49:28.236443 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-decf5f49-afe8-442a-8f6b-97540af25d88 admin admin] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:49:28.257230 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132e587b-7583-40db-8435-1a3d50cf8f21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:49:28.257945 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132e587b-7583-40db-8435-1a3d50cf8f21 admin admin] REQUEST_METHOD: `POST` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:49:28.258224 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132e587b-7583-40db-8435-1a3d50cf8f21 admin admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:49:28.258523 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132e587b-7583-40db-8435-1a3d50cf8f21 admin admin] PATH_INFO: `/v3/users` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:49:28.259189 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-132e587b-7583-40db-8435-1a3d50cf8f21 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:49:28.261227 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-132e587b-7583-40db-8435-1a3d50cf8f21 admin admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:49:28.309446 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 843/1706] 10.222.0.25 () {58 vars in 958 bytes} [Tue Sep 13 19:49:28 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 271 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 19:49:28.310727 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22d97be-c976-470e-8ce6-d6bdc29bfadd None None] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:49:28.313132 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 864/1707] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Sep 13 19:49:28 2022] POST /identity/v3/users => generated 303 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 19:49:28.315027 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132e587b-7583-40db-8435-1a3d50cf8f21 admin admin] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:49:28.318671 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.fernet_utils [None req-132e587b-7583-40db-8435-1a3d50cf8f21 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:49:28.318830 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.fernet_utils [None req-f22d97be-c976-470e-8ce6-d6bdc29bfadd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:49:28.347925 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG dbcounter [-] [87935] Writing DB stats keystone:SELECT=100 {{(pid=87935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:49:28.478693 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22d97be-c976-470e-8ce6-d6bdc29bfadd None None] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:49:28.490648 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2655ce0d-38a8-497e-a4e2-f6c2f0d5859c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1196a96e4a404f559600b69f929ea9da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a10a4268f3c4cb29f4e00c292e2df62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:49:28.491286 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2655ce0d-38a8-497e-a4e2-f6c2f0d5859c service neutron] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:49:28.491563 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2655ce0d-38a8-497e-a4e2-f6c2f0d5859c service neutron] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:49:28.491836 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2655ce0d-38a8-497e-a4e2-f6c2f0d5859c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:49:28.514117 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2655ce0d-38a8-497e-a4e2-f6c2f0d5859c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:49:28.515622 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2655ce0d-38a8-497e-a4e2-f6c2f0d5859c service neutron] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:49:28.524558 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132e587b-7583-40db-8435-1a3d50cf8f21 admin admin] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:49:28.547477 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932691b0-c0e5-4df8-adcc-298c0e848f75 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd71fe5a8275f4ea98555afdcefc902a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a10a4268f3c4cb29f4e00c292e2df62', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:49:28.548111 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932691b0-c0e5-4df8-adcc-298c0e848f75 service nova] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:49:28.548420 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932691b0-c0e5-4df8-adcc-298c0e848f75 service nova] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:49:28.548697 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932691b0-c0e5-4df8-adcc-298c0e848f75 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:49:28.553942 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 844/1708] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Sep 13 19:49:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 244 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 19:49:28.554882 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2655ce0d-38a8-497e-a4e2-f6c2f0d5859c service neutron] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:49:28.574937 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-932691b0-c0e5-4df8-adcc-298c0e848f75 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:49:28.576596 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-932691b0-c0e5-4df8-adcc-298c0e848f75 service nova] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:49:28.586935 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2655ce0d-38a8-497e-a4e2-f6c2f0d5859c service neutron] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:49:28.600126 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3143c1e0-ed62-4601-adf0-961f11d0b079 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:49:28.600841 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3143c1e0-ed62-4601-adf0-961f11d0b079 admin admin] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:49:28.601129 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3143c1e0-ed62-4601-adf0-961f11d0b079 admin admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:49:28.601401 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3143c1e0-ed62-4601-adf0-961f11d0b079 admin admin] PATH_INFO: `/v3/roles` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:49:28.603907 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 865/1709] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Sep 13 19:49:28 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 290 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 19:49:28.614292 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3143c1e0-ed62-4601-adf0-961f11d0b079 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:49:28.615944 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3143c1e0-ed62-4601-adf0-961f11d0b079 admin admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:49:28.664534 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 845/1710] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Sep 13 19:49:28 2022] GET /identity/v3/roles => generated 1420 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 19:49:28.668795 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932691b0-c0e5-4df8-adcc-298c0e848f75 service nova] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:49:28.693131 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932691b0-c0e5-4df8-adcc-298c0e848f75 service nova] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:49:28.714234 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27800269-6118-498a-95aa-26bacf9ad20f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:49:28.714880 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27800269-6118-498a-95aa-26bacf9ad20f admin admin] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:49:28.715162 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27800269-6118-498a-95aa-26bacf9ad20f admin admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:49:28.715436 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27800269-6118-498a-95aa-26bacf9ad20f admin admin] PATH_INFO: `/v3/roles` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:49:28.716179 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27800269-6118-498a-95aa-26bacf9ad20f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:49:28.717836 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27800269-6118-498a-95aa-26bacf9ad20f admin admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:49:28.752848 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 866/1711] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Sep 13 19:49:28 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 19:49:28.757472 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3143c1e0-ed62-4601-adf0-961f11d0b079 admin admin] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:49:28.773390 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3143c1e0-ed62-4601-adf0-961f11d0b079 admin admin] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:49:28.783366 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b985f56c-6f42-421e-aca8-8b42a3f06ede admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:49:28.784046 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b985f56c-6f42-421e-aca8-8b42a3f06ede admin admin] REQUEST_METHOD: `PUT` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:49:28.786799 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b985f56c-6f42-421e-aca8-8b42a3f06ede admin admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:49:28.787177 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b985f56c-6f42-421e-aca8-8b42a3f06ede admin admin] PATH_INFO: `/v3/projects/08c1d246200d47f0ab375251419fbd5d/users/9768de5dbd7d452b8fec35cd2255c0a9/roles/a259191f6d0e46fabd9f34536bb28747` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:49:28.837432 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b985f56c-6f42-421e-aca8-8b42a3f06ede admin admin] RBAC: Authorizing `identity:create_grant(project_id=08c1d246200d47f0ab375251419fbd5d, user_id=9768de5dbd7d452b8fec35cd2255c0a9, role_id=a259191f6d0e46fabd9f34536bb28747)` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:49:28.843267 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b985f56c-6f42-421e-aca8-8b42a3f06ede admin admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:49:28.909289 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 846/1712] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Sep 13 19:49:28 2022] PUT /identity/v3/projects/08c1d246200d47f0ab375251419fbd5d/users/9768de5dbd7d452b8fec35cd2255c0a9/roles/a259191f6d0e46fabd9f34536bb28747 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 19:49:28.929203 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ab138b-ed84-4c32-b798-75f42febfacc None None] REQUEST_METHOD: `POST` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:49:28.929203 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ab138b-ed84-4c32-b798-75f42febfacc None None] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:49:28.929203 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ab138b-ed84-4c32-b798-75f42febfacc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:49:28.998325 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG dbcounter [-] [87934] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=87934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:49:29.025369 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.auth.core [None req-c3ab138b-ed84-4c32-b798-75f42febfacc None None] MFA Rules not processed for user `9768de5dbd7d452b8fec35cd2255c0a9`. Rule list: `[]` (Enabled: `True`). {{(pid=87934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:49:29.027323 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.fernet_utils [None req-c3ab138b-ed84-4c32-b798-75f42febfacc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:49:29.225557 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b985f56c-6f42-421e-aca8-8b42a3f06ede admin admin] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:49:29.227790 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 867/1713] 10.222.0.25 () {58 vars in 958 bytes} [Tue Sep 13 19:49:28 2022] POST /identity/v3/auth/tokens => generated 3282 bytes in 307 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 19:49:29.401263 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b985f56c-6f42-421e-aca8-8b42a3f06ede admin admin] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:49:29.409450 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd77ba50-3cea-4527-823c-64840ff3737c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:49:29.411163 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd77ba50-3cea-4527-823c-64840ff3737c admin admin] REQUEST_METHOD: `POST` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:49:29.411640 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd77ba50-3cea-4527-823c-64840ff3737c admin admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:49:29.412095 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd77ba50-3cea-4527-823c-64840ff3737c admin admin] PATH_INFO: `/v3/projects` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:49:29.413182 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd77ba50-3cea-4527-823c-64840ff3737c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:49:29.415829 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd77ba50-3cea-4527-823c-64840ff3737c admin admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:49:29.495015 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 847/1714] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Sep 13 19:49:29 2022] POST /identity/v3/projects => generated 403 bytes in 269 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 19:49:29.497786 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ab138b-ed84-4c32-b798-75f42febfacc None None] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:49:29.525476 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ab138b-ed84-4c32-b798-75f42febfacc None None] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:49:29.679363 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b74aa67-213d-4e10-92f3-ef545f4dffe4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:49:29.680277 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b74aa67-213d-4e10-92f3-ef545f4dffe4 admin admin] REQUEST_METHOD: `POST` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:49:29.680760 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b74aa67-213d-4e10-92f3-ef545f4dffe4 admin admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:49:29.681206 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b74aa67-213d-4e10-92f3-ef545f4dffe4 admin admin] PATH_INFO: `/v3/users` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:49:29.682373 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b74aa67-213d-4e10-92f3-ef545f4dffe4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:49:29.684740 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b74aa67-213d-4e10-92f3-ef545f4dffe4 admin admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:49:29.724879 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 868/1715] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Sep 13 19:49:29 2022] POST /identity/v3/users => generated 308 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 19:49:29.726942 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd77ba50-3cea-4527-823c-64840ff3737c admin admin] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:49:29.728336 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b74aa67-213d-4e10-92f3-ef545f4dffe4 admin admin] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:49:29.728774 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.fernet_utils [None req-fd77ba50-3cea-4527-823c-64840ff3737c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:49:29.741212 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b74aa67-213d-4e10-92f3-ef545f4dffe4 admin admin] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:49:29.756993 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd77ba50-3cea-4527-823c-64840ff3737c admin admin] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:49:29.758647 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afdafd8e-7f3a-453c-a810-cc1250329073 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:49:29.760017 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdafd8e-7f3a-453c-a810-cc1250329073 admin admin] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:49:29.761655 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdafd8e-7f3a-453c-a810-cc1250329073 admin admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:49:29.762397 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdafd8e-7f3a-453c-a810-cc1250329073 admin admin] PATH_INFO: `/v3/roles` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:49:29.763533 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afdafd8e-7f3a-453c-a810-cc1250329073 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:49:29.766817 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afdafd8e-7f3a-453c-a810-cc1250329073 admin admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:49:29.772248 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62fa60b3-fd55-44bd-ba4f-43b6bffcd18f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:49:29.777078 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fa60b3-fd55-44bd-ba4f-43b6bffcd18f admin admin] REQUEST_METHOD: `DELETE` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:49:29.777368 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fa60b3-fd55-44bd-ba4f-43b6bffcd18f admin admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:49:29.777758 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fa60b3-fd55-44bd-ba4f-43b6bffcd18f admin admin] PATH_INFO: `/v3/projects/3cc0ca3717644800b198be7afdf91b7b` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:49:29.783886 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62fa60b3-fd55-44bd-ba4f-43b6bffcd18f admin admin] RBAC: Authorizing `identity:delete_project(project_id=3cc0ca3717644800b198be7afdf91b7b)` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:49:29.785749 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 869/1716] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Sep 13 19:49:29 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 19:49:29.789751 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62fa60b3-fd55-44bd-ba4f-43b6bffcd18f admin admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:49:29.791015 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afdafd8e-7f3a-453c-a810-cc1250329073 admin admin] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:49:29.829337 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afdafd8e-7f3a-453c-a810-cc1250329073 admin admin] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:49:29.840113 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82c96a2-5814-4381-a20c-c626a335eeef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:49:29.847522 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82c96a2-5814-4381-a20c-c626a335eeef admin admin] REQUEST_METHOD: `PUT` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:49:29.848428 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82c96a2-5814-4381-a20c-c626a335eeef admin admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:49:29.848949 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82c96a2-5814-4381-a20c-c626a335eeef admin admin] PATH_INFO: `/v3/projects/d1028bb39f454e5ea4fb08fac358ca6b/users/8b1181400b7d45648b4d264b4423f024/roles/6ca1d4427ff64e0a9d25d96cfb1445f6` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:49:29.899700 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b82c96a2-5814-4381-a20c-c626a335eeef admin admin] RBAC: Authorizing `identity:create_grant(project_id=d1028bb39f454e5ea4fb08fac358ca6b, user_id=8b1181400b7d45648b4d264b4423f024, role_id=6ca1d4427ff64e0a9d25d96cfb1445f6)` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:49:29.903514 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b82c96a2-5814-4381-a20c-c626a335eeef admin admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:49:29.921556 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.notifications [None req-62fa60b3-fd55-44bd-ba4f-43b6bffcd18f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3cc0ca3717644800b198be7afdf91b7b', 'request_id': 'req-62fa60b3-fd55-44bd-ba4f-43b6bffcd18f'} {{(pid=87935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:49:29.932623 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG dbcounter [-] [87935] Writing DB stats keystone:SELECT=93,keystone:INSERT=2,keystone:DELETE=5 {{(pid=87935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:49:29.934339 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.notifications [None req-62fa60b3-fd55-44bd-ba4f-43b6bffcd18f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3cc0ca3717644800b198be7afdf91b7b', 'request_id': 'req-62fa60b3-fd55-44bd-ba4f-43b6bffcd18f'} {{(pid=87935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:49:29.956321 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.notifications [None req-62fa60b3-fd55-44bd-ba4f-43b6bffcd18f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3cc0ca3717644800b198be7afdf91b7b', 'request_id': 'req-62fa60b3-fd55-44bd-ba4f-43b6bffcd18f'} {{(pid=87935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:49:29.962997 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 870/1717] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Sep 13 19:49:29 2022] PUT /identity/v3/projects/d1028bb39f454e5ea4fb08fac358ca6b/users/8b1181400b7d45648b4d264b4423f024/roles/6ca1d4427ff64e0a9d25d96cfb1445f6 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 19:49:29.965063 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343b4edb-1691-4928-9c2d-1625888c842a None None] REQUEST_METHOD: `POST` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:49:29.967908 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343b4edb-1691-4928-9c2d-1625888c842a None None] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:49:29.968805 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343b4edb-1691-4928-9c2d-1625888c842a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:49:29.997779 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.notifications [None req-62fa60b3-fd55-44bd-ba4f-43b6bffcd18f admin admin] The token cache is being invalidate because project 3cc0ca3717644800b198be7afdf91b7b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87935) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 19:49:29.998065 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.notifications [None req-62fa60b3-fd55-44bd-ba4f-43b6bffcd18f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:49:29.998897 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.notifications [None req-62fa60b3-fd55-44bd-ba4f-43b6bffcd18f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:49:30.001649 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 848/1718] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Sep 13 19:49:29 2022] DELETE /identity/v3/projects/3cc0ca3717644800b198be7afdf91b7b => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 19:49:30.003151 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62fa60b3-fd55-44bd-ba4f-43b6bffcd18f admin admin] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:49:30.005634 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.fernet_utils [None req-62fa60b3-fd55-44bd-ba4f-43b6bffcd18f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:49:30.040059 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.auth.core [None req-343b4edb-1691-4928-9c2d-1625888c842a None None] MFA Rules not processed for user `2658bb3ed0fd42948a1b471816e29301`. Rule list: `[]` (Enabled: `True`). {{(pid=87934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:49:30.044272 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.fernet_utils [None req-343b4edb-1691-4928-9c2d-1625888c842a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:49:30.140985 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG dbcounter [-] [87934] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=87934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:49:30.181940 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 871/1719] 10.222.0.25 () {58 vars in 958 bytes} [Tue Sep 13 19:49:29 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 19:49:30.184693 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3e557a-efd3-4f0a-84ac-156f15f550ee None None] REQUEST_METHOD: `POST` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:49:30.185228 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3e557a-efd3-4f0a-84ac-156f15f550ee None None] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:49:30.186385 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3e557a-efd3-4f0a-84ac-156f15f550ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:49:30.205429 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62fa60b3-fd55-44bd-ba4f-43b6bffcd18f admin admin] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:49:30.216409 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.auth.core [None req-8b3e557a-efd3-4f0a-84ac-156f15f550ee None None] MFA Rules not processed for user `7b0aed92d02344acb92a0e4aa67c3068`. Rule list: `[]` (Enabled: `True`). {{(pid=87934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:49:30.222167 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.fernet_utils [None req-8b3e557a-efd3-4f0a-84ac-156f15f550ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:49:30.342656 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7f28fe-106a-4cc6-ae76-dbfade420f22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:49:30.343290 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7f28fe-106a-4cc6-ae76-dbfade420f22 admin admin] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:49:30.343565 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7f28fe-106a-4cc6-ae76-dbfade420f22 admin admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:49:30.343831 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7f28fe-106a-4cc6-ae76-dbfade420f22 admin admin] PATH_INFO: `/v3/roles` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:49:30.344559 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da7f28fe-106a-4cc6-ae76-dbfade420f22 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:49:30.346228 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da7f28fe-106a-4cc6-ae76-dbfade420f22 admin admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:49:30.367878 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 849/1720] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Sep 13 19:49:30 2022] GET /identity/v3/roles => generated 1420 bytes in 365 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 19:49:30.370229 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2abb5c-a5e5-4d1c-8ae4-d4cd677be145 None None] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:49:30.370452 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2abb5c-a5e5-4d1c-8ae4-d4cd677be145 None None] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:49:30.370724 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2abb5c-a5e5-4d1c-8ae4-d4cd677be145 None None] PATH_INFO: `/` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:49:30.372814 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 850/1721] 10.222.0.25 () {54 vars in 912 bytes} [Tue Sep 13 19:49:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:49:30.379505 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2abb5c-a5e5-4d1c-8ae4-d4cd677be145 None None] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:49:30.382309 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.fernet_utils [None req-cb2abb5c-a5e5-4d1c-8ae4-d4cd677be145 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:49:30.413724 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 872/1722] 10.222.0.25 () {58 vars in 958 bytes} [Tue Sep 13 19:49:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 19:49:30.415995 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3e557a-efd3-4f0a-84ac-156f15f550ee None None] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:49:30.444907 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3e557a-efd3-4f0a-84ac-156f15f550ee None None] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:49:30.458753 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9bc2b9-ed02-4943-b003-7d998c694cbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:49:30.460546 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9bc2b9-ed02-4943-b003-7d998c694cbe admin admin] REQUEST_METHOD: `PUT` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:49:30.476541 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9bc2b9-ed02-4943-b003-7d998c694cbe admin admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:49:30.478461 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9bc2b9-ed02-4943-b003-7d998c694cbe admin admin] PATH_INFO: `/v3/projects/d1028bb39f454e5ea4fb08fac358ca6b/users/8b1181400b7d45648b4d264b4423f024/roles/6ca1d4427ff64e0a9d25d96cfb1445f6` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:49:30.485641 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee9bc2b9-ed02-4943-b003-7d998c694cbe admin admin] RBAC: Authorizing `identity:create_grant(project_id=d1028bb39f454e5ea4fb08fac358ca6b, user_id=8b1181400b7d45648b4d264b4423f024, role_id=6ca1d4427ff64e0a9d25d96cfb1445f6)` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:49:30.494824 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee9bc2b9-ed02-4943-b003-7d998c694cbe admin admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:49:30.526640 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2abb5c-a5e5-4d1c-8ae4-d4cd677be145 None None] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:49:30.531676 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 873/1723] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Sep 13 19:49:30 2022] PUT /identity/v3/projects/d1028bb39f454e5ea4fb08fac358ca6b/users/8b1181400b7d45648b4d264b4423f024/roles/6ca1d4427ff64e0a9d25d96cfb1445f6 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 19:49:30.533181 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e42bfa4-8df0-4493-9bb9-cf858b10141f None None] REQUEST_METHOD: `POST` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:49:30.537620 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e42bfa4-8df0-4493-9bb9-cf858b10141f None None] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:49:30.538045 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e42bfa4-8df0-4493-9bb9-cf858b10141f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:49:30.599298 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG dbcounter [-] [87935] Writing DB stats keystone:DELETE=2,keystone:SELECT=97,keystone:INSERT=1 {{(pid=87935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:49:30.663725 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.auth.core [None req-7e42bfa4-8df0-4493-9bb9-cf858b10141f None None] MFA Rules not processed for user `1196a96e4a404f559600b69f929ea9da`. Rule list: `[]` (Enabled: `True`). {{(pid=87934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:49:30.665614 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.fernet_utils [None req-7e42bfa4-8df0-4493-9bb9-cf858b10141f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:49:30.801646 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 874/1724] 10.222.0.25 () {58 vars in 1009 bytes} [Tue Sep 13 19:49:30 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 269 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 19:49:30.804386 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23abd190-17ac-467f-98ed-c5d5ec181035 None None] REQUEST_METHOD: `POST` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:49:30.805688 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23abd190-17ac-467f-98ed-c5d5ec181035 None None] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:49:30.806184 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23abd190-17ac-467f-98ed-c5d5ec181035 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:49:30.813029 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d82f19-042f-4801-a5b9-7c464b1613ae service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd71fe5a8275f4ea98555afdcefc902a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a10a4268f3c4cb29f4e00c292e2df62', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:49:30.814258 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d82f19-042f-4801-a5b9-7c464b1613ae service nova] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:49:30.814714 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d82f19-042f-4801-a5b9-7c464b1613ae service nova] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:49:30.815167 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d82f19-042f-4801-a5b9-7c464b1613ae service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:49:30.854572 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.auth.core [None req-23abd190-17ac-467f-98ed-c5d5ec181035 None None] MFA Rules not processed for user `7b0aed92d02344acb92a0e4aa67c3068`. Rule list: `[]` (Enabled: `True`). {{(pid=87934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:49:30.857908 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.fernet_utils [None req-23abd190-17ac-467f-98ed-c5d5ec181035 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:49:30.966679 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d82f19-042f-4801-a5b9-7c464b1613ae service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:49:30.970380 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d82f19-042f-4801-a5b9-7c464b1613ae service nova] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:49:31.005369 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 851/1725] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Sep 13 19:49:30 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 632 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 19:49:31.008627 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c6528d-6099-4ab7-8269-0bacccf5ee62 None None] REQUEST_METHOD: `POST` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:49:31.008874 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c6528d-6099-4ab7-8269-0bacccf5ee62 None None] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:49:31.009151 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c6528d-6099-4ab7-8269-0bacccf5ee62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:49:31.025910 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 875/1726] 10.222.0.25 () {58 vars in 958 bytes} [Tue Sep 13 19:49:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 19:49:31.028014 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23abd190-17ac-467f-98ed-c5d5ec181035 None None] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:49:31.031036 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.fernet_utils [None req-23abd190-17ac-467f-98ed-c5d5ec181035 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:49:31.061373 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23abd190-17ac-467f-98ed-c5d5ec181035 None None] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:49:31.071618 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6d05f9-5bc0-438b-a8df-8c5d5b3a66d7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1196a96e4a404f559600b69f929ea9da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a10a4268f3c4cb29f4e00c292e2df62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:49:31.072122 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.auth.core [None req-20c6528d-6099-4ab7-8269-0bacccf5ee62 None None] MFA Rules not processed for user `8b1181400b7d45648b4d264b4423f024`. Rule list: `[]` (Enabled: `True`). {{(pid=87935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:49:31.073061 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6d05f9-5bc0-438b-a8df-8c5d5b3a66d7 service neutron] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:49:31.073394 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.fernet_utils [None req-20c6528d-6099-4ab7-8269-0bacccf5ee62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:49:31.073932 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6d05f9-5bc0-438b-a8df-8c5d5b3a66d7 service neutron] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:49:31.074232 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6d05f9-5bc0-438b-a8df-8c5d5b3a66d7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:49:31.100572 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG dbcounter [-] [87934] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:49:31.115033 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a6d05f9-5bc0-438b-a8df-8c5d5b3a66d7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:49:31.119982 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a6d05f9-5bc0-438b-a8df-8c5d5b3a66d7 service neutron] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:49:31.142770 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 876/1727] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Sep 13 19:49:31 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 19:49:31.143592 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6d05f9-5bc0-438b-a8df-8c5d5b3a66d7 service neutron] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:49:31.148680 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.fernet_utils [None req-1a6d05f9-5bc0-438b-a8df-8c5d5b3a66d7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:49:31.194306 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6d05f9-5bc0-438b-a8df-8c5d5b3a66d7 service neutron] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:49:31.211616 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50040822-b4c7-4b81-99b1-3bf5b5afb1b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:49:31.212308 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50040822-b4c7-4b81-99b1-3bf5b5afb1b7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:49:31.212577 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50040822-b4c7-4b81-99b1-3bf5b5afb1b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:49:31.212848 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50040822-b4c7-4b81-99b1-3bf5b5afb1b7 admin admin] PATH_INFO: `/v3/projects/b5dc14d7024f4fa9a3bb7117c4421ca8` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:49:31.221109 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50040822-b4c7-4b81-99b1-3bf5b5afb1b7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b5dc14d7024f4fa9a3bb7117c4421ca8)` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:49:31.226256 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50040822-b4c7-4b81-99b1-3bf5b5afb1b7 admin admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:49:31.342349 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 852/1728] 10.222.0.25 () {58 vars in 958 bytes} [Tue Sep 13 19:49:31 2022] POST /identity/v3/auth/tokens => generated 3347 bytes in 336 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 19:49:31.343767 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c6528d-6099-4ab7-8269-0bacccf5ee62 None None] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:49:31.389137 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c6528d-6099-4ab7-8269-0bacccf5ee62 None None] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:49:31.407788 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.notifications [None req-50040822-b4c7-4b81-99b1-3bf5b5afb1b7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b5dc14d7024f4fa9a3bb7117c4421ca8', 'request_id': 'req-50040822-b4c7-4b81-99b1-3bf5b5afb1b7'} {{(pid=87934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:49:31.426726 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.notifications [None req-50040822-b4c7-4b81-99b1-3bf5b5afb1b7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b5dc14d7024f4fa9a3bb7117c4421ca8', 'request_id': 'req-50040822-b4c7-4b81-99b1-3bf5b5afb1b7'} {{(pid=87934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:49:31.464518 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.notifications [None req-50040822-b4c7-4b81-99b1-3bf5b5afb1b7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b5dc14d7024f4fa9a3bb7117c4421ca8', 'request_id': 'req-50040822-b4c7-4b81-99b1-3bf5b5afb1b7'} {{(pid=87934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:49:31.489800 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.notifications [None req-50040822-b4c7-4b81-99b1-3bf5b5afb1b7 admin admin] The token cache is being invalidate because project b5dc14d7024f4fa9a3bb7117c4421ca8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87934) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 19:49:31.499125 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.notifications [None req-50040822-b4c7-4b81-99b1-3bf5b5afb1b7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:49:31.500762 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.notifications [None req-50040822-b4c7-4b81-99b1-3bf5b5afb1b7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:49:31.508407 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 877/1729] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Sep 13 19:49:31 2022] DELETE /identity/v3/projects/b5dc14d7024f4fa9a3bb7117c4421ca8 => generated 0 bytes in 361 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 19:49:31.509397 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50040822-b4c7-4b81-99b1-3bf5b5afb1b7 admin admin] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:49:31.514142 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.fernet_utils [None req-50040822-b4c7-4b81-99b1-3bf5b5afb1b7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:49:31.549427 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG dbcounter [-] [87935] Writing DB stats keystone:SELECT=100 {{(pid=87935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:49:31.590515 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a90e1ee-780f-46ac-9db8-1741de14084c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:49:31.591197 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a90e1ee-780f-46ac-9db8-1741de14084c admin admin] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:49:31.591477 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a90e1ee-780f-46ac-9db8-1741de14084c admin admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:49:31.591736 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a90e1ee-780f-46ac-9db8-1741de14084c admin admin] PATH_INFO: `/v3/domains` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:49:31.594781 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a90e1ee-780f-46ac-9db8-1741de14084c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87935) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:49:31.595203 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a90e1ee-780f-46ac-9db8-1741de14084c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:49:31.599822 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a90e1ee-780f-46ac-9db8-1741de14084c admin admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:49:31.634504 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 853/1730] 10.222.0.25 () {58 vars in 1153 bytes} [Tue Sep 13 19:49:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:49:31.634504 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a90e1ee-780f-46ac-9db8-1741de14084c admin admin] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:49:31.640604 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.fernet_utils [None req-2a90e1ee-780f-46ac-9db8-1741de14084c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:49:31.674862 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a90e1ee-780f-46ac-9db8-1741de14084c admin admin] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:49:31.691916 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50040822-b4c7-4b81-99b1-3bf5b5afb1b7 admin admin] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:49:31.693019 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287f2c43-cf23-4571-b7b4-3145c331cb9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:49:31.694125 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287f2c43-cf23-4571-b7b4-3145c331cb9e admin admin] REQUEST_METHOD: `DELETE` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:49:31.694389 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287f2c43-cf23-4571-b7b4-3145c331cb9e admin admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:49:31.695056 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287f2c43-cf23-4571-b7b4-3145c331cb9e admin admin] PATH_INFO: `/v3/users/f32c21f2f3274ec8968fc10598100ad2` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:49:31.697145 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-287f2c43-cf23-4571-b7b4-3145c331cb9e admin admin] RBAC: Authorizing `identity:delete_user(user_id=f32c21f2f3274ec8968fc10598100ad2)` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:49:31.702721 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-287f2c43-cf23-4571-b7b4-3145c331cb9e admin admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:49:31.703941 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c19f3b-298d-41eb-a485-81eb3c619663 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cbb50c88b794a7f9f26844effde7d63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a10a4268f3c4cb29f4e00c292e2df62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:49:31.704414 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c19f3b-298d-41eb-a485-81eb3c619663 service cinder] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:49:31.704754 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c19f3b-298d-41eb-a485-81eb3c619663 service cinder] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:49:31.705024 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c19f3b-298d-41eb-a485-81eb3c619663 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:49:31.707448 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.fernet_utils [None req-96c19f3b-298d-41eb-a485-81eb3c619663 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:49:31.852819 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.notifications [None req-287f2c43-cf23-4571-b7b4-3145c331cb9e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f32c21f2f3274ec8968fc10598100ad2'} {{(pid=87935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:49:31.869644 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.notifications [None req-287f2c43-cf23-4571-b7b4-3145c331cb9e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f32c21f2f3274ec8968fc10598100ad2'} {{(pid=87935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:49:31.870378 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c19f3b-298d-41eb-a485-81eb3c619663 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:49:31.871986 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c19f3b-298d-41eb-a485-81eb3c619663 service cinder] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:49:31.895397 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 878/1731] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Sep 13 19:49:31 2022] GET /identity/v3/auth/tokens => generated 3347 bytes in 386 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 19:49:31.896095 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c19f3b-298d-41eb-a485-81eb3c619663 service cinder] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:49:31.900074 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.fernet_utils [None req-96c19f3b-298d-41eb-a485-81eb3c619663 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:49:31.925935 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.notifications [None req-287f2c43-cf23-4571-b7b4-3145c331cb9e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f32c21f2f3274ec8968fc10598100ad2'} {{(pid=87935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:49:31.929296 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.notifications [None req-287f2c43-cf23-4571-b7b4-3145c331cb9e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f32c21f2f3274ec8968fc10598100ad2'} {{(pid=87935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:49:31.930180 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.notifications [None req-287f2c43-cf23-4571-b7b4-3145c331cb9e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f32c21f2f3274ec8968fc10598100ad2'} {{(pid=87935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:49:31.939311 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c19f3b-298d-41eb-a485-81eb3c619663 service cinder] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:49:31.945679 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010b3ab4-0c9b-48cf-9c6b-fbef25387881 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:49:31.946311 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010b3ab4-0c9b-48cf-9c6b-fbef25387881 admin admin] REQUEST_METHOD: `POST` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:49:31.946587 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010b3ab4-0c9b-48cf-9c6b-fbef25387881 admin admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:49:31.946853 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010b3ab4-0c9b-48cf-9c6b-fbef25387881 admin admin] PATH_INFO: `/v3/projects` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:49:31.947493 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-010b3ab4-0c9b-48cf-9c6b-fbef25387881 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:49:31.949528 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-010b3ab4-0c9b-48cf-9c6b-fbef25387881 admin admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:49:31.999535 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 854/1732] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Sep 13 19:49:31 2022] DELETE /identity/v3/users/f32c21f2f3274ec8968fc10598100ad2 => generated 0 bytes in 367 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 19:49:32.001911 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d33cde-8d66-472f-8f51-09812a3686f4 None None] REQUEST_METHOD: `POST` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:49:32.003897 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d33cde-8d66-472f-8f51-09812a3686f4 None None] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:49:32.004666 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d33cde-8d66-472f-8f51-09812a3686f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:49:32.011736 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 879/1733] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Sep 13 19:49:31 2022] POST /identity/v3/projects => generated 381 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 19:49:32.024082 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010b3ab4-0c9b-48cf-9c6b-fbef25387881 admin admin] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:49:32.030653 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.fernet_utils [None req-010b3ab4-0c9b-48cf-9c6b-fbef25387881 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:49:32.091288 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG dbcounter [-] [87934] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=87934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:49:32.109077 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.auth.core [None req-57d33cde-8d66-472f-8f51-09812a3686f4 None None] MFA Rules not processed for user `1c4a47ef1eb244ac95525df0c68e7deb`. Rule list: `[]` (Enabled: `True`). {{(pid=87935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:49:32.112751 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.fernet_utils [None req-57d33cde-8d66-472f-8f51-09812a3686f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:49:32.209167 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010b3ab4-0c9b-48cf-9c6b-fbef25387881 admin admin] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:49:32.218349 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0230e8-bfcd-44cf-8218-afb2cb683715 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:49:32.218862 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0230e8-bfcd-44cf-8218-afb2cb683715 admin admin] REQUEST_METHOD: `POST` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:49:32.219303 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0230e8-bfcd-44cf-8218-afb2cb683715 admin admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:49:32.219894 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0230e8-bfcd-44cf-8218-afb2cb683715 admin admin] PATH_INFO: `/v3/users` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:49:32.221450 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e0230e8-bfcd-44cf-8218-afb2cb683715 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:49:32.224337 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e0230e8-bfcd-44cf-8218-afb2cb683715 admin admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:49:32.271366 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 880/1734] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Sep 13 19:49:32 2022] POST /identity/v3/users => generated 291 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 19:49:32.273577 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0230e8-bfcd-44cf-8218-afb2cb683715 admin admin] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:49:32.279536 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.fernet_utils [None req-2e0230e8-bfcd-44cf-8218-afb2cb683715 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:49:32.314980 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0230e8-bfcd-44cf-8218-afb2cb683715 admin admin] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:49:32.329006 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d74127a-d984-42a2-ba39-a96206205615 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:49:32.330530 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d74127a-d984-42a2-ba39-a96206205615 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:49:32.331173 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d74127a-d984-42a2-ba39-a96206205615 admin admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:49:32.332412 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d74127a-d984-42a2-ba39-a96206205615 admin admin] PATH_INFO: `/v3/users/9768de5dbd7d452b8fec35cd2255c0a9` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:49:32.338062 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d74127a-d984-42a2-ba39-a96206205615 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9768de5dbd7d452b8fec35cd2255c0a9)` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:49:32.343877 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d74127a-d984-42a2-ba39-a96206205615 admin admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:49:32.364437 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 855/1735] 10.222.0.25 () {58 vars in 958 bytes} [Tue Sep 13 19:49:31 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 364 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 19:49:32.375968 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d33cde-8d66-472f-8f51-09812a3686f4 None None] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:49:32.393205 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d33cde-8d66-472f-8f51-09812a3686f4 None None] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:49:32.401274 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc24ceac-eae6-4346-9dc2-0d7f20717e81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:49:32.402067 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc24ceac-eae6-4346-9dc2-0d7f20717e81 admin admin] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:49:32.402355 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc24ceac-eae6-4346-9dc2-0d7f20717e81 admin admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:49:32.402919 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc24ceac-eae6-4346-9dc2-0d7f20717e81 admin admin] PATH_INFO: `/v3/roles` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:49:32.403737 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc24ceac-eae6-4346-9dc2-0d7f20717e81 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:49:32.405925 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc24ceac-eae6-4346-9dc2-0d7f20717e81 admin admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:49:32.426835 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 856/1736] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Sep 13 19:49:32 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 19:49:32.426835 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869cf782-214c-4b6f-b580-16339b1451f4 None None] REQUEST_METHOD: `POST` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:49:32.426835 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869cf782-214c-4b6f-b580-16339b1451f4 None None] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:49:32.426835 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869cf782-214c-4b6f-b580-16339b1451f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:49:32.457785 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.notifications [None req-4d74127a-d984-42a2-ba39-a96206205615 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9768de5dbd7d452b8fec35cd2255c0a9'} {{(pid=87934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:49:32.459039 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.notifications [None req-4d74127a-d984-42a2-ba39-a96206205615 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9768de5dbd7d452b8fec35cd2255c0a9'} {{(pid=87934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:49:32.460967 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.notifications [None req-4d74127a-d984-42a2-ba39-a96206205615 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9768de5dbd7d452b8fec35cd2255c0a9'} {{(pid=87934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:49:32.488346 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.auth.core [None req-869cf782-214c-4b6f-b580-16339b1451f4 None None] MFA Rules not processed for user `1c4a47ef1eb244ac95525df0c68e7deb`. Rule list: `[]` (Enabled: `True`). {{(pid=87935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:49:32.490091 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.fernet_utils [None req-869cf782-214c-4b6f-b580-16339b1451f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:49:32.497834 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.notifications [None req-4d74127a-d984-42a2-ba39-a96206205615 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9768de5dbd7d452b8fec35cd2255c0a9'} {{(pid=87934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:49:32.500313 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 857/1737] 10.222.0.25 () {58 vars in 958 bytes} [Tue Sep 13 19:49:32 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 19:49:32.507860 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869cf782-214c-4b6f-b580-16339b1451f4 None None] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:49:32.509951 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.fernet_utils [None req-869cf782-214c-4b6f-b580-16339b1451f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:49:32.548067 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869cf782-214c-4b6f-b580-16339b1451f4 None None] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:49:32.549151 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.notifications [None req-4d74127a-d984-42a2-ba39-a96206205615 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9768de5dbd7d452b8fec35cd2255c0a9'} {{(pid=87934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:49:32.569629 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a618918c-8d25-4a9b-b7fa-4cd4f19f1a4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:49:32.570953 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a618918c-8d25-4a9b-b7fa-4cd4f19f1a4f admin admin] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:49:32.571306 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a618918c-8d25-4a9b-b7fa-4cd4f19f1a4f admin admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:49:32.571924 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a618918c-8d25-4a9b-b7fa-4cd4f19f1a4f admin admin] PATH_INFO: `/v3/roles` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:49:32.573617 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a618918c-8d25-4a9b-b7fa-4cd4f19f1a4f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:49:32.576157 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a618918c-8d25-4a9b-b7fa-4cd4f19f1a4f admin admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:49:32.600015 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 858/1738] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Sep 13 19:49:32 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 19:49:32.600015 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a618918c-8d25-4a9b-b7fa-4cd4f19f1a4f admin admin] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:49:32.602721 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 881/1739] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Sep 13 19:49:32 2022] DELETE /identity/v3/users/9768de5dbd7d452b8fec35cd2255c0a9 => generated 0 bytes in 333 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 19:49:32.606502 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.fernet_utils [None req-a618918c-8d25-4a9b-b7fa-4cd4f19f1a4f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:49:32.611197 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d74127a-d984-42a2-ba39-a96206205615 admin admin] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:49:32.718796 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG dbcounter [-] [87935] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:49:32.833737 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d74127a-d984-42a2-ba39-a96206205615 admin admin] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:49:32.847798 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d0bfa9-962c-4265-b01b-7b6edf4830c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:49:32.848467 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d0bfa9-962c-4265-b01b-7b6edf4830c6 admin admin] REQUEST_METHOD: `PUT` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:49:32.848888 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d0bfa9-962c-4265-b01b-7b6edf4830c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:49:32.849581 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d0bfa9-962c-4265-b01b-7b6edf4830c6 admin admin] PATH_INFO: `/v3/projects/5c9644d2387f4df38a242d606cd0b296/users/dbd9f343c9224a35ad433c544fe97ec2/roles/a259191f6d0e46fabd9f34536bb28747` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:49:32.871058 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG dbcounter [-] [87934] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=87934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:49:32.875282 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d0bfa9-962c-4265-b01b-7b6edf4830c6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5c9644d2387f4df38a242d606cd0b296, user_id=dbd9f343c9224a35ad433c544fe97ec2, role_id=a259191f6d0e46fabd9f34536bb28747)` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:49:32.882180 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d0bfa9-962c-4265-b01b-7b6edf4830c6 admin admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:49:32.913226 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 882/1740] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Sep 13 19:49:32 2022] PUT /identity/v3/projects/5c9644d2387f4df38a242d606cd0b296/users/dbd9f343c9224a35ad433c544fe97ec2/roles/a259191f6d0e46fabd9f34536bb28747 => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 19:49:32.913226 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f279cf2f-3375-411e-9676-084728f3e661 None None] REQUEST_METHOD: `POST` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:49:32.913226 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f279cf2f-3375-411e-9676-084728f3e661 None None] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:49:32.913226 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f279cf2f-3375-411e-9676-084728f3e661 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:49:32.934987 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.auth.core [None req-f279cf2f-3375-411e-9676-084728f3e661 None None] MFA Rules not processed for user `7b0aed92d02344acb92a0e4aa67c3068`. Rule list: `[]` (Enabled: `True`). {{(pid=87934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:49:32.936443 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.fernet_utils [None req-f279cf2f-3375-411e-9676-084728f3e661 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:49:32.981585 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a618918c-8d25-4a9b-b7fa-4cd4f19f1a4f admin admin] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:49:33.071002 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 883/1741] 10.222.0.25 () {58 vars in 958 bytes} [Tue Sep 13 19:49:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 19:49:33.072443 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f279cf2f-3375-411e-9676-084728f3e661 None None] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:49:33.074437 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.fernet_utils [None req-f279cf2f-3375-411e-9676-084728f3e661 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:49:33.142839 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2aeffbb-055e-4fd9-80a3-18a6a5640a63 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd71fe5a8275f4ea98555afdcefc902a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a10a4268f3c4cb29f4e00c292e2df62', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:49:33.143787 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2aeffbb-055e-4fd9-80a3-18a6a5640a63 service nova] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:49:33.144432 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2aeffbb-055e-4fd9-80a3-18a6a5640a63 service nova] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:49:33.144962 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2aeffbb-055e-4fd9-80a3-18a6a5640a63 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:49:33.149600 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.fernet_utils [None req-a2aeffbb-055e-4fd9-80a3-18a6a5640a63 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:49:33.223776 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f279cf2f-3375-411e-9676-084728f3e661 None None] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:49:33.240976 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524f06bb-1aaf-4af8-ad19-eb7feac2c257 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02eb3d3173c1476cb83a72add0e878e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a10a4268f3c4cb29f4e00c292e2df62', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:49:33.241704 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524f06bb-1aaf-4af8-ad19-eb7feac2c257 service placement] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:49:33.242222 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524f06bb-1aaf-4af8-ad19-eb7feac2c257 service placement] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:49:33.242497 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524f06bb-1aaf-4af8-ad19-eb7feac2c257 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:49:33.244750 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.fernet_utils [None req-524f06bb-1aaf-4af8-ad19-eb7feac2c257 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:49:33.260155 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-524f06bb-1aaf-4af8-ad19-eb7feac2c257 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:49:33.261884 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-524f06bb-1aaf-4af8-ad19-eb7feac2c257 service placement] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:49:33.288689 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 884/1742] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Sep 13 19:49:33 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 217 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 19:49:33.291678 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea29b97-45d5-40cd-bfa4-4d805a1542df None None] REQUEST_METHOD: `POST` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:49:33.291971 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea29b97-45d5-40cd-bfa4-4d805a1542df None None] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:49:33.292262 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea29b97-45d5-40cd-bfa4-4d805a1542df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:49:33.346070 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2aeffbb-055e-4fd9-80a3-18a6a5640a63 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:49:33.349737 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.auth.core [None req-1ea29b97-45d5-40cd-bfa4-4d805a1542df None None] MFA Rules not processed for user `ef71a6041f2d4f7389796f0c4a491ea6`. Rule list: `[]` (Enabled: `True`). {{(pid=87934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:49:33.350961 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.fernet_utils [None req-1ea29b97-45d5-40cd-bfa4-4d805a1542df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:49:33.352760 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2aeffbb-055e-4fd9-80a3-18a6a5640a63 service nova] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:49:33.390653 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 859/1743] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Sep 13 19:49:32 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 792 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 19:49:33.400300 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b133dbff-95e5-4f61-8c9e-fcf276f5796f None None] REQUEST_METHOD: `POST` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:49:33.400300 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b133dbff-95e5-4f61-8c9e-fcf276f5796f None None] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:49:33.400300 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b133dbff-95e5-4f61-8c9e-fcf276f5796f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:49:33.499585 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.auth.core [None req-b133dbff-95e5-4f61-8c9e-fcf276f5796f None None] MFA Rules not processed for user `dbd9f343c9224a35ad433c544fe97ec2`. Rule list: `[]` (Enabled: `True`). {{(pid=87935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:49:33.504014 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.fernet_utils [None req-b133dbff-95e5-4f61-8c9e-fcf276f5796f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:49:33.538341 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 885/1744] 10.222.0.25 () {58 vars in 958 bytes} [Tue Sep 13 19:49:33 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 248 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 19:49:33.539269 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea29b97-45d5-40cd-bfa4-4d805a1542df None None] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:49:33.541083 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.fernet_utils [None req-1ea29b97-45d5-40cd-bfa4-4d805a1542df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:49:33.625338 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG dbcounter [-] [87934] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:49:33.660719 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG dbcounter [-] [87935] Writing DB stats keystone:SELECT=100 {{(pid=87935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:49:33.676442 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea29b97-45d5-40cd-bfa4-4d805a1542df None None] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:49:33.681604 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4626bc-1b69-4c7d-8ff2-53ca7a1de72c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1196a96e4a404f559600b69f929ea9da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a10a4268f3c4cb29f4e00c292e2df62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:49:33.682449 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4626bc-1b69-4c7d-8ff2-53ca7a1de72c service neutron] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:49:33.683333 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4626bc-1b69-4c7d-8ff2-53ca7a1de72c service neutron] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:49:33.683745 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4626bc-1b69-4c7d-8ff2-53ca7a1de72c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:49:33.700083 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a4626bc-1b69-4c7d-8ff2-53ca7a1de72c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:49:33.702002 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a4626bc-1b69-4c7d-8ff2-53ca7a1de72c service neutron] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:49:33.726179 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 886/1745] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Sep 13 19:49:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 187 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 19:49:33.751665 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 860/1746] 10.222.0.25 () {58 vars in 958 bytes} [Tue Sep 13 19:49:33 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 360 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 19:49:33.756118 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4626bc-1b69-4c7d-8ff2-53ca7a1de72c service neutron] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:49:33.782322 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4626bc-1b69-4c7d-8ff2-53ca7a1de72c service neutron] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:49:33.795304 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe0e8c7-386f-4e8b-8c78-22dc104acecd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:49:33.797707 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe0e8c7-386f-4e8b-8c78-22dc104acecd admin admin] REQUEST_METHOD: `POST` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:49:33.798460 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe0e8c7-386f-4e8b-8c78-22dc104acecd admin admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:49:33.798745 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe0e8c7-386f-4e8b-8c78-22dc104acecd admin admin] PATH_INFO: `/v3/projects` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:49:33.801433 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe0e8c7-386f-4e8b-8c78-22dc104acecd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:49:33.809826 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe0e8c7-386f-4e8b-8c78-22dc104acecd admin admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:49:33.874146 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b133dbff-95e5-4f61-8c9e-fcf276f5796f None None] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:49:33.890004 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 887/1747] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Sep 13 19:49:33 2022] POST /identity/v3/projects => generated 379 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 13 19:49:33.891076 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b133dbff-95e5-4f61-8c9e-fcf276f5796f None None] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:49:34.081290 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce05374-d449-4224-93c8-414dbd8150bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:49:34.081607 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce05374-d449-4224-93c8-414dbd8150bf admin admin] REQUEST_METHOD: `POST` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:49:34.081876 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce05374-d449-4224-93c8-414dbd8150bf admin admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:49:34.082154 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce05374-d449-4224-93c8-414dbd8150bf admin admin] PATH_INFO: `/v3/users` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:49:34.085137 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce05374-d449-4224-93c8-414dbd8150bf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:49:34.091208 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce05374-d449-4224-93c8-414dbd8150bf admin admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:49:34.139179 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe0e8c7-386f-4e8b-8c78-22dc104acecd admin admin] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:49:34.150799 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe0e8c7-386f-4e8b-8c78-22dc104acecd admin admin] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:49:34.151739 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 861/1748] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Sep 13 19:49:33 2022] POST /identity/v3/users => generated 296 bytes in 268 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 19:49:34.168371 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416ed21c-69ce-4c89-8443-b92e02195e35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:49:34.169036 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416ed21c-69ce-4c89-8443-b92e02195e35 admin admin] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:49:34.169314 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416ed21c-69ce-4c89-8443-b92e02195e35 admin admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:49:34.169585 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416ed21c-69ce-4c89-8443-b92e02195e35 admin admin] PATH_INFO: `/v3/roles` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:49:34.170229 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-416ed21c-69ce-4c89-8443-b92e02195e35 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:49:34.172117 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-416ed21c-69ce-4c89-8443-b92e02195e35 admin admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:49:34.195291 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 888/1749] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Sep 13 19:49:34 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 13 19:49:34.200019 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce05374-d449-4224-93c8-414dbd8150bf admin admin] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:49:34.219422 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce05374-d449-4224-93c8-414dbd8150bf admin admin] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:49:34.232358 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519f6bb0-ee38-4ea4-a67b-b3b9adf2d948 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:49:34.233472 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519f6bb0-ee38-4ea4-a67b-b3b9adf2d948 admin admin] REQUEST_METHOD: `PUT` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:49:34.233758 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519f6bb0-ee38-4ea4-a67b-b3b9adf2d948 admin admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:49:34.234358 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519f6bb0-ee38-4ea4-a67b-b3b9adf2d948 admin admin] PATH_INFO: `/v3/projects/a4ae6047e615407d8b958beb05ffeee4/users/101f35b26be041389f6b707695aa805e/roles/6ca1d4427ff64e0a9d25d96cfb1445f6` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:49:34.279478 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519f6bb0-ee38-4ea4-a67b-b3b9adf2d948 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a4ae6047e615407d8b958beb05ffeee4, user_id=101f35b26be041389f6b707695aa805e, role_id=6ca1d4427ff64e0a9d25d96cfb1445f6)` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:49:34.281935 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519f6bb0-ee38-4ea4-a67b-b3b9adf2d948 admin admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:49:34.317804 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416ed21c-69ce-4c89-8443-b92e02195e35 admin admin] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:49:34.334322 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 862/1750] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Sep 13 19:49:34 2022] PUT /identity/v3/projects/a4ae6047e615407d8b958beb05ffeee4/users/101f35b26be041389f6b707695aa805e/roles/6ca1d4427ff64e0a9d25d96cfb1445f6 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 19:49:34.351706 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416ed21c-69ce-4c89-8443-b92e02195e35 admin admin] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:49:34.512197 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920105df-5dce-40a9-99a4-53c21d2797fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:49:34.512839 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920105df-5dce-40a9-99a4-53c21d2797fa admin admin] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:49:34.513115 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920105df-5dce-40a9-99a4-53c21d2797fa admin admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:49:34.513397 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920105df-5dce-40a9-99a4-53c21d2797fa admin admin] PATH_INFO: `/v3/roles` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:49:34.514022 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-920105df-5dce-40a9-99a4-53c21d2797fa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:49:34.521973 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-920105df-5dce-40a9-99a4-53c21d2797fa admin admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:49:34.543972 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 889/1751] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Sep 13 19:49:34 2022] GET /identity/v3/roles => generated 1420 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 19:49:34.548368 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519f6bb0-ee38-4ea4-a67b-b3b9adf2d948 admin admin] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:49:34.583740 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519f6bb0-ee38-4ea4-a67b-b3b9adf2d948 admin admin] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:49:34.598106 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9e4e15-8dc2-4807-bd74-dffe8202b9c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:49:34.602342 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9e4e15-8dc2-4807-bd74-dffe8202b9c2 admin admin] REQUEST_METHOD: `PUT` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:49:34.604068 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9e4e15-8dc2-4807-bd74-dffe8202b9c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:49:34.604068 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9e4e15-8dc2-4807-bd74-dffe8202b9c2 admin admin] PATH_INFO: `/v3/projects/a4ae6047e615407d8b958beb05ffeee4/users/101f35b26be041389f6b707695aa805e/roles/6ca1d4427ff64e0a9d25d96cfb1445f6` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:49:34.610503 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e9e4e15-8dc2-4807-bd74-dffe8202b9c2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a4ae6047e615407d8b958beb05ffeee4, user_id=101f35b26be041389f6b707695aa805e, role_id=6ca1d4427ff64e0a9d25d96cfb1445f6)` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:49:34.616925 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e9e4e15-8dc2-4807-bd74-dffe8202b9c2 admin admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:49:34.658452 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 863/1752] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Sep 13 19:49:34 2022] PUT /identity/v3/projects/a4ae6047e615407d8b958beb05ffeee4/users/101f35b26be041389f6b707695aa805e/roles/6ca1d4427ff64e0a9d25d96cfb1445f6 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 19:49:34.659030 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bf98d5-f59b-4fe5-ab0f-52bbe2f9fcc9 None None] REQUEST_METHOD: `POST` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:49:34.659321 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bf98d5-f59b-4fe5-ab0f-52bbe2f9fcc9 None None] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:49:34.660340 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bf98d5-f59b-4fe5-ab0f-52bbe2f9fcc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:49:34.726291 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.auth.core [None req-e3bf98d5-f59b-4fe5-ab0f-52bbe2f9fcc9 None None] MFA Rules not processed for user `101f35b26be041389f6b707695aa805e`. Rule list: `[]` (Enabled: `True`). {{(pid=87934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:49:34.727626 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.fernet_utils [None req-e3bf98d5-f59b-4fe5-ab0f-52bbe2f9fcc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:49:34.891923 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 890/1753] 10.222.0.25 () {58 vars in 958 bytes} [Tue Sep 13 19:49:34 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 19:49:34.899625 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3465aea3-293c-4167-94f7-df2d20adf0a0 None None] REQUEST_METHOD: `POST` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:49:34.900052 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3465aea3-293c-4167-94f7-df2d20adf0a0 None None] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:49:34.900052 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3465aea3-293c-4167-94f7-df2d20adf0a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:49:34.904287 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3bf98d5-f59b-4fe5-ab0f-52bbe2f9fcc9 None None] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:49:34.913515 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.fernet_utils [None req-e3bf98d5-f59b-4fe5-ab0f-52bbe2f9fcc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:49:34.955082 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG dbcounter [-] [87934] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:49:35.037538 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.auth.core [None req-3465aea3-293c-4167-94f7-df2d20adf0a0 None None] MFA Rules not processed for user `066fb7f5f8a548ea99de513906a49cfe`. Rule list: `[]` (Enabled: `True`). {{(pid=87935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:49:35.038774 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.fernet_utils [None req-3465aea3-293c-4167-94f7-df2d20adf0a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:49:35.052175 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3bf98d5-f59b-4fe5-ab0f-52bbe2f9fcc9 None None] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:49:35.064236 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ce8301-445c-4034-8d8f-a4193284db81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:49:35.064988 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ce8301-445c-4034-8d8f-a4193284db81 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:49:35.065312 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ce8301-445c-4034-8d8f-a4193284db81 admin admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:49:35.065585 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ce8301-445c-4034-8d8f-a4193284db81 admin admin] PATH_INFO: `/v3/projects/687c09cecc4b4813a9d454e105716828` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:49:35.072226 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ce8301-445c-4034-8d8f-a4193284db81 admin admin] RBAC: Authorizing `identity:delete_project(project_id=687c09cecc4b4813a9d454e105716828)` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:49:35.074178 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ce8301-445c-4034-8d8f-a4193284db81 admin admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:49:35.179515 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.notifications [None req-e9ce8301-445c-4034-8d8f-a4193284db81 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '687c09cecc4b4813a9d454e105716828', 'request_id': 'req-e9ce8301-445c-4034-8d8f-a4193284db81'} {{(pid=87934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:49:35.197400 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.notifications [None req-e9ce8301-445c-4034-8d8f-a4193284db81 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '687c09cecc4b4813a9d454e105716828', 'request_id': 'req-e9ce8301-445c-4034-8d8f-a4193284db81'} {{(pid=87934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:49:35.205392 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.notifications [None req-e9ce8301-445c-4034-8d8f-a4193284db81 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '687c09cecc4b4813a9d454e105716828', 'request_id': 'req-e9ce8301-445c-4034-8d8f-a4193284db81'} {{(pid=87934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:49:35.230557 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.notifications [None req-e9ce8301-445c-4034-8d8f-a4193284db81 admin admin] The token cache is being invalidate because project 687c09cecc4b4813a9d454e105716828 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87934) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 19:49:35.231673 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.notifications [None req-e9ce8301-445c-4034-8d8f-a4193284db81 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:49:35.232930 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.notifications [None req-e9ce8301-445c-4034-8d8f-a4193284db81 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:49:35.235728 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 891/1754] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Sep 13 19:49:34 2022] DELETE /identity/v3/projects/687c09cecc4b4813a9d454e105716828 => generated 0 bytes in 342 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 19:49:35.236358 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ce8301-445c-4034-8d8f-a4193284db81 admin admin] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:49:35.243318 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.fernet_utils [None req-e9ce8301-445c-4034-8d8f-a4193284db81 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:49:35.317608 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 864/1755] 10.222.0.25 () {58 vars in 958 bytes} [Tue Sep 13 19:49:34 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 429 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 19:49:35.323211 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dba3e6a-b5ff-480c-8d2f-6a9d27a68283 None None] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:49:35.323867 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dba3e6a-b5ff-480c-8d2f-6a9d27a68283 None None] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:49:35.324449 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dba3e6a-b5ff-480c-8d2f-6a9d27a68283 None None] PATH_INFO: `/` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:49:35.332124 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 865/1756] 10.222.0.25 () {54 vars in 912 bytes} [Tue Sep 13 19:49:35 2022] GET /identity => generated 270 bytes in 13 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:49:35.336929 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c48fff-a2a9-4f18-98c4-8d966717c445 None None] REQUEST_METHOD: `POST` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:49:35.337488 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c48fff-a2a9-4f18-98c4-8d966717c445 None None] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:49:35.338360 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c48fff-a2a9-4f18-98c4-8d966717c445 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:49:35.388072 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ce8301-445c-4034-8d8f-a4193284db81 admin admin] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:49:35.396950 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0eb20f6-701e-4dc3-9f37-81bc9075a380 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cbb50c88b794a7f9f26844effde7d63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a10a4268f3c4cb29f4e00c292e2df62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:49:35.397482 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.auth.core [None req-80c48fff-a2a9-4f18-98c4-8d966717c445 None None] MFA Rules not processed for user `7b0aed92d02344acb92a0e4aa67c3068`. Rule list: `[]` (Enabled: `True`). {{(pid=87935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:49:35.397608 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0eb20f6-701e-4dc3-9f37-81bc9075a380 service cinder] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:49:35.397843 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0eb20f6-701e-4dc3-9f37-81bc9075a380 service cinder] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:49:35.398113 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0eb20f6-701e-4dc3-9f37-81bc9075a380 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:49:35.400534 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.fernet_utils [None req-80c48fff-a2a9-4f18-98c4-8d966717c445 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:49:35.402144 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.fernet_utils [None req-e0eb20f6-701e-4dc3-9f37-81bc9075a380 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:49:35.426215 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG dbcounter [-] [87935] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=87935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:49:35.569796 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 866/1757] 10.222.0.25 () {58 vars in 958 bytes} [Tue Sep 13 19:49:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 19:49:35.571445 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0eb20f6-701e-4dc3-9f37-81bc9075a380 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:49:35.572964 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0eb20f6-701e-4dc3-9f37-81bc9075a380 service cinder] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:49:35.573338 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9e4890-368e-4f8e-b981-fdee453cb9b3 None None] REQUEST_METHOD: `POST` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:49:35.573783 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9e4890-368e-4f8e-b981-fdee453cb9b3 None None] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:49:35.574203 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9e4890-368e-4f8e-b981-fdee453cb9b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:49:35.594730 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG dbcounter [-] [87934] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=87934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:49:35.615661 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 892/1758] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Sep 13 19:49:35 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 380 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 19:49:35.617174 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf273c9-bfb7-4233-9779-7595d6996ddb None None] REQUEST_METHOD: `POST` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:49:35.620161 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf273c9-bfb7-4233-9779-7595d6996ddb None None] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:49:35.623274 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf273c9-bfb7-4233-9779-7595d6996ddb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:49:35.642803 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.auth.core [None req-3a9e4890-368e-4f8e-b981-fdee453cb9b3 None None] MFA Rules not processed for user `1196a96e4a404f559600b69f929ea9da`. Rule list: `[]` (Enabled: `True`). {{(pid=87935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:49:35.656455 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.fernet_utils [None req-3a9e4890-368e-4f8e-b981-fdee453cb9b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:49:35.682515 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.auth.core [None req-6bf273c9-bfb7-4233-9779-7595d6996ddb None None] MFA Rules not processed for user `7b0aed92d02344acb92a0e4aa67c3068`. Rule list: `[]` (Enabled: `True`). {{(pid=87934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:49:35.684763 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.fernet_utils [None req-6bf273c9-bfb7-4233-9779-7595d6996ddb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:49:35.718635 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 893/1759] 10.222.0.25 () {58 vars in 958 bytes} [Tue Sep 13 19:49:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 19:49:35.727632 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf273c9-bfb7-4233-9779-7595d6996ddb None None] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:49:35.734085 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.fernet_utils [None req-6bf273c9-bfb7-4233-9779-7595d6996ddb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:49:35.833707 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 867/1760] 10.222.0.25 () {58 vars in 1009 bytes} [Tue Sep 13 19:49:35 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 263 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 19:49:35.834705 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9e4890-368e-4f8e-b981-fdee453cb9b3 None None] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:49:35.858741 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9e4890-368e-4f8e-b981-fdee453cb9b3 None None] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:49:35.871239 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8fad641-d86e-4ef0-bc49-815bf5addf42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:49:35.872054 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fad641-d86e-4ef0-bc49-815bf5addf42 admin admin] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:49:35.872474 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fad641-d86e-4ef0-bc49-815bf5addf42 admin admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:49:35.872846 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fad641-d86e-4ef0-bc49-815bf5addf42 admin admin] PATH_INFO: `/v3/domains` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:49:35.874766 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8fad641-d86e-4ef0-bc49-815bf5addf42 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87935) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:49:35.875184 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8fad641-d86e-4ef0-bc49-815bf5addf42 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:49:35.880282 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8fad641-d86e-4ef0-bc49-815bf5addf42 admin admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:49:35.920720 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 868/1761] 10.222.0.25 () {58 vars in 1153 bytes} [Tue Sep 13 19:49:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:49:35.929270 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8fad641-d86e-4ef0-bc49-815bf5addf42 admin admin] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:49:35.941152 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.fernet_utils [None req-f8fad641-d86e-4ef0-bc49-815bf5addf42 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:49:35.984824 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf273c9-bfb7-4233-9779-7595d6996ddb None None] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:49:35.991076 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8fad641-d86e-4ef0-bc49-815bf5addf42 admin admin] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:49:36.007271 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0549620-eb11-40da-8081-560e7a8da475 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:49:36.008123 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba55aa8-e9e6-4f44-9cf1-03f1bcbaf07d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd71fe5a8275f4ea98555afdcefc902a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a10a4268f3c4cb29f4e00c292e2df62', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:49:36.008392 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0549620-eb11-40da-8081-560e7a8da475 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:49:36.008869 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0549620-eb11-40da-8081-560e7a8da475 admin admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:49:36.008992 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba55aa8-e9e6-4f44-9cf1-03f1bcbaf07d service nova] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:49:36.009310 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba55aa8-e9e6-4f44-9cf1-03f1bcbaf07d service nova] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:49:36.009602 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0549620-eb11-40da-8081-560e7a8da475 admin admin] PATH_INFO: `/v3/projects/08c1d246200d47f0ab375251419fbd5d` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:49:36.009715 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba55aa8-e9e6-4f44-9cf1-03f1bcbaf07d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:49:36.011685 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0549620-eb11-40da-8081-560e7a8da475 admin admin] RBAC: Authorizing `identity:delete_project(project_id=08c1d246200d47f0ab375251419fbd5d)` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:49:36.028039 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0549620-eb11-40da-8081-560e7a8da475 admin admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:49:36.161116 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba55aa8-e9e6-4f44-9cf1-03f1bcbaf07d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:49:36.163181 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba55aa8-e9e6-4f44-9cf1-03f1bcbaf07d service nova] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:49:36.225601 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 894/1762] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Sep 13 19:49:35 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 498 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 19:49:36.226487 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba55aa8-e9e6-4f44-9cf1-03f1bcbaf07d service nova] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:49:36.230936 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.fernet_utils [None req-1ba55aa8-e9e6-4f44-9cf1-03f1bcbaf07d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:49:36.270943 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.notifications [None req-c0549620-eb11-40da-8081-560e7a8da475 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '08c1d246200d47f0ab375251419fbd5d', 'request_id': 'req-c0549620-eb11-40da-8081-560e7a8da475'} {{(pid=87935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:49:36.282648 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba55aa8-e9e6-4f44-9cf1-03f1bcbaf07d service nova] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:49:36.341498 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.notifications [None req-c0549620-eb11-40da-8081-560e7a8da475 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '08c1d246200d47f0ab375251419fbd5d', 'request_id': 'req-c0549620-eb11-40da-8081-560e7a8da475'} {{(pid=87935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:49:36.358201 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.notifications [None req-c0549620-eb11-40da-8081-560e7a8da475 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '08c1d246200d47f0ab375251419fbd5d', 'request_id': 'req-c0549620-eb11-40da-8081-560e7a8da475'} {{(pid=87935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:49:36.416408 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.notifications [None req-c0549620-eb11-40da-8081-560e7a8da475 admin admin] The token cache is being invalidate because project 08c1d246200d47f0ab375251419fbd5d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87935) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 19:49:36.416740 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.notifications [None req-c0549620-eb11-40da-8081-560e7a8da475 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:49:36.422784 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.notifications [None req-c0549620-eb11-40da-8081-560e7a8da475 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:49:36.425796 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 869/1763] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Sep 13 19:49:35 2022] DELETE /identity/v3/projects/08c1d246200d47f0ab375251419fbd5d => generated 0 bytes in 497 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 19:49:36.434395 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0549620-eb11-40da-8081-560e7a8da475 admin admin] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:49:36.444614 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.fernet_utils [None req-c0549620-eb11-40da-8081-560e7a8da475 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:49:36.543030 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1a7368-dad4-442c-a86e-30e0f0fb512c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1196a96e4a404f559600b69f929ea9da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a10a4268f3c4cb29f4e00c292e2df62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:49:36.543858 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1a7368-dad4-442c-a86e-30e0f0fb512c service neutron] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:49:36.544312 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1a7368-dad4-442c-a86e-30e0f0fb512c service neutron] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:49:36.544768 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1a7368-dad4-442c-a86e-30e0f0fb512c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:49:36.563210 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.fernet_utils [None req-6b1a7368-dad4-442c-a86e-30e0f0fb512c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:49:36.617584 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b1a7368-dad4-442c-a86e-30e0f0fb512c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:49:36.619282 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b1a7368-dad4-442c-a86e-30e0f0fb512c service neutron] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:49:36.639929 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 895/1764] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Sep 13 19:49:36 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 414 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 19:49:36.657057 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1a7368-dad4-442c-a86e-30e0f0fb512c service neutron] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:49:36.658895 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.fernet_utils [None req-6b1a7368-dad4-442c-a86e-30e0f0fb512c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:49:36.761560 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG dbcounter [-] [87935] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=87935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:49:36.780731 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG dbcounter [-] [87934] Writing DB stats keystone:SELECT=100 {{(pid=87934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:49:36.844995 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0549620-eb11-40da-8081-560e7a8da475 admin admin] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:49:36.855346 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19746701-31e9-4bb7-851d-2b849616e26a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:49:36.856399 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19746701-31e9-4bb7-851d-2b849616e26a admin admin] REQUEST_METHOD: `POST` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:49:36.858956 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19746701-31e9-4bb7-851d-2b849616e26a admin admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:49:36.859649 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19746701-31e9-4bb7-851d-2b849616e26a admin admin] PATH_INFO: `/v3/projects` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:49:36.870222 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19746701-31e9-4bb7-851d-2b849616e26a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:49:36.873888 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19746701-31e9-4bb7-851d-2b849616e26a admin admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:49:36.908816 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1a7368-dad4-442c-a86e-30e0f0fb512c service neutron] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:49:36.931931 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9960ce35-c517-4877-bf49-4af057546e08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:49:36.932745 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9960ce35-c517-4877-bf49-4af057546e08 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:49:36.933032 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9960ce35-c517-4877-bf49-4af057546e08 admin admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:49:36.933313 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9960ce35-c517-4877-bf49-4af057546e08 admin admin] PATH_INFO: `/v3/users/8b1181400b7d45648b4d264b4423f024` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:49:36.940200 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9960ce35-c517-4877-bf49-4af057546e08 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8b1181400b7d45648b4d264b4423f024)` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:49:36.948525 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9960ce35-c517-4877-bf49-4af057546e08 admin admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:49:36.957256 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 870/1765] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Sep 13 19:49:36 2022] POST /identity/v3/projects => generated 365 bytes in 527 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 19:49:36.960838 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15855b2b-dfdb-4ae6-888f-669b0b034e25 None None] REQUEST_METHOD: `POST` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:49:36.961427 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15855b2b-dfdb-4ae6-888f-669b0b034e25 None None] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:49:36.962087 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15855b2b-dfdb-4ae6-888f-669b0b034e25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:49:37.081626 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.auth.core [None req-15855b2b-dfdb-4ae6-888f-669b0b034e25 None None] MFA Rules not processed for user `2658bb3ed0fd42948a1b471816e29301`. Rule list: `[]` (Enabled: `True`). {{(pid=87935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:49:37.084527 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.fernet_utils [None req-15855b2b-dfdb-4ae6-888f-669b0b034e25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:49:37.085163 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.notifications [None req-9960ce35-c517-4877-bf49-4af057546e08 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8b1181400b7d45648b4d264b4423f024'} {{(pid=87934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:49:37.086071 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.notifications [None req-9960ce35-c517-4877-bf49-4af057546e08 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8b1181400b7d45648b4d264b4423f024'} {{(pid=87934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:49:37.089356 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.notifications [None req-9960ce35-c517-4877-bf49-4af057546e08 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8b1181400b7d45648b4d264b4423f024'} {{(pid=87934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:49:37.151459 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.notifications [None req-9960ce35-c517-4877-bf49-4af057546e08 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8b1181400b7d45648b4d264b4423f024'} {{(pid=87934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:49:37.180393 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.notifications [None req-9960ce35-c517-4877-bf49-4af057546e08 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8b1181400b7d45648b4d264b4423f024'} {{(pid=87934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:49:37.235275 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 896/1766] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Sep 13 19:49:36 2022] DELETE /identity/v3/users/8b1181400b7d45648b4d264b4423f024 => generated 0 bytes in 591 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 19:49:37.239559 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9960ce35-c517-4877-bf49-4af057546e08 admin admin] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:49:37.243310 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.fernet_utils [None req-9960ce35-c517-4877-bf49-4af057546e08 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:49:37.338445 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 871/1767] 10.222.0.25 () {58 vars in 958 bytes} [Tue Sep 13 19:49:36 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 378 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 19:49:37.339434 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15855b2b-dfdb-4ae6-888f-669b0b034e25 None None] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:49:37.349595 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.fernet_utils [None req-15855b2b-dfdb-4ae6-888f-669b0b034e25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:49:37.559847 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9960ce35-c517-4877-bf49-4af057546e08 admin admin] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:49:37.565573 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15855b2b-dfdb-4ae6-888f-669b0b034e25 None None] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:49:37.588119 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-effcdbb7-d81d-46d4-b6ff-6614ed9384ae tempest-VolumeQuotaClassesTest-657523429 tempest-VolumeQuotaClassesTest-657523429-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '101f35b26be041389f6b707695aa805e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ae6047e615407d8b958beb05ffeee4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:49:37.589243 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effcdbb7-d81d-46d4-b6ff-6614ed9384ae tempest-VolumeQuotaClassesTest-657523429 tempest-VolumeQuotaClassesTest-657523429-project-admin] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:49:37.591086 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effcdbb7-d81d-46d4-b6ff-6614ed9384ae tempest-VolumeQuotaClassesTest-657523429 tempest-VolumeQuotaClassesTest-657523429-project-admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:49:37.592419 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effcdbb7-d81d-46d4-b6ff-6614ed9384ae tempest-VolumeQuotaClassesTest-657523429 tempest-VolumeQuotaClassesTest-657523429-project-admin] PATH_INFO: `/v3/domains` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:49:37.595387 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-effcdbb7-d81d-46d4-b6ff-6614ed9384ae tempest-VolumeQuotaClassesTest-657523429 tempest-VolumeQuotaClassesTest-657523429-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=87934) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:49:37.596170 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-effcdbb7-d81d-46d4-b6ff-6614ed9384ae tempest-VolumeQuotaClassesTest-657523429 tempest-VolumeQuotaClassesTest-657523429-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:49:37.605740 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-effcdbb7-d81d-46d4-b6ff-6614ed9384ae tempest-VolumeQuotaClassesTest-657523429 tempest-VolumeQuotaClassesTest-657523429-project-admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:49:37.653240 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 897/1768] 10.222.0.25 () {58 vars in 1153 bytes} [Tue Sep 13 19:49:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 417 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:49:37.654707 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8079b8-407a-4791-a518-09d0272457da None None] REQUEST_METHOD: `POST` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:49:37.654996 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8079b8-407a-4791-a518-09d0272457da None None] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:49:37.655270 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8079b8-407a-4791-a518-09d0272457da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:49:37.728834 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11947b02-0f03-4e00-9b64-8a916f7c72a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:49:37.729482 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11947b02-0f03-4e00-9b64-8a916f7c72a9 admin admin] REQUEST_METHOD: `POST` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:49:37.729750 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11947b02-0f03-4e00-9b64-8a916f7c72a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:49:37.730016 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11947b02-0f03-4e00-9b64-8a916f7c72a9 admin admin] PATH_INFO: `/v3/users` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:49:37.730658 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11947b02-0f03-4e00-9b64-8a916f7c72a9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:49:37.741192 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11947b02-0f03-4e00-9b64-8a916f7c72a9 admin admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:49:37.822603 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 872/1769] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Sep 13 19:49:37 2022] POST /identity/v3/users => generated 283 bytes in 482 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 19:49:37.824972 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.auth.core [None req-ed8079b8-407a-4791-a518-09d0272457da None None] MFA Rules not processed for user `d44977a3225e43f19cdc4a84f0e170cd`. Rule list: `[]` (Enabled: `True`). {{(pid=87934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:49:37.826535 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.fernet_utils [None req-ed8079b8-407a-4791-a518-09d0272457da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:49:37.826881 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11947b02-0f03-4e00-9b64-8a916f7c72a9 admin admin] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:49:37.841590 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG dbcounter [-] [87934] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:49:37.858273 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11947b02-0f03-4e00-9b64-8a916f7c72a9 admin admin] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:49:37.873245 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e03d28-95c3-4e6a-af45-93e1199c7034 tempest-VolumeQuotaClassesTest-657523429 tempest-VolumeQuotaClassesTest-657523429-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '101f35b26be041389f6b707695aa805e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ae6047e615407d8b958beb05ffeee4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:49:37.874195 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e03d28-95c3-4e6a-af45-93e1199c7034 tempest-VolumeQuotaClassesTest-657523429 tempest-VolumeQuotaClassesTest-657523429-project-admin] REQUEST_METHOD: `POST` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:49:37.874484 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e03d28-95c3-4e6a-af45-93e1199c7034 tempest-VolumeQuotaClassesTest-657523429 tempest-VolumeQuotaClassesTest-657523429-project-admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:49:37.874841 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e03d28-95c3-4e6a-af45-93e1199c7034 tempest-VolumeQuotaClassesTest-657523429 tempest-VolumeQuotaClassesTest-657523429-project-admin] PATH_INFO: `/v3/projects` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:49:37.875680 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e03d28-95c3-4e6a-af45-93e1199c7034 tempest-VolumeQuotaClassesTest-657523429 tempest-VolumeQuotaClassesTest-657523429-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:49:37.879031 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e03d28-95c3-4e6a-af45-93e1199c7034 tempest-VolumeQuotaClassesTest-657523429 tempest-VolumeQuotaClassesTest-657523429-project-admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:49:37.886858 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG dbcounter [-] [87935] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=87935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:49:37.912802 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 898/1770] 10.222.0.25 () {58 vars in 1009 bytes} [Tue Sep 13 19:49:37 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 259 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 19:49:37.914016 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8079b8-407a-4791-a518-09d0272457da None None] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:49:37.952419 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 873/1771] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Sep 13 19:49:37 2022] POST /identity/v3/projects => generated 354 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 19:49:37.955953 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8079b8-407a-4791-a518-09d0272457da None None] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:49:37.959452 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e03d28-95c3-4e6a-af45-93e1199c7034 tempest-VolumeQuotaClassesTest-657523429 tempest-VolumeQuotaClassesTest-657523429-project-admin] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:49:38.033503 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b537a30d-e51c-49b6-b349-ced478c25624 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:49:38.034174 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b537a30d-e51c-49b6-b349-ced478c25624 admin admin] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:49:38.034483 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b537a30d-e51c-49b6-b349-ced478c25624 admin admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:49:38.034800 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b537a30d-e51c-49b6-b349-ced478c25624 admin admin] PATH_INFO: `/v3/roles` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:49:38.035592 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b537a30d-e51c-49b6-b349-ced478c25624 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:49:38.037333 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b537a30d-e51c-49b6-b349-ced478c25624 admin admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:49:38.054917 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 899/1772] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Sep 13 19:49:37 2022] GET /identity/v3/roles => generated 1420 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 19:49:38.056118 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b537a30d-e51c-49b6-b349-ced478c25624 admin admin] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:49:38.069679 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b537a30d-e51c-49b6-b349-ced478c25624 admin admin] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:49:38.076814 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40692ef-055d-4f3c-a0ce-a7f7803e2c69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:49:38.077668 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40692ef-055d-4f3c-a0ce-a7f7803e2c69 admin admin] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:49:38.078181 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40692ef-055d-4f3c-a0ce-a7f7803e2c69 admin admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:49:38.078856 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40692ef-055d-4f3c-a0ce-a7f7803e2c69 admin admin] PATH_INFO: `/v3/roles` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:49:38.079886 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e40692ef-055d-4f3c-a0ce-a7f7803e2c69 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:49:38.082175 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e40692ef-055d-4f3c-a0ce-a7f7803e2c69 admin admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:49:38.098390 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 900/1773] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Sep 13 19:49:38 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 19:49:38.099775 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40692ef-055d-4f3c-a0ce-a7f7803e2c69 admin admin] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:49:38.111372 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40692ef-055d-4f3c-a0ce-a7f7803e2c69 admin admin] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:49:38.118568 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d074d60-4b81-4c9e-875b-edf2609de4df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:49:38.120456 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d074d60-4b81-4c9e-875b-edf2609de4df admin admin] REQUEST_METHOD: `PUT` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:49:38.121370 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d074d60-4b81-4c9e-875b-edf2609de4df admin admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:49:38.121976 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d074d60-4b81-4c9e-875b-edf2609de4df admin admin] PATH_INFO: `/v3/projects/dfb85d5bc79c432fa0f3c011f41ec481/users/3350278c3f29498b8cbf213d2951b0f2/roles/a259191f6d0e46fabd9f34536bb28747` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:49:38.139366 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e03d28-95c3-4e6a-af45-93e1199c7034 tempest-VolumeQuotaClassesTest-657523429 tempest-VolumeQuotaClassesTest-657523429-project-admin] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:49:38.148054 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d074d60-4b81-4c9e-875b-edf2609de4df admin admin] RBAC: Authorizing `identity:create_grant(project_id=dfb85d5bc79c432fa0f3c011f41ec481, user_id=3350278c3f29498b8cbf213d2951b0f2, role_id=a259191f6d0e46fabd9f34536bb28747)` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:49:38.151850 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d074d60-4b81-4c9e-875b-edf2609de4df admin admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:49:38.161738 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a617c552-8e4a-437d-9c50-259ec1d7ea37 tempest-VolumeQuotaClassesTest-657523429 tempest-VolumeQuotaClassesTest-657523429-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '101f35b26be041389f6b707695aa805e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ae6047e615407d8b958beb05ffeee4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:49:38.162708 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a617c552-8e4a-437d-9c50-259ec1d7ea37 tempest-VolumeQuotaClassesTest-657523429 tempest-VolumeQuotaClassesTest-657523429-project-admin] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:49:38.163343 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a617c552-8e4a-437d-9c50-259ec1d7ea37 tempest-VolumeQuotaClassesTest-657523429 tempest-VolumeQuotaClassesTest-657523429-project-admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:49:38.164243 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a617c552-8e4a-437d-9c50-259ec1d7ea37 tempest-VolumeQuotaClassesTest-657523429 tempest-VolumeQuotaClassesTest-657523429-project-admin] PATH_INFO: `/v3/domains` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:49:38.165487 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a617c552-8e4a-437d-9c50-259ec1d7ea37 tempest-VolumeQuotaClassesTest-657523429 tempest-VolumeQuotaClassesTest-657523429-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=87935) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:49:38.165487 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a617c552-8e4a-437d-9c50-259ec1d7ea37 tempest-VolumeQuotaClassesTest-657523429 tempest-VolumeQuotaClassesTest-657523429-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:49:38.168302 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a617c552-8e4a-437d-9c50-259ec1d7ea37 tempest-VolumeQuotaClassesTest-657523429 tempest-VolumeQuotaClassesTest-657523429-project-admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:49:38.172362 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 901/1774] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Sep 13 19:49:38 2022] PUT /identity/v3/projects/dfb85d5bc79c432fa0f3c011f41ec481/users/3350278c3f29498b8cbf213d2951b0f2/roles/a259191f6d0e46fabd9f34536bb28747 => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 19:49:38.182873 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d074d60-4b81-4c9e-875b-edf2609de4df admin admin] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:49:38.188883 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 874/1775] 10.222.0.25 () {58 vars in 1153 bytes} [Tue Sep 13 19:49:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 19:49:38.188883 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb922d95-2ebc-42ef-b6cb-bccb33677e87 None None] REQUEST_METHOD: `POST` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:49:38.188883 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb922d95-2ebc-42ef-b6cb-bccb33677e87 None None] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:49:38.188883 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb922d95-2ebc-42ef-b6cb-bccb33677e87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:49:38.205694 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.fernet_utils [None req-5d074d60-4b81-4c9e-875b-edf2609de4df admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:49:38.251934 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.auth.core [None req-eb922d95-2ebc-42ef-b6cb-bccb33677e87 None None] MFA Rules not processed for user `3350278c3f29498b8cbf213d2951b0f2`. Rule list: `[]` (Enabled: `True`). {{(pid=87935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:49:38.256090 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.fernet_utils [None req-eb922d95-2ebc-42ef-b6cb-bccb33677e87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:49:38.420130 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 875/1776] 10.222.0.25 () {58 vars in 958 bytes} [Tue Sep 13 19:49:38 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 19:49:38.423838 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb922d95-2ebc-42ef-b6cb-bccb33677e87 None None] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:49:38.453361 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG dbcounter [-] [87934] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:49:38.465328 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d074d60-4b81-4c9e-875b-edf2609de4df admin admin] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:49:38.474818 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0330610-c4c1-48a7-a747-1b3981b1603d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb42d6ac6cdd4d97a80c3ee0c6f8e3f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a10a4268f3c4cb29f4e00c292e2df62', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:49:38.475891 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0330610-c4c1-48a7-a747-1b3981b1603d service swift] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:49:38.476556 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0330610-c4c1-48a7-a747-1b3981b1603d service swift] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:49:38.477114 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0330610-c4c1-48a7-a747-1b3981b1603d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:49:38.609265 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb922d95-2ebc-42ef-b6cb-bccb33677e87 None None] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:49:38.620190 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1477144e-028a-4c3e-96c8-1188fb29f942 tempest-VolumeQuotaClassesTest-657523429 tempest-VolumeQuotaClassesTest-657523429-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '101f35b26be041389f6b707695aa805e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ae6047e615407d8b958beb05ffeee4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:49:38.621182 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1477144e-028a-4c3e-96c8-1188fb29f942 tempest-VolumeQuotaClassesTest-657523429 tempest-VolumeQuotaClassesTest-657523429-project-admin] REQUEST_METHOD: `DELETE` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:49:38.624090 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1477144e-028a-4c3e-96c8-1188fb29f942 tempest-VolumeQuotaClassesTest-657523429 tempest-VolumeQuotaClassesTest-657523429-project-admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:49:38.624427 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1477144e-028a-4c3e-96c8-1188fb29f942 tempest-VolumeQuotaClassesTest-657523429 tempest-VolumeQuotaClassesTest-657523429-project-admin] PATH_INFO: `/v3/projects/b75662584005420987a03ca74254309b` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:49:38.625436 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0330610-c4c1-48a7-a747-1b3981b1603d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:49:38.629608 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1477144e-028a-4c3e-96c8-1188fb29f942 tempest-VolumeQuotaClassesTest-657523429 tempest-VolumeQuotaClassesTest-657523429-project-admin] RBAC: Authorizing `identity:delete_project(project_id=b75662584005420987a03ca74254309b)` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:49:38.635018 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1477144e-028a-4c3e-96c8-1188fb29f942 tempest-VolumeQuotaClassesTest-657523429 tempest-VolumeQuotaClassesTest-657523429-project-admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:49:38.635561 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0330610-c4c1-48a7-a747-1b3981b1603d service swift] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:49:38.670915 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 902/1777] 10.222.0.25 () {60 vars in 1384 bytes} [Tue Sep 13 19:49:38 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 490 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 13 19:49:38.671992 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0330610-c4c1-48a7-a747-1b3981b1603d service swift] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:49:38.686646 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG dbcounter [-] [87935] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:49:38.904566 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.notifications [None req-1477144e-028a-4c3e-96c8-1188fb29f942 tempest-VolumeQuotaClassesTest-657523429 tempest-VolumeQuotaClassesTest-657523429-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b75662584005420987a03ca74254309b', 'request_id': 'req-1477144e-028a-4c3e-96c8-1188fb29f942'} {{(pid=87935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:49:38.980593 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.notifications [None req-1477144e-028a-4c3e-96c8-1188fb29f942 tempest-VolumeQuotaClassesTest-657523429 tempest-VolumeQuotaClassesTest-657523429-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b75662584005420987a03ca74254309b', 'request_id': 'req-1477144e-028a-4c3e-96c8-1188fb29f942'} {{(pid=87935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:49:39.020459 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.notifications [None req-1477144e-028a-4c3e-96c8-1188fb29f942 tempest-VolumeQuotaClassesTest-657523429 tempest-VolumeQuotaClassesTest-657523429-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b75662584005420987a03ca74254309b', 'request_id': 'req-1477144e-028a-4c3e-96c8-1188fb29f942'} {{(pid=87935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:49:39.074096 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.notifications [None req-1477144e-028a-4c3e-96c8-1188fb29f942 tempest-VolumeQuotaClassesTest-657523429 tempest-VolumeQuotaClassesTest-657523429-project-admin] The token cache is being invalidate because project b75662584005420987a03ca74254309b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87935) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 19:49:39.083538 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.notifications [None req-1477144e-028a-4c3e-96c8-1188fb29f942 tempest-VolumeQuotaClassesTest-657523429 tempest-VolumeQuotaClassesTest-657523429-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:49:39.087000 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0330610-c4c1-48a7-a747-1b3981b1603d service swift] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:49:39.087579 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.notifications [None req-1477144e-028a-4c3e-96c8-1188fb29f942 tempest-VolumeQuotaClassesTest-657523429 tempest-VolumeQuotaClassesTest-657523429-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:49:39.093764 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 876/1778] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Sep 13 19:49:38 2022] DELETE /identity/v3/projects/b75662584005420987a03ca74254309b => generated 0 bytes in 673 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 19:49:39.095055 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1477144e-028a-4c3e-96c8-1188fb29f942 tempest-VolumeQuotaClassesTest-657523429 tempest-VolumeQuotaClassesTest-657523429-project-admin] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:49:39.103496 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.fernet_utils [None req-1477144e-028a-4c3e-96c8-1188fb29f942 tempest-VolumeQuotaClassesTest-657523429 tempest-VolumeQuotaClassesTest-657523429-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:49:39.323299 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47e3296-d26f-492f-a7b0-b6afbf516416 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:49:39.325192 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47e3296-d26f-492f-a7b0-b6afbf516416 admin admin] REQUEST_METHOD: `POST` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:49:39.325580 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47e3296-d26f-492f-a7b0-b6afbf516416 admin admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:49:39.326850 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47e3296-d26f-492f-a7b0-b6afbf516416 admin admin] PATH_INFO: `/v3/projects` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:49:39.327755 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e47e3296-d26f-492f-a7b0-b6afbf516416 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:49:39.333450 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e47e3296-d26f-492f-a7b0-b6afbf516416 admin admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:49:39.436649 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 903/1779] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Sep 13 19:49:38 2022] POST /identity/v3/projects => generated 369 bytes in 765 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 19:49:39.439144 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e887ffcd-1cd1-462f-9d4b-337da9d05325 None None] REQUEST_METHOD: `POST` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:49:39.439681 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e887ffcd-1cd1-462f-9d4b-337da9d05325 None None] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:49:39.440138 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e887ffcd-1cd1-462f-9d4b-337da9d05325 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:49:39.444709 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1477144e-028a-4c3e-96c8-1188fb29f942 tempest-VolumeQuotaClassesTest-657523429 tempest-VolumeQuotaClassesTest-657523429-project-admin] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:49:39.479778 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.auth.core [None req-e887ffcd-1cd1-462f-9d4b-337da9d05325 None None] MFA Rules not processed for user `1196a96e4a404f559600b69f929ea9da`. Rule list: `[]` (Enabled: `True`). {{(pid=87934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:49:39.494741 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.fernet_utils [None req-e887ffcd-1cd1-462f-9d4b-337da9d05325 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:49:39.568598 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG dbcounter [-] [87934] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:49:39.640419 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 904/1780] 10.222.0.57 () {58 vars in 1015 bytes} [Tue Sep 13 19:49:39 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 19:49:39.642437 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e887ffcd-1cd1-462f-9d4b-337da9d05325 None None] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:49:39.646922 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.fernet_utils [None req-e887ffcd-1cd1-462f-9d4b-337da9d05325 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:49:39.721243 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70cbe1f3-bd9c-4586-a25e-ac7ff4194568 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:49:39.724458 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70cbe1f3-bd9c-4586-a25e-ac7ff4194568 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:49:39.733770 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70cbe1f3-bd9c-4586-a25e-ac7ff4194568 admin admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:49:39.734138 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70cbe1f3-bd9c-4586-a25e-ac7ff4194568 admin admin] PATH_INFO: `/v3/projects/d1028bb39f454e5ea4fb08fac358ca6b` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:49:39.736919 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70cbe1f3-bd9c-4586-a25e-ac7ff4194568 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d1028bb39f454e5ea4fb08fac358ca6b)` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:49:39.751762 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70cbe1f3-bd9c-4586-a25e-ac7ff4194568 admin admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:49:39.907055 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e887ffcd-1cd1-462f-9d4b-337da9d05325 None None] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:49:39.927505 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f0af07-f099-4e4a-b09a-6a26df22ca23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:49:39.929216 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f0af07-f099-4e4a-b09a-6a26df22ca23 admin admin] REQUEST_METHOD: `POST` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:49:39.929506 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f0af07-f099-4e4a-b09a-6a26df22ca23 admin admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:49:39.929777 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f0af07-f099-4e4a-b09a-6a26df22ca23 admin admin] PATH_INFO: `/v3/users` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:49:39.932860 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f0af07-f099-4e4a-b09a-6a26df22ca23 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:49:39.937039 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f0af07-f099-4e4a-b09a-6a26df22ca23 admin admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:49:40.012305 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 905/1781] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Sep 13 19:49:39 2022] POST /identity/v3/users => generated 291 bytes in 368 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 19:49:40.013398 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f0af07-f099-4e4a-b09a-6a26df22ca23 admin admin] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:49:40.022044 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.fernet_utils [None req-28f0af07-f099-4e4a-b09a-6a26df22ca23 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:49:40.028386 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG dbcounter [-] [87935] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=87935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:49:40.034810 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.notifications [None req-70cbe1f3-bd9c-4586-a25e-ac7ff4194568 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd1028bb39f454e5ea4fb08fac358ca6b', 'request_id': 'req-70cbe1f3-bd9c-4586-a25e-ac7ff4194568'} {{(pid=87935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:49:40.089691 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.notifications [None req-70cbe1f3-bd9c-4586-a25e-ac7ff4194568 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd1028bb39f454e5ea4fb08fac358ca6b', 'request_id': 'req-70cbe1f3-bd9c-4586-a25e-ac7ff4194568'} {{(pid=87935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:49:40.090023 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f0af07-f099-4e4a-b09a-6a26df22ca23 admin admin] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:49:40.118723 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.notifications [None req-70cbe1f3-bd9c-4586-a25e-ac7ff4194568 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd1028bb39f454e5ea4fb08fac358ca6b', 'request_id': 'req-70cbe1f3-bd9c-4586-a25e-ac7ff4194568'} {{(pid=87935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:49:40.178396 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.notifications [None req-70cbe1f3-bd9c-4586-a25e-ac7ff4194568 admin admin] The token cache is being invalidate because project d1028bb39f454e5ea4fb08fac358ca6b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87935) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 19:49:40.182840 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.notifications [None req-70cbe1f3-bd9c-4586-a25e-ac7ff4194568 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:49:40.184627 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.notifications [None req-70cbe1f3-bd9c-4586-a25e-ac7ff4194568 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:49:40.193599 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 877/1782] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Sep 13 19:49:39 2022] DELETE /identity/v3/projects/d1028bb39f454e5ea4fb08fac358ca6b => generated 0 bytes in 1098 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 19:49:40.197958 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70cbe1f3-bd9c-4586-a25e-ac7ff4194568 admin admin] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:49:40.210508 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.fernet_utils [None req-70cbe1f3-bd9c-4586-a25e-ac7ff4194568 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:49:40.392748 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70cbe1f3-bd9c-4586-a25e-ac7ff4194568 admin admin] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:49:40.399818 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a593c2-5d09-43dd-af2f-48e33a60445a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:49:40.400646 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a593c2-5d09-43dd-af2f-48e33a60445a admin admin] REQUEST_METHOD: `DELETE` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:49:40.401111 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a593c2-5d09-43dd-af2f-48e33a60445a admin admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:49:40.401497 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a593c2-5d09-43dd-af2f-48e33a60445a admin admin] PATH_INFO: `/v3/users/dbd9f343c9224a35ad433c544fe97ec2` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:49:40.402785 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a593c2-5d09-43dd-af2f-48e33a60445a admin admin] RBAC: Authorizing `identity:delete_user(user_id=dbd9f343c9224a35ad433c544fe97ec2)` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:49:40.429062 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a593c2-5d09-43dd-af2f-48e33a60445a admin admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:49:40.492903 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104a43a5-ef2c-4457-b787-adfbf16e45fd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1196a96e4a404f559600b69f929ea9da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a10a4268f3c4cb29f4e00c292e2df62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:49:40.493641 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104a43a5-ef2c-4457-b787-adfbf16e45fd service neutron] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:49:40.505363 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104a43a5-ef2c-4457-b787-adfbf16e45fd service neutron] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:49:40.506065 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104a43a5-ef2c-4457-b787-adfbf16e45fd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:49:40.534084 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.fernet_utils [None req-104a43a5-ef2c-4457-b787-adfbf16e45fd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:49:40.582956 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.notifications [None req-22a593c2-5d09-43dd-af2f-48e33a60445a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dbd9f343c9224a35ad433c544fe97ec2'} {{(pid=87935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:49:40.596925 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.notifications [None req-22a593c2-5d09-43dd-af2f-48e33a60445a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dbd9f343c9224a35ad433c544fe97ec2'} {{(pid=87935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:49:40.604248 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-104a43a5-ef2c-4457-b787-adfbf16e45fd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:49:40.613057 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-104a43a5-ef2c-4457-b787-adfbf16e45fd service neutron] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:49:40.640578 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.notifications [None req-22a593c2-5d09-43dd-af2f-48e33a60445a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dbd9f343c9224a35ad433c544fe97ec2'} {{(pid=87935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:49:40.649652 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.notifications [None req-22a593c2-5d09-43dd-af2f-48e33a60445a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dbd9f343c9224a35ad433c544fe97ec2'} {{(pid=87935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:49:40.651536 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.notifications [None req-22a593c2-5d09-43dd-af2f-48e33a60445a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dbd9f343c9224a35ad433c544fe97ec2'} {{(pid=87935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:49:40.672307 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 906/1783] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Sep 13 19:49:40 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 656 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 19:49:40.677055 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104a43a5-ef2c-4457-b787-adfbf16e45fd service neutron] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:49:40.684137 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 878/1784] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Sep 13 19:49:40 2022] DELETE /identity/v3/users/dbd9f343c9224a35ad433c544fe97ec2 => generated 0 bytes in 490 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 19:49:40.687857 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9fd40a-6cad-4025-8dc5-f4eeef3ba233 None None] REQUEST_METHOD: `POST` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:49:40.688701 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9fd40a-6cad-4025-8dc5-f4eeef3ba233 None None] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:49:40.689110 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.fernet_utils [None req-104a43a5-ef2c-4457-b787-adfbf16e45fd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:49:40.691423 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9fd40a-6cad-4025-8dc5-f4eeef3ba233 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:49:40.743320 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.auth.core [None req-0b9fd40a-6cad-4025-8dc5-f4eeef3ba233 None None] MFA Rules not processed for user `7b0aed92d02344acb92a0e4aa67c3068`. Rule list: `[]` (Enabled: `True`). {{(pid=87935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:49:40.745014 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.fernet_utils [None req-0b9fd40a-6cad-4025-8dc5-f4eeef3ba233 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:49:40.811977 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104a43a5-ef2c-4457-b787-adfbf16e45fd service neutron] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:49:41.014018 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG dbcounter [-] [87935] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=87935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:49:41.061518 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 879/1785] 10.222.0.25 () {58 vars in 958 bytes} [Tue Sep 13 19:49:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 377 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 19:49:41.068019 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eff2697-3670-4f91-8f72-6d2a2aba6b94 None None] REQUEST_METHOD: `POST` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:49:41.068797 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eff2697-3670-4f91-8f72-6d2a2aba6b94 None None] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:49:41.069857 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eff2697-3670-4f91-8f72-6d2a2aba6b94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:49:41.125718 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71384ebf-fa2d-4ca9-b195-41742080e97f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:49:41.126888 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71384ebf-fa2d-4ca9-b195-41742080e97f admin admin] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:49:41.127689 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71384ebf-fa2d-4ca9-b195-41742080e97f admin admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:49:41.131087 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71384ebf-fa2d-4ca9-b195-41742080e97f admin admin] PATH_INFO: `/v3/roles` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:49:41.136506 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.auth.core [None req-9eff2697-3670-4f91-8f72-6d2a2aba6b94 None None] MFA Rules not processed for user `7b0aed92d02344acb92a0e4aa67c3068`. Rule list: `[]` (Enabled: `True`). {{(pid=87935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:49:41.138286 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.fernet_utils [None req-9eff2697-3670-4f91-8f72-6d2a2aba6b94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:49:41.140320 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71384ebf-fa2d-4ca9-b195-41742080e97f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:49:41.142170 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71384ebf-fa2d-4ca9-b195-41742080e97f admin admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:49:41.176731 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 880/1786] 10.222.0.25 () {58 vars in 958 bytes} [Tue Sep 13 19:49:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 19:49:41.179637 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac84b9ef-2ca8-48d9-9a11-fcd3ead88d35 None None] REQUEST_METHOD: `POST` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:49:41.181479 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac84b9ef-2ca8-48d9-9a11-fcd3ead88d35 None None] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:49:41.181725 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac84b9ef-2ca8-48d9-9a11-fcd3ead88d35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:49:41.211181 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 907/1787] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Sep 13 19:49:40 2022] GET /identity/v3/roles => generated 1420 bytes in 538 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 19:49:41.214411 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71384ebf-fa2d-4ca9-b195-41742080e97f admin admin] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:49:41.225129 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.fernet_utils [None req-71384ebf-fa2d-4ca9-b195-41742080e97f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:49:41.264201 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71384ebf-fa2d-4ca9-b195-41742080e97f admin admin] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:49:41.277530 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.auth.core [None req-ac84b9ef-2ca8-48d9-9a11-fcd3ead88d35 None None] MFA Rules not processed for user `7b0aed92d02344acb92a0e4aa67c3068`. Rule list: `[]` (Enabled: `True`). {{(pid=87935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:49:41.280426 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.fernet_utils [None req-ac84b9ef-2ca8-48d9-9a11-fcd3ead88d35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:49:41.293795 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cafc434-eb08-4bf5-b7bb-9abe4c481e49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:49:41.293795 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cafc434-eb08-4bf5-b7bb-9abe4c481e49 admin admin] REQUEST_METHOD: `PUT` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:49:41.294101 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cafc434-eb08-4bf5-b7bb-9abe4c481e49 admin admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:49:41.294432 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cafc434-eb08-4bf5-b7bb-9abe4c481e49 admin admin] PATH_INFO: `/v3/projects/6fa6357edaed4524bd97f4c6da648c53/users/f6994f681b504e9b8c0f3deb359ad5e4/roles/6ca1d4427ff64e0a9d25d96cfb1445f6` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:49:41.305667 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG dbcounter [-] [87934] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:49:41.376144 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cafc434-eb08-4bf5-b7bb-9abe4c481e49 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6fa6357edaed4524bd97f4c6da648c53, user_id=f6994f681b504e9b8c0f3deb359ad5e4, role_id=6ca1d4427ff64e0a9d25d96cfb1445f6)` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:49:41.395173 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 881/1788] 10.222.0.25 () {58 vars in 958 bytes} [Tue Sep 13 19:49:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 19:49:41.399404 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cafc434-eb08-4bf5-b7bb-9abe4c481e49 admin admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:49:41.410116 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac84b9ef-2ca8-48d9-9a11-fcd3ead88d35 None None] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:49:41.416976 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.fernet_utils [None req-ac84b9ef-2ca8-48d9-9a11-fcd3ead88d35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:49:41.473714 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 908/1789] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Sep 13 19:49:41 2022] PUT /identity/v3/projects/6fa6357edaed4524bd97f4c6da648c53/users/f6994f681b504e9b8c0f3deb359ad5e4/roles/6ca1d4427ff64e0a9d25d96cfb1445f6 => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 19:49:41.482727 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cafc434-eb08-4bf5-b7bb-9abe4c481e49 admin admin] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:49:41.684889 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac84b9ef-2ca8-48d9-9a11-fcd3ead88d35 None None] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:49:41.806013 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cafc434-eb08-4bf5-b7bb-9abe4c481e49 admin admin] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:49:41.829337 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da18e95-a21b-40c9-9bfb-8b9509f5626f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:49:41.830236 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da18e95-a21b-40c9-9bfb-8b9509f5626f admin admin] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:49:41.834478 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da18e95-a21b-40c9-9bfb-8b9509f5626f admin admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:49:41.844517 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da18e95-a21b-40c9-9bfb-8b9509f5626f admin admin] PATH_INFO: `/v3/domains` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:49:41.845493 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da18e95-a21b-40c9-9bfb-8b9509f5626f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87934) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:49:41.850004 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da18e95-a21b-40c9-9bfb-8b9509f5626f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:49:41.855323 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da18e95-a21b-40c9-9bfb-8b9509f5626f admin admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:49:41.893152 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 909/1790] 10.222.0.25 () {58 vars in 1153 bytes} [Tue Sep 13 19:49:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 419 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:49:41.898070 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da18e95-a21b-40c9-9bfb-8b9509f5626f admin admin] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:49:41.926564 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da18e95-a21b-40c9-9bfb-8b9509f5626f admin admin] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:49:41.938722 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823d31fb-05fd-4be2-980b-5b9b888cd0aa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1196a96e4a404f559600b69f929ea9da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a10a4268f3c4cb29f4e00c292e2df62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:49:41.942099 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823d31fb-05fd-4be2-980b-5b9b888cd0aa service neutron] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:49:41.944837 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a69049a-453f-4c65-92f5-c6305f9a2138 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:49:41.946808 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a69049a-453f-4c65-92f5-c6305f9a2138 admin admin] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:49:41.947170 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a69049a-453f-4c65-92f5-c6305f9a2138 admin admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:49:41.947546 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a69049a-453f-4c65-92f5-c6305f9a2138 admin admin] PATH_INFO: `/v3/roles` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:49:41.948395 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a69049a-453f-4c65-92f5-c6305f9a2138 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:49:41.950211 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a69049a-453f-4c65-92f5-c6305f9a2138 admin admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:49:41.961032 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823d31fb-05fd-4be2-980b-5b9b888cd0aa service neutron] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:49:41.963259 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823d31fb-05fd-4be2-980b-5b9b888cd0aa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:49:41.971522 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 910/1791] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Sep 13 19:49:41 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 19:49:41.973764 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a69049a-453f-4c65-92f5-c6305f9a2138 admin admin] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:49:41.986908 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-823d31fb-05fd-4be2-980b-5b9b888cd0aa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:49:41.992650 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-823d31fb-05fd-4be2-980b-5b9b888cd0aa service neutron] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:49:42.009413 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a69049a-453f-4c65-92f5-c6305f9a2138 admin admin] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:49:42.022075 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 882/1792] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Sep 13 19:49:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 626 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 19:49:42.023016 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49653ff7-409f-4a17-8ea3-3cd4eca5aab5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:49:42.023633 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823d31fb-05fd-4be2-980b-5b9b888cd0aa service neutron] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:49:42.026470 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49653ff7-409f-4a17-8ea3-3cd4eca5aab5 admin admin] REQUEST_METHOD: `POST` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:49:42.027685 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49653ff7-409f-4a17-8ea3-3cd4eca5aab5 admin admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:49:42.028789 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49653ff7-409f-4a17-8ea3-3cd4eca5aab5 admin admin] PATH_INFO: `/v3/projects` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:49:42.031348 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49653ff7-409f-4a17-8ea3-3cd4eca5aab5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:49:42.043234 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49653ff7-409f-4a17-8ea3-3cd4eca5aab5 admin admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:49:42.057469 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823d31fb-05fd-4be2-980b-5b9b888cd0aa service neutron] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:49:42.081120 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5b7dea-5d05-44d5-929b-c86ce9fb2518 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:49:42.083497 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5b7dea-5d05-44d5-929b-c86ce9fb2518 admin admin] REQUEST_METHOD: `PUT` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:49:42.085440 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5b7dea-5d05-44d5-929b-c86ce9fb2518 admin admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:49:42.088991 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5b7dea-5d05-44d5-929b-c86ce9fb2518 admin admin] PATH_INFO: `/v3/projects/6fa6357edaed4524bd97f4c6da648c53/users/f6994f681b504e9b8c0f3deb359ad5e4/roles/6ca1d4427ff64e0a9d25d96cfb1445f6` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:49:42.095449 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa5b7dea-5d05-44d5-929b-c86ce9fb2518 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6fa6357edaed4524bd97f4c6da648c53, user_id=f6994f681b504e9b8c0f3deb359ad5e4, role_id=6ca1d4427ff64e0a9d25d96cfb1445f6)` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:49:42.098774 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa5b7dea-5d05-44d5-929b-c86ce9fb2518 admin admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:49:42.123960 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 883/1793] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Sep 13 19:49:42 2022] PUT /identity/v3/projects/6fa6357edaed4524bd97f4c6da648c53/users/f6994f681b504e9b8c0f3deb359ad5e4/roles/6ca1d4427ff64e0a9d25d96cfb1445f6 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 19:49:42.139148 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 911/1794] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Sep 13 19:49:41 2022] POST /identity/v3/projects => generated 365 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 19:49:42.140461 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49653ff7-409f-4a17-8ea3-3cd4eca5aab5 admin admin] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:49:42.144379 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28440511-86e8-490e-8ea2-3cfad5711001 None None] REQUEST_METHOD: `POST` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:49:42.144796 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28440511-86e8-490e-8ea2-3cfad5711001 None None] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:49:42.147639 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28440511-86e8-490e-8ea2-3cfad5711001 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:49:42.290691 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.auth.core [None req-28440511-86e8-490e-8ea2-3cfad5711001 None None] MFA Rules not processed for user `f6994f681b504e9b8c0f3deb359ad5e4`. Rule list: `[]` (Enabled: `True`). {{(pid=87935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:49:42.297009 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.fernet_utils [None req-28440511-86e8-490e-8ea2-3cfad5711001 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:49:42.429249 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49653ff7-409f-4a17-8ea3-3cd4eca5aab5 admin admin] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:49:42.446843 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997a2acb-cc5a-4608-a8dd-51afd436fa5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:49:42.448348 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997a2acb-cc5a-4608-a8dd-51afd436fa5d admin admin] REQUEST_METHOD: `POST` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:49:42.449977 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997a2acb-cc5a-4608-a8dd-51afd436fa5d admin admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:49:42.450304 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997a2acb-cc5a-4608-a8dd-51afd436fa5d admin admin] PATH_INFO: `/v3/users` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:49:42.452300 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-997a2acb-cc5a-4608-a8dd-51afd436fa5d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:49:42.499628 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-997a2acb-cc5a-4608-a8dd-51afd436fa5d admin admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:49:42.648561 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 912/1795] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Sep 13 19:49:42 2022] POST /identity/v3/users => generated 283 bytes in 508 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 19:49:42.653826 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997a2acb-cc5a-4608-a8dd-51afd436fa5d admin admin] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:49:42.724903 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997a2acb-cc5a-4608-a8dd-51afd436fa5d admin admin] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:49:42.751893 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 884/1796] 10.222.0.25 () {58 vars in 958 bytes} [Tue Sep 13 19:49:42 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 616 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 19:49:42.760804 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee58665-78af-4310-a306-736f0663b04d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:49:42.766182 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28440511-86e8-490e-8ea2-3cfad5711001 None None] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:49:42.768428 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee58665-78af-4310-a306-736f0663b04d admin admin] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:49:42.769233 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee58665-78af-4310-a306-736f0663b04d admin admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:49:42.775421 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.fernet_utils [None req-28440511-86e8-490e-8ea2-3cfad5711001 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:49:42.776632 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee58665-78af-4310-a306-736f0663b04d admin admin] PATH_INFO: `/v3/roles` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:49:42.785392 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee58665-78af-4310-a306-736f0663b04d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:49:42.788799 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee58665-78af-4310-a306-736f0663b04d admin admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:49:42.887020 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG dbcounter [-] [87935] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:49:42.899556 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 913/1797] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Sep 13 19:49:42 2022] GET /identity/v3/roles => generated 1420 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 19:49:42.903977 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee58665-78af-4310-a306-736f0663b04d admin admin] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:49:42.973900 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee58665-78af-4310-a306-736f0663b04d admin admin] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:49:43.005079 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c5fc43-516a-4b0f-868c-dc097096a8e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:49:43.005702 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c5fc43-516a-4b0f-868c-dc097096a8e3 admin admin] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:49:43.005873 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c5fc43-516a-4b0f-868c-dc097096a8e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:49:43.006111 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c5fc43-516a-4b0f-868c-dc097096a8e3 admin admin] PATH_INFO: `/v3/roles` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:49:43.006395 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28440511-86e8-490e-8ea2-3cfad5711001 None None] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:49:43.006792 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c5fc43-516a-4b0f-868c-dc097096a8e3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:49:43.018815 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c5fc43-516a-4b0f-868c-dc097096a8e3 admin admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:49:43.023576 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24a5024-a4c6-4b81-859c-e73ce6f3b491 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cbb50c88b794a7f9f26844effde7d63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a10a4268f3c4cb29f4e00c292e2df62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:49:43.026260 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24a5024-a4c6-4b81-859c-e73ce6f3b491 service cinder] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:49:43.027828 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24a5024-a4c6-4b81-859c-e73ce6f3b491 service cinder] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:49:43.028349 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24a5024-a4c6-4b81-859c-e73ce6f3b491 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:49:43.055328 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b24a5024-a4c6-4b81-859c-e73ce6f3b491 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:49:43.057210 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b24a5024-a4c6-4b81-859c-e73ce6f3b491 service cinder] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:49:43.070244 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 914/1798] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Sep 13 19:49:42 2022] GET /identity/v3/roles => generated 1420 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 19:49:43.071479 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c5fc43-516a-4b0f-868c-dc097096a8e3 admin admin] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:49:43.095231 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 885/1799] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Sep 13 19:49:42 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 19:49:43.101230 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c5fc43-516a-4b0f-868c-dc097096a8e3 admin admin] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:49:43.119242 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eca5ca6-3cfc-4e40-b224-f02ce8612604 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:49:43.121414 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eca5ca6-3cfc-4e40-b224-f02ce8612604 admin admin] REQUEST_METHOD: `PUT` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:49:43.122626 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eca5ca6-3cfc-4e40-b224-f02ce8612604 admin admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:49:43.123690 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eca5ca6-3cfc-4e40-b224-f02ce8612604 admin admin] PATH_INFO: `/v3/projects/6e35af637e864779bf6188d323d362c8/users/be6cdb1f85964f758aad7e016601b601/roles/a259191f6d0e46fabd9f34536bb28747` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:49:43.157031 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24a5024-a4c6-4b81-859c-e73ce6f3b491 service cinder] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:49:43.158679 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.fernet_utils [None req-b24a5024-a4c6-4b81-859c-e73ce6f3b491 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:49:43.166953 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG dbcounter [-] [87934] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=87934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:49:43.180561 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24a5024-a4c6-4b81-859c-e73ce6f3b491 service cinder] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:49:43.182108 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eca5ca6-3cfc-4e40-b224-f02ce8612604 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6e35af637e864779bf6188d323d362c8, user_id=be6cdb1f85964f758aad7e016601b601, role_id=a259191f6d0e46fabd9f34536bb28747)` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:49:43.193929 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eca5ca6-3cfc-4e40-b224-f02ce8612604 admin admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:49:43.203742 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e81074-4b13-46df-a131-9661461d535b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cbb50c88b794a7f9f26844effde7d63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a10a4268f3c4cb29f4e00c292e2df62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:49:43.207644 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e81074-4b13-46df-a131-9661461d535b service cinder] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:49:43.208114 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e81074-4b13-46df-a131-9661461d535b service cinder] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:49:43.208450 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e81074-4b13-46df-a131-9661461d535b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:49:43.214990 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.fernet_utils [None req-52e81074-4b13-46df-a131-9661461d535b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:49:43.221171 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 915/1800] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Sep 13 19:49:43 2022] PUT /identity/v3/projects/6e35af637e864779bf6188d323d362c8/users/be6cdb1f85964f758aad7e016601b601/roles/a259191f6d0e46fabd9f34536bb28747 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 19:49:43.239075 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2515e902-03d3-49be-8dd1-3adfad58c807 None None] REQUEST_METHOD: `POST` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:49:43.239722 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2515e902-03d3-49be-8dd1-3adfad58c807 None None] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:49:43.240199 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2515e902-03d3-49be-8dd1-3adfad58c807 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:49:43.329561 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.auth.core [None req-2515e902-03d3-49be-8dd1-3adfad58c807 None None] MFA Rules not processed for user `be6cdb1f85964f758aad7e016601b601`. Rule list: `[]` (Enabled: `True`). {{(pid=87934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:49:43.331846 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.fernet_utils [None req-2515e902-03d3-49be-8dd1-3adfad58c807 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:49:43.402695 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e81074-4b13-46df-a131-9661461d535b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:49:43.404603 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e81074-4b13-46df-a131-9661461d535b service cinder] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:49:43.432682 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 886/1801] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Sep 13 19:49:43 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 276 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 13 19:49:43.464120 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 916/1802] 10.222.0.25 () {58 vars in 958 bytes} [Tue Sep 13 19:49:43 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 19:49:43.468553 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e81074-4b13-46df-a131-9661461d535b service cinder] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:49:43.495351 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e81074-4b13-46df-a131-9661461d535b service cinder] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:49:43.645807 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf72e4f-7316-413f-899e-677e78beeb54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:49:43.648734 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf72e4f-7316-413f-899e-677e78beeb54 admin admin] REQUEST_METHOD: `POST` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:49:43.650392 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf72e4f-7316-413f-899e-677e78beeb54 admin admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:49:43.653151 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf72e4f-7316-413f-899e-677e78beeb54 admin admin] PATH_INFO: `/v3/projects` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:49:43.654911 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf72e4f-7316-413f-899e-677e78beeb54 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:49:43.662350 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf72e4f-7316-413f-899e-677e78beeb54 admin admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:49:43.759271 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 887/1803] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Sep 13 19:49:43 2022] POST /identity/v3/projects => generated 363 bytes in 281 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 13 19:49:43.760188 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2515e902-03d3-49be-8dd1-3adfad58c807 None None] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:49:43.779573 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2515e902-03d3-49be-8dd1-3adfad58c807 None None] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:49:44.033740 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989472da-d5d4-4805-b579-bc99c64c7372 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:49:44.038467 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989472da-d5d4-4805-b579-bc99c64c7372 admin admin] REQUEST_METHOD: `POST` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:49:44.042492 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989472da-d5d4-4805-b579-bc99c64c7372 admin admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:49:44.046833 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989472da-d5d4-4805-b579-bc99c64c7372 admin admin] PATH_INFO: `/v3/users` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:49:44.047855 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-989472da-d5d4-4805-b579-bc99c64c7372 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:49:44.055294 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-989472da-d5d4-4805-b579-bc99c64c7372 admin admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:49:44.169888 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf72e4f-7316-413f-899e-677e78beeb54 admin admin] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:49:44.170945 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 917/1804] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Sep 13 19:49:43 2022] POST /identity/v3/users => generated 288 bytes in 413 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 13 19:49:44.194525 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf72e4f-7316-413f-899e-677e78beeb54 admin admin] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:49:44.236517 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dab4663-453b-465b-a0a9-29b2cb1e202f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:49:44.239305 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dab4663-453b-465b-a0a9-29b2cb1e202f admin admin] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:49:44.240310 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dab4663-453b-465b-a0a9-29b2cb1e202f admin admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:49:44.240612 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dab4663-453b-465b-a0a9-29b2cb1e202f admin admin] PATH_INFO: `/v3/roles` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:49:44.243411 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dab4663-453b-465b-a0a9-29b2cb1e202f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:49:44.246438 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dab4663-453b-465b-a0a9-29b2cb1e202f admin admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:49:44.287378 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989472da-d5d4-4805-b579-bc99c64c7372 admin admin] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:49:44.288263 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 888/1805] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Sep 13 19:49:44 2022] GET /identity/v3/roles => generated 1420 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 19:49:44.301739 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989472da-d5d4-4805-b579-bc99c64c7372 admin admin] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:49:44.321313 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c5be90-0c2c-4af9-910b-8e41997268fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:49:44.322206 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c5be90-0c2c-4af9-910b-8e41997268fc admin admin] REQUEST_METHOD: `PUT` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:49:44.322883 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c5be90-0c2c-4af9-910b-8e41997268fc admin admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:49:44.323638 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c5be90-0c2c-4af9-910b-8e41997268fc admin admin] PATH_INFO: `/v3/projects/feab5de402164393ac4cbb2e3206f15c/users/adacb55e7f00473e8661982ae1760ef2/roles/6ca1d4427ff64e0a9d25d96cfb1445f6` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:49:44.389634 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c5be90-0c2c-4af9-910b-8e41997268fc admin admin] RBAC: Authorizing `identity:create_grant(project_id=feab5de402164393ac4cbb2e3206f15c, user_id=adacb55e7f00473e8661982ae1760ef2, role_id=6ca1d4427ff64e0a9d25d96cfb1445f6)` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:49:44.392639 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c5be90-0c2c-4af9-910b-8e41997268fc admin admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:49:44.438489 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dab4663-453b-465b-a0a9-29b2cb1e202f admin admin] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:49:44.444706 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 918/1806] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Sep 13 19:49:44 2022] PUT /identity/v3/projects/feab5de402164393ac4cbb2e3206f15c/users/adacb55e7f00473e8661982ae1760ef2/roles/6ca1d4427ff64e0a9d25d96cfb1445f6 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 19:49:44.454771 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dab4663-453b-465b-a0a9-29b2cb1e202f admin admin] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:49:44.506598 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG dbcounter [-] [87935] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:49:44.531489 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c5be90-0c2c-4af9-910b-8e41997268fc admin admin] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:49:44.533633 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.fernet_utils [None req-b0c5be90-0c2c-4af9-910b-8e41997268fc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:49:44.661810 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be5b7e8-2e05-42da-a19c-0eb04365c1d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:49:44.663039 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be5b7e8-2e05-42da-a19c-0eb04365c1d0 admin admin] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:49:44.663599 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be5b7e8-2e05-42da-a19c-0eb04365c1d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:49:44.664445 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be5b7e8-2e05-42da-a19c-0eb04365c1d0 admin admin] PATH_INFO: `/v3/roles` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:49:44.666203 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be5b7e8-2e05-42da-a19c-0eb04365c1d0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:49:44.684093 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be5b7e8-2e05-42da-a19c-0eb04365c1d0 admin admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:49:44.722641 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG dbcounter [-] [87934] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=87934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:49:44.762899 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 889/1807] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Sep 13 19:49:44 2022] GET /identity/v3/roles => generated 1420 bytes in 323 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 19:49:44.764743 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be5b7e8-2e05-42da-a19c-0eb04365c1d0 admin admin] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:49:44.768009 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c5be90-0c2c-4af9-910b-8e41997268fc admin admin] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:49:44.780105 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be5b7e8-2e05-42da-a19c-0eb04365c1d0 admin admin] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:49:44.786693 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd41cc4-5872-4702-910a-bd7f87773107 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:49:44.787534 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd41cc4-5872-4702-910a-bd7f87773107 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:49:44.787812 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd41cc4-5872-4702-910a-bd7f87773107 admin admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:49:44.788081 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd41cc4-5872-4702-910a-bd7f87773107 admin admin] PATH_INFO: `/v3/projects/5c9644d2387f4df38a242d606cd0b296` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:49:44.788789 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99845bd-9b27-481a-95dc-dc78fb175dde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:49:44.789740 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99845bd-9b27-481a-95dc-dc78fb175dde admin admin] REQUEST_METHOD: `PUT` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:49:44.789964 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99845bd-9b27-481a-95dc-dc78fb175dde admin admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:49:44.790211 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99845bd-9b27-481a-95dc-dc78fb175dde admin admin] PATH_INFO: `/v3/projects/feab5de402164393ac4cbb2e3206f15c/users/adacb55e7f00473e8661982ae1760ef2/roles/6ca1d4427ff64e0a9d25d96cfb1445f6` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:49:44.792192 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd41cc4-5872-4702-910a-bd7f87773107 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5c9644d2387f4df38a242d606cd0b296)` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:49:44.792548 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c99845bd-9b27-481a-95dc-dc78fb175dde admin admin] RBAC: Authorizing `identity:create_grant(project_id=feab5de402164393ac4cbb2e3206f15c, user_id=adacb55e7f00473e8661982ae1760ef2, role_id=6ca1d4427ff64e0a9d25d96cfb1445f6)` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:49:44.794288 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd41cc4-5872-4702-910a-bd7f87773107 admin admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:49:44.795552 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c99845bd-9b27-481a-95dc-dc78fb175dde admin admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:49:44.842900 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 890/1808] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Sep 13 19:49:44 2022] PUT /identity/v3/projects/feab5de402164393ac4cbb2e3206f15c/users/adacb55e7f00473e8661982ae1760ef2/roles/6ca1d4427ff64e0a9d25d96cfb1445f6 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 19:49:44.847605 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d900574-6ace-4953-91fc-6811726d9df8 None None] REQUEST_METHOD: `POST` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:49:44.847996 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d900574-6ace-4953-91fc-6811726d9df8 None None] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:49:44.848302 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d900574-6ace-4953-91fc-6811726d9df8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:49:44.939088 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.notifications [None req-1cd41cc4-5872-4702-910a-bd7f87773107 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5c9644d2387f4df38a242d606cd0b296', 'request_id': 'req-1cd41cc4-5872-4702-910a-bd7f87773107'} {{(pid=87934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:49:44.950325 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.notifications [None req-1cd41cc4-5872-4702-910a-bd7f87773107 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5c9644d2387f4df38a242d606cd0b296', 'request_id': 'req-1cd41cc4-5872-4702-910a-bd7f87773107'} {{(pid=87934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:49:44.966824 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.auth.core [None req-1d900574-6ace-4953-91fc-6811726d9df8 None None] MFA Rules not processed for user `adacb55e7f00473e8661982ae1760ef2`. Rule list: `[]` (Enabled: `True`). {{(pid=87935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:49:44.971520 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.fernet_utils [None req-1d900574-6ace-4953-91fc-6811726d9df8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:49:44.977256 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.notifications [None req-1cd41cc4-5872-4702-910a-bd7f87773107 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5c9644d2387f4df38a242d606cd0b296', 'request_id': 'req-1cd41cc4-5872-4702-910a-bd7f87773107'} {{(pid=87934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:49:44.999144 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.notifications [None req-1cd41cc4-5872-4702-910a-bd7f87773107 admin admin] The token cache is being invalidate because project 5c9644d2387f4df38a242d606cd0b296 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87934) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 19:49:45.000034 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.notifications [None req-1cd41cc4-5872-4702-910a-bd7f87773107 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:49:45.001533 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.notifications [None req-1cd41cc4-5872-4702-910a-bd7f87773107 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:49:45.006626 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 919/1809] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Sep 13 19:49:44 2022] DELETE /identity/v3/projects/5c9644d2387f4df38a242d606cd0b296 => generated 0 bytes in 476 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 19:49:45.011070 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd41cc4-5872-4702-910a-bd7f87773107 admin admin] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:49:45.013113 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.fernet_utils [None req-1cd41cc4-5872-4702-910a-bd7f87773107 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:49:45.207487 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd41cc4-5872-4702-910a-bd7f87773107 admin admin] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:49:45.221570 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e622b1b8-93f2-4049-a5ee-3a391da7385a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:49:45.223933 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e622b1b8-93f2-4049-a5ee-3a391da7385a admin admin] REQUEST_METHOD: `DELETE` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:49:45.225395 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e622b1b8-93f2-4049-a5ee-3a391da7385a admin admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:49:45.226503 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e622b1b8-93f2-4049-a5ee-3a391da7385a admin admin] PATH_INFO: `/v3/users/101f35b26be041389f6b707695aa805e` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:49:45.228730 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e622b1b8-93f2-4049-a5ee-3a391da7385a admin admin] RBAC: Authorizing `identity:delete_user(user_id=101f35b26be041389f6b707695aa805e)` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:49:45.236687 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e622b1b8-93f2-4049-a5ee-3a391da7385a admin admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:49:45.255589 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 891/1810] 10.222.0.25 () {58 vars in 958 bytes} [Tue Sep 13 19:49:44 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 412 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 19:49:45.271195 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d900574-6ace-4953-91fc-6811726d9df8 None None] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:49:45.277107 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.fernet_utils [None req-1d900574-6ace-4953-91fc-6811726d9df8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:49:45.414783 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.notifications [None req-e622b1b8-93f2-4049-a5ee-3a391da7385a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '101f35b26be041389f6b707695aa805e'} {{(pid=87934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:49:45.415604 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.notifications [None req-e622b1b8-93f2-4049-a5ee-3a391da7385a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '101f35b26be041389f6b707695aa805e'} {{(pid=87934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:49:45.416476 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.notifications [None req-e622b1b8-93f2-4049-a5ee-3a391da7385a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '101f35b26be041389f6b707695aa805e'} {{(pid=87934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:49:45.437466 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.notifications [None req-e622b1b8-93f2-4049-a5ee-3a391da7385a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '101f35b26be041389f6b707695aa805e'} {{(pid=87934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:49:45.459566 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d900574-6ace-4953-91fc-6811726d9df8 None None] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:49:45.469837 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f6cf95-a872-463e-af1b-3c814e203382 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cbb50c88b794a7f9f26844effde7d63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a10a4268f3c4cb29f4e00c292e2df62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:49:45.472956 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f6cf95-a872-463e-af1b-3c814e203382 service cinder] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:49:45.476240 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f6cf95-a872-463e-af1b-3c814e203382 service cinder] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:49:45.476418 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.notifications [None req-e622b1b8-93f2-4049-a5ee-3a391da7385a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '101f35b26be041389f6b707695aa805e'} {{(pid=87934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:49:45.476946 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f6cf95-a872-463e-af1b-3c814e203382 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:49:45.479736 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG dbcounter [-] [87934] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=87934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:49:45.482061 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.fernet_utils [None req-87f6cf95-a872-463e-af1b-3c814e203382 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:49:45.501831 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 920/1811] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Sep 13 19:49:45 2022] DELETE /identity/v3/users/101f35b26be041389f6b707695aa805e => generated 0 bytes in 491 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 19:49:45.504405 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab4a745-70ce-4665-b2d2-849e4e69c837 None None] REQUEST_METHOD: `POST` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:49:45.504694 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab4a745-70ce-4665-b2d2-849e4e69c837 None None] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:49:45.504967 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab4a745-70ce-4665-b2d2-849e4e69c837 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:49:45.513499 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f6cf95-a872-463e-af1b-3c814e203382 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:49:45.515450 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f6cf95-a872-463e-af1b-3c814e203382 service cinder] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:49:45.540062 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 892/1812] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Sep 13 19:49:45 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 269 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 19:49:45.601155 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.auth.core [None req-6ab4a745-70ce-4665-b2d2-849e4e69c837 None None] MFA Rules not processed for user `066fb7f5f8a548ea99de513906a49cfe`. Rule list: `[]` (Enabled: `True`). {{(pid=87934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:49:45.610242 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.fernet_utils [None req-6ab4a745-70ce-4665-b2d2-849e4e69c837 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:49:45.873168 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f6cf95-a872-463e-af1b-3c814e203382 service cinder] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:49:45.874553 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.fernet_utils [None req-87f6cf95-a872-463e-af1b-3c814e203382 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:49:45.888608 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f6cf95-a872-463e-af1b-3c814e203382 service cinder] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:49:45.894493 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 921/1813] 10.222.0.25 () {58 vars in 958 bytes} [Tue Sep 13 19:49:45 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 391 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 19:49:46.044625 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG dbcounter [-] [87935] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:49:46.071075 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79a6a0b-b546-49b0-9d21-52919b69ef27 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cbb50c88b794a7f9f26844effde7d63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a10a4268f3c4cb29f4e00c292e2df62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:49:46.071945 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79a6a0b-b546-49b0-9d21-52919b69ef27 service cinder] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:49:46.072414 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79a6a0b-b546-49b0-9d21-52919b69ef27 service cinder] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:49:46.072783 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79a6a0b-b546-49b0-9d21-52919b69ef27 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:49:46.074834 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.fernet_utils [None req-f79a6a0b-b546-49b0-9d21-52919b69ef27 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:49:46.222363 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f79a6a0b-b546-49b0-9d21-52919b69ef27 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:49:46.226965 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f79a6a0b-b546-49b0-9d21-52919b69ef27 service cinder] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:49:46.273776 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 893/1814] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Sep 13 19:49:45 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 401 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 13 19:49:47.096832 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b341c1-bf57-4cad-b569-f13189062121 None None] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:49:47.097964 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b341c1-bf57-4cad-b569-f13189062121 None None] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:49:47.097964 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b341c1-bf57-4cad-b569-f13189062121 None None] PATH_INFO: `/` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:49:47.105455 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 922/1815] 10.222.0.25 () {54 vars in 921 bytes} [Tue Sep 13 19:49:47 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:49:47.394862 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc446d24-295f-4917-b74b-92f0a80794b8 None None] REQUEST_METHOD: `POST` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:49:47.395792 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc446d24-295f-4917-b74b-92f0a80794b8 None None] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:49:47.396247 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc446d24-295f-4917-b74b-92f0a80794b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:49:47.442945 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.auth.core [None req-cc446d24-295f-4917-b74b-92f0a80794b8 None None] MFA Rules not processed for user `d71fe5a8275f4ea98555afdcefc902a0`. Rule list: `[]` (Enabled: `True`). {{(pid=87935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:49:47.444838 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.fernet_utils [None req-cc446d24-295f-4917-b74b-92f0a80794b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:49:47.713073 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 894/1816] 10.222.0.25 () {58 vars in 1018 bytes} [Tue Sep 13 19:49:47 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 320 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 19:49:48.040844 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b341c1-bf57-4cad-b569-f13189062121 None None] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:49:48.043527 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.fernet_utils [None req-a7b341c1-bf57-4cad-b569-f13189062121 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:49:48.417349 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b341c1-bf57-4cad-b569-f13189062121 None None] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:49:48.481781 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbedefd3-ffb6-4024-9b41-5c1266a0e3f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:49:48.485450 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbedefd3-ffb6-4024-9b41-5c1266a0e3f2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:49:48.489076 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbedefd3-ffb6-4024-9b41-5c1266a0e3f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:49:48.491138 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbedefd3-ffb6-4024-9b41-5c1266a0e3f2 admin admin] PATH_INFO: `/v3/projects/a4ae6047e615407d8b958beb05ffeee4` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:49:48.498795 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbedefd3-ffb6-4024-9b41-5c1266a0e3f2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a4ae6047e615407d8b958beb05ffeee4)` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:49:48.505487 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbedefd3-ffb6-4024-9b41-5c1266a0e3f2 admin admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:49:48.672309 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.notifications [None req-cbedefd3-ffb6-4024-9b41-5c1266a0e3f2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a4ae6047e615407d8b958beb05ffeee4', 'request_id': 'req-cbedefd3-ffb6-4024-9b41-5c1266a0e3f2'} {{(pid=87934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:49:48.698187 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.notifications [None req-cbedefd3-ffb6-4024-9b41-5c1266a0e3f2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a4ae6047e615407d8b958beb05ffeee4', 'request_id': 'req-cbedefd3-ffb6-4024-9b41-5c1266a0e3f2'} {{(pid=87934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:49:48.717844 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.notifications [None req-cbedefd3-ffb6-4024-9b41-5c1266a0e3f2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a4ae6047e615407d8b958beb05ffeee4', 'request_id': 'req-cbedefd3-ffb6-4024-9b41-5c1266a0e3f2'} {{(pid=87934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:49:48.748595 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.notifications [None req-cbedefd3-ffb6-4024-9b41-5c1266a0e3f2 admin admin] The token cache is being invalidate because project a4ae6047e615407d8b958beb05ffeee4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87934) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 19:49:48.749174 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.notifications [None req-cbedefd3-ffb6-4024-9b41-5c1266a0e3f2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:49:48.750791 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.notifications [None req-cbedefd3-ffb6-4024-9b41-5c1266a0e3f2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:49:48.760825 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 923/1817] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Sep 13 19:49:48 2022] DELETE /identity/v3/projects/a4ae6047e615407d8b958beb05ffeee4 => generated 0 bytes in 717 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 19:49:48.762738 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1dc963-8fe9-4311-90ad-3753f4e1e8aa None None] REQUEST_METHOD: `POST` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:49:48.763238 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1dc963-8fe9-4311-90ad-3753f4e1e8aa None None] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:49:48.763313 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1dc963-8fe9-4311-90ad-3753f4e1e8aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:49:48.814888 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbedefd3-ffb6-4024-9b41-5c1266a0e3f2 admin admin] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:49:48.817666 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.fernet_utils [None req-cbedefd3-ffb6-4024-9b41-5c1266a0e3f2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:49:48.851673 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.auth.core [None req-1d1dc963-8fe9-4311-90ad-3753f4e1e8aa None None] MFA Rules not processed for user `7b0aed92d02344acb92a0e4aa67c3068`. Rule list: `[]` (Enabled: `True`). {{(pid=87935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:49:48.853475 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.fernet_utils [None req-1d1dc963-8fe9-4311-90ad-3753f4e1e8aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:49:48.954387 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG dbcounter [-] [87934] Writing DB stats keystone:DELETE=8,keystone:SELECT=91,keystone:INSERT=1 {{(pid=87934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:49:49.132465 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 895/1818] 10.222.0.25 () {58 vars in 958 bytes} [Tue Sep 13 19:49:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 371 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 19:49:49.141733 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268c525d-070e-4da0-a2c4-d6b20f4ac705 None None] REQUEST_METHOD: `POST` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:49:49.142330 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268c525d-070e-4da0-a2c4-d6b20f4ac705 None None] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:49:49.142817 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268c525d-070e-4da0-a2c4-d6b20f4ac705 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:49:49.147466 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbedefd3-ffb6-4024-9b41-5c1266a0e3f2 admin admin] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:49:49.168032 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677b2d1f-4f61-4001-ab6e-0b028abb0304 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd71fe5a8275f4ea98555afdcefc902a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a10a4268f3c4cb29f4e00c292e2df62', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:49:49.170765 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677b2d1f-4f61-4001-ab6e-0b028abb0304 service nova] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:49:49.171469 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677b2d1f-4f61-4001-ab6e-0b028abb0304 service nova] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:49:49.173021 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677b2d1f-4f61-4001-ab6e-0b028abb0304 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:49:49.179079 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.fernet_utils [None req-677b2d1f-4f61-4001-ab6e-0b028abb0304 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:49:49.200064 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.auth.core [None req-268c525d-070e-4da0-a2c4-d6b20f4ac705 None None] MFA Rules not processed for user `7b0aed92d02344acb92a0e4aa67c3068`. Rule list: `[]` (Enabled: `True`). {{(pid=87935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:49:49.201475 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.fernet_utils [None req-268c525d-070e-4da0-a2c4-d6b20f4ac705 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:49:49.231077 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 896/1819] 10.222.0.25 () {58 vars in 958 bytes} [Tue Sep 13 19:49:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 19:49:49.232535 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268c525d-070e-4da0-a2c4-d6b20f4ac705 None None] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:49:49.240570 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-677b2d1f-4f61-4001-ab6e-0b028abb0304 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:49:49.242522 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-677b2d1f-4f61-4001-ab6e-0b028abb0304 service nova] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:49:49.258415 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268c525d-070e-4da0-a2c4-d6b20f4ac705 None None] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:49:49.264507 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f3f945-6504-4fc6-b55c-5881f6b8dfc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:49:49.265641 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f3f945-6504-4fc6-b55c-5881f6b8dfc1 admin admin] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:49:49.265822 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f3f945-6504-4fc6-b55c-5881f6b8dfc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:49:49.266188 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f3f945-6504-4fc6-b55c-5881f6b8dfc1 admin admin] PATH_INFO: `/v3/domains` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:49:49.267324 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f3f945-6504-4fc6-b55c-5881f6b8dfc1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87935) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:49:49.267718 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f3f945-6504-4fc6-b55c-5881f6b8dfc1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:49:49.270334 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f3f945-6504-4fc6-b55c-5881f6b8dfc1 admin admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:49:49.282796 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 924/1820] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Sep 13 19:49:48 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 468 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 13 19:49:49.286625 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 897/1821] 10.222.0.25 () {58 vars in 1153 bytes} [Tue Sep 13 19:49:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:49:49.291798 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677b2d1f-4f61-4001-ab6e-0b028abb0304 service nova] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:49:49.335825 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677b2d1f-4f61-4001-ab6e-0b028abb0304 service nova] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:49:49.371074 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57bc707b-610c-4689-99d8-9af7510936cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:49:49.371074 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bc707b-610c-4689-99d8-9af7510936cd admin admin] REQUEST_METHOD: `POST` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:49:49.371074 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bc707b-610c-4689-99d8-9af7510936cd admin admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:49:49.371074 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bc707b-610c-4689-99d8-9af7510936cd admin admin] PATH_INFO: `/v3/projects` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:49:49.373438 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57bc707b-610c-4689-99d8-9af7510936cd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:49:49.383764 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57bc707b-610c-4689-99d8-9af7510936cd admin admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:49:49.485765 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 925/1822] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Sep 13 19:49:49 2022] POST /identity/v3/projects => generated 383 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 19:49:49.488278 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f3f945-6504-4fc6-b55c-5881f6b8dfc1 admin admin] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:49:49.514359 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f3f945-6504-4fc6-b55c-5881f6b8dfc1 admin admin] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:49:49.526928 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG dbcounter [-] [87935] Writing DB stats keystone:SELECT=100 {{(pid=87935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:49:49.829406 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22a577a-73ce-4e8f-ae67-9827b5d1ceb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:49:49.831649 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22a577a-73ce-4e8f-ae67-9827b5d1ceb6 admin admin] REQUEST_METHOD: `POST` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:49:49.833347 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22a577a-73ce-4e8f-ae67-9827b5d1ceb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:49:49.834476 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22a577a-73ce-4e8f-ae67-9827b5d1ceb6 admin admin] PATH_INFO: `/v3/users` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:49:49.835297 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f22a577a-73ce-4e8f-ae67-9827b5d1ceb6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:49:49.842222 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f22a577a-73ce-4e8f-ae67-9827b5d1ceb6 admin admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:49:49.892391 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 898/1823] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Sep 13 19:49:49 2022] POST /identity/v3/users => generated 292 bytes in 409 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 19:49:49.894950 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57bc707b-610c-4689-99d8-9af7510936cd admin admin] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:49:49.916581 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57bc707b-610c-4689-99d8-9af7510936cd admin admin] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:49:49.937656 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8b5154-f50c-4805-aa3b-27c8e2ce649f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:49:49.942450 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8b5154-f50c-4805-aa3b-27c8e2ce649f admin admin] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:49:49.943348 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8b5154-f50c-4805-aa3b-27c8e2ce649f admin admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:49:49.944993 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8b5154-f50c-4805-aa3b-27c8e2ce649f admin admin] PATH_INFO: `/v3/roles` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:49:49.947608 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f8b5154-f50c-4805-aa3b-27c8e2ce649f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:49:49.955750 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f8b5154-f50c-4805-aa3b-27c8e2ce649f admin admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:49:50.020337 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 926/1824] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Sep 13 19:49:49 2022] GET /identity/v3/roles => generated 1420 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 19:49:50.022576 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22a577a-73ce-4e8f-ae67-9827b5d1ceb6 admin admin] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:49:50.037603 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22a577a-73ce-4e8f-ae67-9827b5d1ceb6 admin admin] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:49:50.065251 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7da5c89-6fda-4384-80e7-a12a13e660fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:49:50.066062 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7da5c89-6fda-4384-80e7-a12a13e660fd admin admin] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:49:50.066446 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7da5c89-6fda-4384-80e7-a12a13e660fd admin admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:49:50.066886 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7da5c89-6fda-4384-80e7-a12a13e660fd admin admin] PATH_INFO: `/v3/roles` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:49:50.072969 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7da5c89-6fda-4384-80e7-a12a13e660fd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:49:50.077880 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7da5c89-6fda-4384-80e7-a12a13e660fd admin admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:49:50.122872 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 899/1825] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Sep 13 19:49:50 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 19:49:50.127415 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8b5154-f50c-4805-aa3b-27c8e2ce649f admin admin] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:49:50.146302 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8b5154-f50c-4805-aa3b-27c8e2ce649f admin admin] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:49:50.177086 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34464c2b-76c9-4004-9d13-e6c21f3312f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:49:50.178711 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34464c2b-76c9-4004-9d13-e6c21f3312f0 admin admin] REQUEST_METHOD: `PUT` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:49:50.180967 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34464c2b-76c9-4004-9d13-e6c21f3312f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:49:50.182197 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34464c2b-76c9-4004-9d13-e6c21f3312f0 admin admin] PATH_INFO: `/v3/projects/1147d3b2ef354d41a5081972dcb1fb2c/users/e35f25a2d44a4e1497346f1cc09bce89/roles/a259191f6d0e46fabd9f34536bb28747` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:49:50.212190 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7da5c89-6fda-4384-80e7-a12a13e660fd admin admin] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:49:50.214239 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.fernet_utils [None req-e7da5c89-6fda-4384-80e7-a12a13e660fd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:49:50.236847 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34464c2b-76c9-4004-9d13-e6c21f3312f0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1147d3b2ef354d41a5081972dcb1fb2c, user_id=e35f25a2d44a4e1497346f1cc09bce89, role_id=a259191f6d0e46fabd9f34536bb28747)` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:49:50.243265 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7da5c89-6fda-4384-80e7-a12a13e660fd admin admin] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:49:50.249986 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34464c2b-76c9-4004-9d13-e6c21f3312f0 admin admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:49:50.256743 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec939cc-94bf-4b12-9c8c-509ea78c6470 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:49:50.259044 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec939cc-94bf-4b12-9c8c-509ea78c6470 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:49:50.259445 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec939cc-94bf-4b12-9c8c-509ea78c6470 admin admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:49:50.260566 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec939cc-94bf-4b12-9c8c-509ea78c6470 admin admin] PATH_INFO: `/v3/users/3350278c3f29498b8cbf213d2951b0f2` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:49:50.265600 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec939cc-94bf-4b12-9c8c-509ea78c6470 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3350278c3f29498b8cbf213d2951b0f2)` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:49:50.270605 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec939cc-94bf-4b12-9c8c-509ea78c6470 admin admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:49:50.335092 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 927/1826] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Sep 13 19:49:50 2022] PUT /identity/v3/projects/1147d3b2ef354d41a5081972dcb1fb2c/users/e35f25a2d44a4e1497346f1cc09bce89/roles/a259191f6d0e46fabd9f34536bb28747 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 19:49:50.350292 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be4463e-9162-44e1-80b9-8616d2b3c611 None None] REQUEST_METHOD: `POST` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:49:50.351326 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be4463e-9162-44e1-80b9-8616d2b3c611 None None] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:49:50.351819 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be4463e-9162-44e1-80b9-8616d2b3c611 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:49:50.461350 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.auth.core [None req-3be4463e-9162-44e1-80b9-8616d2b3c611 None None] MFA Rules not processed for user `e35f25a2d44a4e1497346f1cc09bce89`. Rule list: `[]` (Enabled: `True`). {{(pid=87934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:49:50.462650 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.fernet_utils [None req-3be4463e-9162-44e1-80b9-8616d2b3c611 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:49:50.467575 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.notifications [None req-bec939cc-94bf-4b12-9c8c-509ea78c6470 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3350278c3f29498b8cbf213d2951b0f2'} {{(pid=87935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:49:50.512139 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.notifications [None req-bec939cc-94bf-4b12-9c8c-509ea78c6470 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3350278c3f29498b8cbf213d2951b0f2'} {{(pid=87935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:49:50.591167 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.notifications [None req-bec939cc-94bf-4b12-9c8c-509ea78c6470 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3350278c3f29498b8cbf213d2951b0f2'} {{(pid=87935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:49:50.595931 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.notifications [None req-bec939cc-94bf-4b12-9c8c-509ea78c6470 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3350278c3f29498b8cbf213d2951b0f2'} {{(pid=87935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:49:50.600513 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.notifications [None req-bec939cc-94bf-4b12-9c8c-509ea78c6470 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3350278c3f29498b8cbf213d2951b0f2'} {{(pid=87935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:49:50.675427 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 900/1827] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Sep 13 19:49:50 2022] DELETE /identity/v3/users/3350278c3f29498b8cbf213d2951b0f2 => generated 0 bytes in 464 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 19:49:50.680279 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26154a1-b60d-4f82-9de8-f6479b0caf3a None None] REQUEST_METHOD: `POST` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:49:50.680602 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26154a1-b60d-4f82-9de8-f6479b0caf3a None None] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:49:50.680935 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26154a1-b60d-4f82-9de8-f6479b0caf3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:49:50.715009 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 928/1828] 10.222.0.25 () {58 vars in 958 bytes} [Tue Sep 13 19:49:50 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 365 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 19:49:50.717006 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be4463e-9162-44e1-80b9-8616d2b3c611 None None] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:49:50.721163 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.fernet_utils [None req-3be4463e-9162-44e1-80b9-8616d2b3c611 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:49:50.770507 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.auth.core [None req-a26154a1-b60d-4f82-9de8-f6479b0caf3a None None] MFA Rules not processed for user `7b0aed92d02344acb92a0e4aa67c3068`. Rule list: `[]` (Enabled: `True`). {{(pid=87935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:49:50.775770 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.fernet_utils [None req-a26154a1-b60d-4f82-9de8-f6479b0caf3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:49:50.942489 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG dbcounter [-] [87934] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=87934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:49:51.001028 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be4463e-9162-44e1-80b9-8616d2b3c611 None None] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:49:51.093151 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG dbcounter [-] [87935] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=87935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:49:51.145024 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 901/1829] 10.222.0.25 () {58 vars in 958 bytes} [Tue Sep 13 19:49:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 466 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 19:49:51.145976 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26154a1-b60d-4f82-9de8-f6479b0caf3a None None] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:49:51.151457 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.fernet_utils [None req-a26154a1-b60d-4f82-9de8-f6479b0caf3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:49:51.193364 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26154a1-b60d-4f82-9de8-f6479b0caf3a None None] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:49:51.218180 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732c5247-5e39-49bb-b949-22d8e313bd41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:49:51.218852 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732c5247-5e39-49bb-b949-22d8e313bd41 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:49:51.219135 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732c5247-5e39-49bb-b949-22d8e313bd41 admin admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:49:51.219410 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732c5247-5e39-49bb-b949-22d8e313bd41 admin admin] PATH_INFO: `/v3/users/0aac5ce25cc84f21ae031e82da24c5d8` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:49:51.220320 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ec0933-67e4-4044-a1eb-477b1820c626 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:49:51.221121 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ec0933-67e4-4044-a1eb-477b1820c626 admin admin] REQUEST_METHOD: `POST` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:49:51.221351 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ec0933-67e4-4044-a1eb-477b1820c626 admin admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:49:51.222150 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ec0933-67e4-4044-a1eb-477b1820c626 admin admin] PATH_INFO: `/v3/projects` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:49:51.223555 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-732c5247-5e39-49bb-b949-22d8e313bd41 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0aac5ce25cc84f21ae031e82da24c5d8)` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:49:51.229160 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-732c5247-5e39-49bb-b949-22d8e313bd41 admin admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:49:51.234342 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ec0933-67e4-4044-a1eb-477b1820c626 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:49:51.239637 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ec0933-67e4-4044-a1eb-477b1820c626 admin admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:49:51.304826 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 929/1830] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Sep 13 19:49:50 2022] POST /identity/v3/projects => generated 383 bytes in 589 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 19:49:51.305734 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ec0933-67e4-4044-a1eb-477b1820c626 admin admin] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:49:51.316164 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.fernet_utils [None req-b7ec0933-67e4-4044-a1eb-477b1820c626 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:49:51.429304 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.notifications [None req-732c5247-5e39-49bb-b949-22d8e313bd41 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0aac5ce25cc84f21ae031e82da24c5d8'} {{(pid=87935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:49:51.449365 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.notifications [None req-732c5247-5e39-49bb-b949-22d8e313bd41 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0aac5ce25cc84f21ae031e82da24c5d8'} {{(pid=87935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:49:51.480000 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.notifications [None req-732c5247-5e39-49bb-b949-22d8e313bd41 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0aac5ce25cc84f21ae031e82da24c5d8'} {{(pid=87935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:49:51.481488 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.notifications [None req-732c5247-5e39-49bb-b949-22d8e313bd41 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0aac5ce25cc84f21ae031e82da24c5d8'} {{(pid=87935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:49:51.483281 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.notifications [None req-732c5247-5e39-49bb-b949-22d8e313bd41 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0aac5ce25cc84f21ae031e82da24c5d8'} {{(pid=87935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:49:51.500509 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ec0933-67e4-4044-a1eb-477b1820c626 admin admin] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:49:51.512941 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d961751-e3b4-42ee-ae0c-7d2a7fe853d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:49:51.513698 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d961751-e3b4-42ee-ae0c-7d2a7fe853d0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:49:51.513887 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d961751-e3b4-42ee-ae0c-7d2a7fe853d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:49:51.514166 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d961751-e3b4-42ee-ae0c-7d2a7fe853d0 admin admin] PATH_INFO: `/v3/users/be6cdb1f85964f758aad7e016601b601` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:49:51.518130 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d961751-e3b4-42ee-ae0c-7d2a7fe853d0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=be6cdb1f85964f758aad7e016601b601)` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:49:51.520771 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d961751-e3b4-42ee-ae0c-7d2a7fe853d0 admin admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:49:51.529054 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 902/1831] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Sep 13 19:49:51 2022] DELETE /identity/v3/users/0aac5ce25cc84f21ae031e82da24c5d8 => generated 0 bytes in 383 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 19:49:51.535097 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732c5247-5e39-49bb-b949-22d8e313bd41 admin admin] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:49:51.538149 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.fernet_utils [None req-732c5247-5e39-49bb-b949-22d8e313bd41 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:49:51.640604 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.notifications [None req-3d961751-e3b4-42ee-ae0c-7d2a7fe853d0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'be6cdb1f85964f758aad7e016601b601'} {{(pid=87934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:49:51.642321 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.notifications [None req-3d961751-e3b4-42ee-ae0c-7d2a7fe853d0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'be6cdb1f85964f758aad7e016601b601'} {{(pid=87934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:49:51.644610 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.notifications [None req-3d961751-e3b4-42ee-ae0c-7d2a7fe853d0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'be6cdb1f85964f758aad7e016601b601'} {{(pid=87934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:49:51.670752 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.notifications [None req-3d961751-e3b4-42ee-ae0c-7d2a7fe853d0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'be6cdb1f85964f758aad7e016601b601'} {{(pid=87934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:49:51.691213 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732c5247-5e39-49bb-b949-22d8e313bd41 admin admin] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:49:51.698726 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2fe7dd-7747-487c-ab4d-d3f9c4f6de9f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1196a96e4a404f559600b69f929ea9da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a10a4268f3c4cb29f4e00c292e2df62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:49:51.700655 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2fe7dd-7747-487c-ab4d-d3f9c4f6de9f service neutron] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:49:51.700988 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2fe7dd-7747-487c-ab4d-d3f9c4f6de9f service neutron] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:49:51.701179 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2fe7dd-7747-487c-ab4d-d3f9c4f6de9f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:49:51.707298 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.fernet_utils [None req-5a2fe7dd-7747-487c-ab4d-d3f9c4f6de9f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:49:51.733522 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.notifications [None req-3d961751-e3b4-42ee-ae0c-7d2a7fe853d0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'be6cdb1f85964f758aad7e016601b601'} {{(pid=87934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:49:51.771981 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG dbcounter [-] [87934] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=87934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:49:51.787625 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 930/1832] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Sep 13 19:49:51 2022] DELETE /identity/v3/users/be6cdb1f85964f758aad7e016601b601 => generated 0 bytes in 482 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 19:49:51.788666 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d961751-e3b4-42ee-ae0c-7d2a7fe853d0 admin admin] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:49:51.794104 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.fernet_utils [None req-3d961751-e3b4-42ee-ae0c-7d2a7fe853d0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:49:51.893653 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a2fe7dd-7747-487c-ab4d-d3f9c4f6de9f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:49:51.896416 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a2fe7dd-7747-487c-ab4d-d3f9c4f6de9f service neutron] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:49:51.912532 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 903/1833] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Sep 13 19:49:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 383 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 19:49:51.914770 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184fcb3f-c6a8-4130-b0ed-9b857df3f87a None None] REQUEST_METHOD: `POST` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:49:51.914770 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184fcb3f-c6a8-4130-b0ed-9b857df3f87a None None] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:49:51.915366 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184fcb3f-c6a8-4130-b0ed-9b857df3f87a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:49:51.946362 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.auth.core [None req-184fcb3f-c6a8-4130-b0ed-9b857df3f87a None None] MFA Rules not processed for user `7b0aed92d02344acb92a0e4aa67c3068`. Rule list: `[]` (Enabled: `True`). {{(pid=87935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:49:51.948039 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.fernet_utils [None req-184fcb3f-c6a8-4130-b0ed-9b857df3f87a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:49:51.983426 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG dbcounter [-] [87935] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:49:51.990441 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d961751-e3b4-42ee-ae0c-7d2a7fe853d0 admin admin] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:49:52.006359 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd28c3cf-e102-48bb-b33b-8e6ec27477db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:49:52.007118 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd28c3cf-e102-48bb-b33b-8e6ec27477db admin admin] REQUEST_METHOD: `POST` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:49:52.007404 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd28c3cf-e102-48bb-b33b-8e6ec27477db admin admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:49:52.007716 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd28c3cf-e102-48bb-b33b-8e6ec27477db admin admin] PATH_INFO: `/v3/users` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:49:52.008535 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd28c3cf-e102-48bb-b33b-8e6ec27477db admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:49:52.011065 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd28c3cf-e102-48bb-b33b-8e6ec27477db admin admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:49:52.073166 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 931/1834] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Sep 13 19:49:51 2022] POST /identity/v3/users => generated 298 bytes in 285 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 19:49:52.074659 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2ff436-4892-49ac-b149-cff5d4a68084 None None] REQUEST_METHOD: `POST` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:49:52.074949 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2ff436-4892-49ac-b149-cff5d4a68084 None None] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:49:52.075268 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2ff436-4892-49ac-b149-cff5d4a68084 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:49:52.150725 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.auth.core [None req-ec2ff436-4892-49ac-b149-cff5d4a68084 None None] MFA Rules not processed for user `7b0aed92d02344acb92a0e4aa67c3068`. Rule list: `[]` (Enabled: `True`). {{(pid=87934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:49:52.151994 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.fernet_utils [None req-ec2ff436-4892-49ac-b149-cff5d4a68084 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:49:52.183711 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 932/1835] 10.222.0.25 () {58 vars in 958 bytes} [Tue Sep 13 19:49:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 19:49:52.188026 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2ff436-4892-49ac-b149-cff5d4a68084 None None] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:49:52.199309 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 904/1836] 10.222.0.25 () {58 vars in 958 bytes} [Tue Sep 13 19:49:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 286 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 19:49:52.229984 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2ff436-4892-49ac-b149-cff5d4a68084 None None] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:49:52.257911 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d934ce-0071-43fe-a166-c0596213cc67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:49:52.258910 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d934ce-0071-43fe-a166-c0596213cc67 admin admin] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:49:52.260167 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d934ce-0071-43fe-a166-c0596213cc67 admin admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:49:52.265493 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d934ce-0071-43fe-a166-c0596213cc67 admin admin] PATH_INFO: `/v3/roles` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:49:52.266462 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d934ce-0071-43fe-a166-c0596213cc67 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:49:52.269351 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d934ce-0071-43fe-a166-c0596213cc67 admin admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:49:52.308622 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 933/1837] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Sep 13 19:49:52 2022] GET /identity/v3/roles => generated 1420 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 19:49:52.313590 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184fcb3f-c6a8-4130-b0ed-9b857df3f87a None None] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:49:52.326154 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184fcb3f-c6a8-4130-b0ed-9b857df3f87a None None] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:49:52.329575 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d934ce-0071-43fe-a166-c0596213cc67 admin admin] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:49:52.332491 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.fernet_utils [None req-48d934ce-0071-43fe-a166-c0596213cc67 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:49:52.341662 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e96d6f8-dc2a-49ec-9c5e-d51f71c3cd13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:49:52.342683 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e96d6f8-dc2a-49ec-9c5e-d51f71c3cd13 admin admin] REQUEST_METHOD: `PUT` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:49:52.342996 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e96d6f8-dc2a-49ec-9c5e-d51f71c3cd13 admin admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:49:52.343619 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e96d6f8-dc2a-49ec-9c5e-d51f71c3cd13 admin admin] PATH_INFO: `/v3/projects/b1f515b0b37a4b3c882d01bc91ef0e9c/users/3ddc49e46b9644508daf13fa2e9880b9/roles/6ca1d4427ff64e0a9d25d96cfb1445f6` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:49:52.421344 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e96d6f8-dc2a-49ec-9c5e-d51f71c3cd13 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b1f515b0b37a4b3c882d01bc91ef0e9c, user_id=3ddc49e46b9644508daf13fa2e9880b9, role_id=6ca1d4427ff64e0a9d25d96cfb1445f6)` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:49:52.427453 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e96d6f8-dc2a-49ec-9c5e-d51f71c3cd13 admin admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:49:52.469268 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 905/1838] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Sep 13 19:49:52 2022] PUT /identity/v3/projects/b1f515b0b37a4b3c882d01bc91ef0e9c/users/3ddc49e46b9644508daf13fa2e9880b9/roles/6ca1d4427ff64e0a9d25d96cfb1445f6 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 19:49:52.469268 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e96d6f8-dc2a-49ec-9c5e-d51f71c3cd13 admin admin] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:49:52.473183 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.fernet_utils [None req-8e96d6f8-dc2a-49ec-9c5e-d51f71c3cd13 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:49:52.600830 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d934ce-0071-43fe-a166-c0596213cc67 admin admin] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:49:52.744644 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e96d6f8-dc2a-49ec-9c5e-d51f71c3cd13 admin admin] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:49:52.750186 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0b47e8-aeee-4547-a13a-90ee03567ad9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1196a96e4a404f559600b69f929ea9da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a10a4268f3c4cb29f4e00c292e2df62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:49:52.751209 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0b47e8-aeee-4547-a13a-90ee03567ad9 service neutron] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:49:52.751496 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0b47e8-aeee-4547-a13a-90ee03567ad9 service neutron] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:49:52.751872 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0b47e8-aeee-4547-a13a-90ee03567ad9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:49:52.794199 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b4bba0-5f92-45c4-aabf-1b0bdfe58688 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1196a96e4a404f559600b69f929ea9da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a10a4268f3c4cb29f4e00c292e2df62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:49:52.794884 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b4bba0-5f92-45c4-aabf-1b0bdfe58688 service neutron] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:49:52.795128 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b4bba0-5f92-45c4-aabf-1b0bdfe58688 service neutron] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:49:52.795416 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b4bba0-5f92-45c4-aabf-1b0bdfe58688 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:49:52.872751 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG dbcounter [-] [87934] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:49:52.916614 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b4bba0-5f92-45c4-aabf-1b0bdfe58688 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:49:52.918349 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b4bba0-5f92-45c4-aabf-1b0bdfe58688 service neutron] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:49:52.948412 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 934/1839] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Sep 13 19:49:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 619 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 19:49:52.949331 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b4bba0-5f92-45c4-aabf-1b0bdfe58688 service neutron] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:49:52.961849 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da0b47e8-aeee-4547-a13a-90ee03567ad9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:49:52.963831 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b4bba0-5f92-45c4-aabf-1b0bdfe58688 service neutron] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:49:52.970516 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e991ed1-73db-4227-89f0-4f4722ba875b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:49:52.970755 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da0b47e8-aeee-4547-a13a-90ee03567ad9 service neutron] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:49:52.972857 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e991ed1-73db-4227-89f0-4f4722ba875b admin admin] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:49:52.973439 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e991ed1-73db-4227-89f0-4f4722ba875b admin admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:49:52.974118 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e991ed1-73db-4227-89f0-4f4722ba875b admin admin] PATH_INFO: `/v3/roles` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:49:52.974959 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e991ed1-73db-4227-89f0-4f4722ba875b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:49:52.976961 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e991ed1-73db-4227-89f0-4f4722ba875b admin admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:49:53.005477 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 935/1840] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Sep 13 19:49:52 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 19:49:53.009509 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83622298-a6b3-46f6-8cc8-df0881b3b6b3 None None] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:49:53.009950 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83622298-a6b3-46f6-8cc8-df0881b3b6b3 None None] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:49:53.011105 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83622298-a6b3-46f6-8cc8-df0881b3b6b3 None None] PATH_INFO: `/` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:49:53.012693 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 936/1841] 10.222.0.25 () {54 vars in 921 bytes} [Tue Sep 13 19:49:53 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:49:53.013964 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83622298-a6b3-46f6-8cc8-df0881b3b6b3 None None] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:49:53.022430 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 906/1842] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Sep 13 19:49:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 555 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 19:49:53.035849 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83622298-a6b3-46f6-8cc8-df0881b3b6b3 None None] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:49:53.044030 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48dad330-1b09-44b2-8db6-c5bf7fbab157 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:49:53.044921 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48dad330-1b09-44b2-8db6-c5bf7fbab157 admin admin] REQUEST_METHOD: `PUT` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:49:53.045641 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48dad330-1b09-44b2-8db6-c5bf7fbab157 admin admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:49:53.045968 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48dad330-1b09-44b2-8db6-c5bf7fbab157 admin admin] PATH_INFO: `/v3/projects/b1f515b0b37a4b3c882d01bc91ef0e9c/users/3ddc49e46b9644508daf13fa2e9880b9/roles/6ca1d4427ff64e0a9d25d96cfb1445f6` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:49:53.048651 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48dad330-1b09-44b2-8db6-c5bf7fbab157 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b1f515b0b37a4b3c882d01bc91ef0e9c, user_id=3ddc49e46b9644508daf13fa2e9880b9, role_id=6ca1d4427ff64e0a9d25d96cfb1445f6)` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:49:53.053295 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48dad330-1b09-44b2-8db6-c5bf7fbab157 admin admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:49:53.072934 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 937/1843] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Sep 13 19:49:53 2022] PUT /identity/v3/projects/b1f515b0b37a4b3c882d01bc91ef0e9c/users/3ddc49e46b9644508daf13fa2e9880b9/roles/6ca1d4427ff64e0a9d25d96cfb1445f6 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 19:49:53.088324 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a490dc49-3796-4243-9965-b9276ba57428 None None] REQUEST_METHOD: `POST` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:49:53.088709 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a490dc49-3796-4243-9965-b9276ba57428 None None] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:49:53.088863 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a490dc49-3796-4243-9965-b9276ba57428 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:49:53.134437 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.auth.core [None req-a490dc49-3796-4243-9965-b9276ba57428 None None] MFA Rules not processed for user `3ddc49e46b9644508daf13fa2e9880b9`. Rule list: `[]` (Enabled: `True`). {{(pid=87935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:49:53.136067 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.fernet_utils [None req-a490dc49-3796-4243-9965-b9276ba57428 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:49:53.186344 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG dbcounter [-] [87935] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:49:53.212487 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474cb02d-b2a5-43e5-a6c0-6018e3461e90 None None] REQUEST_METHOD: `POST` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:49:53.213165 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474cb02d-b2a5-43e5-a6c0-6018e3461e90 None None] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:49:53.213730 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474cb02d-b2a5-43e5-a6c0-6018e3461e90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:49:53.249790 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.auth.core [None req-474cb02d-b2a5-43e5-a6c0-6018e3461e90 None None] MFA Rules not processed for user `d71fe5a8275f4ea98555afdcefc902a0`. Rule list: `[]` (Enabled: `True`). {{(pid=87934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:49:53.251441 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.fernet_utils [None req-474cb02d-b2a5-43e5-a6c0-6018e3461e90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:49:53.283115 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 907/1844] 10.222.0.25 () {58 vars in 958 bytes} [Tue Sep 13 19:49:53 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 19:49:53.302873 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a490dc49-3796-4243-9965-b9276ba57428 None None] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:49:53.306126 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.fernet_utils [None req-a490dc49-3796-4243-9965-b9276ba57428 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:49:53.391313 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 938/1845] 10.222.0.25 () {58 vars in 1018 bytes} [Tue Sep 13 19:49:53 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 19:49:53.430360 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474cb02d-b2a5-43e5-a6c0-6018e3461e90 None None] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:49:53.431864 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.fernet_utils [None req-474cb02d-b2a5-43e5-a6c0-6018e3461e90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:49:53.451592 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474cb02d-b2a5-43e5-a6c0-6018e3461e90 None None] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:49:53.470257 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7275454-f024-422e-b5ae-87f892cf58ee service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd71fe5a8275f4ea98555afdcefc902a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a10a4268f3c4cb29f4e00c292e2df62', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:49:53.470916 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7275454-f024-422e-b5ae-87f892cf58ee service nova] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:49:53.471941 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7275454-f024-422e-b5ae-87f892cf58ee service nova] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:49:53.472082 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7275454-f024-422e-b5ae-87f892cf58ee service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:49:53.472725 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a490dc49-3796-4243-9965-b9276ba57428 None None] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:49:53.491003 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558624c9-22a9-4d72-9e87-072fc70dae79 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cbb50c88b794a7f9f26844effde7d63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a10a4268f3c4cb29f4e00c292e2df62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:49:53.491590 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558624c9-22a9-4d72-9e87-072fc70dae79 service cinder] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:49:53.492029 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558624c9-22a9-4d72-9e87-072fc70dae79 service cinder] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:49:53.492335 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558624c9-22a9-4d72-9e87-072fc70dae79 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:49:53.499821 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7275454-f024-422e-b5ae-87f892cf58ee service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:49:53.501405 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7275454-f024-422e-b5ae-87f892cf58ee service nova] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:49:53.514146 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-558624c9-22a9-4d72-9e87-072fc70dae79 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:49:53.515647 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-558624c9-22a9-4d72-9e87-072fc70dae79 service cinder] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:49:53.527829 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 939/1846] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Sep 13 19:49:53 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 13 19:49:53.533186 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 908/1847] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Sep 13 19:49:53 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 231 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 19:49:53.683103 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7275454-f024-422e-b5ae-87f892cf58ee service nova] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:49:53.693496 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7275454-f024-422e-b5ae-87f892cf58ee service nova] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:49:53.700182 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8951df87-9757-4399-9df2-b584ea2d7cb1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cbb50c88b794a7f9f26844effde7d63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a10a4268f3c4cb29f4e00c292e2df62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:49:53.701105 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8951df87-9757-4399-9df2-b584ea2d7cb1 service cinder] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:49:53.701999 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8951df87-9757-4399-9df2-b584ea2d7cb1 service cinder] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:49:53.702913 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8951df87-9757-4399-9df2-b584ea2d7cb1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:49:53.708786 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.fernet_utils [None req-8951df87-9757-4399-9df2-b584ea2d7cb1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:49:54.053214 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8951df87-9757-4399-9df2-b584ea2d7cb1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:49:54.056917 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8951df87-9757-4399-9df2-b584ea2d7cb1 service cinder] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:49:54.099790 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 940/1848] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Sep 13 19:49:53 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 417 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 19:49:54.881527 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558624c9-22a9-4d72-9e87-072fc70dae79 service cinder] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:49:54.883496 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.fernet_utils [None req-558624c9-22a9-4d72-9e87-072fc70dae79 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:49:55.055534 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558624c9-22a9-4d72-9e87-072fc70dae79 service cinder] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:49:55.062807 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94548424-abaa-4a21-96d3-62a8febf5a07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:49:55.063604 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94548424-abaa-4a21-96d3-62a8febf5a07 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:49:55.063882 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94548424-abaa-4a21-96d3-62a8febf5a07 admin admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:49:55.064928 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94548424-abaa-4a21-96d3-62a8febf5a07 admin admin] PATH_INFO: `/v3/projects/61c6a0e4bd314a38965cb88f821697c7` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:49:55.066913 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94548424-abaa-4a21-96d3-62a8febf5a07 admin admin] RBAC: Authorizing `identity:delete_project(project_id=61c6a0e4bd314a38965cb88f821697c7)` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:49:55.069053 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94548424-abaa-4a21-96d3-62a8febf5a07 admin admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:49:55.123205 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.notifications [None req-94548424-abaa-4a21-96d3-62a8febf5a07 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '61c6a0e4bd314a38965cb88f821697c7', 'request_id': 'req-94548424-abaa-4a21-96d3-62a8febf5a07'} {{(pid=87935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:49:55.129955 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.notifications [None req-94548424-abaa-4a21-96d3-62a8febf5a07 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '61c6a0e4bd314a38965cb88f821697c7', 'request_id': 'req-94548424-abaa-4a21-96d3-62a8febf5a07'} {{(pid=87935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:49:55.148786 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.notifications [None req-94548424-abaa-4a21-96d3-62a8febf5a07 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '61c6a0e4bd314a38965cb88f821697c7', 'request_id': 'req-94548424-abaa-4a21-96d3-62a8febf5a07'} {{(pid=87935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:49:55.167540 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.notifications [None req-94548424-abaa-4a21-96d3-62a8febf5a07 admin admin] The token cache is being invalidate because project 61c6a0e4bd314a38965cb88f821697c7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87935) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 19:49:55.168486 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.notifications [None req-94548424-abaa-4a21-96d3-62a8febf5a07 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:49:55.169502 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.notifications [None req-94548424-abaa-4a21-96d3-62a8febf5a07 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:49:55.171415 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 909/1849] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Sep 13 19:49:54 2022] DELETE /identity/v3/projects/61c6a0e4bd314a38965cb88f821697c7 => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 19:49:55.176119 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8951df87-9757-4399-9df2-b584ea2d7cb1 service cinder] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:49:55.193504 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8951df87-9757-4399-9df2-b584ea2d7cb1 service cinder] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:49:55.235419 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG dbcounter [-] [87934] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:49:55.279024 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1de2c1-bb97-4435-a44f-b92119903c05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:49:55.279949 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1de2c1-bb97-4435-a44f-b92119903c05 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:49:55.280074 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1de2c1-bb97-4435-a44f-b92119903c05 admin admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:49:55.280882 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1de2c1-bb97-4435-a44f-b92119903c05 admin admin] PATH_INFO: `/v3/users/3be4d86a85084d72bd585f49e0733eaa` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:49:55.282388 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db1de2c1-bb97-4435-a44f-b92119903c05 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3be4d86a85084d72bd585f49e0733eaa)` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:49:55.284545 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db1de2c1-bb97-4435-a44f-b92119903c05 admin admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:49:55.349271 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.notifications [None req-db1de2c1-bb97-4435-a44f-b92119903c05 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3be4d86a85084d72bd585f49e0733eaa'} {{(pid=87934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:49:55.350538 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.notifications [None req-db1de2c1-bb97-4435-a44f-b92119903c05 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3be4d86a85084d72bd585f49e0733eaa'} {{(pid=87934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:49:55.351259 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.notifications [None req-db1de2c1-bb97-4435-a44f-b92119903c05 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3be4d86a85084d72bd585f49e0733eaa'} {{(pid=87934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:49:55.359662 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.notifications [None req-db1de2c1-bb97-4435-a44f-b92119903c05 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3be4d86a85084d72bd585f49e0733eaa'} {{(pid=87934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:49:55.374631 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.notifications [None req-db1de2c1-bb97-4435-a44f-b92119903c05 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3be4d86a85084d72bd585f49e0733eaa'} {{(pid=87934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:49:55.392835 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 941/1850] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Sep 13 19:49:55 2022] DELETE /identity/v3/users/3be4d86a85084d72bd585f49e0733eaa => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 19:49:55.501294 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94548424-abaa-4a21-96d3-62a8febf5a07 admin admin] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:49:55.502928 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.fernet_utils [None req-94548424-abaa-4a21-96d3-62a8febf5a07 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:49:55.517616 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG dbcounter [-] [87935] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=87935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:49:55.525059 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94548424-abaa-4a21-96d3-62a8febf5a07 admin admin] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:49:55.578307 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1de2c1-bb97-4435-a44f-b92119903c05 admin admin] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:49:55.580036 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.fernet_utils [None req-db1de2c1-bb97-4435-a44f-b92119903c05 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:49:55.692838 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb564f2-4a7e-475a-81d3-1f5ab17e4334 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:49:55.699353 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1de2c1-bb97-4435-a44f-b92119903c05 admin admin] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:49:55.702568 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb564f2-4a7e-475a-81d3-1f5ab17e4334 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:49:55.704083 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb564f2-4a7e-475a-81d3-1f5ab17e4334 admin admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:49:55.704491 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb564f2-4a7e-475a-81d3-1f5ab17e4334 admin admin] PATH_INFO: `/v3/projects/dfb85d5bc79c432fa0f3c011f41ec481` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:49:55.707391 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870ba451-f0d1-4977-a62f-c993f74d43ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:49:55.707391 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870ba451-f0d1-4977-a62f-c993f74d43ca admin admin] REQUEST_METHOD: `DELETE` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:49:55.707652 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870ba451-f0d1-4977-a62f-c993f74d43ca admin admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:49:55.707744 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870ba451-f0d1-4977-a62f-c993f74d43ca admin admin] PATH_INFO: `/v3/projects/6e35af637e864779bf6188d323d362c8` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:49:55.709312 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-870ba451-f0d1-4977-a62f-c993f74d43ca admin admin] RBAC: Authorizing `identity:delete_project(project_id=6e35af637e864779bf6188d323d362c8)` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:49:55.711493 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-870ba451-f0d1-4977-a62f-c993f74d43ca admin admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:49:55.723604 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb564f2-4a7e-475a-81d3-1f5ab17e4334 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dfb85d5bc79c432fa0f3c011f41ec481)` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:49:55.726487 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb564f2-4a7e-475a-81d3-1f5ab17e4334 admin admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:49:55.821755 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.notifications [None req-1eb564f2-4a7e-475a-81d3-1f5ab17e4334 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dfb85d5bc79c432fa0f3c011f41ec481', 'request_id': 'req-1eb564f2-4a7e-475a-81d3-1f5ab17e4334'} {{(pid=87935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:49:55.832000 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.notifications [None req-1eb564f2-4a7e-475a-81d3-1f5ab17e4334 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dfb85d5bc79c432fa0f3c011f41ec481', 'request_id': 'req-1eb564f2-4a7e-475a-81d3-1f5ab17e4334'} {{(pid=87935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:49:55.844931 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.notifications [None req-1eb564f2-4a7e-475a-81d3-1f5ab17e4334 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dfb85d5bc79c432fa0f3c011f41ec481', 'request_id': 'req-1eb564f2-4a7e-475a-81d3-1f5ab17e4334'} {{(pid=87935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:49:55.861626 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.notifications [None req-1eb564f2-4a7e-475a-81d3-1f5ab17e4334 admin admin] The token cache is being invalidate because project dfb85d5bc79c432fa0f3c011f41ec481 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87935) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 19:49:55.862226 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.notifications [None req-1eb564f2-4a7e-475a-81d3-1f5ab17e4334 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:49:55.863514 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.notifications [None req-1eb564f2-4a7e-475a-81d3-1f5ab17e4334 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:49:55.868577 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 910/1851] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Sep 13 19:49:55 2022] DELETE /identity/v3/projects/dfb85d5bc79c432fa0f3c011f41ec481 => generated 0 bytes in 365 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 19:49:55.870192 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb564f2-4a7e-475a-81d3-1f5ab17e4334 admin admin] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:49:55.872541 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.fernet_utils [None req-1eb564f2-4a7e-475a-81d3-1f5ab17e4334 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:49:55.905832 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.notifications [None req-870ba451-f0d1-4977-a62f-c993f74d43ca admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6e35af637e864779bf6188d323d362c8', 'request_id': 'req-870ba451-f0d1-4977-a62f-c993f74d43ca'} {{(pid=87934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:49:55.907712 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG dbcounter [-] [87934] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=87934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:49:55.927669 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.notifications [None req-870ba451-f0d1-4977-a62f-c993f74d43ca admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6e35af637e864779bf6188d323d362c8', 'request_id': 'req-870ba451-f0d1-4977-a62f-c993f74d43ca'} {{(pid=87934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:49:55.952115 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.notifications [None req-870ba451-f0d1-4977-a62f-c993f74d43ca admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6e35af637e864779bf6188d323d362c8', 'request_id': 'req-870ba451-f0d1-4977-a62f-c993f74d43ca'} {{(pid=87934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:49:55.972090 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.notifications [None req-870ba451-f0d1-4977-a62f-c993f74d43ca admin admin] The token cache is being invalidate because project 6e35af637e864779bf6188d323d362c8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87934) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 19:49:55.972451 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.notifications [None req-870ba451-f0d1-4977-a62f-c993f74d43ca admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:49:55.973958 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.notifications [None req-870ba451-f0d1-4977-a62f-c993f74d43ca admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:49:55.978797 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 942/1852] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Sep 13 19:49:55 2022] DELETE /identity/v3/projects/6e35af637e864779bf6188d323d362c8 => generated 0 bytes in 398 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 19:49:55.980022 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870ba451-f0d1-4977-a62f-c993f74d43ca admin admin] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:49:55.986265 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.fernet_utils [None req-870ba451-f0d1-4977-a62f-c993f74d43ca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:49:56.079294 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb564f2-4a7e-475a-81d3-1f5ab17e4334 admin admin] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:49:56.161966 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870ba451-f0d1-4977-a62f-c993f74d43ca admin admin] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:49:56.162598 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG dbcounter [-] [87935] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=87935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:49:56.175720 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4aafad-5615-4968-bb02-ee75dc250e08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:49:56.176622 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4aafad-5615-4968-bb02-ee75dc250e08 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:49:56.177821 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4aafad-5615-4968-bb02-ee75dc250e08 admin admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:49:56.178158 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4aafad-5615-4968-bb02-ee75dc250e08 admin admin] PATH_INFO: `/v3/users/adacb55e7f00473e8661982ae1760ef2` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:49:56.179596 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c4aafad-5615-4968-bb02-ee75dc250e08 admin admin] RBAC: Authorizing `identity:delete_user(user_id=adacb55e7f00473e8661982ae1760ef2)` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:49:56.183449 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c4aafad-5615-4968-bb02-ee75dc250e08 admin admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:49:56.228088 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7f97ec-53a9-4436-962e-6e1cb5243bb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:49:56.229030 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7f97ec-53a9-4436-962e-6e1cb5243bb5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:49:56.229445 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7f97ec-53a9-4436-962e-6e1cb5243bb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:49:56.230348 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7f97ec-53a9-4436-962e-6e1cb5243bb5 admin admin] PATH_INFO: `/v3/users/f6994f681b504e9b8c0f3deb359ad5e4` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:49:56.232907 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f7f97ec-53a9-4436-962e-6e1cb5243bb5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f6994f681b504e9b8c0f3deb359ad5e4)` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:49:56.238295 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f7f97ec-53a9-4436-962e-6e1cb5243bb5 admin admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:49:56.325998 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.notifications [None req-6c4aafad-5615-4968-bb02-ee75dc250e08 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'adacb55e7f00473e8661982ae1760ef2'} {{(pid=87934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:49:56.326849 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.notifications [None req-6c4aafad-5615-4968-bb02-ee75dc250e08 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'adacb55e7f00473e8661982ae1760ef2'} {{(pid=87934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:49:56.327872 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.notifications [None req-6c4aafad-5615-4968-bb02-ee75dc250e08 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'adacb55e7f00473e8661982ae1760ef2'} {{(pid=87934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:49:56.348066 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.notifications [None req-6c4aafad-5615-4968-bb02-ee75dc250e08 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'adacb55e7f00473e8661982ae1760ef2'} {{(pid=87934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:49:56.366315 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.notifications [None req-6c4aafad-5615-4968-bb02-ee75dc250e08 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'adacb55e7f00473e8661982ae1760ef2'} {{(pid=87934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:49:56.383610 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.notifications [None req-8f7f97ec-53a9-4436-962e-6e1cb5243bb5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f6994f681b504e9b8c0f3deb359ad5e4'} {{(pid=87935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:49:56.405163 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 943/1853] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Sep 13 19:49:55 2022] DELETE /identity/v3/users/adacb55e7f00473e8661982ae1760ef2 => generated 0 bytes in 423 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 19:49:56.406130 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4aafad-5615-4968-bb02-ee75dc250e08 admin admin] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:49:56.407694 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.fernet_utils [None req-6c4aafad-5615-4968-bb02-ee75dc250e08 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:49:56.414650 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.notifications [None req-8f7f97ec-53a9-4436-962e-6e1cb5243bb5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f6994f681b504e9b8c0f3deb359ad5e4'} {{(pid=87935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:49:56.440986 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.notifications [None req-8f7f97ec-53a9-4436-962e-6e1cb5243bb5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f6994f681b504e9b8c0f3deb359ad5e4'} {{(pid=87935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:49:56.443513 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.notifications [None req-8f7f97ec-53a9-4436-962e-6e1cb5243bb5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f6994f681b504e9b8c0f3deb359ad5e4'} {{(pid=87935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:49:56.446151 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.notifications [None req-8f7f97ec-53a9-4436-962e-6e1cb5243bb5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f6994f681b504e9b8c0f3deb359ad5e4'} {{(pid=87935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:49:56.473606 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 911/1854] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Sep 13 19:49:55 2022] DELETE /identity/v3/users/f6994f681b504e9b8c0f3deb359ad5e4 => generated 0 bytes in 604 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 19:49:56.528405 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG dbcounter [-] [87934] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=87934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:49:56.535501 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4aafad-5615-4968-bb02-ee75dc250e08 admin admin] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:49:56.610117 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d73cb7b-4327-4095-b23a-ac3d3f61af7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:49:56.610892 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d73cb7b-4327-4095-b23a-ac3d3f61af7a admin admin] REQUEST_METHOD: `DELETE` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:49:56.611177 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d73cb7b-4327-4095-b23a-ac3d3f61af7a admin admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:49:56.611447 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d73cb7b-4327-4095-b23a-ac3d3f61af7a admin admin] PATH_INFO: `/v3/projects/722cf90e49ed4039a883e301618f3590` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:49:56.613071 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d73cb7b-4327-4095-b23a-ac3d3f61af7a admin admin] RBAC: Authorizing `identity:delete_project(project_id=722cf90e49ed4039a883e301618f3590)` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:49:56.615351 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d73cb7b-4327-4095-b23a-ac3d3f61af7a admin admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:49:56.678438 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.notifications [None req-1d73cb7b-4327-4095-b23a-ac3d3f61af7a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '722cf90e49ed4039a883e301618f3590', 'request_id': 'req-1d73cb7b-4327-4095-b23a-ac3d3f61af7a'} {{(pid=87934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:49:56.685246 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.notifications [None req-1d73cb7b-4327-4095-b23a-ac3d3f61af7a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '722cf90e49ed4039a883e301618f3590', 'request_id': 'req-1d73cb7b-4327-4095-b23a-ac3d3f61af7a'} {{(pid=87934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:49:56.691302 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.notifications [None req-1d73cb7b-4327-4095-b23a-ac3d3f61af7a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '722cf90e49ed4039a883e301618f3590', 'request_id': 'req-1d73cb7b-4327-4095-b23a-ac3d3f61af7a'} {{(pid=87934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:49:56.705176 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.notifications [None req-1d73cb7b-4327-4095-b23a-ac3d3f61af7a admin admin] The token cache is being invalidate because project 722cf90e49ed4039a883e301618f3590 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87934) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 19:49:56.705491 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.notifications [None req-1d73cb7b-4327-4095-b23a-ac3d3f61af7a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:49:56.706434 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.notifications [None req-1d73cb7b-4327-4095-b23a-ac3d3f61af7a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:49:56.708149 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 944/1855] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Sep 13 19:49:56 2022] DELETE /identity/v3/projects/722cf90e49ed4039a883e301618f3590 => generated 0 bytes in 302 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 19:49:56.713366 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb2b66e-b8f8-4a0e-9e60-d8d21c79d948 None None] REQUEST_METHOD: `POST` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:49:56.713749 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb2b66e-b8f8-4a0e-9e60-d8d21c79d948 None None] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:49:56.714092 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb2b66e-b8f8-4a0e-9e60-d8d21c79d948 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:49:56.739274 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.auth.core [None req-8bb2b66e-b8f8-4a0e-9e60-d8d21c79d948 None None] MFA Rules not processed for user `7b0aed92d02344acb92a0e4aa67c3068`. Rule list: `[]` (Enabled: `True`). {{(pid=87935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:49:56.740583 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.fernet_utils [None req-8bb2b66e-b8f8-4a0e-9e60-d8d21c79d948 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:49:56.805761 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 912/1856] 10.222.0.25 () {58 vars in 958 bytes} [Tue Sep 13 19:49:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 19:49:56.813940 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18479a3-ce4b-4077-bd7c-a9a1c11eb93c None None] REQUEST_METHOD: `POST` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:49:56.814226 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18479a3-ce4b-4077-bd7c-a9a1c11eb93c None None] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:49:56.814496 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18479a3-ce4b-4077-bd7c-a9a1c11eb93c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:49:56.836524 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.auth.core [None req-f18479a3-ce4b-4077-bd7c-a9a1c11eb93c None None] MFA Rules not processed for user `7b0aed92d02344acb92a0e4aa67c3068`. Rule list: `[]` (Enabled: `True`). {{(pid=87934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:49:56.838567 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.fernet_utils [None req-f18479a3-ce4b-4077-bd7c-a9a1c11eb93c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:49:56.871946 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 945/1857] 10.222.0.25 () {58 vars in 958 bytes} [Tue Sep 13 19:49:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 19:49:56.876103 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb2b66e-b8f8-4a0e-9e60-d8d21c79d948 None None] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:49:56.892065 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb2b66e-b8f8-4a0e-9e60-d8d21c79d948 None None] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:49:56.899434 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9a3e63-9575-4e5c-8a75-bce793d5b0fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:49:56.900543 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9a3e63-9575-4e5c-8a75-bce793d5b0fb admin admin] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:49:56.900829 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9a3e63-9575-4e5c-8a75-bce793d5b0fb admin admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:49:56.901089 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9a3e63-9575-4e5c-8a75-bce793d5b0fb admin admin] PATH_INFO: `/v3/domains` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:49:56.901900 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff9a3e63-9575-4e5c-8a75-bce793d5b0fb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87935) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:49:56.902205 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff9a3e63-9575-4e5c-8a75-bce793d5b0fb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:49:56.903822 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff9a3e63-9575-4e5c-8a75-bce793d5b0fb admin admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:49:56.918262 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 913/1858] 10.222.0.25 () {58 vars in 1153 bytes} [Tue Sep 13 19:49:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:49:56.922235 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18479a3-ce4b-4077-bd7c-a9a1c11eb93c None None] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:49:56.933116 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18479a3-ce4b-4077-bd7c-a9a1c11eb93c None None] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:49:56.948404 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe63b76-cb19-43d6-b577-baf86bb3629c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:49:56.949561 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe63b76-cb19-43d6-b577-baf86bb3629c admin admin] REQUEST_METHOD: `POST` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:49:56.950352 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe63b76-cb19-43d6-b577-baf86bb3629c admin admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:49:56.951633 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe63b76-cb19-43d6-b577-baf86bb3629c admin admin] PATH_INFO: `/v3/projects` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:49:56.952727 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe63b76-cb19-43d6-b577-baf86bb3629c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:49:56.958647 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe63b76-cb19-43d6-b577-baf86bb3629c admin admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:49:56.991476 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 946/1859] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Sep 13 19:49:56 2022] POST /identity/v3/projects => generated 387 bytes in 70 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 13 19:49:56.995646 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9a3e63-9575-4e5c-8a75-bce793d5b0fb admin admin] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:49:57.006460 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9a3e63-9575-4e5c-8a75-bce793d5b0fb admin admin] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:49:57.072255 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG dbcounter [-] [87935] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:49:57.091403 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3847c0-3f57-487d-8f95-9250d641c8ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:49:57.092246 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3847c0-3f57-487d-8f95-9250d641c8ee admin admin] REQUEST_METHOD: `POST` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:49:57.092539 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3847c0-3f57-487d-8f95-9250d641c8ee admin admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:49:57.092816 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3847c0-3f57-487d-8f95-9250d641c8ee admin admin] PATH_INFO: `/v3/users` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:49:57.094779 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a3847c0-3f57-487d-8f95-9250d641c8ee admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:49:57.097021 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a3847c0-3f57-487d-8f95-9250d641c8ee admin admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:49:57.120239 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 914/1860] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Sep 13 19:49:56 2022] POST /identity/v3/users => generated 294 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 19:49:57.124276 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe63b76-cb19-43d6-b577-baf86bb3629c admin admin] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:49:57.137050 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe63b76-cb19-43d6-b577-baf86bb3629c admin admin] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:49:57.142985 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2109af-e943-445f-a7ac-dc7ad312c4b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:49:57.144542 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2109af-e943-445f-a7ac-dc7ad312c4b6 admin admin] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:49:57.144542 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2109af-e943-445f-a7ac-dc7ad312c4b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:49:57.144542 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2109af-e943-445f-a7ac-dc7ad312c4b6 admin admin] PATH_INFO: `/v3/roles` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:49:57.145409 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da2109af-e943-445f-a7ac-dc7ad312c4b6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:49:57.147174 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da2109af-e943-445f-a7ac-dc7ad312c4b6 admin admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:49:57.163455 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 947/1861] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Sep 13 19:49:57 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 19:49:57.165618 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3847c0-3f57-487d-8f95-9250d641c8ee admin admin] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:49:57.178893 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3847c0-3f57-487d-8f95-9250d641c8ee admin admin] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:49:57.198916 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9595ed9-b135-4487-b4a5-dbf041f04bfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:49:57.201120 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9595ed9-b135-4487-b4a5-dbf041f04bfb admin admin] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:49:57.201676 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9595ed9-b135-4487-b4a5-dbf041f04bfb admin admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:49:57.202309 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9595ed9-b135-4487-b4a5-dbf041f04bfb admin admin] PATH_INFO: `/v3/roles` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:49:57.203076 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9595ed9-b135-4487-b4a5-dbf041f04bfb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:49:57.205623 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9595ed9-b135-4487-b4a5-dbf041f04bfb admin admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:49:57.226399 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 915/1862] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Sep 13 19:49:57 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 19:49:57.228005 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2109af-e943-445f-a7ac-dc7ad312c4b6 admin admin] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:49:57.239119 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2109af-e943-445f-a7ac-dc7ad312c4b6 admin admin] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:49:57.244834 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c54499b-8d67-4f12-abe6-29d59b0d2b07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:49:57.245513 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c54499b-8d67-4f12-abe6-29d59b0d2b07 admin admin] REQUEST_METHOD: `PUT` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:49:57.245798 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c54499b-8d67-4f12-abe6-29d59b0d2b07 admin admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:49:57.246074 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c54499b-8d67-4f12-abe6-29d59b0d2b07 admin admin] PATH_INFO: `/v3/projects/2293c5a9f9e14b23a578e2f045939cbb/users/4c1fb3dc7ae54eda836872656920d5bf/roles/a259191f6d0e46fabd9f34536bb28747` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:49:57.266617 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c54499b-8d67-4f12-abe6-29d59b0d2b07 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2293c5a9f9e14b23a578e2f045939cbb, user_id=4c1fb3dc7ae54eda836872656920d5bf, role_id=a259191f6d0e46fabd9f34536bb28747)` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:49:57.269893 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c54499b-8d67-4f12-abe6-29d59b0d2b07 admin admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:49:57.292340 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 948/1863] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Sep 13 19:49:57 2022] PUT /identity/v3/projects/2293c5a9f9e14b23a578e2f045939cbb/users/4c1fb3dc7ae54eda836872656920d5bf/roles/a259191f6d0e46fabd9f34536bb28747 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 19:49:57.300755 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79f29d8-98f5-44f9-957f-a152dd8c7896 None None] REQUEST_METHOD: `POST` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:49:57.301073 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79f29d8-98f5-44f9-957f-a152dd8c7896 None None] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:49:57.301345 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79f29d8-98f5-44f9-957f-a152dd8c7896 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:49:57.341076 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c54499b-8d67-4f12-abe6-29d59b0d2b07 admin admin] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:49:57.343333 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.fernet_utils [None req-4c54499b-8d67-4f12-abe6-29d59b0d2b07 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:49:57.382989 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.auth.core [None req-c79f29d8-98f5-44f9-957f-a152dd8c7896 None None] MFA Rules not processed for user `4c1fb3dc7ae54eda836872656920d5bf`. Rule list: `[]` (Enabled: `True`). {{(pid=87935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:49:57.391229 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.fernet_utils [None req-c79f29d8-98f5-44f9-957f-a152dd8c7896 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:49:57.410047 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG dbcounter [-] [87934] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=87934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:49:57.477051 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c54499b-8d67-4f12-abe6-29d59b0d2b07 admin admin] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:49:57.486001 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9543dc-e565-4aba-b95b-85a2f12b1b72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:49:57.486653 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9543dc-e565-4aba-b95b-85a2f12b1b72 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:49:57.487070 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9543dc-e565-4aba-b95b-85a2f12b1b72 admin admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:49:57.487347 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9543dc-e565-4aba-b95b-85a2f12b1b72 admin admin] PATH_INFO: `/v3/projects/6fa6357edaed4524bd97f4c6da648c53` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:49:57.488892 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e9543dc-e565-4aba-b95b-85a2f12b1b72 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6fa6357edaed4524bd97f4c6da648c53)` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:49:57.490797 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e9543dc-e565-4aba-b95b-85a2f12b1b72 admin admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:49:57.529664 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 916/1864] 10.222.0.25 () {58 vars in 958 bytes} [Tue Sep 13 19:49:57 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 19:49:57.530973 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79f29d8-98f5-44f9-957f-a152dd8c7896 None None] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:49:57.533497 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.fernet_utils [None req-c79f29d8-98f5-44f9-957f-a152dd8c7896 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:49:57.547195 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79f29d8-98f5-44f9-957f-a152dd8c7896 None None] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:49:57.559058 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.notifications [None req-9e9543dc-e565-4aba-b95b-85a2f12b1b72 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6fa6357edaed4524bd97f4c6da648c53', 'request_id': 'req-9e9543dc-e565-4aba-b95b-85a2f12b1b72'} {{(pid=87934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:49:57.569224 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.notifications [None req-9e9543dc-e565-4aba-b95b-85a2f12b1b72 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6fa6357edaed4524bd97f4c6da648c53', 'request_id': 'req-9e9543dc-e565-4aba-b95b-85a2f12b1b72'} {{(pid=87934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:49:57.581143 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.notifications [None req-9e9543dc-e565-4aba-b95b-85a2f12b1b72 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6fa6357edaed4524bd97f4c6da648c53', 'request_id': 'req-9e9543dc-e565-4aba-b95b-85a2f12b1b72'} {{(pid=87934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:49:57.606886 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.notifications [None req-9e9543dc-e565-4aba-b95b-85a2f12b1b72 admin admin] The token cache is being invalidate because project 6fa6357edaed4524bd97f4c6da648c53 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87934) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 19:49:57.607249 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.notifications [None req-9e9543dc-e565-4aba-b95b-85a2f12b1b72 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:49:57.607906 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.notifications [None req-9e9543dc-e565-4aba-b95b-85a2f12b1b72 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:49:57.609471 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 949/1865] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Sep 13 19:49:57 2022] DELETE /identity/v3/projects/6fa6357edaed4524bd97f4c6da648c53 => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 19:49:57.613954 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9543dc-e565-4aba-b95b-85a2f12b1b72 admin admin] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:49:57.613954 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.fernet_utils [None req-9e9543dc-e565-4aba-b95b-85a2f12b1b72 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:49:57.629855 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984f70c3-3c85-4782-af60-f76b06198e90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:49:57.631044 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984f70c3-3c85-4782-af60-f76b06198e90 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:49:57.631407 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984f70c3-3c85-4782-af60-f76b06198e90 admin admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:49:57.631685 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984f70c3-3c85-4782-af60-f76b06198e90 admin admin] PATH_INFO: `/v3/users/e35f25a2d44a4e1497346f1cc09bce89` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:49:57.634309 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-984f70c3-3c85-4782-af60-f76b06198e90 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e35f25a2d44a4e1497346f1cc09bce89)` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:49:57.637598 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-984f70c3-3c85-4782-af60-f76b06198e90 admin admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:49:57.707997 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9543dc-e565-4aba-b95b-85a2f12b1b72 admin admin] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:49:57.713211 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f70ffa-d0ba-4989-97bc-02930b6641e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:49:57.713931 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f70ffa-d0ba-4989-97bc-02930b6641e7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:49:57.714297 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f70ffa-d0ba-4989-97bc-02930b6641e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:49:57.714737 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f70ffa-d0ba-4989-97bc-02930b6641e7 admin admin] PATH_INFO: `/v3/projects/feab5de402164393ac4cbb2e3206f15c` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:49:57.716024 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f70ffa-d0ba-4989-97bc-02930b6641e7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=feab5de402164393ac4cbb2e3206f15c)` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:49:57.726416 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f70ffa-d0ba-4989-97bc-02930b6641e7 admin admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:49:57.746752 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.notifications [None req-984f70c3-3c85-4782-af60-f76b06198e90 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e35f25a2d44a4e1497346f1cc09bce89'} {{(pid=87935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:49:57.759840 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.notifications [None req-984f70c3-3c85-4782-af60-f76b06198e90 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e35f25a2d44a4e1497346f1cc09bce89'} {{(pid=87935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:49:57.765503 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG dbcounter [-] [87935] Writing DB stats keystone:SELECT=88,keystone:INSERT=4,keystone:DELETE=8 {{(pid=87935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:49:57.779033 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.notifications [None req-984f70c3-3c85-4782-af60-f76b06198e90 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e35f25a2d44a4e1497346f1cc09bce89'} {{(pid=87935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:49:57.780514 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.notifications [None req-984f70c3-3c85-4782-af60-f76b06198e90 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e35f25a2d44a4e1497346f1cc09bce89'} {{(pid=87935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:49:57.781162 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.notifications [None req-984f70c3-3c85-4782-af60-f76b06198e90 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e35f25a2d44a4e1497346f1cc09bce89'} {{(pid=87935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:49:57.796513 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 917/1866] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Sep 13 19:49:57 2022] DELETE /identity/v3/users/e35f25a2d44a4e1497346f1cc09bce89 => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 19:49:57.797323 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984f70c3-3c85-4782-af60-f76b06198e90 admin admin] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:49:57.798642 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.fernet_utils [None req-984f70c3-3c85-4782-af60-f76b06198e90 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:49:57.827716 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.notifications [None req-04f70ffa-d0ba-4989-97bc-02930b6641e7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'feab5de402164393ac4cbb2e3206f15c', 'request_id': 'req-04f70ffa-d0ba-4989-97bc-02930b6641e7'} {{(pid=87934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:49:57.836167 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.notifications [None req-04f70ffa-d0ba-4989-97bc-02930b6641e7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'feab5de402164393ac4cbb2e3206f15c', 'request_id': 'req-04f70ffa-d0ba-4989-97bc-02930b6641e7'} {{(pid=87934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:49:57.844005 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.notifications [None req-04f70ffa-d0ba-4989-97bc-02930b6641e7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'feab5de402164393ac4cbb2e3206f15c', 'request_id': 'req-04f70ffa-d0ba-4989-97bc-02930b6641e7'} {{(pid=87934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:49:57.847004 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG dbcounter [-] [87934] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=87934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:49:57.860915 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.notifications [None req-04f70ffa-d0ba-4989-97bc-02930b6641e7 admin admin] The token cache is being invalidate because project feab5de402164393ac4cbb2e3206f15c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87934) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 19:49:57.861347 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.notifications [None req-04f70ffa-d0ba-4989-97bc-02930b6641e7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:49:57.862061 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.notifications [None req-04f70ffa-d0ba-4989-97bc-02930b6641e7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:49:57.866690 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 950/1867] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Sep 13 19:49:57 2022] DELETE /identity/v3/projects/feab5de402164393ac4cbb2e3206f15c => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 19:49:57.868045 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2285f4a7-2949-4087-a425-40dd45d55ca8 None None] REQUEST_METHOD: `POST` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:49:57.868385 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2285f4a7-2949-4087-a425-40dd45d55ca8 None None] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:49:57.868668 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2285f4a7-2949-4087-a425-40dd45d55ca8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:49:57.883735 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984f70c3-3c85-4782-af60-f76b06198e90 admin admin] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:49:57.891749 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.auth.core [None req-2285f4a7-2949-4087-a425-40dd45d55ca8 None None] MFA Rules not processed for user `7b0aed92d02344acb92a0e4aa67c3068`. Rule list: `[]` (Enabled: `True`). {{(pid=87934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:49:57.893133 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.fernet_utils [None req-2285f4a7-2949-4087-a425-40dd45d55ca8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:49:57.950847 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2bab8c7-1205-489a-b6a0-5994f688f2d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:49:57.951467 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bab8c7-1205-489a-b6a0-5994f688f2d7 admin admin] REQUEST_METHOD: `POST` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:49:57.951741 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bab8c7-1205-489a-b6a0-5994f688f2d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:49:57.952008 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bab8c7-1205-489a-b6a0-5994f688f2d7 admin admin] PATH_INFO: `/v3/projects` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:49:57.953119 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2bab8c7-1205-489a-b6a0-5994f688f2d7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:49:57.955324 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2bab8c7-1205-489a-b6a0-5994f688f2d7 admin admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:49:57.969458 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 951/1868] 10.222.0.25 () {58 vars in 958 bytes} [Tue Sep 13 19:49:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 19:49:57.971121 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10620cd8-7ebe-4ffc-8d94-f1057152f80d None None] REQUEST_METHOD: `POST` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:49:57.972230 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10620cd8-7ebe-4ffc-8d94-f1057152f80d None None] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:49:57.972713 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10620cd8-7ebe-4ffc-8d94-f1057152f80d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:49:57.989425 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 918/1869] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Sep 13 19:49:57 2022] POST /identity/v3/projects => generated 387 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 19:49:57.990930 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bef490-42f6-4b8c-9e32-4705440de43c None None] REQUEST_METHOD: `POST` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:49:57.991223 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bef490-42f6-4b8c-9e32-4705440de43c None None] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:49:57.991494 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bef490-42f6-4b8c-9e32-4705440de43c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:49:58.009370 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.auth.core [None req-10620cd8-7ebe-4ffc-8d94-f1057152f80d None None] MFA Rules not processed for user `7b0aed92d02344acb92a0e4aa67c3068`. Rule list: `[]` (Enabled: `True`). {{(pid=87934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:49:58.010980 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.fernet_utils [None req-10620cd8-7ebe-4ffc-8d94-f1057152f80d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:49:58.014361 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.auth.core [None req-00bef490-42f6-4b8c-9e32-4705440de43c None None] MFA Rules not processed for user `7b0aed92d02344acb92a0e4aa67c3068`. Rule list: `[]` (Enabled: `True`). {{(pid=87935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:49:58.015663 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.fernet_utils [None req-00bef490-42f6-4b8c-9e32-4705440de43c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:49:58.090633 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 919/1870] 10.222.0.25 () {58 vars in 958 bytes} [Tue Sep 13 19:49:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 19:49:58.092465 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a68e212-249a-4574-be02-00cb96d105d1 None None] REQUEST_METHOD: `POST` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:49:58.093024 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a68e212-249a-4574-be02-00cb96d105d1 None None] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:49:58.093225 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a68e212-249a-4574-be02-00cb96d105d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:49:58.108188 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 952/1871] 10.222.0.25 () {58 vars in 958 bytes} [Tue Sep 13 19:49:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 19:49:58.109091 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10620cd8-7ebe-4ffc-8d94-f1057152f80d None None] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:49:58.110541 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.fernet_utils [None req-10620cd8-7ebe-4ffc-8d94-f1057152f80d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:49:58.118853 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.auth.core [None req-5a68e212-249a-4574-be02-00cb96d105d1 None None] MFA Rules not processed for user `7b0aed92d02344acb92a0e4aa67c3068`. Rule list: `[]` (Enabled: `True`). {{(pid=87935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:49:58.120259 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.fernet_utils [None req-5a68e212-249a-4574-be02-00cb96d105d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:49:58.126083 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10620cd8-7ebe-4ffc-8d94-f1057152f80d None None] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:49:58.129610 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 920/1872] 10.222.0.25 () {58 vars in 958 bytes} [Tue Sep 13 19:49:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 19:49:58.132027 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010c832e-8173-4964-acf6-07705d994a8e None None] REQUEST_METHOD: `POST` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:49:58.132146 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99a4c2a-7223-4279-8d3e-383bfacdf996 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:49:58.132359 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010c832e-8173-4964-acf6-07705d994a8e None None] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:49:58.132779 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010c832e-8173-4964-acf6-07705d994a8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:49:58.132885 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99a4c2a-7223-4279-8d3e-383bfacdf996 admin admin] REQUEST_METHOD: `POST` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:49:58.133100 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99a4c2a-7223-4279-8d3e-383bfacdf996 admin admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:49:58.133402 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99a4c2a-7223-4279-8d3e-383bfacdf996 admin admin] PATH_INFO: `/v3/users` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:49:58.134795 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b99a4c2a-7223-4279-8d3e-383bfacdf996 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:49:58.137559 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b99a4c2a-7223-4279-8d3e-383bfacdf996 admin admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:49:58.142635 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG dbcounter [-] [87935] Writing DB stats keystone:DELETE=2,keystone:SELECT=97,keystone:INSERT=1 {{(pid=87935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:49:58.167178 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.auth.core [None req-010c832e-8173-4964-acf6-07705d994a8e None None] MFA Rules not processed for user `7b0aed92d02344acb92a0e4aa67c3068`. Rule list: `[]` (Enabled: `True`). {{(pid=87935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:49:58.168875 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.fernet_utils [None req-010c832e-8173-4964-acf6-07705d994a8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:49:58.170589 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 953/1873] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Sep 13 19:49:58 2022] POST /identity/v3/users => generated 300 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 19:49:58.171774 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99a4c2a-7223-4279-8d3e-383bfacdf996 admin admin] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:49:58.180349 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 921/1874] 10.222.0.25 () {58 vars in 958 bytes} [Tue Sep 13 19:49:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 19:49:58.182441 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010c832e-8173-4964-acf6-07705d994a8e None None] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:49:58.184445 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.fernet_utils [None req-010c832e-8173-4964-acf6-07705d994a8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:49:58.189828 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99a4c2a-7223-4279-8d3e-383bfacdf996 admin admin] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:49:58.198645 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6ace71-37a7-46d4-b63d-d6403fd5396c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:49:58.199511 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6ace71-37a7-46d4-b63d-d6403fd5396c admin admin] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:49:58.199929 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6ace71-37a7-46d4-b63d-d6403fd5396c admin admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:49:58.201058 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6ace71-37a7-46d4-b63d-d6403fd5396c admin admin] PATH_INFO: `/v3/domains` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:49:58.202156 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b6ace71-37a7-46d4-b63d-d6403fd5396c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87934) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:49:58.202804 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b6ace71-37a7-46d4-b63d-d6403fd5396c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:49:58.205052 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b6ace71-37a7-46d4-b63d-d6403fd5396c admin admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:49:58.223007 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 954/1875] 10.222.0.25 () {58 vars in 1153 bytes} [Tue Sep 13 19:49:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:49:58.224259 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6ace71-37a7-46d4-b63d-d6403fd5396c admin admin] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:49:58.237033 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6ace71-37a7-46d4-b63d-d6403fd5396c admin admin] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:49:58.254975 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c0ea64-163e-44ec-a399-9cb2253dc9d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:49:58.255654 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c0ea64-163e-44ec-a399-9cb2253dc9d0 admin admin] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:49:58.255937 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c0ea64-163e-44ec-a399-9cb2253dc9d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:49:58.264567 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c0ea64-163e-44ec-a399-9cb2253dc9d0 admin admin] PATH_INFO: `/v3/roles` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:49:58.266448 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c0ea64-163e-44ec-a399-9cb2253dc9d0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:49:58.271355 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c0ea64-163e-44ec-a399-9cb2253dc9d0 admin admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:49:58.271926 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010c832e-8173-4964-acf6-07705d994a8e None None] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:49:58.277330 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119dca6c-6722-4398-a6bb-d64f58d7ac8d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1196a96e4a404f559600b69f929ea9da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a10a4268f3c4cb29f4e00c292e2df62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:49:58.278096 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119dca6c-6722-4398-a6bb-d64f58d7ac8d service neutron] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:49:58.278372 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119dca6c-6722-4398-a6bb-d64f58d7ac8d service neutron] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:49:58.278637 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119dca6c-6722-4398-a6bb-d64f58d7ac8d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:49:58.288874 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 955/1876] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Sep 13 19:49:58 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 19:49:58.290471 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-119dca6c-6722-4398-a6bb-d64f58d7ac8d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:49:58.292624 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-119dca6c-6722-4398-a6bb-d64f58d7ac8d service neutron] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:49:58.294929 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c0ea64-163e-44ec-a399-9cb2253dc9d0 admin admin] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:49:58.307548 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 922/1877] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Sep 13 19:49:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 19:49:58.308445 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119dca6c-6722-4398-a6bb-d64f58d7ac8d service neutron] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:49:58.309248 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c0ea64-163e-44ec-a399-9cb2253dc9d0 admin admin] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:49:58.316201 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e683c92-3b8e-4d44-a594-ce1ac76344cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:49:58.316951 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e683c92-3b8e-4d44-a594-ce1ac76344cd admin admin] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:49:58.317238 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e683c92-3b8e-4d44-a594-ce1ac76344cd admin admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:49:58.317516 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e683c92-3b8e-4d44-a594-ce1ac76344cd admin admin] PATH_INFO: `/v3/domains` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:49:58.318774 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e683c92-3b8e-4d44-a594-ce1ac76344cd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87934) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:49:58.319301 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e683c92-3b8e-4d44-a594-ce1ac76344cd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:49:58.320992 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e683c92-3b8e-4d44-a594-ce1ac76344cd admin admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:49:58.338943 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119dca6c-6722-4398-a6bb-d64f58d7ac8d service neutron] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:49:58.342602 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 956/1878] 10.222.0.25 () {58 vars in 1153 bytes} [Tue Sep 13 19:49:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:49:58.342602 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e683c92-3b8e-4d44-a594-ce1ac76344cd admin admin] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:49:58.348548 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa6b919-22b8-49f2-b7f6-56d9ce820cc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:49:58.349161 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa6b919-22b8-49f2-b7f6-56d9ce820cc8 admin admin] REQUEST_METHOD: `POST` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:49:58.352125 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa6b919-22b8-49f2-b7f6-56d9ce820cc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:49:58.352553 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa6b919-22b8-49f2-b7f6-56d9ce820cc8 admin admin] PATH_INFO: `/v3/projects` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:49:58.353291 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa6b919-22b8-49f2-b7f6-56d9ce820cc8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:49:58.356764 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e683c92-3b8e-4d44-a594-ce1ac76344cd admin admin] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:49:58.358448 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa6b919-22b8-49f2-b7f6-56d9ce820cc8 admin admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:49:58.380081 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd967ca-20d1-4f54-84d9-cb0eda33e3ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:49:58.380910 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd967ca-20d1-4f54-84d9-cb0eda33e3ee admin admin] REQUEST_METHOD: `PUT` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:49:58.381296 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd967ca-20d1-4f54-84d9-cb0eda33e3ee admin admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:49:58.381766 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd967ca-20d1-4f54-84d9-cb0eda33e3ee admin admin] PATH_INFO: `/v3/projects/621fecce5ea94359bdff9f55c017d4fb/users/f2f8e24aa8d4490aab193faacb8318a7/roles/6ca1d4427ff64e0a9d25d96cfb1445f6` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:49:58.420385 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd967ca-20d1-4f54-84d9-cb0eda33e3ee admin admin] RBAC: Authorizing `identity:create_grant(project_id=621fecce5ea94359bdff9f55c017d4fb, user_id=f2f8e24aa8d4490aab193faacb8318a7, role_id=6ca1d4427ff64e0a9d25d96cfb1445f6)` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:49:58.421995 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 923/1879] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Sep 13 19:49:58 2022] POST /identity/v3/projects => generated 377 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 19:49:58.423028 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa6b919-22b8-49f2-b7f6-56d9ce820cc8 admin admin] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:49:58.427514 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd967ca-20d1-4f54-84d9-cb0eda33e3ee admin admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:49:58.452289 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 957/1880] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Sep 13 19:49:58 2022] PUT /identity/v3/projects/621fecce5ea94359bdff9f55c017d4fb/users/f2f8e24aa8d4490aab193faacb8318a7/roles/6ca1d4427ff64e0a9d25d96cfb1445f6 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 19:49:58.453150 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd967ca-20d1-4f54-84d9-cb0eda33e3ee admin admin] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:49:58.489691 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG dbcounter [-] [87934] Writing DB stats keystone:INSERT=5,keystone:DELETE=1,keystone:SELECT=94 {{(pid=87934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:49:58.595977 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd967ca-20d1-4f54-84d9-cb0eda33e3ee admin admin] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:49:58.605156 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdfe4347-e34d-431d-b1f9-888e65a75d50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:49:58.606071 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfe4347-e34d-431d-b1f9-888e65a75d50 admin admin] REQUEST_METHOD: `POST` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:49:58.606359 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfe4347-e34d-431d-b1f9-888e65a75d50 admin admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:49:58.606633 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfe4347-e34d-431d-b1f9-888e65a75d50 admin admin] PATH_INFO: `/v3/users` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:49:58.607272 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdfe4347-e34d-431d-b1f9-888e65a75d50 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:49:58.611634 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdfe4347-e34d-431d-b1f9-888e65a75d50 admin admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:49:58.641466 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa6b919-22b8-49f2-b7f6-56d9ce820cc8 admin admin] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:49:58.643482 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 958/1881] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Sep 13 19:49:58 2022] POST /identity/v3/users => generated 289 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 19:49:58.644671 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdfe4347-e34d-431d-b1f9-888e65a75d50 admin admin] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:49:58.653317 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ba6ea6-3bfc-439f-b34b-32c468e59189 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:49:58.654031 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ba6ea6-3bfc-439f-b34b-32c468e59189 admin admin] REQUEST_METHOD: `POST` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:49:58.654366 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ba6ea6-3bfc-439f-b34b-32c468e59189 admin admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:49:58.654647 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ba6ea6-3bfc-439f-b34b-32c468e59189 admin admin] PATH_INFO: `/v3/projects` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:49:58.655298 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ba6ea6-3bfc-439f-b34b-32c468e59189 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:49:58.657334 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ba6ea6-3bfc-439f-b34b-32c468e59189 admin admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:49:58.659399 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdfe4347-e34d-431d-b1f9-888e65a75d50 admin admin] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:49:58.666722 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c868270-1cd4-4541-83f3-8a18bd2b4fbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:49:58.668491 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c868270-1cd4-4541-83f3-8a18bd2b4fbb admin admin] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:49:58.670957 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c868270-1cd4-4541-83f3-8a18bd2b4fbb admin admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:49:58.671173 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c868270-1cd4-4541-83f3-8a18bd2b4fbb admin admin] PATH_INFO: `/v3/roles` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:49:58.671904 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c868270-1cd4-4541-83f3-8a18bd2b4fbb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:49:58.673648 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c868270-1cd4-4541-83f3-8a18bd2b4fbb admin admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:49:58.701293 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 959/1882] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Sep 13 19:49:58 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 19:49:58.708103 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c868270-1cd4-4541-83f3-8a18bd2b4fbb admin admin] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:49:58.730274 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 924/1883] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Sep 13 19:49:58 2022] POST /identity/v3/projects => generated 377 bytes in 304 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 19:49:58.730274 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ba6ea6-3bfc-439f-b34b-32c468e59189 admin admin] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:49:58.736374 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c868270-1cd4-4541-83f3-8a18bd2b4fbb admin admin] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:49:58.884366 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcaadb0c-26ce-4e9b-8c27-22ec07870475 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:49:58.885036 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcaadb0c-26ce-4e9b-8c27-22ec07870475 admin admin] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:49:58.885318 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcaadb0c-26ce-4e9b-8c27-22ec07870475 admin admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:49:58.885618 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcaadb0c-26ce-4e9b-8c27-22ec07870475 admin admin] PATH_INFO: `/v3/roles` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:49:58.886310 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcaadb0c-26ce-4e9b-8c27-22ec07870475 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:49:58.888002 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcaadb0c-26ce-4e9b-8c27-22ec07870475 admin admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:49:58.898012 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ba6ea6-3bfc-439f-b34b-32c468e59189 admin admin] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:49:58.903798 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9f0f27-d7e6-4e8d-b02c-5a59c9a2b3bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:49:58.905329 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9f0f27-d7e6-4e8d-b02c-5a59c9a2b3bf admin admin] REQUEST_METHOD: `PUT` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:49:58.905522 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9f0f27-d7e6-4e8d-b02c-5a59c9a2b3bf admin admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:49:58.905628 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 960/1884] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Sep 13 19:49:58 2022] GET /identity/v3/roles => generated 1420 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 19:49:58.906362 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9f0f27-d7e6-4e8d-b02c-5a59c9a2b3bf admin admin] PATH_INFO: `/v3/projects/621fecce5ea94359bdff9f55c017d4fb/users/f2f8e24aa8d4490aab193faacb8318a7/roles/6ca1d4427ff64e0a9d25d96cfb1445f6` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:49:58.906555 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcaadb0c-26ce-4e9b-8c27-22ec07870475 admin admin] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:49:58.911414 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b9f0f27-d7e6-4e8d-b02c-5a59c9a2b3bf admin admin] RBAC: Authorizing `identity:create_grant(project_id=621fecce5ea94359bdff9f55c017d4fb, user_id=f2f8e24aa8d4490aab193faacb8318a7, role_id=6ca1d4427ff64e0a9d25d96cfb1445f6)` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:49:58.914425 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b9f0f27-d7e6-4e8d-b02c-5a59c9a2b3bf admin admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:49:58.922963 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG dbcounter [-] [87935] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:49:58.937106 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcaadb0c-26ce-4e9b-8c27-22ec07870475 admin admin] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:49:58.946254 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 925/1885] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Sep 13 19:49:58 2022] PUT /identity/v3/projects/621fecce5ea94359bdff9f55c017d4fb/users/f2f8e24aa8d4490aab193faacb8318a7/roles/6ca1d4427ff64e0a9d25d96cfb1445f6 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 19:49:58.950211 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9f0f27-d7e6-4e8d-b02c-5a59c9a2b3bf admin admin] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:49:59.037103 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38868145-c3db-4551-a13a-ab06d28a9cbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:49:59.038210 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38868145-c3db-4551-a13a-ab06d28a9cbb admin admin] REQUEST_METHOD: `POST` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:49:59.038717 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38868145-c3db-4551-a13a-ab06d28a9cbb admin admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:49:59.039203 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38868145-c3db-4551-a13a-ab06d28a9cbb admin admin] PATH_INFO: `/v3/users` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:49:59.040642 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38868145-c3db-4551-a13a-ab06d28a9cbb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:49:59.042963 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38868145-c3db-4551-a13a-ab06d28a9cbb admin admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:49:59.088170 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 961/1886] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Sep 13 19:49:58 2022] POST /identity/v3/users => generated 289 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 19:49:59.088170 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c634c0f-435d-4e90-8e0a-445f69351f8d None None] REQUEST_METHOD: `POST` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:49:59.088170 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c634c0f-435d-4e90-8e0a-445f69351f8d None None] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:49:59.088170 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c634c0f-435d-4e90-8e0a-445f69351f8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:49:59.097182 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9f0f27-d7e6-4e8d-b02c-5a59c9a2b3bf admin admin] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:49:59.103701 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d572927-f954-42eb-b725-8b565eae6241 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:49:59.104463 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d572927-f954-42eb-b725-8b565eae6241 admin admin] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:49:59.104804 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d572927-f954-42eb-b725-8b565eae6241 admin admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:49:59.105137 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d572927-f954-42eb-b725-8b565eae6241 admin admin] PATH_INFO: `/v3/roles` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:49:59.105860 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d572927-f954-42eb-b725-8b565eae6241 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:49:59.108269 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d572927-f954-42eb-b725-8b565eae6241 admin admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:49:59.121397 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 926/1887] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Sep 13 19:49:58 2022] GET /identity/v3/roles => generated 1420 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 19:49:59.122262 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d572927-f954-42eb-b725-8b565eae6241 admin admin] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:49:59.135907 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.auth.core [None req-5c634c0f-435d-4e90-8e0a-445f69351f8d None None] MFA Rules not processed for user `f2f8e24aa8d4490aab193faacb8318a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:49:59.137656 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.fernet_utils [None req-5c634c0f-435d-4e90-8e0a-445f69351f8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:49:59.142865 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d572927-f954-42eb-b725-8b565eae6241 admin admin] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:49:59.149835 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG dbcounter [-] [87934] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=87934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:49:59.152197 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a688df-afe6-40fe-85eb-eb8627954635 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:49:59.152977 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a688df-afe6-40fe-85eb-eb8627954635 admin admin] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:49:59.153595 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a688df-afe6-40fe-85eb-eb8627954635 admin admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:49:59.153936 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a688df-afe6-40fe-85eb-eb8627954635 admin admin] PATH_INFO: `/v3/roles` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:49:59.154662 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a688df-afe6-40fe-85eb-eb8627954635 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:49:59.159221 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a688df-afe6-40fe-85eb-eb8627954635 admin admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:49:59.176071 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 927/1888] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Sep 13 19:49:59 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 19:49:59.177105 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a688df-afe6-40fe-85eb-eb8627954635 admin admin] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:49:59.193482 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a688df-afe6-40fe-85eb-eb8627954635 admin admin] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:49:59.202622 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47102d51-fb25-4eb2-9001-d5a2a335d02a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:49:59.204114 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47102d51-fb25-4eb2-9001-d5a2a335d02a admin admin] REQUEST_METHOD: `PUT` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:49:59.204602 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47102d51-fb25-4eb2-9001-d5a2a335d02a admin admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:49:59.205088 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47102d51-fb25-4eb2-9001-d5a2a335d02a admin admin] PATH_INFO: `/v3/projects/ccd7c1885c7f4c629d9f575a6afc315d/users/39a1d44ae66340f1aa95ea45081ab24e/roles/a259191f6d0e46fabd9f34536bb28747` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:49:59.230703 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47102d51-fb25-4eb2-9001-d5a2a335d02a admin admin] RBAC: Authorizing `identity:create_grant(project_id=ccd7c1885c7f4c629d9f575a6afc315d, user_id=39a1d44ae66340f1aa95ea45081ab24e, role_id=a259191f6d0e46fabd9f34536bb28747)` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:49:59.235216 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47102d51-fb25-4eb2-9001-d5a2a335d02a admin admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:49:59.266994 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 928/1889] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Sep 13 19:49:59 2022] PUT /identity/v3/projects/ccd7c1885c7f4c629d9f575a6afc315d/users/39a1d44ae66340f1aa95ea45081ab24e/roles/a259191f6d0e46fabd9f34536bb28747 => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 19:49:59.268294 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47102d51-fb25-4eb2-9001-d5a2a335d02a admin admin] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:49:59.274318 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 962/1890] 10.222.0.25 () {58 vars in 958 bytes} [Tue Sep 13 19:49:59 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 19:49:59.285459 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943cb16e-2e2b-40ae-add6-8be6df1c592b None None] REQUEST_METHOD: `POST` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:49:59.285988 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943cb16e-2e2b-40ae-add6-8be6df1c592b None None] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:49:59.286205 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943cb16e-2e2b-40ae-add6-8be6df1c592b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:49:59.334481 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.auth.core [None req-943cb16e-2e2b-40ae-add6-8be6df1c592b None None] MFA Rules not processed for user `39a1d44ae66340f1aa95ea45081ab24e`. Rule list: `[]` (Enabled: `True`). {{(pid=87934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:49:59.336846 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.fernet_utils [None req-943cb16e-2e2b-40ae-add6-8be6df1c592b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:49:59.371879 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47102d51-fb25-4eb2-9001-d5a2a335d02a admin admin] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:49:59.376654 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72d7597-7ef0-4c42-abae-b9957ad0bf47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:49:59.377328 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72d7597-7ef0-4c42-abae-b9957ad0bf47 admin admin] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:49:59.378200 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72d7597-7ef0-4c42-abae-b9957ad0bf47 admin admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:49:59.378569 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72d7597-7ef0-4c42-abae-b9957ad0bf47 admin admin] PATH_INFO: `/v3/roles` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:49:59.379277 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e72d7597-7ef0-4c42-abae-b9957ad0bf47 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:49:59.381035 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e72d7597-7ef0-4c42-abae-b9957ad0bf47 admin admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:49:59.391526 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 929/1891] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Sep 13 19:49:59 2022] GET /identity/v3/roles => generated 1420 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 19:49:59.392500 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72d7597-7ef0-4c42-abae-b9957ad0bf47 admin admin] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:49:59.394935 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.fernet_utils [None req-e72d7597-7ef0-4c42-abae-b9957ad0bf47 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:49:59.426491 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 963/1892] 10.222.0.25 () {58 vars in 958 bytes} [Tue Sep 13 19:49:59 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 19:49:59.427422 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943cb16e-2e2b-40ae-add6-8be6df1c592b None None] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:49:59.428839 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.fernet_utils [None req-943cb16e-2e2b-40ae-add6-8be6df1c592b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:49:59.444778 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943cb16e-2e2b-40ae-add6-8be6df1c592b None None] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:49:59.449842 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5031f0a-b106-4456-ab89-16876865bca0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:49:59.450527 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5031f0a-b106-4456-ab89-16876865bca0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:49:59.450807 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5031f0a-b106-4456-ab89-16876865bca0 admin admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:49:59.451080 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5031f0a-b106-4456-ab89-16876865bca0 admin admin] PATH_INFO: `/v3/projects/1147d3b2ef354d41a5081972dcb1fb2c` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:49:59.452230 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5031f0a-b106-4456-ab89-16876865bca0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1147d3b2ef354d41a5081972dcb1fb2c)` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:49:59.454517 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5031f0a-b106-4456-ab89-16876865bca0 admin admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:49:59.460838 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72d7597-7ef0-4c42-abae-b9957ad0bf47 admin admin] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:49:59.464614 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030407f3-3ef4-4b09-805a-88f8362b1fac service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cbb50c88b794a7f9f26844effde7d63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a10a4268f3c4cb29f4e00c292e2df62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:49:59.465218 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030407f3-3ef4-4b09-805a-88f8362b1fac service cinder] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:49:59.465494 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030407f3-3ef4-4b09-805a-88f8362b1fac service cinder] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:49:59.465765 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030407f3-3ef4-4b09-805a-88f8362b1fac service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:49:59.471772 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG dbcounter [-] [87935] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:49:59.514056 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.notifications [None req-c5031f0a-b106-4456-ab89-16876865bca0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1147d3b2ef354d41a5081972dcb1fb2c', 'request_id': 'req-c5031f0a-b106-4456-ab89-16876865bca0'} {{(pid=87934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:49:59.521351 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.notifications [None req-c5031f0a-b106-4456-ab89-16876865bca0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1147d3b2ef354d41a5081972dcb1fb2c', 'request_id': 'req-c5031f0a-b106-4456-ab89-16876865bca0'} {{(pid=87934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:49:59.527259 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.notifications [None req-c5031f0a-b106-4456-ab89-16876865bca0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1147d3b2ef354d41a5081972dcb1fb2c', 'request_id': 'req-c5031f0a-b106-4456-ab89-16876865bca0'} {{(pid=87934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:49:59.536422 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-030407f3-3ef4-4b09-805a-88f8362b1fac service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:49:59.538090 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-030407f3-3ef4-4b09-805a-88f8362b1fac service cinder] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:49:59.542065 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.notifications [None req-c5031f0a-b106-4456-ab89-16876865bca0 admin admin] The token cache is being invalidate because project 1147d3b2ef354d41a5081972dcb1fb2c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87934) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 19:49:59.542395 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.notifications [None req-c5031f0a-b106-4456-ab89-16876865bca0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:49:59.543044 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.notifications [None req-c5031f0a-b106-4456-ab89-16876865bca0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:49:59.544623 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 964/1893] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Sep 13 19:49:59 2022] DELETE /identity/v3/projects/1147d3b2ef354d41a5081972dcb1fb2c => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 19:49:59.545506 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5031f0a-b106-4456-ab89-16876865bca0 admin admin] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:49:59.548319 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.fernet_utils [None req-c5031f0a-b106-4456-ab89-16876865bca0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:49:59.551139 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 930/1894] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Sep 13 19:49:59 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 19:49:59.551866 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030407f3-3ef4-4b09-805a-88f8362b1fac service cinder] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:49:59.562955 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030407f3-3ef4-4b09-805a-88f8362b1fac service cinder] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:49:59.572958 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG dbcounter [-] [87934] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=87934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:49:59.647269 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5031f0a-b106-4456-ab89-16876865bca0 admin admin] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:49:59.652236 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d951b0a-91c5-41b8-8fad-9183ba257fed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:49:59.652949 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d951b0a-91c5-41b8-8fad-9183ba257fed admin admin] REQUEST_METHOD: `PUT` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:49:59.653230 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d951b0a-91c5-41b8-8fad-9183ba257fed admin admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:49:59.653607 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d951b0a-91c5-41b8-8fad-9183ba257fed admin admin] PATH_INFO: `/v3/projects/4372119fe5204cf2821439fb5dbd0d3e/users/df7d0f6995b44913b5c0b922c3db88ab/roles/a259191f6d0e46fabd9f34536bb28747` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:49:59.657500 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52aa810e-269e-4952-9061-451019f08858 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:49:59.658100 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52aa810e-269e-4952-9061-451019f08858 admin admin] REQUEST_METHOD: `POST` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:49:59.658378 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52aa810e-269e-4952-9061-451019f08858 admin admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:49:59.658683 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52aa810e-269e-4952-9061-451019f08858 admin admin] PATH_INFO: `/v3/projects` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:49:59.659904 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52aa810e-269e-4952-9061-451019f08858 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:49:59.661843 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52aa810e-269e-4952-9061-451019f08858 admin admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:49:59.669292 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d951b0a-91c5-41b8-8fad-9183ba257fed admin admin] RBAC: Authorizing `identity:create_grant(project_id=4372119fe5204cf2821439fb5dbd0d3e, user_id=df7d0f6995b44913b5c0b922c3db88ab, role_id=a259191f6d0e46fabd9f34536bb28747)` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:49:59.671936 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d951b0a-91c5-41b8-8fad-9183ba257fed admin admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:49:59.689882 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 965/1895] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Sep 13 19:49:59 2022] PUT /identity/v3/projects/4372119fe5204cf2821439fb5dbd0d3e/users/df7d0f6995b44913b5c0b922c3db88ab/roles/a259191f6d0e46fabd9f34536bb28747 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 19:49:59.690899 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d951b0a-91c5-41b8-8fad-9183ba257fed admin admin] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:49:59.696706 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 931/1896] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Sep 13 19:49:59 2022] POST /identity/v3/projects => generated 377 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 19:49:59.696706 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52aa810e-269e-4952-9061-451019f08858 admin admin] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:49:59.700870 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.fernet_utils [None req-52aa810e-269e-4952-9061-451019f08858 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:49:59.703837 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.fernet_utils [None req-7d951b0a-91c5-41b8-8fad-9183ba257fed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:49:59.793535 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d951b0a-91c5-41b8-8fad-9183ba257fed admin admin] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:49:59.800016 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10cbdfba-ca3a-45d3-a8b8-5c4f99d2d296 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:49:59.801348 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cbdfba-ca3a-45d3-a8b8-5c4f99d2d296 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:49:59.801700 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cbdfba-ca3a-45d3-a8b8-5c4f99d2d296 admin admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:49:59.802042 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cbdfba-ca3a-45d3-a8b8-5c4f99d2d296 admin admin] PATH_INFO: `/v3/users/3ddc49e46b9644508daf13fa2e9880b9` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:49:59.803017 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52aa810e-269e-4952-9061-451019f08858 admin admin] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:49:59.804191 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10cbdfba-ca3a-45d3-a8b8-5c4f99d2d296 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3ddc49e46b9644508daf13fa2e9880b9)` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:49:59.807291 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10cbdfba-ca3a-45d3-a8b8-5c4f99d2d296 admin admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:49:59.808951 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c01fa9-f7e5-42a9-af18-231c323919f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:49:59.809909 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c01fa9-f7e5-42a9-af18-231c323919f4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:49:59.810350 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c01fa9-f7e5-42a9-af18-231c323919f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:49:59.810876 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c01fa9-f7e5-42a9-af18-231c323919f4 admin admin] PATH_INFO: `/v3/users/4c1fb3dc7ae54eda836872656920d5bf` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:49:59.812433 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c01fa9-f7e5-42a9-af18-231c323919f4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4c1fb3dc7ae54eda836872656920d5bf)` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:49:59.815056 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c01fa9-f7e5-42a9-af18-231c323919f4 admin admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:49:59.874721 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.notifications [None req-10cbdfba-ca3a-45d3-a8b8-5c4f99d2d296 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3ddc49e46b9644508daf13fa2e9880b9'} {{(pid=87934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:49:59.875587 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.notifications [None req-10cbdfba-ca3a-45d3-a8b8-5c4f99d2d296 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3ddc49e46b9644508daf13fa2e9880b9'} {{(pid=87934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:49:59.876301 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.notifications [None req-10cbdfba-ca3a-45d3-a8b8-5c4f99d2d296 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3ddc49e46b9644508daf13fa2e9880b9'} {{(pid=87934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:49:59.883318 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG dbcounter [-] [87935] Writing DB stats keystone:SELECT=94,keystone:INSERT=1,keystone:DELETE=5 {{(pid=87935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:49:59.887766 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.notifications [None req-10cbdfba-ca3a-45d3-a8b8-5c4f99d2d296 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3ddc49e46b9644508daf13fa2e9880b9'} {{(pid=87934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:49:59.910650 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.notifications [None req-10cbdfba-ca3a-45d3-a8b8-5c4f99d2d296 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3ddc49e46b9644508daf13fa2e9880b9'} {{(pid=87934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:49:59.932861 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 966/1897] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Sep 13 19:49:59 2022] DELETE /identity/v3/users/3ddc49e46b9644508daf13fa2e9880b9 => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 19:49:59.934155 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10cbdfba-ca3a-45d3-a8b8-5c4f99d2d296 admin admin] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:49:59.936169 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.fernet_utils [None req-10cbdfba-ca3a-45d3-a8b8-5c4f99d2d296 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:49:59.941813 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.notifications [None req-42c01fa9-f7e5-42a9-af18-231c323919f4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4c1fb3dc7ae54eda836872656920d5bf'} {{(pid=87935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:49:59.952195 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.notifications [None req-42c01fa9-f7e5-42a9-af18-231c323919f4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4c1fb3dc7ae54eda836872656920d5bf'} {{(pid=87935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:49:59.967624 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG dbcounter [-] [87934] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=87934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:49:59.992876 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.notifications [None req-42c01fa9-f7e5-42a9-af18-231c323919f4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4c1fb3dc7ae54eda836872656920d5bf'} {{(pid=87935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:49:59.993830 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.notifications [None req-42c01fa9-f7e5-42a9-af18-231c323919f4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4c1fb3dc7ae54eda836872656920d5bf'} {{(pid=87935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:49:59.994695 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.notifications [None req-42c01fa9-f7e5-42a9-af18-231c323919f4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4c1fb3dc7ae54eda836872656920d5bf'} {{(pid=87935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:50:00.019663 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 932/1898] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Sep 13 19:49:59 2022] DELETE /identity/v3/users/4c1fb3dc7ae54eda836872656920d5bf => generated 0 bytes in 319 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 19:50:00.023127 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c800b032-8ad1-4a17-8ff4-bc256e815508 None None] REQUEST_METHOD: `POST` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:50:00.023989 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c800b032-8ad1-4a17-8ff4-bc256e815508 None None] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:50:00.025075 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c800b032-8ad1-4a17-8ff4-bc256e815508 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:50:00.051306 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10cbdfba-ca3a-45d3-a8b8-5c4f99d2d296 admin admin] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:50:00.069403 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.auth.core [None req-c800b032-8ad1-4a17-8ff4-bc256e815508 None None] MFA Rules not processed for user `df7d0f6995b44913b5c0b922c3db88ab`. Rule list: `[]` (Enabled: `True`). {{(pid=87935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:50:00.071435 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.fernet_utils [None req-c800b032-8ad1-4a17-8ff4-bc256e815508 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:50:00.153743 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d6a7ab-0b16-436a-8cf1-aeb75128b5c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:50:00.154734 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d6a7ab-0b16-436a-8cf1-aeb75128b5c2 admin admin] REQUEST_METHOD: `POST` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:50:00.155267 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d6a7ab-0b16-436a-8cf1-aeb75128b5c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:50:00.155739 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d6a7ab-0b16-436a-8cf1-aeb75128b5c2 admin admin] PATH_INFO: `/v3/users` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:50:00.156800 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d6a7ab-0b16-436a-8cf1-aeb75128b5c2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:50:00.159770 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d6a7ab-0b16-436a-8cf1-aeb75128b5c2 admin admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:50:00.175486 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 933/1899] 10.222.0.25 () {58 vars in 958 bytes} [Tue Sep 13 19:50:00 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 19:50:00.175486 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7c4f3d-a90b-4e21-8ce5-f2c4c4181eec None None] REQUEST_METHOD: `POST` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:50:00.175486 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7c4f3d-a90b-4e21-8ce5-f2c4c4181eec None None] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:50:00.175486 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7c4f3d-a90b-4e21-8ce5-f2c4c4181eec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:50:00.196533 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 967/1900] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Sep 13 19:49:59 2022] POST /identity/v3/users => generated 295 bytes in 263 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 19:50:00.197833 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d6a7ab-0b16-436a-8cf1-aeb75128b5c2 admin admin] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:50:00.199719 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.auth.core [None req-3f7c4f3d-a90b-4e21-8ce5-f2c4c4181eec None None] MFA Rules not processed for user `7b0aed92d02344acb92a0e4aa67c3068`. Rule list: `[]` (Enabled: `True`). {{(pid=87935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:50:00.200504 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.fernet_utils [None req-79d6a7ab-0b16-436a-8cf1-aeb75128b5c2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:50:00.201634 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.fernet_utils [None req-3f7c4f3d-a90b-4e21-8ce5-f2c4c4181eec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:50:00.211359 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 934/1901] 10.222.0.25 () {58 vars in 958 bytes} [Tue Sep 13 19:50:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 19:50:00.212259 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7c4f3d-a90b-4e21-8ce5-f2c4c4181eec None None] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:50:00.213642 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.fernet_utils [None req-3f7c4f3d-a90b-4e21-8ce5-f2c4c4181eec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:50:00.216638 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d6a7ab-0b16-436a-8cf1-aeb75128b5c2 admin admin] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:50:00.222820 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06364e70-6b22-4595-bc2d-3768a4e8eb4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:50:00.224292 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06364e70-6b22-4595-bc2d-3768a4e8eb4d admin admin] REQUEST_METHOD: `POST` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:50:00.224913 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06364e70-6b22-4595-bc2d-3768a4e8eb4d admin admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:50:00.225401 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06364e70-6b22-4595-bc2d-3768a4e8eb4d admin admin] PATH_INFO: `/v3/projects` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:50:00.226261 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06364e70-6b22-4595-bc2d-3768a4e8eb4d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:50:00.227852 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7c4f3d-a90b-4e21-8ce5-f2c4c4181eec None None] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:50:00.230580 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06364e70-6b22-4595-bc2d-3768a4e8eb4d admin admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:50:00.233215 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9158c8-d8e1-47e8-a81d-048998d4a868 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:50:00.233961 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9158c8-d8e1-47e8-a81d-048998d4a868 admin admin] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:50:00.234241 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9158c8-d8e1-47e8-a81d-048998d4a868 admin admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:50:00.234507 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9158c8-d8e1-47e8-a81d-048998d4a868 admin admin] PATH_INFO: `/v3/roles` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:50:00.235162 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b9158c8-d8e1-47e8-a81d-048998d4a868 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:50:00.237578 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b9158c8-d8e1-47e8-a81d-048998d4a868 admin admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:50:00.258696 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 935/1902] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Sep 13 19:50:00 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 19:50:00.262711 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9158c8-d8e1-47e8-a81d-048998d4a868 admin admin] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:50:00.276709 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 968/1903] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Sep 13 19:50:00 2022] POST /identity/v3/projects => generated 377 bytes in 78 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 19:50:00.280001 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06364e70-6b22-4595-bc2d-3768a4e8eb4d admin admin] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:50:00.283030 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9158c8-d8e1-47e8-a81d-048998d4a868 admin admin] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:50:00.386651 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa528762-ca76-4e04-ab9a-eb3dd05b67e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:50:00.388423 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa528762-ca76-4e04-ab9a-eb3dd05b67e0 admin admin] REQUEST_METHOD: `PUT` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:50:00.389054 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa528762-ca76-4e04-ab9a-eb3dd05b67e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:50:00.389473 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa528762-ca76-4e04-ab9a-eb3dd05b67e0 admin admin] PATH_INFO: `/v3/projects/7f40eddbf85d4702b561cd79b64493fd/users/9ab2b7c57508493f84a80cb474240d6a/roles/6ca1d4427ff64e0a9d25d96cfb1445f6` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:50:00.411337 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa528762-ca76-4e04-ab9a-eb3dd05b67e0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7f40eddbf85d4702b561cd79b64493fd, user_id=9ab2b7c57508493f84a80cb474240d6a, role_id=6ca1d4427ff64e0a9d25d96cfb1445f6)` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:50:00.415216 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa528762-ca76-4e04-ab9a-eb3dd05b67e0 admin admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:50:00.439842 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 936/1904] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Sep 13 19:50:00 2022] PUT /identity/v3/projects/7f40eddbf85d4702b561cd79b64493fd/users/9ab2b7c57508493f84a80cb474240d6a/roles/6ca1d4427ff64e0a9d25d96cfb1445f6 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 19:50:00.442987 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa528762-ca76-4e04-ab9a-eb3dd05b67e0 admin admin] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:50:00.445998 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.fernet_utils [None req-aa528762-ca76-4e04-ab9a-eb3dd05b67e0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:50:00.448977 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06364e70-6b22-4595-bc2d-3768a4e8eb4d admin admin] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:50:00.451805 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG dbcounter [-] [87935] Writing DB stats keystone:SELECT=93,keystone:DELETE=5,keystone:INSERT=2 {{(pid=87935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:50:00.543563 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG dbcounter [-] [87934] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=87934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:50:00.577693 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc217621-69ab-4fe0-b1ff-95fc0864e69a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:50:00.582053 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc217621-69ab-4fe0-b1ff-95fc0864e69a admin admin] REQUEST_METHOD: `POST` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:50:00.582505 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc217621-69ab-4fe0-b1ff-95fc0864e69a admin admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:50:00.582793 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc217621-69ab-4fe0-b1ff-95fc0864e69a admin admin] PATH_INFO: `/v3/users` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:50:00.583457 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc217621-69ab-4fe0-b1ff-95fc0864e69a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:50:00.585681 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc217621-69ab-4fe0-b1ff-95fc0864e69a admin admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:50:00.594035 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa528762-ca76-4e04-ab9a-eb3dd05b67e0 admin admin] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:50:00.601432 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357c024e-b4c7-4286-89c6-73d777186316 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1196a96e4a404f559600b69f929ea9da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a10a4268f3c4cb29f4e00c292e2df62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:50:00.603362 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357c024e-b4c7-4286-89c6-73d777186316 service neutron] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:50:00.607466 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357c024e-b4c7-4286-89c6-73d777186316 service neutron] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:50:00.607813 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357c024e-b4c7-4286-89c6-73d777186316 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:50:00.621570 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 969/1905] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Sep 13 19:50:00 2022] POST /identity/v3/users => generated 295 bytes in 342 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 13 19:50:00.623559 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc217621-69ab-4fe0-b1ff-95fc0864e69a admin admin] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:50:00.628366 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-357c024e-b4c7-4286-89c6-73d777186316 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:50:00.630037 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-357c024e-b4c7-4286-89c6-73d777186316 service neutron] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:50:00.646244 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 937/1906] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Sep 13 19:50:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 205 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 19:50:00.647248 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357c024e-b4c7-4286-89c6-73d777186316 service neutron] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:50:00.649076 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc217621-69ab-4fe0-b1ff-95fc0864e69a admin admin] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:50:00.660975 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416fecac-7ba7-4929-bcf1-350179a35011 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:50:00.661667 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416fecac-7ba7-4929-bcf1-350179a35011 admin admin] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:50:00.662149 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416fecac-7ba7-4929-bcf1-350179a35011 admin admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:50:00.662432 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416fecac-7ba7-4929-bcf1-350179a35011 admin admin] PATH_INFO: `/v3/roles` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:50:00.663088 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-416fecac-7ba7-4929-bcf1-350179a35011 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:50:00.666537 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357c024e-b4c7-4286-89c6-73d777186316 service neutron] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:50:00.667754 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-416fecac-7ba7-4929-bcf1-350179a35011 admin admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:50:00.678338 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a915bb6-c9e1-4da0-a81a-648614de168c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:50:00.679120 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a915bb6-c9e1-4da0-a81a-648614de168c admin admin] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:50:00.679497 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a915bb6-c9e1-4da0-a81a-648614de168c admin admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:50:00.679870 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a915bb6-c9e1-4da0-a81a-648614de168c admin admin] PATH_INFO: `/v3/roles` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:50:00.680650 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a915bb6-c9e1-4da0-a81a-648614de168c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:50:00.682799 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a915bb6-c9e1-4da0-a81a-648614de168c admin admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:50:00.682983 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 970/1907] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Sep 13 19:50:00 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 19:50:00.687742 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416fecac-7ba7-4929-bcf1-350179a35011 admin admin] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:50:00.705164 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 938/1908] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Sep 13 19:50:00 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 19:50:00.713946 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a915bb6-c9e1-4da0-a81a-648614de168c admin admin] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:50:00.724841 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416fecac-7ba7-4929-bcf1-350179a35011 admin admin] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:50:00.744333 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a915bb6-c9e1-4da0-a81a-648614de168c admin admin] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:50:00.754080 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06cb20c6-d6ee-42ad-bd7a-dc2a16262433 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:50:00.754760 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06cb20c6-d6ee-42ad-bd7a-dc2a16262433 admin admin] REQUEST_METHOD: `PUT` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:50:00.755043 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06cb20c6-d6ee-42ad-bd7a-dc2a16262433 admin admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:50:00.755318 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06cb20c6-d6ee-42ad-bd7a-dc2a16262433 admin admin] PATH_INFO: `/v3/projects/d97362afd16940d7ba017d0d1961e53d/users/6cac9dbea80548d2a9bc8bc15f2744a0/roles/6ca1d4427ff64e0a9d25d96cfb1445f6` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:50:00.756241 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595e76e1-6cac-46bd-b7bb-d56036b7cc1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:50:00.757209 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595e76e1-6cac-46bd-b7bb-d56036b7cc1d admin admin] REQUEST_METHOD: `PUT` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:50:00.757670 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595e76e1-6cac-46bd-b7bb-d56036b7cc1d admin admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:50:00.758199 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595e76e1-6cac-46bd-b7bb-d56036b7cc1d admin admin] PATH_INFO: `/v3/projects/7f40eddbf85d4702b561cd79b64493fd/users/9ab2b7c57508493f84a80cb474240d6a/roles/6ca1d4427ff64e0a9d25d96cfb1445f6` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:50:00.761294 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-595e76e1-6cac-46bd-b7bb-d56036b7cc1d admin admin] RBAC: Authorizing `identity:create_grant(project_id=7f40eddbf85d4702b561cd79b64493fd, user_id=9ab2b7c57508493f84a80cb474240d6a, role_id=6ca1d4427ff64e0a9d25d96cfb1445f6)` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:50:00.764910 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-595e76e1-6cac-46bd-b7bb-d56036b7cc1d admin admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:50:00.775710 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06cb20c6-d6ee-42ad-bd7a-dc2a16262433 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d97362afd16940d7ba017d0d1961e53d, user_id=6cac9dbea80548d2a9bc8bc15f2744a0, role_id=6ca1d4427ff64e0a9d25d96cfb1445f6)` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:50:00.778660 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06cb20c6-d6ee-42ad-bd7a-dc2a16262433 admin admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:50:00.807180 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 939/1910] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Sep 13 19:50:00 2022] PUT /identity/v3/projects/d97362afd16940d7ba017d0d1961e53d/users/6cac9dbea80548d2a9bc8bc15f2744a0/roles/6ca1d4427ff64e0a9d25d96cfb1445f6 => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 19:50:00.809082 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06cb20c6-d6ee-42ad-bd7a-dc2a16262433 admin admin] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:50:00.813529 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 971/1910] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Sep 13 19:50:00 2022] PUT /identity/v3/projects/7f40eddbf85d4702b561cd79b64493fd/users/9ab2b7c57508493f84a80cb474240d6a/roles/6ca1d4427ff64e0a9d25d96cfb1445f6 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 19:50:00.815373 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80806ef-c2e5-4795-94cc-bee0262b5de8 None None] REQUEST_METHOD: `POST` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:50:00.815769 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80806ef-c2e5-4795-94cc-bee0262b5de8 None None] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:50:00.816110 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80806ef-c2e5-4795-94cc-bee0262b5de8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:50:00.854180 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.auth.core [None req-b80806ef-c2e5-4795-94cc-bee0262b5de8 None None] MFA Rules not processed for user `9ab2b7c57508493f84a80cb474240d6a`. Rule list: `[]` (Enabled: `True`). {{(pid=87934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:50:00.856078 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.fernet_utils [None req-b80806ef-c2e5-4795-94cc-bee0262b5de8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:50:00.905781 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06cb20c6-d6ee-42ad-bd7a-dc2a16262433 admin admin] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:50:00.993284 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 972/1911] 10.222.0.25 () {58 vars in 958 bytes} [Tue Sep 13 19:50:00 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 19:50:00.995755 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca71594f-87e0-4d72-98c2-673769b2d185 None None] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:50:00.996178 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca71594f-87e0-4d72-98c2-673769b2d185 None None] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:50:00.996954 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca71594f-87e0-4d72-98c2-673769b2d185 None None] PATH_INFO: `/` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:50:00.999699 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 973/1912] 10.222.0.25 () {54 vars in 921 bytes} [Tue Sep 13 19:50:00 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:50:01.000704 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca71594f-87e0-4d72-98c2-673769b2d185 None None] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:50:01.002016 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba471f98-d55a-4727-9458-cd70bd2163e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:50:01.003485 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.fernet_utils [None req-ca71594f-87e0-4d72-98c2-673769b2d185 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:50:01.003619 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba471f98-d55a-4727-9458-cd70bd2163e4 admin admin] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:50:01.003949 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba471f98-d55a-4727-9458-cd70bd2163e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:50:01.004810 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba471f98-d55a-4727-9458-cd70bd2163e4 admin admin] PATH_INFO: `/v3/roles` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:50:01.005602 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba471f98-d55a-4727-9458-cd70bd2163e4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:50:01.007451 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba471f98-d55a-4727-9458-cd70bd2163e4 admin admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:50:01.022638 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 940/1913] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Sep 13 19:50:00 2022] GET /identity/v3/roles => generated 1420 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 19:50:01.024201 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba471f98-d55a-4727-9458-cd70bd2163e4 admin admin] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:50:01.037412 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba471f98-d55a-4727-9458-cd70bd2163e4 admin admin] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:50:01.045449 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc6ce24-8f4b-43ca-b912-3967b58fbcd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:50:01.047258 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc6ce24-8f4b-43ca-b912-3967b58fbcd6 admin admin] REQUEST_METHOD: `PUT` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:50:01.047582 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc6ce24-8f4b-43ca-b912-3967b58fbcd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:50:01.047860 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc6ce24-8f4b-43ca-b912-3967b58fbcd6 admin admin] PATH_INFO: `/v3/projects/d97362afd16940d7ba017d0d1961e53d/users/6cac9dbea80548d2a9bc8bc15f2744a0/roles/6ca1d4427ff64e0a9d25d96cfb1445f6` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:50:01.051445 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc6ce24-8f4b-43ca-b912-3967b58fbcd6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d97362afd16940d7ba017d0d1961e53d, user_id=6cac9dbea80548d2a9bc8bc15f2744a0, role_id=6ca1d4427ff64e0a9d25d96cfb1445f6)` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:50:01.055911 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc6ce24-8f4b-43ca-b912-3967b58fbcd6 admin admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:50:01.066416 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG dbcounter [-] [87935] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=87935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:50:01.084313 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 941/1914] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Sep 13 19:50:01 2022] PUT /identity/v3/projects/d97362afd16940d7ba017d0d1961e53d/users/6cac9dbea80548d2a9bc8bc15f2744a0/roles/6ca1d4427ff64e0a9d25d96cfb1445f6 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 19:50:01.084313 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc00103-af10-4416-bdc9-9e0bde247dc5 None None] REQUEST_METHOD: `POST` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:50:01.084313 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc00103-af10-4416-bdc9-9e0bde247dc5 None None] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:50:01.084313 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc00103-af10-4416-bdc9-9e0bde247dc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:50:01.098047 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca71594f-87e0-4d72-98c2-673769b2d185 None None] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:50:01.106775 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.auth.core [None req-fcc00103-af10-4416-bdc9-9e0bde247dc5 None None] MFA Rules not processed for user `d71fe5a8275f4ea98555afdcefc902a0`. Rule list: `[]` (Enabled: `True`). {{(pid=87935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:50:01.108633 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.fernet_utils [None req-fcc00103-af10-4416-bdc9-9e0bde247dc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:50:01.193883 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG dbcounter [-] [87934] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=87934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:50:01.207064 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f86500-e172-4189-ac06-54797c49191f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cbb50c88b794a7f9f26844effde7d63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a10a4268f3c4cb29f4e00c292e2df62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:50:01.208495 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f86500-e172-4189-ac06-54797c49191f service cinder] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:50:01.211872 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f86500-e172-4189-ac06-54797c49191f service cinder] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:50:01.212349 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f86500-e172-4189-ac06-54797c49191f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:50:01.217879 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.fernet_utils [None req-06f86500-e172-4189-ac06-54797c49191f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:50:01.242913 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 942/1915] 10.222.0.25 () {58 vars in 1018 bytes} [Tue Sep 13 19:50:01 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 19:50:01.244284 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5abc1f-b472-446e-8017-eb67e13f6bfa None None] REQUEST_METHOD: `POST` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:50:01.245809 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5abc1f-b472-446e-8017-eb67e13f6bfa None None] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:50:01.246256 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5abc1f-b472-446e-8017-eb67e13f6bfa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:50:01.332619 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.auth.core [None req-2c5abc1f-b472-446e-8017-eb67e13f6bfa None None] MFA Rules not processed for user `6cac9dbea80548d2a9bc8bc15f2744a0`. Rule list: `[]` (Enabled: `True`). {{(pid=87935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:50:01.333864 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.fernet_utils [None req-2c5abc1f-b472-446e-8017-eb67e13f6bfa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:50:01.414911 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f86500-e172-4189-ac06-54797c49191f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:50:01.416504 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f86500-e172-4189-ac06-54797c49191f service cinder] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:50:01.432341 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 974/1916] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Sep 13 19:50:00 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 432 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 19:50:01.433632 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f86500-e172-4189-ac06-54797c49191f service cinder] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:50:01.435174 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.fernet_utils [None req-06f86500-e172-4189-ac06-54797c49191f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:50:01.472343 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 943/1917] 10.222.0.25 () {58 vars in 958 bytes} [Tue Sep 13 19:50:01 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 19:50:01.475049 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5abc1f-b472-446e-8017-eb67e13f6bfa None None] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:50:01.479418 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.fernet_utils [None req-2c5abc1f-b472-446e-8017-eb67e13f6bfa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:50:01.524401 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f86500-e172-4189-ac06-54797c49191f service cinder] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:50:01.531956 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552d22a8-331c-4b8c-8119-6b4ea54c3a71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:50:01.532856 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552d22a8-331c-4b8c-8119-6b4ea54c3a71 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:50:01.533280 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552d22a8-331c-4b8c-8119-6b4ea54c3a71 admin admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:50:01.534316 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552d22a8-331c-4b8c-8119-6b4ea54c3a71 admin admin] PATH_INFO: `/v3/projects/b1f515b0b37a4b3c882d01bc91ef0e9c` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:50:01.535502 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5abc1f-b472-446e-8017-eb67e13f6bfa None None] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:50:01.536290 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-552d22a8-331c-4b8c-8119-6b4ea54c3a71 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b1f515b0b37a4b3c882d01bc91ef0e9c)` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:50:01.539165 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-552d22a8-331c-4b8c-8119-6b4ea54c3a71 admin admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:50:01.556295 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8812915-62f4-4cd5-92ec-dd46d3834c19 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd71fe5a8275f4ea98555afdcefc902a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a10a4268f3c4cb29f4e00c292e2df62', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:50:01.557275 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8812915-62f4-4cd5-92ec-dd46d3834c19 service nova] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:50:01.558280 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8812915-62f4-4cd5-92ec-dd46d3834c19 service nova] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:50:01.558720 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8812915-62f4-4cd5-92ec-dd46d3834c19 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:50:01.581541 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8812915-62f4-4cd5-92ec-dd46d3834c19 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:50:01.584156 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8812915-62f4-4cd5-92ec-dd46d3834c19 service nova] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:50:01.612700 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 944/1918] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Sep 13 19:50:01 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 19:50:01.616274 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8812915-62f4-4cd5-92ec-dd46d3834c19 service nova] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:50:01.620590 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.fernet_utils [None req-d8812915-62f4-4cd5-92ec-dd46d3834c19 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:50:01.620996 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.notifications [None req-552d22a8-331c-4b8c-8119-6b4ea54c3a71 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b1f515b0b37a4b3c882d01bc91ef0e9c', 'request_id': 'req-552d22a8-331c-4b8c-8119-6b4ea54c3a71'} {{(pid=87934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:50:01.637510 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.notifications [None req-552d22a8-331c-4b8c-8119-6b4ea54c3a71 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b1f515b0b37a4b3c882d01bc91ef0e9c', 'request_id': 'req-552d22a8-331c-4b8c-8119-6b4ea54c3a71'} {{(pid=87934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:50:01.651743 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.notifications [None req-552d22a8-331c-4b8c-8119-6b4ea54c3a71 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b1f515b0b37a4b3c882d01bc91ef0e9c', 'request_id': 'req-552d22a8-331c-4b8c-8119-6b4ea54c3a71'} {{(pid=87934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:50:01.653831 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8812915-62f4-4cd5-92ec-dd46d3834c19 service nova] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:50:01.673828 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.notifications [None req-552d22a8-331c-4b8c-8119-6b4ea54c3a71 admin admin] The token cache is being invalidate because project b1f515b0b37a4b3c882d01bc91ef0e9c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87934) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 19:50:01.674156 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.notifications [None req-552d22a8-331c-4b8c-8119-6b4ea54c3a71 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:50:01.675765 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.notifications [None req-552d22a8-331c-4b8c-8119-6b4ea54c3a71 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:50:01.679485 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 975/1919] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Sep 13 19:50:01 2022] DELETE /identity/v3/projects/b1f515b0b37a4b3c882d01bc91ef0e9c => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 19:50:01.680401 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552d22a8-331c-4b8c-8119-6b4ea54c3a71 admin admin] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:50:01.689768 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.fernet_utils [None req-552d22a8-331c-4b8c-8119-6b4ea54c3a71 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:50:01.780425 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3872fa51-4f9b-435c-a041-7a9841f6cb27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:50:01.781747 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3872fa51-4f9b-435c-a041-7a9841f6cb27 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:50:01.782124 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3872fa51-4f9b-435c-a041-7a9841f6cb27 admin admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:50:01.782476 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3872fa51-4f9b-435c-a041-7a9841f6cb27 admin admin] PATH_INFO: `/v3/projects/2293c5a9f9e14b23a578e2f045939cbb` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:50:01.784149 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3872fa51-4f9b-435c-a041-7a9841f6cb27 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2293c5a9f9e14b23a578e2f045939cbb)` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:50:01.791373 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3872fa51-4f9b-435c-a041-7a9841f6cb27 admin admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:50:01.802457 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG dbcounter [-] [87935] Writing DB stats keystone:SELECT=100 {{(pid=87935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:50:01.808508 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG dbcounter [-] [87934] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=87934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:50:01.875562 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552d22a8-331c-4b8c-8119-6b4ea54c3a71 admin admin] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:50:01.884103 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f182e61-2498-49c1-b7d0-cb93b514b6af service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cbb50c88b794a7f9f26844effde7d63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a10a4268f3c4cb29f4e00c292e2df62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:50:01.884899 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f182e61-2498-49c1-b7d0-cb93b514b6af service cinder] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:50:01.885580 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f182e61-2498-49c1-b7d0-cb93b514b6af service cinder] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:50:01.885896 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f182e61-2498-49c1-b7d0-cb93b514b6af service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:50:01.890226 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.fernet_utils [None req-8f182e61-2498-49c1-b7d0-cb93b514b6af service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:50:01.934629 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.notifications [None req-3872fa51-4f9b-435c-a041-7a9841f6cb27 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2293c5a9f9e14b23a578e2f045939cbb', 'request_id': 'req-3872fa51-4f9b-435c-a041-7a9841f6cb27'} {{(pid=87935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:50:01.949978 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.notifications [None req-3872fa51-4f9b-435c-a041-7a9841f6cb27 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2293c5a9f9e14b23a578e2f045939cbb', 'request_id': 'req-3872fa51-4f9b-435c-a041-7a9841f6cb27'} {{(pid=87935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:50:01.966761 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.notifications [None req-3872fa51-4f9b-435c-a041-7a9841f6cb27 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2293c5a9f9e14b23a578e2f045939cbb', 'request_id': 'req-3872fa51-4f9b-435c-a041-7a9841f6cb27'} {{(pid=87935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:50:01.993451 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.notifications [None req-3872fa51-4f9b-435c-a041-7a9841f6cb27 admin admin] The token cache is being invalidate because project 2293c5a9f9e14b23a578e2f045939cbb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87935) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 19:50:01.993737 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.notifications [None req-3872fa51-4f9b-435c-a041-7a9841f6cb27 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:50:01.995329 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.notifications [None req-3872fa51-4f9b-435c-a041-7a9841f6cb27 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:50:01.999759 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 945/1920] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Sep 13 19:50:01 2022] DELETE /identity/v3/projects/2293c5a9f9e14b23a578e2f045939cbb => generated 0 bytes in 386 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 19:50:02.001105 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c80d2fd-6a4c-4aa8-a76f-9afdafd28d32 None None] REQUEST_METHOD: `POST` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:50:02.001386 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c80d2fd-6a4c-4aa8-a76f-9afdafd28d32 None None] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:50:02.001653 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c80d2fd-6a4c-4aa8-a76f-9afdafd28d32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:50:02.065766 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f182e61-2498-49c1-b7d0-cb93b514b6af service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:50:02.067839 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f182e61-2498-49c1-b7d0-cb93b514b6af service cinder] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:50:02.069343 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.auth.core [None req-6c80d2fd-6a4c-4aa8-a76f-9afdafd28d32 None None] MFA Rules not processed for user `7b0aed92d02344acb92a0e4aa67c3068`. Rule list: `[]` (Enabled: `True`). {{(pid=87935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:50:02.074821 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.fernet_utils [None req-6c80d2fd-6a4c-4aa8-a76f-9afdafd28d32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:50:02.086023 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 976/1921] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Sep 13 19:50:01 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 406 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 19:50:02.086713 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f182e61-2498-49c1-b7d0-cb93b514b6af service cinder] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:50:02.088488 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.fernet_utils [None req-8f182e61-2498-49c1-b7d0-cb93b514b6af service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:50:02.117089 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f182e61-2498-49c1-b7d0-cb93b514b6af service cinder] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:50:02.244858 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 946/1922] 10.222.0.25 () {58 vars in 958 bytes} [Tue Sep 13 19:50:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 244 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 19:50:02.251748 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f91e230-0b0e-4e50-8332-621a65cfedf2 None None] REQUEST_METHOD: `POST` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:50:02.252107 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f91e230-0b0e-4e50-8332-621a65cfedf2 None None] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:50:02.253333 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f91e230-0b0e-4e50-8332-621a65cfedf2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:50:02.281129 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a05713-344e-4a2e-bdfa-55466cb89d8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:50:02.281392 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a05713-344e-4a2e-bdfa-55466cb89d8b admin admin] REQUEST_METHOD: `DELETE` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:50:02.281707 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a05713-344e-4a2e-bdfa-55466cb89d8b admin admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:50:02.281981 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a05713-344e-4a2e-bdfa-55466cb89d8b admin admin] PATH_INFO: `/v3/users/f2f8e24aa8d4490aab193faacb8318a7` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:50:02.284018 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a05713-344e-4a2e-bdfa-55466cb89d8b admin admin] RBAC: Authorizing `identity:delete_user(user_id=f2f8e24aa8d4490aab193faacb8318a7)` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:50:02.286605 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a05713-344e-4a2e-bdfa-55466cb89d8b admin admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:50:02.297680 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.auth.core [None req-9f91e230-0b0e-4e50-8332-621a65cfedf2 None None] MFA Rules not processed for user `7b0aed92d02344acb92a0e4aa67c3068`. Rule list: `[]` (Enabled: `True`). {{(pid=87935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:50:02.300603 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.fernet_utils [None req-9f91e230-0b0e-4e50-8332-621a65cfedf2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:50:02.327351 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 947/1923] 10.222.0.25 () {58 vars in 958 bytes} [Tue Sep 13 19:50:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 19:50:02.331974 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f91e230-0b0e-4e50-8332-621a65cfedf2 None None] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:50:02.355578 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f91e230-0b0e-4e50-8332-621a65cfedf2 None None] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:50:02.363451 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195d3523-01e1-44a5-98fa-6a55a7dcdbc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:50:02.370025 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195d3523-01e1-44a5-98fa-6a55a7dcdbc5 admin admin] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:50:02.370448 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195d3523-01e1-44a5-98fa-6a55a7dcdbc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:50:02.370779 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195d3523-01e1-44a5-98fa-6a55a7dcdbc5 admin admin] PATH_INFO: `/v3/domains` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:50:02.371872 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-195d3523-01e1-44a5-98fa-6a55a7dcdbc5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87935) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:50:02.372350 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-195d3523-01e1-44a5-98fa-6a55a7dcdbc5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:50:02.390065 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-195d3523-01e1-44a5-98fa-6a55a7dcdbc5 admin admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:50:02.410892 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 948/1924] 10.222.0.25 () {58 vars in 1153 bytes} [Tue Sep 13 19:50:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:50:02.415737 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195d3523-01e1-44a5-98fa-6a55a7dcdbc5 admin admin] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:50:02.418164 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.notifications [None req-e1a05713-344e-4a2e-bdfa-55466cb89d8b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f2f8e24aa8d4490aab193faacb8318a7'} {{(pid=87934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:50:02.422229 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.notifications [None req-e1a05713-344e-4a2e-bdfa-55466cb89d8b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f2f8e24aa8d4490aab193faacb8318a7'} {{(pid=87934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:50:02.424529 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.notifications [None req-e1a05713-344e-4a2e-bdfa-55466cb89d8b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f2f8e24aa8d4490aab193faacb8318a7'} {{(pid=87934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:50:02.439161 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195d3523-01e1-44a5-98fa-6a55a7dcdbc5 admin admin] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:50:02.442467 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.notifications [None req-e1a05713-344e-4a2e-bdfa-55466cb89d8b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f2f8e24aa8d4490aab193faacb8318a7'} {{(pid=87934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:50:02.452910 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae39db0-0c73-4e7c-849b-e7dd30b85e35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:50:02.454126 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae39db0-0c73-4e7c-849b-e7dd30b85e35 admin admin] REQUEST_METHOD: `POST` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:50:02.454273 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae39db0-0c73-4e7c-849b-e7dd30b85e35 admin admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:50:02.456420 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae39db0-0c73-4e7c-849b-e7dd30b85e35 admin admin] PATH_INFO: `/v3/projects` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:50:02.459084 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae39db0-0c73-4e7c-849b-e7dd30b85e35 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:50:02.465164 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae39db0-0c73-4e7c-849b-e7dd30b85e35 admin admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:50:02.488055 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.notifications [None req-e1a05713-344e-4a2e-bdfa-55466cb89d8b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f2f8e24aa8d4490aab193faacb8318a7'} {{(pid=87934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:50:02.523376 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 977/1925] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Sep 13 19:50:02 2022] DELETE /identity/v3/users/f2f8e24aa8d4490aab193faacb8318a7 => generated 0 bytes in 437 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 19:50:02.539690 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 949/1926] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Sep 13 19:50:02 2022] POST /identity/v3/projects => generated 371 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 19:50:02.539893 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a05713-344e-4a2e-bdfa-55466cb89d8b admin admin] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:50:02.539893 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.fernet_utils [None req-e1a05713-344e-4a2e-bdfa-55466cb89d8b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:50:02.554465 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG dbcounter [-] [87934] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:50:02.671176 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a05713-344e-4a2e-bdfa-55466cb89d8b admin admin] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:50:02.772892 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90377ee0-41c9-4c89-a18a-0e79bedf26ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:50:02.773653 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90377ee0-41c9-4c89-a18a-0e79bedf26ae admin admin] REQUEST_METHOD: `POST` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:50:02.773975 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90377ee0-41c9-4c89-a18a-0e79bedf26ae admin admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:50:02.774187 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90377ee0-41c9-4c89-a18a-0e79bedf26ae admin admin] PATH_INFO: `/v3/users` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:50:02.774858 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90377ee0-41c9-4c89-a18a-0e79bedf26ae admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:50:02.776828 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90377ee0-41c9-4c89-a18a-0e79bedf26ae admin admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:50:02.806910 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 978/1927] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Sep 13 19:50:02 2022] POST /identity/v3/users => generated 286 bytes in 269 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 19:50:02.809723 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae39db0-0c73-4e7c-849b-e7dd30b85e35 admin admin] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:50:02.827688 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae39db0-0c73-4e7c-849b-e7dd30b85e35 admin admin] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:50:02.836278 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380c1792-53af-4a4b-a98e-765d1458b135 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:50:02.836959 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380c1792-53af-4a4b-a98e-765d1458b135 admin admin] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:50:02.837237 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380c1792-53af-4a4b-a98e-765d1458b135 admin admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:50:02.838193 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380c1792-53af-4a4b-a98e-765d1458b135 admin admin] PATH_INFO: `/v3/roles` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:50:02.838633 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-380c1792-53af-4a4b-a98e-765d1458b135 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:50:02.840445 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-380c1792-53af-4a4b-a98e-765d1458b135 admin admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:50:02.856253 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 950/1928] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Sep 13 19:50:02 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 19:50:02.859133 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90377ee0-41c9-4c89-a18a-0e79bedf26ae admin admin] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:50:02.889758 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90377ee0-41c9-4c89-a18a-0e79bedf26ae admin admin] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:50:02.902398 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f266b179-fc30-4d3d-b0bf-5331b8e92a42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:50:02.903245 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f266b179-fc30-4d3d-b0bf-5331b8e92a42 admin admin] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:50:02.903357 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f266b179-fc30-4d3d-b0bf-5331b8e92a42 admin admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:50:02.904445 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f266b179-fc30-4d3d-b0bf-5331b8e92a42 admin admin] PATH_INFO: `/v3/roles` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:50:02.906698 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f266b179-fc30-4d3d-b0bf-5331b8e92a42 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:50:02.907193 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f266b179-fc30-4d3d-b0bf-5331b8e92a42 admin admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:50:02.921289 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 979/1929] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Sep 13 19:50:02 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 19:50:02.926343 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380c1792-53af-4a4b-a98e-765d1458b135 admin admin] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:50:02.936901 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380c1792-53af-4a4b-a98e-765d1458b135 admin admin] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:50:02.941685 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46854dda-71ef-4c5f-ad6c-2752fd3010c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:50:02.942342 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46854dda-71ef-4c5f-ad6c-2752fd3010c4 admin admin] REQUEST_METHOD: `PUT` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:50:02.942615 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46854dda-71ef-4c5f-ad6c-2752fd3010c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:50:02.942889 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46854dda-71ef-4c5f-ad6c-2752fd3010c4 admin admin] PATH_INFO: `/v3/projects/e6a73b5c8337430194fdeadb73007ad7/users/84cce4563f86421181f25655df396079/roles/a259191f6d0e46fabd9f34536bb28747` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:50:02.959766 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46854dda-71ef-4c5f-ad6c-2752fd3010c4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e6a73b5c8337430194fdeadb73007ad7, user_id=84cce4563f86421181f25655df396079, role_id=a259191f6d0e46fabd9f34536bb28747)` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:50:02.962501 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46854dda-71ef-4c5f-ad6c-2752fd3010c4 admin admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:50:02.976665 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 951/1930] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Sep 13 19:50:02 2022] PUT /identity/v3/projects/e6a73b5c8337430194fdeadb73007ad7/users/84cce4563f86421181f25655df396079/roles/a259191f6d0e46fabd9f34536bb28747 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 19:50:02.981752 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab0588a-6119-4158-9706-039253e5574f None None] REQUEST_METHOD: `POST` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:50:02.982070 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab0588a-6119-4158-9706-039253e5574f None None] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:50:02.982429 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab0588a-6119-4158-9706-039253e5574f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:50:03.009772 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.auth.core [None req-6ab0588a-6119-4158-9706-039253e5574f None None] MFA Rules not processed for user `7b0aed92d02344acb92a0e4aa67c3068`. Rule list: `[]` (Enabled: `True`). {{(pid=87934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:50:03.010993 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.fernet_utils [None req-6ab0588a-6119-4158-9706-039253e5574f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:50:03.082056 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 980/1931] 10.222.0.25 () {58 vars in 958 bytes} [Tue Sep 13 19:50:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 19:50:03.090987 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46854dda-71ef-4c5f-ad6c-2752fd3010c4 admin admin] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:50:03.095178 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.fernet_utils [None req-46854dda-71ef-4c5f-ad6c-2752fd3010c4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:50:03.098340 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab0588a-6119-4158-9706-039253e5574f None None] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:50:03.099952 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.fernet_utils [None req-6ab0588a-6119-4158-9706-039253e5574f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:50:03.111400 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46854dda-71ef-4c5f-ad6c-2752fd3010c4 admin admin] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:50:03.117150 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a03623e-4e7a-451c-8baa-fe6be29cb252 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:50:03.117783 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a03623e-4e7a-451c-8baa-fe6be29cb252 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:50:03.118056 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a03623e-4e7a-451c-8baa-fe6be29cb252 admin admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:50:03.118383 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a03623e-4e7a-451c-8baa-fe6be29cb252 admin admin] PATH_INFO: `/v3/projects/621fecce5ea94359bdff9f55c017d4fb` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:50:03.119966 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a03623e-4e7a-451c-8baa-fe6be29cb252 admin admin] RBAC: Authorizing `identity:delete_project(project_id=621fecce5ea94359bdff9f55c017d4fb)` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:50:03.122786 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a03623e-4e7a-451c-8baa-fe6be29cb252 admin admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:50:03.136624 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG dbcounter [-] [87935] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=87935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:50:03.136758 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG dbcounter [-] [87934] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:50:03.167496 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab0588a-6119-4158-9706-039253e5574f None None] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:50:03.181262 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.notifications [None req-5a03623e-4e7a-451c-8baa-fe6be29cb252 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '621fecce5ea94359bdff9f55c017d4fb', 'request_id': 'req-5a03623e-4e7a-451c-8baa-fe6be29cb252'} {{(pid=87935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:50:03.187525 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.notifications [None req-5a03623e-4e7a-451c-8baa-fe6be29cb252 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '621fecce5ea94359bdff9f55c017d4fb', 'request_id': 'req-5a03623e-4e7a-451c-8baa-fe6be29cb252'} {{(pid=87935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:50:03.204892 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.notifications [None req-5a03623e-4e7a-451c-8baa-fe6be29cb252 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '621fecce5ea94359bdff9f55c017d4fb', 'request_id': 'req-5a03623e-4e7a-451c-8baa-fe6be29cb252'} {{(pid=87935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:50:03.219127 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.notifications [None req-5a03623e-4e7a-451c-8baa-fe6be29cb252 admin admin] The token cache is being invalidate because project 621fecce5ea94359bdff9f55c017d4fb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87935) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 19:50:03.219425 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.notifications [None req-5a03623e-4e7a-451c-8baa-fe6be29cb252 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:50:03.220137 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.notifications [None req-5a03623e-4e7a-451c-8baa-fe6be29cb252 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:50:03.222141 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 952/1932] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Sep 13 19:50:03 2022] DELETE /identity/v3/projects/621fecce5ea94359bdff9f55c017d4fb => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 19:50:03.223243 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a03623e-4e7a-451c-8baa-fe6be29cb252 admin admin] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:50:03.224692 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.fernet_utils [None req-5a03623e-4e7a-451c-8baa-fe6be29cb252 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:50:03.239306 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75c9b3b-cb01-4536-b001-61c45dc7b2e9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1196a96e4a404f559600b69f929ea9da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a10a4268f3c4cb29f4e00c292e2df62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:50:03.239953 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75c9b3b-cb01-4536-b001-61c45dc7b2e9 service neutron] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:50:03.240343 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75c9b3b-cb01-4536-b001-61c45dc7b2e9 service neutron] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:50:03.240680 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75c9b3b-cb01-4536-b001-61c45dc7b2e9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:50:03.242646 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.fernet_utils [None req-d75c9b3b-cb01-4536-b001-61c45dc7b2e9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:50:03.289283 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a03623e-4e7a-451c-8baa-fe6be29cb252 admin admin] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:50:03.293042 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84613228-13fd-486c-893c-96006cb32bcb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cbb50c88b794a7f9f26844effde7d63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a10a4268f3c4cb29f4e00c292e2df62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:50:03.294314 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84613228-13fd-486c-893c-96006cb32bcb service cinder] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:50:03.294314 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84613228-13fd-486c-893c-96006cb32bcb service cinder] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:50:03.294314 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84613228-13fd-486c-893c-96006cb32bcb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:50:03.296159 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.fernet_utils [None req-84613228-13fd-486c-893c-96006cb32bcb service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:50:03.324837 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d75c9b3b-cb01-4536-b001-61c45dc7b2e9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:50:03.326353 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d75c9b3b-cb01-4536-b001-61c45dc7b2e9 service neutron] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:50:03.338126 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 981/1933] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Sep 13 19:50:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 240 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 13 19:50:03.339736 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec9bc76-2a34-442c-b667-fd5fe2f37772 None None] REQUEST_METHOD: `POST` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:50:03.340092 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec9bc76-2a34-442c-b667-fd5fe2f37772 None None] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:50:03.340461 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec9bc76-2a34-442c-b667-fd5fe2f37772 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:50:03.360981 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.auth.core [None req-0ec9bc76-2a34-442c-b667-fd5fe2f37772 None None] MFA Rules not processed for user `7b0aed92d02344acb92a0e4aa67c3068`. Rule list: `[]` (Enabled: `True`). {{(pid=87934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:50:03.362744 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.fernet_utils [None req-0ec9bc76-2a34-442c-b667-fd5fe2f37772 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:50:03.370999 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84613228-13fd-486c-893c-96006cb32bcb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:50:03.371187 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 982/1934] 10.222.0.25 () {58 vars in 958 bytes} [Tue Sep 13 19:50:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 19:50:03.372831 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84613228-13fd-486c-893c-96006cb32bcb service cinder] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:50:03.379913 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0008ae-7b8b-47d0-aa66-98679321b5d5 None None] REQUEST_METHOD: `POST` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:50:03.380478 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0008ae-7b8b-47d0-aa66-98679321b5d5 None None] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:50:03.380660 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0008ae-7b8b-47d0-aa66-98679321b5d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:50:03.392409 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 953/1935] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Sep 13 19:50:03 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 170 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 19:50:03.409948 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.auth.core [None req-6b0008ae-7b8b-47d0-aa66-98679321b5d5 None None] MFA Rules not processed for user `7b0aed92d02344acb92a0e4aa67c3068`. Rule list: `[]` (Enabled: `True`). {{(pid=87934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:50:03.411187 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.fernet_utils [None req-6b0008ae-7b8b-47d0-aa66-98679321b5d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:50:03.430467 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 983/1936] 10.222.0.25 () {58 vars in 958 bytes} [Tue Sep 13 19:50:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 19:50:03.448918 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84613228-13fd-486c-893c-96006cb32bcb service cinder] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:50:03.453086 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84613228-13fd-486c-893c-96006cb32bcb service cinder] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:50:03.458400 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b96b566-0e79-418d-92c4-dd56cfada01d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:50:03.459142 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b96b566-0e79-418d-92c4-dd56cfada01d admin admin] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:50:03.459540 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b96b566-0e79-418d-92c4-dd56cfada01d admin admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:50:03.459857 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b96b566-0e79-418d-92c4-dd56cfada01d admin admin] PATH_INFO: `/v3/domains` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:50:03.460656 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b96b566-0e79-418d-92c4-dd56cfada01d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87935) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:50:03.461109 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b96b566-0e79-418d-92c4-dd56cfada01d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:50:03.463346 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b96b566-0e79-418d-92c4-dd56cfada01d admin admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:50:03.485774 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 954/1937] 10.222.0.25 () {58 vars in 1153 bytes} [Tue Sep 13 19:50:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:50:03.486870 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0008ae-7b8b-47d0-aa66-98679321b5d5 None None] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:50:03.498945 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0008ae-7b8b-47d0-aa66-98679321b5d5 None None] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:50:03.505953 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c1ad13-9cd3-4fa2-bc6e-e4c957f3fdfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:50:03.506579 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c1ad13-9cd3-4fa2-bc6e-e4c957f3fdfd admin admin] REQUEST_METHOD: `POST` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:50:03.506857 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c1ad13-9cd3-4fa2-bc6e-e4c957f3fdfd admin admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:50:03.507128 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c1ad13-9cd3-4fa2-bc6e-e4c957f3fdfd admin admin] PATH_INFO: `/v3/projects` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:50:03.507872 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c1ad13-9cd3-4fa2-bc6e-e4c957f3fdfd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:50:03.510493 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c1ad13-9cd3-4fa2-bc6e-e4c957f3fdfd admin admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:50:03.551619 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 984/1938] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Sep 13 19:50:03 2022] POST /identity/v3/projects => generated 389 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 19:50:03.556611 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b96b566-0e79-418d-92c4-dd56cfada01d admin admin] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:50:03.589564 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b96b566-0e79-418d-92c4-dd56cfada01d admin admin] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:50:03.679829 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG dbcounter [-] [87935] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=87935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:50:03.730981 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af844cb-173e-4c6d-9cd0-2babf62d1424 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:50:03.732142 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af844cb-173e-4c6d-9cd0-2babf62d1424 admin admin] REQUEST_METHOD: `POST` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:50:03.732491 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af844cb-173e-4c6d-9cd0-2babf62d1424 admin admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:50:03.732768 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af844cb-173e-4c6d-9cd0-2babf62d1424 admin admin] PATH_INFO: `/v3/users` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:50:03.733501 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af844cb-173e-4c6d-9cd0-2babf62d1424 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:50:03.735818 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af844cb-173e-4c6d-9cd0-2babf62d1424 admin admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:50:03.764392 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 955/1939] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Sep 13 19:50:03 2022] POST /identity/v3/users => generated 295 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 19:50:03.768737 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c1ad13-9cd3-4fa2-bc6e-e4c957f3fdfd admin admin] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:50:03.782973 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c1ad13-9cd3-4fa2-bc6e-e4c957f3fdfd admin admin] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:50:03.797549 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445a5a7d-e30d-4d98-82f2-714b2e5a96fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:50:03.798169 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445a5a7d-e30d-4d98-82f2-714b2e5a96fb admin admin] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:50:03.798444 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445a5a7d-e30d-4d98-82f2-714b2e5a96fb admin admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:50:03.798720 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445a5a7d-e30d-4d98-82f2-714b2e5a96fb admin admin] PATH_INFO: `/v3/roles` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:50:03.799377 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-445a5a7d-e30d-4d98-82f2-714b2e5a96fb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:50:03.801036 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-445a5a7d-e30d-4d98-82f2-714b2e5a96fb admin admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:50:03.819096 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 985/1940] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Sep 13 19:50:03 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 19:50:03.823924 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af844cb-173e-4c6d-9cd0-2babf62d1424 admin admin] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:50:03.837041 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af844cb-173e-4c6d-9cd0-2babf62d1424 admin admin] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:50:03.842513 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a63ffb-67d6-4692-a798-8c653b7b3a91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:50:03.843322 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a63ffb-67d6-4692-a798-8c653b7b3a91 admin admin] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:50:03.843662 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a63ffb-67d6-4692-a798-8c653b7b3a91 admin admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:50:03.844003 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a63ffb-67d6-4692-a798-8c653b7b3a91 admin admin] PATH_INFO: `/v3/roles` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:50:03.844907 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a63ffb-67d6-4692-a798-8c653b7b3a91 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:50:03.847622 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a63ffb-67d6-4692-a798-8c653b7b3a91 admin admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:50:03.874131 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 956/1941] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Sep 13 19:50:03 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 19:50:03.878860 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445a5a7d-e30d-4d98-82f2-714b2e5a96fb admin admin] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:50:03.894653 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445a5a7d-e30d-4d98-82f2-714b2e5a96fb admin admin] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:50:03.903451 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbea1a8e-5dff-4fec-9eef-3443d97414ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:50:03.904826 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbea1a8e-5dff-4fec-9eef-3443d97414ae admin admin] REQUEST_METHOD: `PUT` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:50:03.905171 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbea1a8e-5dff-4fec-9eef-3443d97414ae admin admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:50:03.905495 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbea1a8e-5dff-4fec-9eef-3443d97414ae admin admin] PATH_INFO: `/v3/projects/13eeee72904e4367a63c3ea2b13f6fb3/users/24de71036b954cc78c8ccc28cbfda90c/roles/a259191f6d0e46fabd9f34536bb28747` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:50:03.954954 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbea1a8e-5dff-4fec-9eef-3443d97414ae admin admin] RBAC: Authorizing `identity:create_grant(project_id=13eeee72904e4367a63c3ea2b13f6fb3, user_id=24de71036b954cc78c8ccc28cbfda90c, role_id=a259191f6d0e46fabd9f34536bb28747)` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:50:03.959059 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbea1a8e-5dff-4fec-9eef-3443d97414ae admin admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:50:03.989674 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 986/1942] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Sep 13 19:50:03 2022] PUT /identity/v3/projects/13eeee72904e4367a63c3ea2b13f6fb3/users/24de71036b954cc78c8ccc28cbfda90c/roles/a259191f6d0e46fabd9f34536bb28747 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 19:50:04.000567 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c971333f-0df4-45c5-9664-e2638a04d5ca None None] REQUEST_METHOD: `POST` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:50:04.001176 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c971333f-0df4-45c5-9664-e2638a04d5ca None None] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:50:04.001987 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c971333f-0df4-45c5-9664-e2638a04d5ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:50:04.059248 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.auth.core [None req-c971333f-0df4-45c5-9664-e2638a04d5ca None None] MFA Rules not processed for user `24de71036b954cc78c8ccc28cbfda90c`. Rule list: `[]` (Enabled: `True`). {{(pid=87935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:50:04.060837 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.fernet_utils [None req-c971333f-0df4-45c5-9664-e2638a04d5ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:50:04.148581 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 957/1943] 10.222.0.25 () {58 vars in 958 bytes} [Tue Sep 13 19:50:03 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 19:50:04.150291 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbea1a8e-5dff-4fec-9eef-3443d97414ae admin admin] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:50:04.186100 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG dbcounter [-] [87934] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=87934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:50:04.231658 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbea1a8e-5dff-4fec-9eef-3443d97414ae admin admin] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:50:04.236253 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7dc0440-e8a8-4543-8b80-c23af8038768 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:50:04.237537 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7dc0440-e8a8-4543-8b80-c23af8038768 admin admin] REQUEST_METHOD: `POST` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:50:04.237847 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7dc0440-e8a8-4543-8b80-c23af8038768 admin admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:50:04.238149 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7dc0440-e8a8-4543-8b80-c23af8038768 admin admin] PATH_INFO: `/v3/projects` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:50:04.238766 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7dc0440-e8a8-4543-8b80-c23af8038768 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:50:04.240675 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7dc0440-e8a8-4543-8b80-c23af8038768 admin admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:50:04.269882 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 987/1944] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Sep 13 19:50:04 2022] POST /identity/v3/projects => generated 387 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 13 19:50:04.274009 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c971333f-0df4-45c5-9664-e2638a04d5ca None None] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:50:04.286472 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c971333f-0df4-45c5-9664-e2638a04d5ca None None] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:50:04.352663 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aaf9397-0012-4a44-91ae-aa2f16f82a35 None None] REQUEST_METHOD: `POST` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:50:04.352980 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aaf9397-0012-4a44-91ae-aa2f16f82a35 None None] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:50:04.353207 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aaf9397-0012-4a44-91ae-aa2f16f82a35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:50:04.381528 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd46ddd1-b4fd-491c-9b33-cd7b331b48d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:50:04.383191 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd46ddd1-b4fd-491c-9b33-cd7b331b48d0 admin admin] REQUEST_METHOD: `POST` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:50:04.383466 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd46ddd1-b4fd-491c-9b33-cd7b331b48d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:50:04.383902 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd46ddd1-b4fd-491c-9b33-cd7b331b48d0 admin admin] PATH_INFO: `/v3/users` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:50:04.384609 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd46ddd1-b4fd-491c-9b33-cd7b331b48d0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:50:04.385306 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.auth.core [None req-6aaf9397-0012-4a44-91ae-aa2f16f82a35 None None] MFA Rules not processed for user `84cce4563f86421181f25655df396079`. Rule list: `[]` (Enabled: `True`). {{(pid=87934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:50:04.386571 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd46ddd1-b4fd-491c-9b33-cd7b331b48d0 admin admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:50:04.386947 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.fernet_utils [None req-6aaf9397-0012-4a44-91ae-aa2f16f82a35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:50:04.414083 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 958/1945] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Sep 13 19:50:04 2022] POST /identity/v3/users => generated 300 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 13 19:50:04.415515 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd46ddd1-b4fd-491c-9b33-cd7b331b48d0 admin admin] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:50:04.425879 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd46ddd1-b4fd-491c-9b33-cd7b331b48d0 admin admin] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:50:04.430821 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b983d2b9-d206-4f07-adf1-3ae72005d348 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:50:04.431500 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b983d2b9-d206-4f07-adf1-3ae72005d348 admin admin] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:50:04.431870 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b983d2b9-d206-4f07-adf1-3ae72005d348 admin admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:50:04.432237 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b983d2b9-d206-4f07-adf1-3ae72005d348 admin admin] PATH_INFO: `/v3/roles` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:50:04.433082 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b983d2b9-d206-4f07-adf1-3ae72005d348 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:50:04.434747 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b983d2b9-d206-4f07-adf1-3ae72005d348 admin admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:50:04.451975 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 959/1946] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Sep 13 19:50:04 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 13 19:50:04.454491 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b983d2b9-d206-4f07-adf1-3ae72005d348 admin admin] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:50:04.472243 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b983d2b9-d206-4f07-adf1-3ae72005d348 admin admin] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:50:04.477024 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc88b94-58b2-4f1e-a10c-5702ceec198c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:50:04.477691 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc88b94-58b2-4f1e-a10c-5702ceec198c admin admin] REQUEST_METHOD: `PUT` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:50:04.477967 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc88b94-58b2-4f1e-a10c-5702ceec198c admin admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:50:04.478236 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc88b94-58b2-4f1e-a10c-5702ceec198c admin admin] PATH_INFO: `/v3/projects/ce6e21625bd54840b29318242194ec02/users/fc1c3a84acad4c179aaa220bda3d570c/roles/6ca1d4427ff64e0a9d25d96cfb1445f6` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:50:04.483488 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 988/1947] 10.222.0.25 () {58 vars in 958 bytes} [Tue Sep 13 19:50:04 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 19:50:04.488700 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aaf9397-0012-4a44-91ae-aa2f16f82a35 None None] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:50:04.490353 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.fernet_utils [None req-6aaf9397-0012-4a44-91ae-aa2f16f82a35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:50:04.497839 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc88b94-58b2-4f1e-a10c-5702ceec198c admin admin] RBAC: Authorizing `identity:create_grant(project_id=ce6e21625bd54840b29318242194ec02, user_id=fc1c3a84acad4c179aaa220bda3d570c, role_id=6ca1d4427ff64e0a9d25d96cfb1445f6)` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:50:04.500849 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc88b94-58b2-4f1e-a10c-5702ceec198c admin admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:50:04.512149 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aaf9397-0012-4a44-91ae-aa2f16f82a35 None None] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:50:04.517223 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4c1fe6-7152-40a6-aecd-e9c28e75cc50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:50:04.517872 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4c1fe6-7152-40a6-aecd-e9c28e75cc50 admin admin] REQUEST_METHOD: `POST` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:50:04.518209 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4c1fe6-7152-40a6-aecd-e9c28e75cc50 admin admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:50:04.518439 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4c1fe6-7152-40a6-aecd-e9c28e75cc50 admin admin] PATH_INFO: `/v3/projects` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:50:04.519273 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b4c1fe6-7152-40a6-aecd-e9c28e75cc50 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:50:04.521629 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b4c1fe6-7152-40a6-aecd-e9c28e75cc50 admin admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:50:04.523971 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG dbcounter [-] [87935] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=87935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:50:04.534597 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 960/1948] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Sep 13 19:50:04 2022] PUT /identity/v3/projects/ce6e21625bd54840b29318242194ec02/users/fc1c3a84acad4c179aaa220bda3d570c/roles/6ca1d4427ff64e0a9d25d96cfb1445f6 => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 19:50:04.536140 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc88b94-58b2-4f1e-a10c-5702ceec198c admin admin] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:50:04.569295 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 989/1949] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Sep 13 19:50:04 2022] POST /identity/v3/projects => generated 373 bytes in 81 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 13 19:50:04.573547 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4c1fe6-7152-40a6-aecd-e9c28e75cc50 admin admin] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:50:04.656903 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4c1fe6-7152-40a6-aecd-e9c28e75cc50 admin admin] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:50:04.664767 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72064b3-9c4e-4387-8e51-a8a503a3ae3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:50:04.665255 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72064b3-9c4e-4387-8e51-a8a503a3ae3b admin admin] REQUEST_METHOD: `POST` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:50:04.665782 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72064b3-9c4e-4387-8e51-a8a503a3ae3b admin admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:50:04.666107 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72064b3-9c4e-4387-8e51-a8a503a3ae3b admin admin] PATH_INFO: `/v3/users` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:50:04.667730 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b72064b3-9c4e-4387-8e51-a8a503a3ae3b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:50:04.669258 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b72064b3-9c4e-4387-8e51-a8a503a3ae3b admin admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:50:04.673788 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc88b94-58b2-4f1e-a10c-5702ceec198c admin admin] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:50:04.681873 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e382a7cf-1bd3-48ae-bfb0-bab9ff111d6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:50:04.682623 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e382a7cf-1bd3-48ae-bfb0-bab9ff111d6e admin admin] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:50:04.683270 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e382a7cf-1bd3-48ae-bfb0-bab9ff111d6e admin admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:50:04.683731 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e382a7cf-1bd3-48ae-bfb0-bab9ff111d6e admin admin] PATH_INFO: `/v3/roles` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:50:04.684573 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e382a7cf-1bd3-48ae-bfb0-bab9ff111d6e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:50:04.686838 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e382a7cf-1bd3-48ae-bfb0-bab9ff111d6e admin admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:50:04.707144 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 961/1950] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Sep 13 19:50:04 2022] GET /identity/v3/roles => generated 1420 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 19:50:04.714385 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 990/1951] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Sep 13 19:50:04 2022] POST /identity/v3/users => generated 293 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 19:50:04.717592 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e382a7cf-1bd3-48ae-bfb0-bab9ff111d6e admin admin] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:50:04.728741 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72064b3-9c4e-4387-8e51-a8a503a3ae3b admin admin] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:50:04.743258 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72064b3-9c4e-4387-8e51-a8a503a3ae3b admin admin] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:50:04.746450 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e382a7cf-1bd3-48ae-bfb0-bab9ff111d6e admin admin] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:50:04.748296 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20dd971c-c33e-4100-8488-75d8b5bcd4bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:50:04.749079 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20dd971c-c33e-4100-8488-75d8b5bcd4bd admin admin] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:50:04.749361 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20dd971c-c33e-4100-8488-75d8b5bcd4bd admin admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:50:04.749628 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20dd971c-c33e-4100-8488-75d8b5bcd4bd admin admin] PATH_INFO: `/v3/roles` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:50:04.750359 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20dd971c-c33e-4100-8488-75d8b5bcd4bd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:50:04.752425 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20dd971c-c33e-4100-8488-75d8b5bcd4bd admin admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:50:04.755946 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG dbcounter [-] [87934] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=87934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:50:04.758824 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f2115b-a9c0-4a47-8c73-dcdd0b3967c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:50:04.759503 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f2115b-a9c0-4a47-8c73-dcdd0b3967c9 admin admin] REQUEST_METHOD: `PUT` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:50:04.759784 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f2115b-a9c0-4a47-8c73-dcdd0b3967c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:50:04.760059 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f2115b-a9c0-4a47-8c73-dcdd0b3967c9 admin admin] PATH_INFO: `/v3/projects/ce6e21625bd54840b29318242194ec02/users/fc1c3a84acad4c179aaa220bda3d570c/roles/6ca1d4427ff64e0a9d25d96cfb1445f6` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:50:04.767087 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 991/1952] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Sep 13 19:50:04 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 19:50:04.771101 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20dd971c-c33e-4100-8488-75d8b5bcd4bd admin admin] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:50:04.773132 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f2115b-a9c0-4a47-8c73-dcdd0b3967c9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ce6e21625bd54840b29318242194ec02, user_id=fc1c3a84acad4c179aaa220bda3d570c, role_id=6ca1d4427ff64e0a9d25d96cfb1445f6)` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:50:04.778186 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f2115b-a9c0-4a47-8c73-dcdd0b3967c9 admin admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:50:04.786360 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20dd971c-c33e-4100-8488-75d8b5bcd4bd admin admin] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:50:04.794240 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 962/1953] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Sep 13 19:50:04 2022] PUT /identity/v3/projects/ce6e21625bd54840b29318242194ec02/users/fc1c3a84acad4c179aaa220bda3d570c/roles/6ca1d4427ff64e0a9d25d96cfb1445f6 => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 19:50:04.807612 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309ed452-a2d1-4765-92fd-65b5ea3c49a1 None None] REQUEST_METHOD: `POST` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:50:04.807992 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309ed452-a2d1-4765-92fd-65b5ea3c49a1 None None] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:50:04.808397 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309ed452-a2d1-4765-92fd-65b5ea3c49a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:50:04.885303 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc75a038-da44-4f24-a1ab-1d51546031c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:50:04.886391 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc75a038-da44-4f24-a1ab-1d51546031c7 admin admin] REQUEST_METHOD: `PUT` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:50:04.886872 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc75a038-da44-4f24-a1ab-1d51546031c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:50:04.887350 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc75a038-da44-4f24-a1ab-1d51546031c7 admin admin] PATH_INFO: `/v3/projects/9ad0a5a472a945ddb510079825998453/users/e10a5398c5ac48889f2e35083cdae43d/roles/6ca1d4427ff64e0a9d25d96cfb1445f6` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:50:04.888904 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.auth.core [None req-309ed452-a2d1-4765-92fd-65b5ea3c49a1 None None] MFA Rules not processed for user `fc1c3a84acad4c179aaa220bda3d570c`. Rule list: `[]` (Enabled: `True`). {{(pid=87935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:50:04.890199 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.fernet_utils [None req-309ed452-a2d1-4765-92fd-65b5ea3c49a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:50:04.908005 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc75a038-da44-4f24-a1ab-1d51546031c7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9ad0a5a472a945ddb510079825998453, user_id=e10a5398c5ac48889f2e35083cdae43d, role_id=6ca1d4427ff64e0a9d25d96cfb1445f6)` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:50:04.913390 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc75a038-da44-4f24-a1ab-1d51546031c7 admin admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:50:04.938715 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 992/1954] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Sep 13 19:50:04 2022] PUT /identity/v3/projects/9ad0a5a472a945ddb510079825998453/users/e10a5398c5ac48889f2e35083cdae43d/roles/6ca1d4427ff64e0a9d25d96cfb1445f6 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 19:50:04.943792 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc75a038-da44-4f24-a1ab-1d51546031c7 admin admin] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:50:05.041887 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 963/1955] 10.222.0.25 () {58 vars in 958 bytes} [Tue Sep 13 19:50:04 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 19:50:05.055712 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309ed452-a2d1-4765-92fd-65b5ea3c49a1 None None] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:50:05.057537 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.fernet_utils [None req-309ed452-a2d1-4765-92fd-65b5ea3c49a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:50:05.114713 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc75a038-da44-4f24-a1ab-1d51546031c7 admin admin] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:50:05.138205 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa8ddcb-c2f2-4d90-b0ef-096cf489cde8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:50:05.139137 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa8ddcb-c2f2-4d90-b0ef-096cf489cde8 admin admin] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:50:05.139433 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa8ddcb-c2f2-4d90-b0ef-096cf489cde8 admin admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:50:05.139761 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa8ddcb-c2f2-4d90-b0ef-096cf489cde8 admin admin] PATH_INFO: `/v3/roles` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:50:05.140504 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa8ddcb-c2f2-4d90-b0ef-096cf489cde8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:50:05.144306 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa8ddcb-c2f2-4d90-b0ef-096cf489cde8 admin admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:50:05.164725 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 993/1956] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Sep 13 19:50:04 2022] GET /identity/v3/roles => generated 1420 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 19:50:05.170368 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa8ddcb-c2f2-4d90-b0ef-096cf489cde8 admin admin] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:50:05.174452 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309ed452-a2d1-4765-92fd-65b5ea3c49a1 None None] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:50:05.194370 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa8ddcb-c2f2-4d90-b0ef-096cf489cde8 admin admin] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:50:05.204708 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33694c59-a9df-4899-86f1-007f139e7333 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:50:05.206086 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33694c59-a9df-4899-86f1-007f139e7333 admin admin] REQUEST_METHOD: `PUT` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:50:05.206432 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33694c59-a9df-4899-86f1-007f139e7333 admin admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:50:05.206709 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33694c59-a9df-4899-86f1-007f139e7333 admin admin] PATH_INFO: `/v3/projects/9ad0a5a472a945ddb510079825998453/users/e10a5398c5ac48889f2e35083cdae43d/roles/6ca1d4427ff64e0a9d25d96cfb1445f6` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:50:05.210088 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33694c59-a9df-4899-86f1-007f139e7333 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9ad0a5a472a945ddb510079825998453, user_id=e10a5398c5ac48889f2e35083cdae43d, role_id=6ca1d4427ff64e0a9d25d96cfb1445f6)` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:50:05.213881 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33694c59-a9df-4899-86f1-007f139e7333 admin admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:50:05.232985 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 994/1957] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Sep 13 19:50:05 2022] PUT /identity/v3/projects/9ad0a5a472a945ddb510079825998453/users/e10a5398c5ac48889f2e35083cdae43d/roles/6ca1d4427ff64e0a9d25d96cfb1445f6 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 19:50:05.255869 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG dbcounter [-] [87935] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:50:05.312904 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9c087d-8962-4fd9-8c22-02e152a969ac service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cbb50c88b794a7f9f26844effde7d63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a10a4268f3c4cb29f4e00c292e2df62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:50:05.313885 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9c087d-8962-4fd9-8c22-02e152a969ac service cinder] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:50:05.314044 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9c087d-8962-4fd9-8c22-02e152a969ac service cinder] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:50:05.314294 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9c087d-8962-4fd9-8c22-02e152a969ac service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:50:05.419714 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33694c59-a9df-4899-86f1-007f139e7333 admin admin] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:50:05.468610 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e9c087d-8962-4fd9-8c22-02e152a969ac service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:50:05.470841 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e9c087d-8962-4fd9-8c22-02e152a969ac service cinder] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:50:05.487098 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 964/1958] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Sep 13 19:50:05 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 432 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 19:50:05.525105 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33694c59-a9df-4899-86f1-007f139e7333 admin admin] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:50:05.531629 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5351744-a6ea-4a00-aa32-3291c9c55cb0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cbb50c88b794a7f9f26844effde7d63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a10a4268f3c4cb29f4e00c292e2df62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:50:05.532758 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5351744-a6ea-4a00-aa32-3291c9c55cb0 service cinder] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:50:05.533202 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5351744-a6ea-4a00-aa32-3291c9c55cb0 service cinder] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:50:05.533513 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5351744-a6ea-4a00-aa32-3291c9c55cb0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:50:05.537416 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.fernet_utils [None req-c5351744-a6ea-4a00-aa32-3291c9c55cb0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:50:05.571692 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG dbcounter [-] [87934] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=87934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:50:05.665528 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5351744-a6ea-4a00-aa32-3291c9c55cb0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:50:05.669260 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5351744-a6ea-4a00-aa32-3291c9c55cb0 service cinder] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:50:05.709335 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 995/1959] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Sep 13 19:50:05 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 290 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 19:50:05.745250 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9c087d-8962-4fd9-8c22-02e152a969ac service cinder] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:50:05.760853 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9c087d-8962-4fd9-8c22-02e152a969ac service cinder] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:50:05.846032 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e82285-c431-40df-a6c0-512d133f4970 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:50:05.846939 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e82285-c431-40df-a6c0-512d133f4970 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:50:05.847389 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e82285-c431-40df-a6c0-512d133f4970 admin admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:50:05.847826 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e82285-c431-40df-a6c0-512d133f4970 admin admin] PATH_INFO: `/v3/users/24de71036b954cc78c8ccc28cbfda90c` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:50:05.849188 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e82285-c431-40df-a6c0-512d133f4970 admin admin] RBAC: Authorizing `identity:delete_user(user_id=24de71036b954cc78c8ccc28cbfda90c)` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:50:05.851304 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e82285-c431-40df-a6c0-512d133f4970 admin admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:50:05.952947 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.notifications [None req-82e82285-c431-40df-a6c0-512d133f4970 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '24de71036b954cc78c8ccc28cbfda90c'} {{(pid=87935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:50:05.965058 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.notifications [None req-82e82285-c431-40df-a6c0-512d133f4970 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '24de71036b954cc78c8ccc28cbfda90c'} {{(pid=87935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:50:05.992993 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.notifications [None req-82e82285-c431-40df-a6c0-512d133f4970 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '24de71036b954cc78c8ccc28cbfda90c'} {{(pid=87935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:50:05.992993 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.notifications [None req-82e82285-c431-40df-a6c0-512d133f4970 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '24de71036b954cc78c8ccc28cbfda90c'} {{(pid=87935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:50:06.000657 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.notifications [None req-82e82285-c431-40df-a6c0-512d133f4970 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '24de71036b954cc78c8ccc28cbfda90c'} {{(pid=87935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:50:06.009050 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG dbcounter [-] [87935] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:50:06.029361 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 965/1960] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Sep 13 19:50:05 2022] DELETE /identity/v3/users/24de71036b954cc78c8ccc28cbfda90c => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 19:50:06.031352 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045549db-52ba-4156-9cef-f8cee5825c67 None None] REQUEST_METHOD: `POST` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:50:06.031638 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045549db-52ba-4156-9cef-f8cee5825c67 None None] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:50:06.031910 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045549db-52ba-4156-9cef-f8cee5825c67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:50:06.060443 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.auth.core [None req-045549db-52ba-4156-9cef-f8cee5825c67 None None] MFA Rules not processed for user `7b0aed92d02344acb92a0e4aa67c3068`. Rule list: `[]` (Enabled: `True`). {{(pid=87934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:50:06.062038 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.fernet_utils [None req-045549db-52ba-4156-9cef-f8cee5825c67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:50:06.165922 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 996/1961] 10.222.0.25 () {58 vars in 958 bytes} [Tue Sep 13 19:50:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 19:50:06.179569 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e82285-c431-40df-a6c0-512d133f4970 admin admin] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:50:06.181246 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.fernet_utils [None req-82e82285-c431-40df-a6c0-512d133f4970 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:50:06.293226 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e82285-c431-40df-a6c0-512d133f4970 admin admin] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:50:06.302109 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3aa24bc-f08f-45c3-995c-4ab586b041cd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1196a96e4a404f559600b69f929ea9da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a10a4268f3c4cb29f4e00c292e2df62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:50:06.302656 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3aa24bc-f08f-45c3-995c-4ab586b041cd service neutron] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:50:06.302934 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3aa24bc-f08f-45c3-995c-4ab586b041cd service neutron] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:50:06.303205 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3aa24bc-f08f-45c3-995c-4ab586b041cd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:50:06.313220 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3aa24bc-f08f-45c3-995c-4ab586b041cd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:50:06.314815 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3aa24bc-f08f-45c3-995c-4ab586b041cd service neutron] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:50:06.329082 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 966/1962] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Sep 13 19:50:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 19:50:06.637262 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03604229-6371-4d69-86a7-42853b61dc47 None None] REQUEST_METHOD: `POST` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:50:06.638131 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03604229-6371-4d69-86a7-42853b61dc47 None None] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:50:06.638656 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03604229-6371-4d69-86a7-42853b61dc47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:50:06.715238 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.auth.core [None req-03604229-6371-4d69-86a7-42853b61dc47 None None] MFA Rules not processed for user `e10a5398c5ac48889f2e35083cdae43d`. Rule list: `[]` (Enabled: `True`). {{(pid=87934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:50:06.719823 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.fernet_utils [None req-03604229-6371-4d69-86a7-42853b61dc47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:50:06.732466 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3aa24bc-f08f-45c3-995c-4ab586b041cd service neutron] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:50:06.738403 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.fernet_utils [None req-e3aa24bc-f08f-45c3-995c-4ab586b041cd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:50:06.773900 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3aa24bc-f08f-45c3-995c-4ab586b041cd service neutron] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:50:06.783364 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83791ff5-cd3d-45c2-8b42-1ea478682393 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:50:06.784371 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83791ff5-cd3d-45c2-8b42-1ea478682393 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:50:06.787571 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83791ff5-cd3d-45c2-8b42-1ea478682393 admin admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:50:06.787983 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83791ff5-cd3d-45c2-8b42-1ea478682393 admin admin] PATH_INFO: `/v3/projects/13eeee72904e4367a63c3ea2b13f6fb3` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:50:06.789821 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83791ff5-cd3d-45c2-8b42-1ea478682393 admin admin] RBAC: Authorizing `identity:delete_project(project_id=13eeee72904e4367a63c3ea2b13f6fb3)` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:50:06.792164 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83791ff5-cd3d-45c2-8b42-1ea478682393 admin admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:50:06.872968 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.notifications [None req-83791ff5-cd3d-45c2-8b42-1ea478682393 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '13eeee72904e4367a63c3ea2b13f6fb3', 'request_id': 'req-83791ff5-cd3d-45c2-8b42-1ea478682393'} {{(pid=87935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:50:06.886759 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.notifications [None req-83791ff5-cd3d-45c2-8b42-1ea478682393 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '13eeee72904e4367a63c3ea2b13f6fb3', 'request_id': 'req-83791ff5-cd3d-45c2-8b42-1ea478682393'} {{(pid=87935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:50:06.902399 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 997/1963] 10.222.0.25 () {58 vars in 958 bytes} [Tue Sep 13 19:50:06 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 261 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 19:50:06.910291 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c528f7-ca75-4adf-8606-388df8d4f1ff None None] REQUEST_METHOD: `POST` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:50:06.910291 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c528f7-ca75-4adf-8606-388df8d4f1ff None None] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:50:06.910291 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c528f7-ca75-4adf-8606-388df8d4f1ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:50:06.918215 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.notifications [None req-83791ff5-cd3d-45c2-8b42-1ea478682393 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '13eeee72904e4367a63c3ea2b13f6fb3', 'request_id': 'req-83791ff5-cd3d-45c2-8b42-1ea478682393'} {{(pid=87935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:50:06.934456 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.auth.core [None req-c7c528f7-ca75-4adf-8606-388df8d4f1ff None None] MFA Rules not processed for user `84cce4563f86421181f25655df396079`. Rule list: `[]` (Enabled: `True`). {{(pid=87934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:50:06.936022 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.fernet_utils [None req-c7c528f7-ca75-4adf-8606-388df8d4f1ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:50:06.943871 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.notifications [None req-83791ff5-cd3d-45c2-8b42-1ea478682393 admin admin] The token cache is being invalidate because project 13eeee72904e4367a63c3ea2b13f6fb3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87935) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 19:50:06.944146 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.notifications [None req-83791ff5-cd3d-45c2-8b42-1ea478682393 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:50:06.945175 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.notifications [None req-83791ff5-cd3d-45c2-8b42-1ea478682393 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:50:06.947448 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 967/1964] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Sep 13 19:50:06 2022] DELETE /identity/v3/projects/13eeee72904e4367a63c3ea2b13f6fb3 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 19:50:06.953752 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83791ff5-cd3d-45c2-8b42-1ea478682393 admin admin] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:50:06.956198 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.fernet_utils [None req-83791ff5-cd3d-45c2-8b42-1ea478682393 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:50:06.981955 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG dbcounter [-] [87934] Writing DB stats keystone:SELECT=100 {{(pid=87934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:50:07.014988 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 998/1965] 10.222.0.25 () {58 vars in 958 bytes} [Tue Sep 13 19:50:06 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 19:50:07.027477 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c528f7-ca75-4adf-8606-388df8d4f1ff None None] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:50:07.028913 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.fernet_utils [None req-c7c528f7-ca75-4adf-8606-388df8d4f1ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:50:07.034405 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83791ff5-cd3d-45c2-8b42-1ea478682393 admin admin] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:50:07.041191 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4562ed-4234-4f7b-bf62-e90b37b47184 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:50:07.041884 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4562ed-4234-4f7b-bf62-e90b37b47184 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:50:07.042163 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4562ed-4234-4f7b-bf62-e90b37b47184 admin admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:50:07.042435 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4562ed-4234-4f7b-bf62-e90b37b47184 admin admin] PATH_INFO: `/v3/users/fc1c3a84acad4c179aaa220bda3d570c` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:50:07.043598 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f4562ed-4234-4f7b-bf62-e90b37b47184 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fc1c3a84acad4c179aaa220bda3d570c)` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:50:07.046178 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f4562ed-4234-4f7b-bf62-e90b37b47184 admin admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:50:07.081361 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG dbcounter [-] [87935] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:50:07.110519 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.notifications [None req-3f4562ed-4234-4f7b-bf62-e90b37b47184 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fc1c3a84acad4c179aaa220bda3d570c'} {{(pid=87935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:50:07.120460 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.notifications [None req-3f4562ed-4234-4f7b-bf62-e90b37b47184 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fc1c3a84acad4c179aaa220bda3d570c'} {{(pid=87935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:50:07.135996 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.notifications [None req-3f4562ed-4234-4f7b-bf62-e90b37b47184 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fc1c3a84acad4c179aaa220bda3d570c'} {{(pid=87935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:50:07.137109 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.notifications [None req-3f4562ed-4234-4f7b-bf62-e90b37b47184 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fc1c3a84acad4c179aaa220bda3d570c'} {{(pid=87935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:50:07.137412 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.notifications [None req-3f4562ed-4234-4f7b-bf62-e90b37b47184 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fc1c3a84acad4c179aaa220bda3d570c'} {{(pid=87935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:50:07.148477 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c528f7-ca75-4adf-8606-388df8d4f1ff None None] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:50:07.154740 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 968/1966] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Sep 13 19:50:06 2022] DELETE /identity/v3/users/fc1c3a84acad4c179aaa220bda3d570c => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 19:50:07.155289 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d7334c-04b7-4df4-9487-e96b5bd20e4a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd71fe5a8275f4ea98555afdcefc902a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a10a4268f3c4cb29f4e00c292e2df62', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:50:07.155836 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d7334c-04b7-4df4-9487-e96b5bd20e4a service nova] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:50:07.156116 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d7334c-04b7-4df4-9487-e96b5bd20e4a service nova] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:50:07.156411 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d7334c-04b7-4df4-9487-e96b5bd20e4a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:50:07.159153 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.fernet_utils [None req-c2d7334c-04b7-4df4-9487-e96b5bd20e4a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:50:07.170287 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d7334c-04b7-4df4-9487-e96b5bd20e4a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:50:07.172084 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d7334c-04b7-4df4-9487-e96b5bd20e4a service nova] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:50:07.182742 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 999/1967] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Sep 13 19:50:07 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 19:50:07.895361 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4562ed-4234-4f7b-bf62-e90b37b47184 admin admin] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:50:07.896635 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.fernet_utils [None req-3f4562ed-4234-4f7b-bf62-e90b37b47184 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:50:07.977299 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4562ed-4234-4f7b-bf62-e90b37b47184 admin admin] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:50:07.983349 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1825fe-c43c-410f-a7c6-554bb7a9972b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:50:07.983990 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1825fe-c43c-410f-a7c6-554bb7a9972b admin admin] REQUEST_METHOD: `DELETE` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:50:07.984312 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1825fe-c43c-410f-a7c6-554bb7a9972b admin admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:50:07.985056 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1825fe-c43c-410f-a7c6-554bb7a9972b admin admin] PATH_INFO: `/v3/users/39a1d44ae66340f1aa95ea45081ab24e` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:50:07.988094 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d1825fe-c43c-410f-a7c6-554bb7a9972b admin admin] RBAC: Authorizing `identity:delete_user(user_id=39a1d44ae66340f1aa95ea45081ab24e)` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:50:07.990105 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d1825fe-c43c-410f-a7c6-554bb7a9972b admin admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:50:08.057845 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.notifications [None req-7d1825fe-c43c-410f-a7c6-554bb7a9972b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '39a1d44ae66340f1aa95ea45081ab24e'} {{(pid=87935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:50:08.071054 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.notifications [None req-7d1825fe-c43c-410f-a7c6-554bb7a9972b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '39a1d44ae66340f1aa95ea45081ab24e'} {{(pid=87935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:50:08.097466 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.notifications [None req-7d1825fe-c43c-410f-a7c6-554bb7a9972b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '39a1d44ae66340f1aa95ea45081ab24e'} {{(pid=87935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:50:08.098168 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.notifications [None req-7d1825fe-c43c-410f-a7c6-554bb7a9972b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '39a1d44ae66340f1aa95ea45081ab24e'} {{(pid=87935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:50:08.102580 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.notifications [None req-7d1825fe-c43c-410f-a7c6-554bb7a9972b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '39a1d44ae66340f1aa95ea45081ab24e'} {{(pid=87935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:50:08.124833 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d7334c-04b7-4df4-9487-e96b5bd20e4a service nova] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:50:08.126768 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.fernet_utils [None req-c2d7334c-04b7-4df4-9487-e96b5bd20e4a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:50:08.150401 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 969/1968] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Sep 13 19:50:07 2022] DELETE /identity/v3/users/39a1d44ae66340f1aa95ea45081ab24e => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 19:50:08.151714 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d7334c-04b7-4df4-9487-e96b5bd20e4a service nova] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:50:08.155979 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41ce987-92a0-427c-8a97-448dd7b1ed1c None None] REQUEST_METHOD: `POST` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:50:08.156521 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41ce987-92a0-427c-8a97-448dd7b1ed1c None None] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:50:08.157859 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41ce987-92a0-427c-8a97-448dd7b1ed1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:50:08.222875 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.auth.core [None req-b41ce987-92a0-427c-8a97-448dd7b1ed1c None None] MFA Rules not processed for user `7b0aed92d02344acb92a0e4aa67c3068`. Rule list: `[]` (Enabled: `True`). {{(pid=87935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:50:08.224029 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.fernet_utils [None req-b41ce987-92a0-427c-8a97-448dd7b1ed1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:50:08.254188 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG dbcounter [-] [87935] Writing DB stats keystone:DELETE=17,keystone:SELECT=81,keystone:INSERT=2 {{(pid=87935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:50:08.273688 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0a6f72-edec-4c33-8ffd-0318f7736ddc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:50:08.274344 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0a6f72-edec-4c33-8ffd-0318f7736ddc admin admin] REQUEST_METHOD: `DELETE` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:50:08.275273 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0a6f72-edec-4c33-8ffd-0318f7736ddc admin admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:50:08.275558 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0a6f72-edec-4c33-8ffd-0318f7736ddc admin admin] PATH_INFO: `/v3/projects/ce6e21625bd54840b29318242194ec02` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:50:08.277055 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f0a6f72-edec-4c33-8ffd-0318f7736ddc admin admin] RBAC: Authorizing `identity:delete_project(project_id=ce6e21625bd54840b29318242194ec02)` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:50:08.279979 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f0a6f72-edec-4c33-8ffd-0318f7736ddc admin admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:50:08.349222 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.notifications [None req-4f0a6f72-edec-4c33-8ffd-0318f7736ddc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ce6e21625bd54840b29318242194ec02', 'request_id': 'req-4f0a6f72-edec-4c33-8ffd-0318f7736ddc'} {{(pid=87934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:50:08.357652 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.notifications [None req-4f0a6f72-edec-4c33-8ffd-0318f7736ddc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ce6e21625bd54840b29318242194ec02', 'request_id': 'req-4f0a6f72-edec-4c33-8ffd-0318f7736ddc'} {{(pid=87934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:50:08.364899 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.notifications [None req-4f0a6f72-edec-4c33-8ffd-0318f7736ddc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ce6e21625bd54840b29318242194ec02', 'request_id': 'req-4f0a6f72-edec-4c33-8ffd-0318f7736ddc'} {{(pid=87934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:50:08.378700 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 970/1969] 10.222.0.25 () {58 vars in 958 bytes} [Tue Sep 13 19:50:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 19:50:08.380932 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG dbcounter [-] [87934] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=87934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:50:08.388067 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.notifications [None req-4f0a6f72-edec-4c33-8ffd-0318f7736ddc admin admin] The token cache is being invalidate because project ce6e21625bd54840b29318242194ec02 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87934) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 19:50:08.388486 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.notifications [None req-4f0a6f72-edec-4c33-8ffd-0318f7736ddc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:50:08.390491 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41ce987-92a0-427c-8a97-448dd7b1ed1c None None] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:50:08.390690 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.notifications [None req-4f0a6f72-edec-4c33-8ffd-0318f7736ddc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:50:08.392648 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.fernet_utils [None req-b41ce987-92a0-427c-8a97-448dd7b1ed1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:50:08.394711 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 1000/1970] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Sep 13 19:50:08 2022] DELETE /identity/v3/projects/ce6e21625bd54840b29318242194ec02 => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 19:50:08.400428 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914b9497-84eb-4854-9628-85123278fe74 None None] REQUEST_METHOD: `POST` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:50:08.401680 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914b9497-84eb-4854-9628-85123278fe74 None None] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:50:08.402591 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914b9497-84eb-4854-9628-85123278fe74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:50:08.436911 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.auth.core [None req-914b9497-84eb-4854-9628-85123278fe74 None None] MFA Rules not processed for user `7b0aed92d02344acb92a0e4aa67c3068`. Rule list: `[]` (Enabled: `True`). {{(pid=87934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:50:08.438419 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.fernet_utils [None req-914b9497-84eb-4854-9628-85123278fe74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:50:08.538459 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41ce987-92a0-427c-8a97-448dd7b1ed1c None None] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:50:08.555975 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 1001/1971] 10.222.0.25 () {58 vars in 958 bytes} [Tue Sep 13 19:50:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 19:50:08.558022 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bb6732-caf3-4292-9825-3cb737a9bb72 None None] REQUEST_METHOD: `POST` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:50:08.558409 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bb6732-caf3-4292-9825-3cb737a9bb72 None None] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:50:08.558885 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bb6732-caf3-4292-9825-3cb737a9bb72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:50:08.587680 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.auth.core [None req-54bb6732-caf3-4292-9825-3cb737a9bb72 None None] MFA Rules not processed for user `7b0aed92d02344acb92a0e4aa67c3068`. Rule list: `[]` (Enabled: `True`). {{(pid=87934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:50:08.589041 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.fernet_utils [None req-54bb6732-caf3-4292-9825-3cb737a9bb72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:50:08.608295 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 1002/1972] 10.222.0.25 () {58 vars in 958 bytes} [Tue Sep 13 19:50:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 19:50:08.611247 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54bb6732-caf3-4292-9825-3cb737a9bb72 None None] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:50:08.633261 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54bb6732-caf3-4292-9825-3cb737a9bb72 None None] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:50:08.646571 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43e2fb0-4394-4299-a1a4-ad3a1a36d3b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:50:08.647245 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43e2fb0-4394-4299-a1a4-ad3a1a36d3b9 admin admin] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:50:08.647697 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43e2fb0-4394-4299-a1a4-ad3a1a36d3b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:50:08.647996 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43e2fb0-4394-4299-a1a4-ad3a1a36d3b9 admin admin] PATH_INFO: `/v3/domains` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:50:08.648562 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f43e2fb0-4394-4299-a1a4-ad3a1a36d3b9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87934) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:50:08.648864 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f43e2fb0-4394-4299-a1a4-ad3a1a36d3b9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:50:08.651292 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f43e2fb0-4394-4299-a1a4-ad3a1a36d3b9 admin admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:50:08.676277 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd40d80-8f5e-483d-aaf6-be1f86d7650d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1196a96e4a404f559600b69f929ea9da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a10a4268f3c4cb29f4e00c292e2df62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:50:08.678298 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd40d80-8f5e-483d-aaf6-be1f86d7650d service neutron] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:50:08.679489 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd40d80-8f5e-483d-aaf6-be1f86d7650d service neutron] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:50:08.680144 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd40d80-8f5e-483d-aaf6-be1f86d7650d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:50:08.686148 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.fernet_utils [None req-7fd40d80-8f5e-483d-aaf6-be1f86d7650d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:50:08.695621 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 1003/1973] 10.222.0.25 () {58 vars in 1153 bytes} [Tue Sep 13 19:50:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:50:08.701700 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43e2fb0-4394-4299-a1a4-ad3a1a36d3b9 admin admin] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:50:08.719509 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd40d80-8f5e-483d-aaf6-be1f86d7650d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:50:08.722791 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd40d80-8f5e-483d-aaf6-be1f86d7650d service neutron] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:50:08.731223 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43e2fb0-4394-4299-a1a4-ad3a1a36d3b9 admin admin] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:50:08.736091 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 971/1974] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Sep 13 19:50:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 13 19:50:08.744107 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81685a43-4064-4efb-9442-4963db55354f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:50:08.745038 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81685a43-4064-4efb-9442-4963db55354f admin admin] REQUEST_METHOD: `POST` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:50:08.745550 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81685a43-4064-4efb-9442-4963db55354f admin admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:50:08.745990 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81685a43-4064-4efb-9442-4963db55354f admin admin] PATH_INFO: `/v3/projects` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:50:08.747176 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81685a43-4064-4efb-9442-4963db55354f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:50:08.752271 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81685a43-4064-4efb-9442-4963db55354f admin admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:50:08.801172 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 1004/1975] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Sep 13 19:50:08 2022] POST /identity/v3/projects => generated 407 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 19:50:08.802953 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd40d80-8f5e-483d-aaf6-be1f86d7650d service neutron] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:50:08.820541 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd40d80-8f5e-483d-aaf6-be1f86d7650d service neutron] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:50:08.911241 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba72cd3-76dd-4bb5-8664-d7286c3acb82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:50:08.911905 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba72cd3-76dd-4bb5-8664-d7286c3acb82 admin admin] REQUEST_METHOD: `POST` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:50:08.912352 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba72cd3-76dd-4bb5-8664-d7286c3acb82 admin admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:50:08.912699 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba72cd3-76dd-4bb5-8664-d7286c3acb82 admin admin] PATH_INFO: `/v3/users` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:50:08.913739 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba72cd3-76dd-4bb5-8664-d7286c3acb82 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:50:08.917898 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba72cd3-76dd-4bb5-8664-d7286c3acb82 admin admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:50:08.949869 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 972/1976] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Sep 13 19:50:08 2022] POST /identity/v3/users => generated 304 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 13 19:50:08.954134 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81685a43-4064-4efb-9442-4963db55354f admin admin] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:50:08.965569 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81685a43-4064-4efb-9442-4963db55354f admin admin] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:50:08.971012 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb49d57-2800-48bb-ba57-607fd144d566 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:50:08.971664 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb49d57-2800-48bb-ba57-607fd144d566 admin admin] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:50:08.972068 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb49d57-2800-48bb-ba57-607fd144d566 admin admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:50:08.972413 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb49d57-2800-48bb-ba57-607fd144d566 admin admin] PATH_INFO: `/v3/roles` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:50:08.973176 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb49d57-2800-48bb-ba57-607fd144d566 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:50:08.975284 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb49d57-2800-48bb-ba57-607fd144d566 admin admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:50:08.989866 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 1005/1977] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Sep 13 19:50:08 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 19:50:08.991696 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba72cd3-76dd-4bb5-8664-d7286c3acb82 admin admin] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:50:09.011556 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba72cd3-76dd-4bb5-8664-d7286c3acb82 admin admin] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:50:09.017470 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564db191-e815-427e-ae34-2d2ee0bd54ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:50:09.018467 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564db191-e815-427e-ae34-2d2ee0bd54ac admin admin] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:50:09.018929 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564db191-e815-427e-ae34-2d2ee0bd54ac admin admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:50:09.019433 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564db191-e815-427e-ae34-2d2ee0bd54ac admin admin] PATH_INFO: `/v3/roles` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:50:09.020384 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-564db191-e815-427e-ae34-2d2ee0bd54ac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:50:09.022328 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-564db191-e815-427e-ae34-2d2ee0bd54ac admin admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:50:09.024147 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG dbcounter [-] [87935] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:50:09.042126 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 973/1978] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Sep 13 19:50:08 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 19:50:09.043337 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb49d57-2800-48bb-ba57-607fd144d566 admin admin] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:50:09.063590 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb49d57-2800-48bb-ba57-607fd144d566 admin admin] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:50:09.070231 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2f4059-c6d4-417f-af5e-ddf2af9b7374 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:50:09.070980 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2f4059-c6d4-417f-af5e-ddf2af9b7374 admin admin] REQUEST_METHOD: `PUT` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:50:09.071377 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2f4059-c6d4-417f-af5e-ddf2af9b7374 admin admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:50:09.071739 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2f4059-c6d4-417f-af5e-ddf2af9b7374 admin admin] PATH_INFO: `/v3/projects/721999bab6dc401ea3f26112a47636b7/users/e6285dae8aca437db86bd55c45c3b2b2/roles/a259191f6d0e46fabd9f34536bb28747` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:50:09.094005 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b2f4059-c6d4-417f-af5e-ddf2af9b7374 admin admin] RBAC: Authorizing `identity:create_grant(project_id=721999bab6dc401ea3f26112a47636b7, user_id=e6285dae8aca437db86bd55c45c3b2b2, role_id=a259191f6d0e46fabd9f34536bb28747)` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:50:09.098373 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b2f4059-c6d4-417f-af5e-ddf2af9b7374 admin admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:50:09.115633 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 1006/1979] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Sep 13 19:50:09 2022] PUT /identity/v3/projects/721999bab6dc401ea3f26112a47636b7/users/e6285dae8aca437db86bd55c45c3b2b2/roles/a259191f6d0e46fabd9f34536bb28747 => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 19:50:09.130966 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564db191-e815-427e-ae34-2d2ee0bd54ac admin admin] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:50:09.132200 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4697e8-f7df-4080-92ea-e5caf0fb8fa3 None None] REQUEST_METHOD: `POST` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:50:09.132708 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4697e8-f7df-4080-92ea-e5caf0fb8fa3 None None] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:50:09.132809 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4697e8-f7df-4080-92ea-e5caf0fb8fa3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:50:09.133825 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.fernet_utils [None req-564db191-e815-427e-ae34-2d2ee0bd54ac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:50:09.155861 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564db191-e815-427e-ae34-2d2ee0bd54ac admin admin] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:50:09.194601 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.auth.core [None req-bb4697e8-f7df-4080-92ea-e5caf0fb8fa3 None None] MFA Rules not processed for user `e6285dae8aca437db86bd55c45c3b2b2`. Rule list: `[]` (Enabled: `True`). {{(pid=87934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:50:09.195823 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.fernet_utils [None req-bb4697e8-f7df-4080-92ea-e5caf0fb8fa3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:50:09.278429 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3398fc70-53b9-40f0-aecf-ca5e21c71d4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:50:09.279906 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3398fc70-53b9-40f0-aecf-ca5e21c71d4d admin admin] REQUEST_METHOD: `DELETE` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:50:09.280188 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3398fc70-53b9-40f0-aecf-ca5e21c71d4d admin admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:50:09.280494 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3398fc70-53b9-40f0-aecf-ca5e21c71d4d admin admin] PATH_INFO: `/v3/projects/ccd7c1885c7f4c629d9f575a6afc315d` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:50:09.282713 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3398fc70-53b9-40f0-aecf-ca5e21c71d4d admin admin] RBAC: Authorizing `identity:delete_project(project_id=ccd7c1885c7f4c629d9f575a6afc315d)` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:50:09.291446 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3398fc70-53b9-40f0-aecf-ca5e21c71d4d admin admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:50:09.328247 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 1007/1980] 10.222.0.25 () {58 vars in 958 bytes} [Tue Sep 13 19:50:09 2022] POST /identity/v3/auth/tokens => generated 3284 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 19:50:09.331186 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4697e8-f7df-4080-92ea-e5caf0fb8fa3 None None] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:50:09.351575 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4697e8-f7df-4080-92ea-e5caf0fb8fa3 None None] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:50:09.356691 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c1ae19-89c0-4cfb-b668-bad52f030edb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:50:09.357316 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c1ae19-89c0-4cfb-b668-bad52f030edb admin admin] REQUEST_METHOD: `POST` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:50:09.357578 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c1ae19-89c0-4cfb-b668-bad52f030edb admin admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:50:09.357845 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c1ae19-89c0-4cfb-b668-bad52f030edb admin admin] PATH_INFO: `/v3/projects` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:50:09.358478 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c1ae19-89c0-4cfb-b668-bad52f030edb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:50:09.360391 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c1ae19-89c0-4cfb-b668-bad52f030edb admin admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:50:09.372884 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG dbcounter [-] [87934] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=87934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:50:09.375609 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.notifications [None req-3398fc70-53b9-40f0-aecf-ca5e21c71d4d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ccd7c1885c7f4c629d9f575a6afc315d', 'request_id': 'req-3398fc70-53b9-40f0-aecf-ca5e21c71d4d'} {{(pid=87935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:50:09.385905 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.notifications [None req-3398fc70-53b9-40f0-aecf-ca5e21c71d4d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ccd7c1885c7f4c629d9f575a6afc315d', 'request_id': 'req-3398fc70-53b9-40f0-aecf-ca5e21c71d4d'} {{(pid=87935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:50:09.393577 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.notifications [None req-3398fc70-53b9-40f0-aecf-ca5e21c71d4d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ccd7c1885c7f4c629d9f575a6afc315d', 'request_id': 'req-3398fc70-53b9-40f0-aecf-ca5e21c71d4d'} {{(pid=87935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:50:09.395042 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 1008/1981] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Sep 13 19:50:09 2022] POST /identity/v3/projects => generated 409 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 13 19:50:09.399071 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c1ae19-89c0-4cfb-b668-bad52f030edb admin admin] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:50:09.418011 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.notifications [None req-3398fc70-53b9-40f0-aecf-ca5e21c71d4d admin admin] The token cache is being invalidate because project ccd7c1885c7f4c629d9f575a6afc315d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87935) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 19:50:09.418780 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.notifications [None req-3398fc70-53b9-40f0-aecf-ca5e21c71d4d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:50:09.419790 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.notifications [None req-3398fc70-53b9-40f0-aecf-ca5e21c71d4d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:50:09.422233 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 974/1982] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Sep 13 19:50:09 2022] DELETE /identity/v3/projects/ccd7c1885c7f4c629d9f575a6afc315d => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 19:50:09.426692 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3398fc70-53b9-40f0-aecf-ca5e21c71d4d admin admin] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:50:09.428557 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.fernet_utils [None req-3398fc70-53b9-40f0-aecf-ca5e21c71d4d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:50:09.484020 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c1ae19-89c0-4cfb-b668-bad52f030edb admin admin] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:50:09.489795 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d031a836-2a1f-488b-af33-dcb4f0fc0b9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:50:09.490450 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d031a836-2a1f-488b-af33-dcb4f0fc0b9d admin admin] REQUEST_METHOD: `POST` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:50:09.490727 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d031a836-2a1f-488b-af33-dcb4f0fc0b9d admin admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:50:09.491190 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d031a836-2a1f-488b-af33-dcb4f0fc0b9d admin admin] PATH_INFO: `/v3/users` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:50:09.491768 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d031a836-2a1f-488b-af33-dcb4f0fc0b9d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:50:09.493866 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d031a836-2a1f-488b-af33-dcb4f0fc0b9d admin admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:50:09.503757 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3398fc70-53b9-40f0-aecf-ca5e21c71d4d admin admin] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:50:09.510451 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb003ad-b439-4566-bf90-57b2f085d1ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:50:09.511079 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb003ad-b439-4566-bf90-57b2f085d1ac admin admin] REQUEST_METHOD: `DELETE` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:50:09.511357 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb003ad-b439-4566-bf90-57b2f085d1ac admin admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:50:09.511625 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb003ad-b439-4566-bf90-57b2f085d1ac admin admin] PATH_INFO: `/v3/users/9ab2b7c57508493f84a80cb474240d6a` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:50:09.512793 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb003ad-b439-4566-bf90-57b2f085d1ac admin admin] RBAC: Authorizing `identity:delete_user(user_id=9ab2b7c57508493f84a80cb474240d6a)` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:50:09.514813 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb003ad-b439-4566-bf90-57b2f085d1ac admin admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:50:09.516266 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 1009/1983] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Sep 13 19:50:09 2022] POST /identity/v3/users => generated 311 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 13 19:50:09.520970 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d031a836-2a1f-488b-af33-dcb4f0fc0b9d admin admin] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:50:09.522886 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.fernet_utils [None req-d031a836-2a1f-488b-af33-dcb4f0fc0b9d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:50:09.538065 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d031a836-2a1f-488b-af33-dcb4f0fc0b9d admin admin] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:50:09.544153 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6dc2a8e-062d-4803-ab25-a717cc86f5f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:50:09.545183 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6dc2a8e-062d-4803-ab25-a717cc86f5f3 admin admin] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:50:09.545563 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6dc2a8e-062d-4803-ab25-a717cc86f5f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:50:09.547747 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6dc2a8e-062d-4803-ab25-a717cc86f5f3 admin admin] PATH_INFO: `/v3/roles` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:50:09.547747 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6dc2a8e-062d-4803-ab25-a717cc86f5f3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:50:09.549813 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6dc2a8e-062d-4803-ab25-a717cc86f5f3 admin admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:50:09.554615 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG dbcounter [-] [87935] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=87935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:50:09.570970 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 1010/1984] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Sep 13 19:50:09 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 13 19:50:09.571872 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6dc2a8e-062d-4803-ab25-a717cc86f5f3 admin admin] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:50:09.583767 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6dc2a8e-062d-4803-ab25-a717cc86f5f3 admin admin] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:50:09.594340 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.notifications [None req-4fb003ad-b439-4566-bf90-57b2f085d1ac admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9ab2b7c57508493f84a80cb474240d6a'} {{(pid=87935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:50:09.595593 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d986c228-7c29-4991-b58a-150ff0a1e538 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:50:09.597569 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d986c228-7c29-4991-b58a-150ff0a1e538 admin admin] REQUEST_METHOD: `PUT` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:50:09.598027 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d986c228-7c29-4991-b58a-150ff0a1e538 admin admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:50:09.598479 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d986c228-7c29-4991-b58a-150ff0a1e538 admin admin] PATH_INFO: `/v3/projects/0fa8b75ad59f449c86e01eac1cd41a35/users/7e5361ed276647c082dfbe799047b1ed/roles/6ca1d4427ff64e0a9d25d96cfb1445f6` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:50:09.606167 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.notifications [None req-4fb003ad-b439-4566-bf90-57b2f085d1ac admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9ab2b7c57508493f84a80cb474240d6a'} {{(pid=87935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:50:09.626860 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.notifications [None req-4fb003ad-b439-4566-bf90-57b2f085d1ac admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9ab2b7c57508493f84a80cb474240d6a'} {{(pid=87935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:50:09.627794 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.notifications [None req-4fb003ad-b439-4566-bf90-57b2f085d1ac admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9ab2b7c57508493f84a80cb474240d6a'} {{(pid=87935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:50:09.628471 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.notifications [None req-4fb003ad-b439-4566-bf90-57b2f085d1ac admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9ab2b7c57508493f84a80cb474240d6a'} {{(pid=87935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:50:09.638714 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d986c228-7c29-4991-b58a-150ff0a1e538 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0fa8b75ad59f449c86e01eac1cd41a35, user_id=7e5361ed276647c082dfbe799047b1ed, role_id=6ca1d4427ff64e0a9d25d96cfb1445f6)` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:50:09.642240 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d986c228-7c29-4991-b58a-150ff0a1e538 admin admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:50:09.647535 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 975/1985] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Sep 13 19:50:09 2022] DELETE /identity/v3/users/9ab2b7c57508493f84a80cb474240d6a => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 19:50:09.673079 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 1011/1986] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Sep 13 19:50:09 2022] PUT /identity/v3/projects/0fa8b75ad59f449c86e01eac1cd41a35/users/7e5361ed276647c082dfbe799047b1ed/roles/6ca1d4427ff64e0a9d25d96cfb1445f6 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 19:50:09.684086 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb003ad-b439-4566-bf90-57b2f085d1ac admin admin] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:50:09.686068 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.fernet_utils [None req-4fb003ad-b439-4566-bf90-57b2f085d1ac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:50:09.787313 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb003ad-b439-4566-bf90-57b2f085d1ac admin admin] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:50:09.884149 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b372a6-ded0-4410-8456-0546906122e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:50:09.885268 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b372a6-ded0-4410-8456-0546906122e3 admin admin] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:50:09.885786 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b372a6-ded0-4410-8456-0546906122e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:50:09.886136 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b372a6-ded0-4410-8456-0546906122e3 admin admin] PATH_INFO: `/v3/roles` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:50:09.888195 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b372a6-ded0-4410-8456-0546906122e3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:50:09.891292 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b372a6-ded0-4410-8456-0546906122e3 admin admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:50:09.922885 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 976/1987] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Sep 13 19:50:09 2022] GET /identity/v3/roles => generated 1420 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 19:50:09.925950 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d986c228-7c29-4991-b58a-150ff0a1e538 admin admin] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:50:09.942307 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d986c228-7c29-4991-b58a-150ff0a1e538 admin admin] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:50:09.956484 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5404e212-69e5-422c-800b-452a9672432f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:50:09.957235 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5404e212-69e5-422c-800b-452a9672432f admin admin] REQUEST_METHOD: `PUT` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:50:09.957672 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5404e212-69e5-422c-800b-452a9672432f admin admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:50:09.957945 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5404e212-69e5-422c-800b-452a9672432f admin admin] PATH_INFO: `/v3/projects/0fa8b75ad59f449c86e01eac1cd41a35/users/7e5361ed276647c082dfbe799047b1ed/roles/6ca1d4427ff64e0a9d25d96cfb1445f6` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:50:09.963857 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5404e212-69e5-422c-800b-452a9672432f admin admin] RBAC: Authorizing `identity:create_grant(project_id=0fa8b75ad59f449c86e01eac1cd41a35, user_id=7e5361ed276647c082dfbe799047b1ed, role_id=6ca1d4427ff64e0a9d25d96cfb1445f6)` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:50:09.966710 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5404e212-69e5-422c-800b-452a9672432f admin admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:50:09.989220 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 1012/1988] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Sep 13 19:50:09 2022] PUT /identity/v3/projects/0fa8b75ad59f449c86e01eac1cd41a35/users/7e5361ed276647c082dfbe799047b1ed/roles/6ca1d4427ff64e0a9d25d96cfb1445f6 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 19:50:09.999330 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e756a9c6-cee1-49f0-a23f-ae3084052090 None None] REQUEST_METHOD: `POST` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:50:09.999832 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e756a9c6-cee1-49f0-a23f-ae3084052090 None None] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:50:10.000291 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e756a9c6-cee1-49f0-a23f-ae3084052090 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:50:10.048599 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.auth.core [None req-e756a9c6-cee1-49f0-a23f-ae3084052090 None None] MFA Rules not processed for user `7e5361ed276647c082dfbe799047b1ed`. Rule list: `[]` (Enabled: `True`). {{(pid=87935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:50:10.050380 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.fernet_utils [None req-e756a9c6-cee1-49f0-a23f-ae3084052090 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:50:10.096326 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG dbcounter [-] [87935] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=87935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:50:10.146290 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 977/1989] 10.222.0.25 () {58 vars in 958 bytes} [Tue Sep 13 19:50:09 2022] POST /identity/v3/auth/tokens => generated 3353 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 19:50:10.165429 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5404e212-69e5-422c-800b-452a9672432f admin admin] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:50:10.167981 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.fernet_utils [None req-5404e212-69e5-422c-800b-452a9672432f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:50:10.173798 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e756a9c6-cee1-49f0-a23f-ae3084052090 None None] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:50:10.176623 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.fernet_utils [None req-e756a9c6-cee1-49f0-a23f-ae3084052090 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:50:10.271241 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5404e212-69e5-422c-800b-452a9672432f admin admin] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:50:10.277450 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886d3185-f73c-42a7-9b4a-1d7e8ec7643c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cbb50c88b794a7f9f26844effde7d63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a10a4268f3c4cb29f4e00c292e2df62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:50:10.278179 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886d3185-f73c-42a7-9b4a-1d7e8ec7643c service cinder] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:50:10.278456 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886d3185-f73c-42a7-9b4a-1d7e8ec7643c service cinder] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:50:10.278723 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886d3185-f73c-42a7-9b4a-1d7e8ec7643c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:50:10.283225 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e756a9c6-cee1-49f0-a23f-ae3084052090 None None] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:50:10.288113 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54d2e54-57b9-4d24-8d3b-851d24c78302 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:50:10.288784 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54d2e54-57b9-4d24-8d3b-851d24c78302 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:50:10.289060 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54d2e54-57b9-4d24-8d3b-851d24c78302 admin admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:50:10.289322 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54d2e54-57b9-4d24-8d3b-851d24c78302 admin admin] PATH_INFO: `/v3/projects/7f40eddbf85d4702b561cd79b64493fd` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:50:10.290603 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c54d2e54-57b9-4d24-8d3b-851d24c78302 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7f40eddbf85d4702b561cd79b64493fd)` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:50:10.292861 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c54d2e54-57b9-4d24-8d3b-851d24c78302 admin admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:50:10.295861 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-886d3185-f73c-42a7-9b4a-1d7e8ec7643c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:50:10.297733 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-886d3185-f73c-42a7-9b4a-1d7e8ec7643c service cinder] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:50:10.310003 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 1013/1990] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Sep 13 19:50:10 2022] GET /identity/v3/auth/tokens => generated 3353 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 19:50:10.363388 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.notifications [None req-c54d2e54-57b9-4d24-8d3b-851d24c78302 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7f40eddbf85d4702b561cd79b64493fd', 'request_id': 'req-c54d2e54-57b9-4d24-8d3b-851d24c78302'} {{(pid=87935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:50:10.371756 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.notifications [None req-c54d2e54-57b9-4d24-8d3b-851d24c78302 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7f40eddbf85d4702b561cd79b64493fd', 'request_id': 'req-c54d2e54-57b9-4d24-8d3b-851d24c78302'} {{(pid=87935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:50:10.387903 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.notifications [None req-c54d2e54-57b9-4d24-8d3b-851d24c78302 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7f40eddbf85d4702b561cd79b64493fd', 'request_id': 'req-c54d2e54-57b9-4d24-8d3b-851d24c78302'} {{(pid=87935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:50:10.406631 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.notifications [None req-c54d2e54-57b9-4d24-8d3b-851d24c78302 admin admin] The token cache is being invalidate because project 7f40eddbf85d4702b561cd79b64493fd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87935) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 19:50:10.406990 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.notifications [None req-c54d2e54-57b9-4d24-8d3b-851d24c78302 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:50:10.409540 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.notifications [None req-c54d2e54-57b9-4d24-8d3b-851d24c78302 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:50:10.415975 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 978/1991] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Sep 13 19:50:10 2022] DELETE /identity/v3/projects/7f40eddbf85d4702b561cd79b64493fd => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 19:50:10.420779 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6836a2a0-352c-4f34-bbde-2820d75c0899 None None] REQUEST_METHOD: `POST` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:50:10.421065 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6836a2a0-352c-4f34-bbde-2820d75c0899 None None] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:50:10.421375 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6836a2a0-352c-4f34-bbde-2820d75c0899 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:50:10.459892 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.auth.core [None req-6836a2a0-352c-4f34-bbde-2820d75c0899 None None] MFA Rules not processed for user `7b0aed92d02344acb92a0e4aa67c3068`. Rule list: `[]` (Enabled: `True`). {{(pid=87934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:50:10.465726 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.fernet_utils [None req-6836a2a0-352c-4f34-bbde-2820d75c0899 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:50:10.516683 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG dbcounter [-] [87934] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=87934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:50:10.563725 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54d2e54-57b9-4d24-8d3b-851d24c78302 admin admin] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:50:10.565849 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.fernet_utils [None req-c54d2e54-57b9-4d24-8d3b-851d24c78302 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:50:10.572272 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 1014/1992] 10.222.0.25 () {58 vars in 958 bytes} [Tue Sep 13 19:50:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 19:50:10.580777 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd47972-1239-459f-966b-f848d4f71473 None None] REQUEST_METHOD: `POST` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:50:10.581139 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd47972-1239-459f-966b-f848d4f71473 None None] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:50:10.581441 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd47972-1239-459f-966b-f848d4f71473 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:50:10.602832 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.auth.core [None req-3fd47972-1239-459f-966b-f848d4f71473 None None] MFA Rules not processed for user `7b0aed92d02344acb92a0e4aa67c3068`. Rule list: `[]` (Enabled: `True`). {{(pid=87934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:50:10.604072 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.fernet_utils [None req-3fd47972-1239-459f-966b-f848d4f71473 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:50:10.613354 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 1015/1993] 10.222.0.25 () {58 vars in 958 bytes} [Tue Sep 13 19:50:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 19:50:10.617496 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd47972-1239-459f-966b-f848d4f71473 None None] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:50:10.628147 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd47972-1239-459f-966b-f848d4f71473 None None] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:50:10.634200 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e4daab-42a1-4199-a284-20de672dbb21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:50:10.634817 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e4daab-42a1-4199-a284-20de672dbb21 admin admin] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:50:10.635093 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e4daab-42a1-4199-a284-20de672dbb21 admin admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:50:10.635359 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e4daab-42a1-4199-a284-20de672dbb21 admin admin] PATH_INFO: `/v3/domains` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:50:10.636010 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e4daab-42a1-4199-a284-20de672dbb21 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87934) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:50:10.636342 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e4daab-42a1-4199-a284-20de672dbb21 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:50:10.637947 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e4daab-42a1-4199-a284-20de672dbb21 admin admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:50:10.655088 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 1016/1994] 10.222.0.25 () {58 vars in 1153 bytes} [Tue Sep 13 19:50:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 19:50:10.655988 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e4daab-42a1-4199-a284-20de672dbb21 admin admin] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:50:10.667044 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e4daab-42a1-4199-a284-20de672dbb21 admin admin] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:50:10.672802 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e35698-c889-484b-94c1-2b6f16411b17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:50:10.672802 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e35698-c889-484b-94c1-2b6f16411b17 admin admin] REQUEST_METHOD: `POST` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:50:10.672802 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e35698-c889-484b-94c1-2b6f16411b17 admin admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:50:10.673079 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54d2e54-57b9-4d24-8d3b-851d24c78302 admin admin] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:50:10.673189 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e35698-c889-484b-94c1-2b6f16411b17 admin admin] PATH_INFO: `/v3/projects` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:50:10.673846 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e35698-c889-484b-94c1-2b6f16411b17 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:50:10.676403 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e35698-c889-484b-94c1-2b6f16411b17 admin admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:50:10.680078 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6e13f4-e940-46b1-acc0-13a2ffbc0114 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cbb50c88b794a7f9f26844effde7d63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a10a4268f3c4cb29f4e00c292e2df62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:50:10.681029 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6e13f4-e940-46b1-acc0-13a2ffbc0114 service cinder] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:50:10.681473 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6e13f4-e940-46b1-acc0-13a2ffbc0114 service cinder] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:50:10.681921 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6e13f4-e940-46b1-acc0-13a2ffbc0114 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:50:10.683743 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.fernet_utils [None req-cb6e13f4-e940-46b1-acc0-13a2ffbc0114 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:50:10.710168 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG dbcounter [-] [87935] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=87935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:50:10.716747 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 1017/1995] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Sep 13 19:50:10 2022] POST /identity/v3/projects => generated 383 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 19:50:10.722300 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e35698-c889-484b-94c1-2b6f16411b17 admin admin] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:50:10.821143 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb6e13f4-e940-46b1-acc0-13a2ffbc0114 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:50:10.822976 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb6e13f4-e940-46b1-acc0-13a2ffbc0114 service cinder] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:50:10.841393 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e35698-c889-484b-94c1-2b6f16411b17 admin admin] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:50:10.844918 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 979/1996] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Sep 13 19:50:10 2022] GET /identity/v3/auth/tokens => generated 3284 bytes in 283 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 13 19:50:10.851498 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c9c2cf-7c2f-4b11-9e8e-1080668da5f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:50:10.852231 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c9c2cf-7c2f-4b11-9e8e-1080668da5f8 admin admin] REQUEST_METHOD: `POST` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:50:10.852632 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c9c2cf-7c2f-4b11-9e8e-1080668da5f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:50:10.852980 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c9c2cf-7c2f-4b11-9e8e-1080668da5f8 admin admin] PATH_INFO: `/v3/users` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:50:10.853881 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c9c2cf-7c2f-4b11-9e8e-1080668da5f8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:50:10.856821 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c9c2cf-7c2f-4b11-9e8e-1080668da5f8 admin admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:50:10.897568 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 1018/1997] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Sep 13 19:50:10 2022] POST /identity/v3/users => generated 292 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 19:50:10.901865 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6e13f4-e940-46b1-acc0-13a2ffbc0114 service cinder] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:50:10.918701 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6e13f4-e940-46b1-acc0-13a2ffbc0114 service cinder] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:50:10.936532 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dcac5ec-d682-41e7-9606-90c6b46c4dcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:50:10.937168 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcac5ec-d682-41e7-9606-90c6b46c4dcc admin admin] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:50:10.937447 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcac5ec-d682-41e7-9606-90c6b46c4dcc admin admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:50:10.937793 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcac5ec-d682-41e7-9606-90c6b46c4dcc admin admin] PATH_INFO: `/v3/roles` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:50:10.943676 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dcac5ec-d682-41e7-9606-90c6b46c4dcc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:50:10.944809 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dcac5ec-d682-41e7-9606-90c6b46c4dcc admin admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:50:10.968670 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 980/1998] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Sep 13 19:50:10 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 19:50:10.972938 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c9c2cf-7c2f-4b11-9e8e-1080668da5f8 admin admin] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:50:10.984568 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c9c2cf-7c2f-4b11-9e8e-1080668da5f8 admin admin] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:50:10.997976 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc271489-0b79-4a47-a0f7-11657a5b5a17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:50:10.999176 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc271489-0b79-4a47-a0f7-11657a5b5a17 admin admin] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:50:10.999684 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc271489-0b79-4a47-a0f7-11657a5b5a17 admin admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:50:11.000304 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc271489-0b79-4a47-a0f7-11657a5b5a17 admin admin] PATH_INFO: `/v3/roles` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:50:11.001319 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc271489-0b79-4a47-a0f7-11657a5b5a17 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:50:11.004305 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc271489-0b79-4a47-a0f7-11657a5b5a17 admin admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:50:11.024167 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dcac5ec-d682-41e7-9606-90c6b46c4dcc admin admin] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:50:11.027760 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 1019/1999] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Sep 13 19:50:10 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 19:50:11.037328 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dcac5ec-d682-41e7-9606-90c6b46c4dcc admin admin] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:50:11.050196 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4991b9b-8887-469e-abe0-c7d1494f7d5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:50:11.052762 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4991b9b-8887-469e-abe0-c7d1494f7d5d admin admin] REQUEST_METHOD: `PUT` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:50:11.053411 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4991b9b-8887-469e-abe0-c7d1494f7d5d admin admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:50:11.053910 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4991b9b-8887-469e-abe0-c7d1494f7d5d admin admin] PATH_INFO: `/v3/projects/aa742d5df35b4e99861e8224cb23e241/users/ea773a7d449d46d09b2a1977eae6faf2/roles/a259191f6d0e46fabd9f34536bb28747` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:50:11.102084 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4991b9b-8887-469e-abe0-c7d1494f7d5d admin admin] RBAC: Authorizing `identity:create_grant(project_id=aa742d5df35b4e99861e8224cb23e241, user_id=ea773a7d449d46d09b2a1977eae6faf2, role_id=a259191f6d0e46fabd9f34536bb28747)` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:50:11.106128 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4991b9b-8887-469e-abe0-c7d1494f7d5d admin admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:50:11.145358 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 981/2000] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Sep 13 19:50:11 2022] PUT /identity/v3/projects/aa742d5df35b4e99861e8224cb23e241/users/ea773a7d449d46d09b2a1977eae6faf2/roles/a259191f6d0e46fabd9f34536bb28747 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 19:50:11.147416 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6085176-1a2a-479b-8259-6b63cb02876c None None] REQUEST_METHOD: `POST` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:50:11.147909 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6085176-1a2a-479b-8259-6b63cb02876c None None] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:50:11.148308 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6085176-1a2a-479b-8259-6b63cb02876c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:50:11.206609 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.auth.core [None req-f6085176-1a2a-479b-8259-6b63cb02876c None None] MFA Rules not processed for user `ea773a7d449d46d09b2a1977eae6faf2`. Rule list: `[]` (Enabled: `True`). {{(pid=87934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:50:11.207806 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.fernet_utils [None req-f6085176-1a2a-479b-8259-6b63cb02876c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:50:11.379083 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 1020/2001] 10.222.0.25 () {58 vars in 958 bytes} [Tue Sep 13 19:50:11 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 19:50:11.383395 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4991b9b-8887-469e-abe0-c7d1494f7d5d admin admin] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:50:11.482274 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4991b9b-8887-469e-abe0-c7d1494f7d5d admin admin] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:50:11.488697 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc658f1-8b82-4200-a39f-985b3f17a071 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:50:11.489775 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc658f1-8b82-4200-a39f-985b3f17a071 admin admin] REQUEST_METHOD: `POST` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:50:11.492476 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc658f1-8b82-4200-a39f-985b3f17a071 admin admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:50:11.492754 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc658f1-8b82-4200-a39f-985b3f17a071 admin admin] PATH_INFO: `/v3/projects` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:50:11.493428 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc658f1-8b82-4200-a39f-985b3f17a071 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:50:11.495378 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc658f1-8b82-4200-a39f-985b3f17a071 admin admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:50:11.537154 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 982/2002] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Sep 13 19:50:11 2022] POST /identity/v3/projects => generated 383 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 19:50:11.538885 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6085176-1a2a-479b-8259-6b63cb02876c None None] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:50:11.546948 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG dbcounter [-] [87934] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=87934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:50:11.558164 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6085176-1a2a-479b-8259-6b63cb02876c None None] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:50:11.651455 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53cfa96c-1fef-4ec2-9233-8a03e1ebe578 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:50:11.652156 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53cfa96c-1fef-4ec2-9233-8a03e1ebe578 admin admin] REQUEST_METHOD: `POST` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:50:11.652551 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53cfa96c-1fef-4ec2-9233-8a03e1ebe578 admin admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:50:11.653088 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53cfa96c-1fef-4ec2-9233-8a03e1ebe578 admin admin] PATH_INFO: `/v3/users` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:50:11.653874 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53cfa96c-1fef-4ec2-9233-8a03e1ebe578 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:50:11.656599 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53cfa96c-1fef-4ec2-9233-8a03e1ebe578 admin admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:50:11.690823 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 1021/2003] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Sep 13 19:50:11 2022] POST /identity/v3/users => generated 298 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 13 19:50:11.695552 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc658f1-8b82-4200-a39f-985b3f17a071 admin admin] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:50:11.710793 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc658f1-8b82-4200-a39f-985b3f17a071 admin admin] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:50:11.723081 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712e6aeb-af8c-454b-80a5-dac3dfe65038 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:50:11.723846 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712e6aeb-af8c-454b-80a5-dac3dfe65038 admin admin] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:50:11.724466 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712e6aeb-af8c-454b-80a5-dac3dfe65038 admin admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:50:11.724917 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712e6aeb-af8c-454b-80a5-dac3dfe65038 admin admin] PATH_INFO: `/v3/roles` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:50:11.726906 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-712e6aeb-af8c-454b-80a5-dac3dfe65038 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:50:11.729002 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-712e6aeb-af8c-454b-80a5-dac3dfe65038 admin admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:50:11.769137 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 983/2004] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Sep 13 19:50:11 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 19:50:11.773304 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53cfa96c-1fef-4ec2-9233-8a03e1ebe578 admin admin] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:50:11.788930 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53cfa96c-1fef-4ec2-9233-8a03e1ebe578 admin admin] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:50:11.793931 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7e8d99-926b-47e8-a95e-47d6339b14e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:50:11.795141 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7e8d99-926b-47e8-a95e-47d6339b14e0 admin admin] REQUEST_METHOD: `PUT` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:50:11.795656 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7e8d99-926b-47e8-a95e-47d6339b14e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:50:11.796310 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7e8d99-926b-47e8-a95e-47d6339b14e0 admin admin] PATH_INFO: `/v3/projects/71c681da8b7b41bd8d77f910c8e0e973/users/31b4d194166e48d9a0c0b3d095f7dac3/roles/6ca1d4427ff64e0a9d25d96cfb1445f6` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:50:11.821507 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea7e8d99-926b-47e8-a95e-47d6339b14e0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=71c681da8b7b41bd8d77f910c8e0e973, user_id=31b4d194166e48d9a0c0b3d095f7dac3, role_id=6ca1d4427ff64e0a9d25d96cfb1445f6)` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:50:11.839511 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea7e8d99-926b-47e8-a95e-47d6339b14e0 admin admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:50:11.872597 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 1022/2005] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Sep 13 19:50:11 2022] PUT /identity/v3/projects/71c681da8b7b41bd8d77f910c8e0e973/users/31b4d194166e48d9a0c0b3d095f7dac3/roles/6ca1d4427ff64e0a9d25d96cfb1445f6 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 19:50:11.879850 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712e6aeb-af8c-454b-80a5-dac3dfe65038 admin admin] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:50:11.891823 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712e6aeb-af8c-454b-80a5-dac3dfe65038 admin admin] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:50:11.990627 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG dbcounter [-] [87935] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=87935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:50:12.004872 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30fa8fec-4550-4533-88bf-99ef56f9f902 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:50:12.005697 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fa8fec-4550-4533-88bf-99ef56f9f902 admin admin] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:50:12.006041 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fa8fec-4550-4533-88bf-99ef56f9f902 admin admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:50:12.006391 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fa8fec-4550-4533-88bf-99ef56f9f902 admin admin] PATH_INFO: `/v3/roles` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:50:12.007125 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30fa8fec-4550-4533-88bf-99ef56f9f902 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:50:12.012267 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30fa8fec-4550-4533-88bf-99ef56f9f902 admin admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:50:12.030893 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 984/2006] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Sep 13 19:50:11 2022] GET /identity/v3/roles => generated 1420 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 19:50:12.035188 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7e8d99-926b-47e8-a95e-47d6339b14e0 admin admin] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:50:12.074551 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7e8d99-926b-47e8-a95e-47d6339b14e0 admin admin] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:50:12.085776 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed57a77-6cfd-4a36-8826-613da5aa345e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:50:12.087008 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed57a77-6cfd-4a36-8826-613da5aa345e admin admin] REQUEST_METHOD: `PUT` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:50:12.087846 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed57a77-6cfd-4a36-8826-613da5aa345e admin admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:50:12.089753 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed57a77-6cfd-4a36-8826-613da5aa345e admin admin] PATH_INFO: `/v3/projects/71c681da8b7b41bd8d77f910c8e0e973/users/31b4d194166e48d9a0c0b3d095f7dac3/roles/6ca1d4427ff64e0a9d25d96cfb1445f6` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:50:12.092606 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed57a77-6cfd-4a36-8826-613da5aa345e admin admin] RBAC: Authorizing `identity:create_grant(project_id=71c681da8b7b41bd8d77f910c8e0e973, user_id=31b4d194166e48d9a0c0b3d095f7dac3, role_id=6ca1d4427ff64e0a9d25d96cfb1445f6)` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:50:12.098493 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed57a77-6cfd-4a36-8826-613da5aa345e admin admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:50:12.113058 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 1023/2007] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Sep 13 19:50:12 2022] PUT /identity/v3/projects/71c681da8b7b41bd8d77f910c8e0e973/users/31b4d194166e48d9a0c0b3d095f7dac3/roles/6ca1d4427ff64e0a9d25d96cfb1445f6 => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 19:50:12.124942 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89763b71-dd12-4225-86bd-d3e66851226e None None] REQUEST_METHOD: `POST` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:50:12.125462 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89763b71-dd12-4225-86bd-d3e66851226e None None] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:50:12.126102 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89763b71-dd12-4225-86bd-d3e66851226e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:50:12.167447 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.auth.core [None req-89763b71-dd12-4225-86bd-d3e66851226e None None] MFA Rules not processed for user `31b4d194166e48d9a0c0b3d095f7dac3`. Rule list: `[]` (Enabled: `True`). {{(pid=87935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:50:12.168728 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.fernet_utils [None req-89763b71-dd12-4225-86bd-d3e66851226e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:50:12.286050 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 985/2008] 10.222.0.25 () {58 vars in 958 bytes} [Tue Sep 13 19:50:12 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 19:50:12.297819 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed57a77-6cfd-4a36-8826-613da5aa345e admin admin] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:50:12.373776 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed57a77-6cfd-4a36-8826-613da5aa345e admin admin] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:50:12.378769 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00aff12-21b9-4380-a01d-bc8e3f50e320 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cbb50c88b794a7f9f26844effde7d63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a10a4268f3c4cb29f4e00c292e2df62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:50:12.379616 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00aff12-21b9-4380-a01d-bc8e3f50e320 service cinder] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:50:12.380095 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00aff12-21b9-4380-a01d-bc8e3f50e320 service cinder] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:50:12.380736 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00aff12-21b9-4380-a01d-bc8e3f50e320 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:50:12.450208 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e00aff12-21b9-4380-a01d-bc8e3f50e320 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:50:12.451870 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e00aff12-21b9-4380-a01d-bc8e3f50e320 service cinder] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:50:12.462814 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 1024/2009] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Sep 13 19:50:12 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 19:50:17.917431 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89763b71-dd12-4225-86bd-d3e66851226e None None] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:50:17.921850 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.fernet_utils [None req-89763b71-dd12-4225-86bd-d3e66851226e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:50:18.005467 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89763b71-dd12-4225-86bd-d3e66851226e None None] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:50:18.011935 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5604778-6b3d-478d-ad01-117beda00125 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:50:18.012692 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5604778-6b3d-478d-ad01-117beda00125 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:50:18.012928 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5604778-6b3d-478d-ad01-117beda00125 admin admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:50:18.013202 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5604778-6b3d-478d-ad01-117beda00125 admin admin] PATH_INFO: `/v3/users/e6285dae8aca437db86bd55c45c3b2b2` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:50:18.014587 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5604778-6b3d-478d-ad01-117beda00125 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e6285dae8aca437db86bd55c45c3b2b2)` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:50:18.017997 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5604778-6b3d-478d-ad01-117beda00125 admin admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:50:18.055550 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00aff12-21b9-4380-a01d-bc8e3f50e320 service cinder] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:50:18.057144 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.fernet_utils [None req-e00aff12-21b9-4380-a01d-bc8e3f50e320 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:50:18.074658 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00aff12-21b9-4380-a01d-bc8e3f50e320 service cinder] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:50:18.080620 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6aa0c37-3700-42dc-a861-4e0f8a5a020f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cbb50c88b794a7f9f26844effde7d63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a10a4268f3c4cb29f4e00c292e2df62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:50:18.081396 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6aa0c37-3700-42dc-a861-4e0f8a5a020f service cinder] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:50:18.081672 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6aa0c37-3700-42dc-a861-4e0f8a5a020f service cinder] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:50:18.081942 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6aa0c37-3700-42dc-a861-4e0f8a5a020f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:50:18.091573 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG dbcounter [-] [87934] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=87934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:50:18.097360 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6aa0c37-3700-42dc-a861-4e0f8a5a020f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:50:18.097975 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.notifications [None req-e5604778-6b3d-478d-ad01-117beda00125 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e6285dae8aca437db86bd55c45c3b2b2'} {{(pid=87935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:50:18.100333 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6aa0c37-3700-42dc-a861-4e0f8a5a020f service cinder] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:50:18.117518 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.notifications [None req-e5604778-6b3d-478d-ad01-117beda00125 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e6285dae8aca437db86bd55c45c3b2b2'} {{(pid=87935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:50:18.131651 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 1025/2010] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Sep 13 19:50:18 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 77 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 13 19:50:18.153161 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.notifications [None req-e5604778-6b3d-478d-ad01-117beda00125 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e6285dae8aca437db86bd55c45c3b2b2'} {{(pid=87935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:50:18.154162 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.notifications [None req-e5604778-6b3d-478d-ad01-117beda00125 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e6285dae8aca437db86bd55c45c3b2b2'} {{(pid=87935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:50:18.155805 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.notifications [None req-e5604778-6b3d-478d-ad01-117beda00125 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e6285dae8aca437db86bd55c45c3b2b2'} {{(pid=87935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:50:18.175427 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG dbcounter [-] [87935] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:50:18.191083 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 986/2011] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Sep 13 19:50:17 2022] DELETE /identity/v3/users/e6285dae8aca437db86bd55c45c3b2b2 => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 19:50:18.195553 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad28a1d7-ade9-4eb8-9a76-96f711ec3f2c None None] REQUEST_METHOD: `POST` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:50:18.195840 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad28a1d7-ade9-4eb8-9a76-96f711ec3f2c None None] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:50:18.196116 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad28a1d7-ade9-4eb8-9a76-96f711ec3f2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:50:18.227567 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.auth.core [None req-ad28a1d7-ade9-4eb8-9a76-96f711ec3f2c None None] MFA Rules not processed for user `7b0aed92d02344acb92a0e4aa67c3068`. Rule list: `[]` (Enabled: `True`). {{(pid=87934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:50:18.235775 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.fernet_utils [None req-ad28a1d7-ade9-4eb8-9a76-96f711ec3f2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:50:18.356373 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 1026/2012] 10.222.0.25 () {58 vars in 958 bytes} [Tue Sep 13 19:50:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 19:50:18.368873 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5604778-6b3d-478d-ad01-117beda00125 admin admin] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:50:18.370464 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.fernet_utils [None req-e5604778-6b3d-478d-ad01-117beda00125 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:50:18.445442 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5604778-6b3d-478d-ad01-117beda00125 admin admin] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:50:18.449669 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef54287e-85cf-40a0-95a5-b524df541840 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1196a96e4a404f559600b69f929ea9da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a10a4268f3c4cb29f4e00c292e2df62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:50:18.450547 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef54287e-85cf-40a0-95a5-b524df541840 service neutron] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:50:18.451365 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef54287e-85cf-40a0-95a5-b524df541840 service neutron] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:50:18.451365 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef54287e-85cf-40a0-95a5-b524df541840 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:50:18.466225 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef54287e-85cf-40a0-95a5-b524df541840 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:50:18.468131 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef54287e-85cf-40a0-95a5-b524df541840 service neutron] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:50:18.496060 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 987/2013] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Sep 13 19:50:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 19:50:18.848555 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad28a1d7-ade9-4eb8-9a76-96f711ec3f2c None None] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:50:18.850115 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.fernet_utils [None req-ad28a1d7-ade9-4eb8-9a76-96f711ec3f2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:50:18.869174 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad28a1d7-ade9-4eb8-9a76-96f711ec3f2c None None] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:50:18.874171 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082c50d7-41fa-4f09-a4fc-052c6a29318f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:50:18.874846 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082c50d7-41fa-4f09-a4fc-052c6a29318f admin admin] REQUEST_METHOD: `DELETE` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:50:18.875259 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082c50d7-41fa-4f09-a4fc-052c6a29318f admin admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:50:18.875447 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082c50d7-41fa-4f09-a4fc-052c6a29318f admin admin] PATH_INFO: `/v3/projects/721999bab6dc401ea3f26112a47636b7` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:50:18.876574 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-082c50d7-41fa-4f09-a4fc-052c6a29318f admin admin] RBAC: Authorizing `identity:delete_project(project_id=721999bab6dc401ea3f26112a47636b7)` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:50:18.878754 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-082c50d7-41fa-4f09-a4fc-052c6a29318f admin admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:50:18.933238 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.notifications [None req-082c50d7-41fa-4f09-a4fc-052c6a29318f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '721999bab6dc401ea3f26112a47636b7', 'request_id': 'req-082c50d7-41fa-4f09-a4fc-052c6a29318f'} {{(pid=87934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:50:18.939503 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.notifications [None req-082c50d7-41fa-4f09-a4fc-052c6a29318f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '721999bab6dc401ea3f26112a47636b7', 'request_id': 'req-082c50d7-41fa-4f09-a4fc-052c6a29318f'} {{(pid=87934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:50:18.945533 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.notifications [None req-082c50d7-41fa-4f09-a4fc-052c6a29318f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '721999bab6dc401ea3f26112a47636b7', 'request_id': 'req-082c50d7-41fa-4f09-a4fc-052c6a29318f'} {{(pid=87934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:50:18.958297 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.notifications [None req-082c50d7-41fa-4f09-a4fc-052c6a29318f admin admin] The token cache is being invalidate because project 721999bab6dc401ea3f26112a47636b7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87934) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 19:50:18.958582 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.notifications [None req-082c50d7-41fa-4f09-a4fc-052c6a29318f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:50:18.959235 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.notifications [None req-082c50d7-41fa-4f09-a4fc-052c6a29318f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:50:18.960777 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 1027/2014] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Sep 13 19:50:18 2022] DELETE /identity/v3/projects/721999bab6dc401ea3f26112a47636b7 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 19:50:18.964908 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef54287e-85cf-40a0-95a5-b524df541840 service neutron] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:50:18.975258 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef54287e-85cf-40a0-95a5-b524df541840 service neutron] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:50:19.034087 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c15352-4ad6-4a14-a6da-f0632d37e100 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:50:19.034710 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c15352-4ad6-4a14-a6da-f0632d37e100 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:50:19.034983 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c15352-4ad6-4a14-a6da-f0632d37e100 admin admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:50:19.035251 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c15352-4ad6-4a14-a6da-f0632d37e100 admin admin] PATH_INFO: `/v3/users/7e5361ed276647c082dfbe799047b1ed` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:50:19.036418 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c15352-4ad6-4a14-a6da-f0632d37e100 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7e5361ed276647c082dfbe799047b1ed)` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:50:19.038351 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c15352-4ad6-4a14-a6da-f0632d37e100 admin admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:50:19.084584 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.notifications [None req-59c15352-4ad6-4a14-a6da-f0632d37e100 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7e5361ed276647c082dfbe799047b1ed'} {{(pid=87935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:50:19.091782 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.notifications [None req-59c15352-4ad6-4a14-a6da-f0632d37e100 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7e5361ed276647c082dfbe799047b1ed'} {{(pid=87935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:50:19.104656 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.notifications [None req-59c15352-4ad6-4a14-a6da-f0632d37e100 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7e5361ed276647c082dfbe799047b1ed'} {{(pid=87935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:50:19.105295 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.notifications [None req-59c15352-4ad6-4a14-a6da-f0632d37e100 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7e5361ed276647c082dfbe799047b1ed'} {{(pid=87935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:50:19.105898 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.notifications [None req-59c15352-4ad6-4a14-a6da-f0632d37e100 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7e5361ed276647c082dfbe799047b1ed'} {{(pid=87935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:50:19.118834 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 988/2015] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Sep 13 19:50:18 2022] DELETE /identity/v3/users/7e5361ed276647c082dfbe799047b1ed => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 19:50:19.445272 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082c50d7-41fa-4f09-a4fc-052c6a29318f admin admin] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:50:19.446774 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.fernet_utils [None req-082c50d7-41fa-4f09-a4fc-052c6a29318f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:50:19.462464 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082c50d7-41fa-4f09-a4fc-052c6a29318f admin admin] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:50:19.542608 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0aae91-b934-431d-a9ee-a08fe1a6a600 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:50:19.543789 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0aae91-b934-431d-a9ee-a08fe1a6a600 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:50:19.544075 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0aae91-b934-431d-a9ee-a08fe1a6a600 admin admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:50:19.544445 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0aae91-b934-431d-a9ee-a08fe1a6a600 admin admin] PATH_INFO: `/v3/projects/0fa8b75ad59f449c86e01eac1cd41a35` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:50:19.545639 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f0aae91-b934-431d-a9ee-a08fe1a6a600 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0fa8b75ad59f449c86e01eac1cd41a35)` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:50:19.547639 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f0aae91-b934-431d-a9ee-a08fe1a6a600 admin admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:50:19.579252 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG dbcounter [-] [87934] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=87934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:50:19.614367 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.notifications [None req-4f0aae91-b934-431d-a9ee-a08fe1a6a600 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0fa8b75ad59f449c86e01eac1cd41a35', 'request_id': 'req-4f0aae91-b934-431d-a9ee-a08fe1a6a600'} {{(pid=87934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:50:19.620960 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.notifications [None req-4f0aae91-b934-431d-a9ee-a08fe1a6a600 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0fa8b75ad59f449c86e01eac1cd41a35', 'request_id': 'req-4f0aae91-b934-431d-a9ee-a08fe1a6a600'} {{(pid=87934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:50:19.627247 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.notifications [None req-4f0aae91-b934-431d-a9ee-a08fe1a6a600 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0fa8b75ad59f449c86e01eac1cd41a35', 'request_id': 'req-4f0aae91-b934-431d-a9ee-a08fe1a6a600'} {{(pid=87934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:50:19.640223 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.notifications [None req-4f0aae91-b934-431d-a9ee-a08fe1a6a600 admin admin] The token cache is being invalidate because project 0fa8b75ad59f449c86e01eac1cd41a35 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87934) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 19:50:19.640521 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.notifications [None req-4f0aae91-b934-431d-a9ee-a08fe1a6a600 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:50:19.641227 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.notifications [None req-4f0aae91-b934-431d-a9ee-a08fe1a6a600 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:50:19.643415 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 1028/2016] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Sep 13 19:50:19 2022] DELETE /identity/v3/projects/0fa8b75ad59f449c86e01eac1cd41a35 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 19:50:19.648527 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a085fe8-7a84-49d8-9e74-454edea0d230 None None] REQUEST_METHOD: `POST` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:50:19.648811 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a085fe8-7a84-49d8-9e74-454edea0d230 None None] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:50:19.649079 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a085fe8-7a84-49d8-9e74-454edea0d230 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:50:19.670025 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.auth.core [None req-3a085fe8-7a84-49d8-9e74-454edea0d230 None None] MFA Rules not processed for user `7b0aed92d02344acb92a0e4aa67c3068`. Rule list: `[]` (Enabled: `True`). {{(pid=87935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:50:19.671329 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.fernet_utils [None req-3a085fe8-7a84-49d8-9e74-454edea0d230 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:50:19.688411 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG dbcounter [-] [87935] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:50:19.758089 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 989/2017] 10.222.0.25 () {58 vars in 958 bytes} [Tue Sep 13 19:50:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 19:50:19.759850 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac62286-58c0-47ab-9edf-744c496a5237 None None] REQUEST_METHOD: `POST` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:50:19.761066 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac62286-58c0-47ab-9edf-744c496a5237 None None] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:50:19.761066 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac62286-58c0-47ab-9edf-744c496a5237 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:50:19.784726 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.auth.core [None req-3ac62286-58c0-47ab-9edf-744c496a5237 None None] MFA Rules not processed for user `7b0aed92d02344acb92a0e4aa67c3068`. Rule list: `[]` (Enabled: `True`). {{(pid=87934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:50:19.786569 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.fernet_utils [None req-3ac62286-58c0-47ab-9edf-744c496a5237 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:50:19.805353 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 1029/2018] 10.222.0.25 () {58 vars in 958 bytes} [Tue Sep 13 19:50:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 19:50:19.806692 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a085fe8-7a84-49d8-9e74-454edea0d230 None None] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:50:19.819298 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a085fe8-7a84-49d8-9e74-454edea0d230 None None] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:50:19.825281 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37490ddb-082c-42e9-bca5-1ee001821afc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:50:19.825979 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37490ddb-082c-42e9-bca5-1ee001821afc admin admin] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:50:19.826324 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37490ddb-082c-42e9-bca5-1ee001821afc admin admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:50:19.826661 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37490ddb-082c-42e9-bca5-1ee001821afc admin admin] PATH_INFO: `/v3/domains` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:50:19.827422 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37490ddb-082c-42e9-bca5-1ee001821afc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87935) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:50:19.827729 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37490ddb-082c-42e9-bca5-1ee001821afc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:50:19.829818 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37490ddb-082c-42e9-bca5-1ee001821afc admin admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:50:19.852265 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 990/2019] 10.222.0.25 () {58 vars in 1153 bytes} [Tue Sep 13 19:50:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:50:19.854291 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac62286-58c0-47ab-9edf-744c496a5237 None None] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:50:19.869919 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac62286-58c0-47ab-9edf-744c496a5237 None None] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:50:19.877778 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1428be76-fdca-453f-9b29-e9a3c3e8b7b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:50:19.878390 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1428be76-fdca-453f-9b29-e9a3c3e8b7b2 admin admin] REQUEST_METHOD: `POST` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:50:19.878717 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1428be76-fdca-453f-9b29-e9a3c3e8b7b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:50:19.878965 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1428be76-fdca-453f-9b29-e9a3c3e8b7b2 admin admin] PATH_INFO: `/v3/projects` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:50:19.879577 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1428be76-fdca-453f-9b29-e9a3c3e8b7b2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:50:19.881503 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1428be76-fdca-453f-9b29-e9a3c3e8b7b2 admin admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:50:19.913777 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 1030/2020] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Sep 13 19:50:19 2022] POST /identity/v3/projects => generated 383 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 19:50:19.915371 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37490ddb-082c-42e9-bca5-1ee001821afc admin admin] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:50:19.927298 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37490ddb-082c-42e9-bca5-1ee001821afc admin admin] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:50:19.990501 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775774f9-65af-4d71-ba03-806e99c4e5f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:50:19.991147 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775774f9-65af-4d71-ba03-806e99c4e5f4 admin admin] REQUEST_METHOD: `POST` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:50:19.991266 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775774f9-65af-4d71-ba03-806e99c4e5f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:50:19.991537 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775774f9-65af-4d71-ba03-806e99c4e5f4 admin admin] PATH_INFO: `/v3/users` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:50:19.992290 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-775774f9-65af-4d71-ba03-806e99c4e5f4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:50:19.994205 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-775774f9-65af-4d71-ba03-806e99c4e5f4 admin admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:50:20.014685 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 991/2021] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Sep 13 19:50:19 2022] POST /identity/v3/users => generated 292 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 19:50:20.019387 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1428be76-fdca-453f-9b29-e9a3c3e8b7b2 admin admin] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:50:20.029951 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1428be76-fdca-453f-9b29-e9a3c3e8b7b2 admin admin] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:50:20.035675 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466e4aaf-c67d-42ab-bc4e-17e42e75b118 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:50:20.036322 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466e4aaf-c67d-42ab-bc4e-17e42e75b118 admin admin] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:50:20.036615 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466e4aaf-c67d-42ab-bc4e-17e42e75b118 admin admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:50:20.036886 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466e4aaf-c67d-42ab-bc4e-17e42e75b118 admin admin] PATH_INFO: `/v3/roles` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:50:20.037589 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-466e4aaf-c67d-42ab-bc4e-17e42e75b118 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:50:20.039379 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-466e4aaf-c67d-42ab-bc4e-17e42e75b118 admin admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:50:20.050030 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 1031/2022] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Sep 13 19:50:20 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 19:50:20.054181 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775774f9-65af-4d71-ba03-806e99c4e5f4 admin admin] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:50:20.064365 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775774f9-65af-4d71-ba03-806e99c4e5f4 admin admin] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:50:20.069404 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed3fd35-131f-43c4-b93f-039d9f0dc666 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:50:20.070089 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed3fd35-131f-43c4-b93f-039d9f0dc666 admin admin] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:50:20.070431 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed3fd35-131f-43c4-b93f-039d9f0dc666 admin admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:50:20.070739 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed3fd35-131f-43c4-b93f-039d9f0dc666 admin admin] PATH_INFO: `/v3/roles` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:50:20.071381 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed3fd35-131f-43c4-b93f-039d9f0dc666 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:50:20.073043 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed3fd35-131f-43c4-b93f-039d9f0dc666 admin admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:50:20.085556 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 992/2023] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Sep 13 19:50:20 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 19:50:20.089900 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466e4aaf-c67d-42ab-bc4e-17e42e75b118 admin admin] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:50:20.100708 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466e4aaf-c67d-42ab-bc4e-17e42e75b118 admin admin] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:50:20.105744 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1993253a-5539-46c5-ac13-4af16da1f3d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:50:20.106389 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1993253a-5539-46c5-ac13-4af16da1f3d0 admin admin] REQUEST_METHOD: `PUT` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:50:20.106664 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1993253a-5539-46c5-ac13-4af16da1f3d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:50:20.106982 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1993253a-5539-46c5-ac13-4af16da1f3d0 admin admin] PATH_INFO: `/v3/projects/d6430045ff4d4c2ba00f679c50e2abd9/users/3e046ca2bb5f4bcaa7e7466aa33ff502/roles/a259191f6d0e46fabd9f34536bb28747` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:50:20.123709 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1993253a-5539-46c5-ac13-4af16da1f3d0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d6430045ff4d4c2ba00f679c50e2abd9, user_id=3e046ca2bb5f4bcaa7e7466aa33ff502, role_id=a259191f6d0e46fabd9f34536bb28747)` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:50:20.126411 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1993253a-5539-46c5-ac13-4af16da1f3d0 admin admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:50:20.140777 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 1032/2024] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Sep 13 19:50:20 2022] PUT /identity/v3/projects/d6430045ff4d4c2ba00f679c50e2abd9/users/3e046ca2bb5f4bcaa7e7466aa33ff502/roles/a259191f6d0e46fabd9f34536bb28747 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 19:50:20.152440 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893cc9e5-3320-4649-9530-c0afd4d8dcfa None None] REQUEST_METHOD: `POST` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:50:20.152721 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893cc9e5-3320-4649-9530-c0afd4d8dcfa None None] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:50:20.152992 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893cc9e5-3320-4649-9530-c0afd4d8dcfa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:50:20.184714 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.auth.core [None req-893cc9e5-3320-4649-9530-c0afd4d8dcfa None None] MFA Rules not processed for user `3e046ca2bb5f4bcaa7e7466aa33ff502`. Rule list: `[]` (Enabled: `True`). {{(pid=87935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:50:20.186287 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.fernet_utils [None req-893cc9e5-3320-4649-9530-c0afd4d8dcfa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:50:20.255734 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 993/2025] 10.222.0.25 () {58 vars in 958 bytes} [Tue Sep 13 19:50:20 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 19:50:20.266781 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1993253a-5539-46c5-ac13-4af16da1f3d0 admin admin] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:50:20.269097 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.fernet_utils [None req-1993253a-5539-46c5-ac13-4af16da1f3d0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:50:20.326202 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1993253a-5539-46c5-ac13-4af16da1f3d0 admin admin] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:50:20.330633 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140935e2-f24c-4378-a2d3-d187dc509b5a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cbb50c88b794a7f9f26844effde7d63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a10a4268f3c4cb29f4e00c292e2df62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:50:20.331238 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140935e2-f24c-4378-a2d3-d187dc509b5a service cinder] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:50:20.331511 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140935e2-f24c-4378-a2d3-d187dc509b5a service cinder] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:50:20.331779 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140935e2-f24c-4378-a2d3-d187dc509b5a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:50:20.339747 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-140935e2-f24c-4378-a2d3-d187dc509b5a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:50:20.341203 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-140935e2-f24c-4378-a2d3-d187dc509b5a service cinder] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:50:20.350557 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 1033/2026] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Sep 13 19:50:20 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 19:50:20.369162 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893cc9e5-3320-4649-9530-c0afd4d8dcfa None None] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:50:20.386985 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG dbcounter [-] [87935] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:50:20.434739 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893cc9e5-3320-4649-9530-c0afd4d8dcfa None None] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:50:20.439240 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047255af-1df8-401d-8550-6d2204075316 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:50:20.439947 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047255af-1df8-401d-8550-6d2204075316 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:50:20.440251 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047255af-1df8-401d-8550-6d2204075316 admin admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:50:20.440527 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047255af-1df8-401d-8550-6d2204075316 admin admin] PATH_INFO: `/v3/users/3e046ca2bb5f4bcaa7e7466aa33ff502` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:50:20.441703 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-047255af-1df8-401d-8550-6d2204075316 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3e046ca2bb5f4bcaa7e7466aa33ff502)` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:50:20.443622 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-047255af-1df8-401d-8550-6d2204075316 admin admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:50:20.498723 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.notifications [None req-047255af-1df8-401d-8550-6d2204075316 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3e046ca2bb5f4bcaa7e7466aa33ff502'} {{(pid=87935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:50:20.507960 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.notifications [None req-047255af-1df8-401d-8550-6d2204075316 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3e046ca2bb5f4bcaa7e7466aa33ff502'} {{(pid=87935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:50:20.523846 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.notifications [None req-047255af-1df8-401d-8550-6d2204075316 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3e046ca2bb5f4bcaa7e7466aa33ff502'} {{(pid=87935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:50:20.524646 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.notifications [None req-047255af-1df8-401d-8550-6d2204075316 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3e046ca2bb5f4bcaa7e7466aa33ff502'} {{(pid=87935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:50:20.525257 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.notifications [None req-047255af-1df8-401d-8550-6d2204075316 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3e046ca2bb5f4bcaa7e7466aa33ff502'} {{(pid=87935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:50:20.540298 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 994/2027] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Sep 13 19:50:20 2022] DELETE /identity/v3/users/3e046ca2bb5f4bcaa7e7466aa33ff502 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 19:50:20.551660 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98b9b7e-986c-45c4-9207-6777c3c6b1ac None None] REQUEST_METHOD: `POST` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:50:20.552113 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98b9b7e-986c-45c4-9207-6777c3c6b1ac None None] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:50:20.552236 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98b9b7e-986c-45c4-9207-6777c3c6b1ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:50:20.603424 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.auth.core [None req-f98b9b7e-986c-45c4-9207-6777c3c6b1ac None None] MFA Rules not processed for user `7b0aed92d02344acb92a0e4aa67c3068`. Rule list: `[]` (Enabled: `True`). {{(pid=87934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:50:20.605021 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.fernet_utils [None req-f98b9b7e-986c-45c4-9207-6777c3c6b1ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:50:20.654261 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047255af-1df8-401d-8550-6d2204075316 admin admin] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:50:20.655692 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.fernet_utils [None req-047255af-1df8-401d-8550-6d2204075316 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:50:20.671966 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG dbcounter [-] [87934] Writing DB stats keystone:DELETE=7,keystone:SELECT=90,keystone:INSERT=3 {{(pid=87934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:50:20.694689 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 1034/2028] 10.222.0.25 () {58 vars in 958 bytes} [Tue Sep 13 19:50:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 19:50:20.705826 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98b9b7e-986c-45c4-9207-6777c3c6b1ac None None] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:50:20.707397 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.fernet_utils [None req-f98b9b7e-986c-45c4-9207-6777c3c6b1ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:50:20.757322 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047255af-1df8-401d-8550-6d2204075316 admin admin] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:50:20.766050 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477ccb1c-5096-4d21-ba31-ca987d086905 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:50:20.766622 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477ccb1c-5096-4d21-ba31-ca987d086905 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:50:20.766901 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477ccb1c-5096-4d21-ba31-ca987d086905 admin admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:50:20.767173 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477ccb1c-5096-4d21-ba31-ca987d086905 admin admin] PATH_INFO: `/v3/users/df7d0f6995b44913b5c0b922c3db88ab` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:50:20.769656 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-477ccb1c-5096-4d21-ba31-ca987d086905 admin admin] RBAC: Authorizing `identity:delete_user(user_id=df7d0f6995b44913b5c0b922c3db88ab)` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:50:20.773759 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-477ccb1c-5096-4d21-ba31-ca987d086905 admin admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:50:20.792529 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98b9b7e-986c-45c4-9207-6777c3c6b1ac None None] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:50:20.797673 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d4260b-1063-4f2a-8c7b-36d25c6f4805 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1196a96e4a404f559600b69f929ea9da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a10a4268f3c4cb29f4e00c292e2df62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:50:20.798455 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d4260b-1063-4f2a-8c7b-36d25c6f4805 service neutron] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:50:20.798569 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d4260b-1063-4f2a-8c7b-36d25c6f4805 service neutron] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:50:20.799158 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d4260b-1063-4f2a-8c7b-36d25c6f4805 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:50:20.812456 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d4260b-1063-4f2a-8c7b-36d25c6f4805 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:50:20.814378 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d4260b-1063-4f2a-8c7b-36d25c6f4805 service neutron] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:50:20.827774 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG dbcounter [-] [87935] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=87935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:50:20.828648 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 1035/2029] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Sep 13 19:50:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 13 19:50:20.842185 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.notifications [None req-477ccb1c-5096-4d21-ba31-ca987d086905 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'df7d0f6995b44913b5c0b922c3db88ab'} {{(pid=87935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:50:20.852734 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.notifications [None req-477ccb1c-5096-4d21-ba31-ca987d086905 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'df7d0f6995b44913b5c0b922c3db88ab'} {{(pid=87935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:50:20.869973 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.notifications [None req-477ccb1c-5096-4d21-ba31-ca987d086905 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'df7d0f6995b44913b5c0b922c3db88ab'} {{(pid=87935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:50:20.870693 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.notifications [None req-477ccb1c-5096-4d21-ba31-ca987d086905 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'df7d0f6995b44913b5c0b922c3db88ab'} {{(pid=87935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:50:20.871314 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.notifications [None req-477ccb1c-5096-4d21-ba31-ca987d086905 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'df7d0f6995b44913b5c0b922c3db88ab'} {{(pid=87935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:50:20.886586 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 995/2030] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Sep 13 19:50:20 2022] DELETE /identity/v3/users/df7d0f6995b44913b5c0b922c3db88ab => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 19:50:20.891165 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627c2987-e0fb-40cc-9562-bf6a45dfd96c None None] REQUEST_METHOD: `POST` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:50:20.891473 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627c2987-e0fb-40cc-9562-bf6a45dfd96c None None] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:50:20.891842 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627c2987-e0fb-40cc-9562-bf6a45dfd96c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:50:20.914101 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.auth.core [None req-627c2987-e0fb-40cc-9562-bf6a45dfd96c None None] MFA Rules not processed for user `7b0aed92d02344acb92a0e4aa67c3068`. Rule list: `[]` (Enabled: `True`). {{(pid=87934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:50:20.915312 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.fernet_utils [None req-627c2987-e0fb-40cc-9562-bf6a45dfd96c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:50:21.006433 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 1036/2031] 10.222.0.25 () {58 vars in 958 bytes} [Tue Sep 13 19:50:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 19:50:21.017184 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477ccb1c-5096-4d21-ba31-ca987d086905 admin admin] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:50:21.019283 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.fernet_utils [None req-477ccb1c-5096-4d21-ba31-ca987d086905 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:50:21.132875 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477ccb1c-5096-4d21-ba31-ca987d086905 admin admin] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:50:21.141772 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7b7164-5271-4e88-86e2-cece64ae03d2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1196a96e4a404f559600b69f929ea9da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a10a4268f3c4cb29f4e00c292e2df62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:50:21.142741 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7b7164-5271-4e88-86e2-cece64ae03d2 service neutron] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:50:21.142969 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7b7164-5271-4e88-86e2-cece64ae03d2 service neutron] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:50:21.143248 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7b7164-5271-4e88-86e2-cece64ae03d2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:50:21.174858 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f7b7164-5271-4e88-86e2-cece64ae03d2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:50:21.176668 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f7b7164-5271-4e88-86e2-cece64ae03d2 service neutron] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:50:21.187849 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 996/2032] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Sep 13 19:50:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 19:50:21.589872 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627c2987-e0fb-40cc-9562-bf6a45dfd96c None None] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:50:21.591367 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.fernet_utils [None req-627c2987-e0fb-40cc-9562-bf6a45dfd96c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:50:21.603629 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627c2987-e0fb-40cc-9562-bf6a45dfd96c None None] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:50:21.609187 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28bb8e1c-a73c-4a57-b125-e711d02fd463 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:50:21.609977 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bb8e1c-a73c-4a57-b125-e711d02fd463 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:50:21.610372 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bb8e1c-a73c-4a57-b125-e711d02fd463 admin admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:50:21.610718 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bb8e1c-a73c-4a57-b125-e711d02fd463 admin admin] PATH_INFO: `/v3/projects/d6430045ff4d4c2ba00f679c50e2abd9` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:50:21.612859 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28bb8e1c-a73c-4a57-b125-e711d02fd463 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d6430045ff4d4c2ba00f679c50e2abd9)` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:50:21.614889 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28bb8e1c-a73c-4a57-b125-e711d02fd463 admin admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:50:21.670971 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.notifications [None req-28bb8e1c-a73c-4a57-b125-e711d02fd463 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd6430045ff4d4c2ba00f679c50e2abd9', 'request_id': 'req-28bb8e1c-a73c-4a57-b125-e711d02fd463'} {{(pid=87934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:50:21.679449 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.notifications [None req-28bb8e1c-a73c-4a57-b125-e711d02fd463 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd6430045ff4d4c2ba00f679c50e2abd9', 'request_id': 'req-28bb8e1c-a73c-4a57-b125-e711d02fd463'} {{(pid=87934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:50:21.685928 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.notifications [None req-28bb8e1c-a73c-4a57-b125-e711d02fd463 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd6430045ff4d4c2ba00f679c50e2abd9', 'request_id': 'req-28bb8e1c-a73c-4a57-b125-e711d02fd463'} {{(pid=87934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:50:21.705169 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.notifications [None req-28bb8e1c-a73c-4a57-b125-e711d02fd463 admin admin] The token cache is being invalidate because project d6430045ff4d4c2ba00f679c50e2abd9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87934) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 19:50:21.705536 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.notifications [None req-28bb8e1c-a73c-4a57-b125-e711d02fd463 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:50:21.707024 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.notifications [None req-28bb8e1c-a73c-4a57-b125-e711d02fd463 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:50:21.713617 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 1037/2033] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Sep 13 19:50:21 2022] DELETE /identity/v3/projects/d6430045ff4d4c2ba00f679c50e2abd9 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 19:50:21.715413 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3aa711c-ee9e-420e-b0f8-126cdda751bc None None] REQUEST_METHOD: `POST` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:50:21.715767 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3aa711c-ee9e-420e-b0f8-126cdda751bc None None] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:50:21.716111 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3aa711c-ee9e-420e-b0f8-126cdda751bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:50:21.740652 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.auth.core [None req-d3aa711c-ee9e-420e-b0f8-126cdda751bc None None] MFA Rules not processed for user `7b0aed92d02344acb92a0e4aa67c3068`. Rule list: `[]` (Enabled: `True`). {{(pid=87935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:50:21.742172 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.fernet_utils [None req-d3aa711c-ee9e-420e-b0f8-126cdda751bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:50:21.814444 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 997/2034] 10.222.0.25 () {58 vars in 958 bytes} [Tue Sep 13 19:50:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 19:50:21.822502 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486b532d-5b43-4030-ab56-1225758d4dd0 None None] REQUEST_METHOD: `POST` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:50:21.822709 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486b532d-5b43-4030-ab56-1225758d4dd0 None None] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:50:21.822991 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486b532d-5b43-4030-ab56-1225758d4dd0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:50:21.861302 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.auth.core [None req-486b532d-5b43-4030-ab56-1225758d4dd0 None None] MFA Rules not processed for user `7b0aed92d02344acb92a0e4aa67c3068`. Rule list: `[]` (Enabled: `True`). {{(pid=87934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:50:21.862569 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.fernet_utils [None req-486b532d-5b43-4030-ab56-1225758d4dd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:50:21.885300 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 1038/2035] 10.222.0.25 () {58 vars in 958 bytes} [Tue Sep 13 19:50:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 19:50:21.889132 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3aa711c-ee9e-420e-b0f8-126cdda751bc None None] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:50:21.902932 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3aa711c-ee9e-420e-b0f8-126cdda751bc None None] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:50:21.914446 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425d4bd4-06c1-41e1-bb14-68402187f444 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:50:21.915408 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425d4bd4-06c1-41e1-bb14-68402187f444 admin admin] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:50:21.915747 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425d4bd4-06c1-41e1-bb14-68402187f444 admin admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:50:21.916078 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425d4bd4-06c1-41e1-bb14-68402187f444 admin admin] PATH_INFO: `/v3/domains` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:50:21.916888 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-425d4bd4-06c1-41e1-bb14-68402187f444 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87935) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:50:21.917277 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-425d4bd4-06c1-41e1-bb14-68402187f444 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:50:21.920931 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-425d4bd4-06c1-41e1-bb14-68402187f444 admin admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:50:21.933255 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 998/2036] 10.222.0.25 () {58 vars in 1153 bytes} [Tue Sep 13 19:50:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:50:21.940423 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486b532d-5b43-4030-ab56-1225758d4dd0 None None] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:50:21.954261 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486b532d-5b43-4030-ab56-1225758d4dd0 None None] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:50:21.959772 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425d4bd4-06c1-41e1-bb14-68402187f444 admin admin] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:50:21.961665 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.fernet_utils [None req-425d4bd4-06c1-41e1-bb14-68402187f444 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:50:21.962641 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2274c71c-4738-44f2-9df7-a50590c7e964 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:50:21.963672 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2274c71c-4738-44f2-9df7-a50590c7e964 admin admin] REQUEST_METHOD: `POST` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:50:21.964138 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2274c71c-4738-44f2-9df7-a50590c7e964 admin admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:50:21.964502 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2274c71c-4738-44f2-9df7-a50590c7e964 admin admin] PATH_INFO: `/v3/projects` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:50:21.965296 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2274c71c-4738-44f2-9df7-a50590c7e964 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:50:21.967415 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2274c71c-4738-44f2-9df7-a50590c7e964 admin admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:50:21.974864 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG dbcounter [-] [87934] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=87934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:50:21.993634 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425d4bd4-06c1-41e1-bb14-68402187f444 admin admin] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:50:22.005777 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d728bc1-b234-4cf1-a527-b1c4e0430e4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:50:22.006710 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d728bc1-b234-4cf1-a527-b1c4e0430e4a admin admin] REQUEST_METHOD: `DELETE` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:50:22.006853 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d728bc1-b234-4cf1-a527-b1c4e0430e4a admin admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:50:22.007273 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d728bc1-b234-4cf1-a527-b1c4e0430e4a admin admin] PATH_INFO: `/v3/projects/4372119fe5204cf2821439fb5dbd0d3e` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:50:22.008516 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d728bc1-b234-4cf1-a527-b1c4e0430e4a admin admin] RBAC: Authorizing `identity:delete_project(project_id=4372119fe5204cf2821439fb5dbd0d3e)` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:50:22.010590 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d728bc1-b234-4cf1-a527-b1c4e0430e4a admin admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:50:22.023771 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 1039/2037] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Sep 13 19:50:21 2022] POST /identity/v3/projects => generated 361 bytes in 86 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 19:50:22.028319 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2274c71c-4738-44f2-9df7-a50590c7e964 admin admin] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:50:22.102944 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG dbcounter [-] [87935] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=87935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:50:22.114600 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.notifications [None req-8d728bc1-b234-4cf1-a527-b1c4e0430e4a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4372119fe5204cf2821439fb5dbd0d3e', 'request_id': 'req-8d728bc1-b234-4cf1-a527-b1c4e0430e4a'} {{(pid=87935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:50:22.124073 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.notifications [None req-8d728bc1-b234-4cf1-a527-b1c4e0430e4a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4372119fe5204cf2821439fb5dbd0d3e', 'request_id': 'req-8d728bc1-b234-4cf1-a527-b1c4e0430e4a'} {{(pid=87935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:50:22.130638 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2274c71c-4738-44f2-9df7-a50590c7e964 admin admin] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:50:22.137090 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.notifications [None req-8d728bc1-b234-4cf1-a527-b1c4e0430e4a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4372119fe5204cf2821439fb5dbd0d3e', 'request_id': 'req-8d728bc1-b234-4cf1-a527-b1c4e0430e4a'} {{(pid=87935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:50:22.154685 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.notifications [None req-8d728bc1-b234-4cf1-a527-b1c4e0430e4a admin admin] The token cache is being invalidate because project 4372119fe5204cf2821439fb5dbd0d3e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87935) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 19:50:22.158381 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.notifications [None req-8d728bc1-b234-4cf1-a527-b1c4e0430e4a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:50:22.158381 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.notifications [None req-8d728bc1-b234-4cf1-a527-b1c4e0430e4a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:50:22.161700 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 999/2038] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Sep 13 19:50:21 2022] DELETE /identity/v3/projects/4372119fe5204cf2821439fb5dbd0d3e => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 19:50:22.165601 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d728bc1-b234-4cf1-a527-b1c4e0430e4a admin admin] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:50:22.167377 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.fernet_utils [None req-8d728bc1-b234-4cf1-a527-b1c4e0430e4a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:50:22.268444 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d728bc1-b234-4cf1-a527-b1c4e0430e4a admin admin] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:50:22.275727 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372d797d-40fd-43a3-9e84-0fea27c2c4df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:50:22.276600 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372d797d-40fd-43a3-9e84-0fea27c2c4df admin admin] REQUEST_METHOD: `DELETE` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:50:22.276957 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372d797d-40fd-43a3-9e84-0fea27c2c4df admin admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:50:22.277303 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372d797d-40fd-43a3-9e84-0fea27c2c4df admin admin] PATH_INFO: `/v3/users/6cac9dbea80548d2a9bc8bc15f2744a0` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:50:22.278567 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-372d797d-40fd-43a3-9e84-0fea27c2c4df admin admin] RBAC: Authorizing `identity:delete_user(user_id=6cac9dbea80548d2a9bc8bc15f2744a0)` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:50:22.280907 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-372d797d-40fd-43a3-9e84-0fea27c2c4df admin admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:50:22.282529 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89704358-1280-47bd-bc4b-c55d5c4a911e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:50:22.283272 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89704358-1280-47bd-bc4b-c55d5c4a911e admin admin] REQUEST_METHOD: `POST` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:50:22.283571 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89704358-1280-47bd-bc4b-c55d5c4a911e admin admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:50:22.283821 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89704358-1280-47bd-bc4b-c55d5c4a911e admin admin] PATH_INFO: `/v3/users` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:50:22.284582 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89704358-1280-47bd-bc4b-c55d5c4a911e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:50:22.286516 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89704358-1280-47bd-bc4b-c55d5c4a911e admin admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:50:22.335666 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 1040/2039] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Sep 13 19:50:22 2022] POST /identity/v3/users => generated 281 bytes in 308 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 19:50:22.339923 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89704358-1280-47bd-bc4b-c55d5c4a911e admin admin] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:50:22.341866 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.fernet_utils [None req-89704358-1280-47bd-bc4b-c55d5c4a911e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:50:22.371017 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.notifications [None req-372d797d-40fd-43a3-9e84-0fea27c2c4df admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6cac9dbea80548d2a9bc8bc15f2744a0'} {{(pid=87935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:50:22.373547 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89704358-1280-47bd-bc4b-c55d5c4a911e admin admin] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:50:22.379743 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04087fe3-9a78-46bd-96ab-b50f46ee0110 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:50:22.380744 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04087fe3-9a78-46bd-96ab-b50f46ee0110 admin admin] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:50:22.381044 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04087fe3-9a78-46bd-96ab-b50f46ee0110 admin admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:50:22.381384 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04087fe3-9a78-46bd-96ab-b50f46ee0110 admin admin] PATH_INFO: `/v3/roles` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:50:22.381879 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.notifications [None req-372d797d-40fd-43a3-9e84-0fea27c2c4df admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6cac9dbea80548d2a9bc8bc15f2744a0'} {{(pid=87935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:50:22.382229 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04087fe3-9a78-46bd-96ab-b50f46ee0110 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:50:22.384251 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04087fe3-9a78-46bd-96ab-b50f46ee0110 admin admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:50:22.399430 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.notifications [None req-372d797d-40fd-43a3-9e84-0fea27c2c4df admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6cac9dbea80548d2a9bc8bc15f2744a0'} {{(pid=87935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:50:22.399798 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 1041/2040] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Sep 13 19:50:22 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 19:50:22.400826 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.notifications [None req-372d797d-40fd-43a3-9e84-0fea27c2c4df admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6cac9dbea80548d2a9bc8bc15f2744a0'} {{(pid=87935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:50:22.401826 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.notifications [None req-372d797d-40fd-43a3-9e84-0fea27c2c4df admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6cac9dbea80548d2a9bc8bc15f2744a0'} {{(pid=87935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:50:22.403334 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04087fe3-9a78-46bd-96ab-b50f46ee0110 admin admin] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:50:22.405372 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.fernet_utils [None req-04087fe3-9a78-46bd-96ab-b50f46ee0110 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:50:22.418382 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 1000/2041] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Sep 13 19:50:22 2022] DELETE /identity/v3/users/6cac9dbea80548d2a9bc8bc15f2744a0 => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 19:50:22.421610 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04087fe3-9a78-46bd-96ab-b50f46ee0110 admin admin] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:50:22.547424 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3c3ea8-469e-4ea1-9278-d574b74eaf55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:50:22.548346 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3c3ea8-469e-4ea1-9278-d574b74eaf55 admin admin] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:50:22.549878 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3c3ea8-469e-4ea1-9278-d574b74eaf55 admin admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:50:22.550312 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3c3ea8-469e-4ea1-9278-d574b74eaf55 admin admin] PATH_INFO: `/v3/roles` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:50:22.551890 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c3c3ea8-469e-4ea1-9278-d574b74eaf55 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:50:22.553763 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c3c3ea8-469e-4ea1-9278-d574b74eaf55 admin admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:50:22.570461 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 1042/2042] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Sep 13 19:50:22 2022] GET /identity/v3/roles => generated 1420 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 13 19:50:22.574672 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372d797d-40fd-43a3-9e84-0fea27c2c4df admin admin] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:50:22.589827 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372d797d-40fd-43a3-9e84-0fea27c2c4df admin admin] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:50:22.596950 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a80b3f-998d-4f98-9852-b77f01c084f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:50:22.597903 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a80b3f-998d-4f98-9852-b77f01c084f2 admin admin] REQUEST_METHOD: `PUT` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:50:22.598195 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a80b3f-998d-4f98-9852-b77f01c084f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:50:22.598467 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a80b3f-998d-4f98-9852-b77f01c084f2 admin admin] PATH_INFO: `/v3/projects/7cfebf5cd37f430986b56d40814833ad/users/4da9adc7f2e44f4da042cd2fc06253be/roles/a259191f6d0e46fabd9f34536bb28747` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:50:22.624484 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a80b3f-998d-4f98-9852-b77f01c084f2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7cfebf5cd37f430986b56d40814833ad, user_id=4da9adc7f2e44f4da042cd2fc06253be, role_id=a259191f6d0e46fabd9f34536bb28747)` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:50:22.629195 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a80b3f-998d-4f98-9852-b77f01c084f2 admin admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:50:22.646944 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 1001/2043] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Sep 13 19:50:22 2022] PUT /identity/v3/projects/7cfebf5cd37f430986b56d40814833ad/users/4da9adc7f2e44f4da042cd2fc06253be/roles/a259191f6d0e46fabd9f34536bb28747 => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 19:50:22.657474 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294ee2ef-a25c-4353-98c6-3ba20259597a None None] REQUEST_METHOD: `POST` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:50:22.658629 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294ee2ef-a25c-4353-98c6-3ba20259597a None None] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:50:22.658812 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294ee2ef-a25c-4353-98c6-3ba20259597a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:50:22.686670 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG dbcounter [-] [87934] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=87934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:50:22.701282 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.auth.core [None req-294ee2ef-a25c-4353-98c6-3ba20259597a None None] MFA Rules not processed for user `4da9adc7f2e44f4da042cd2fc06253be`. Rule list: `[]` (Enabled: `True`). {{(pid=87934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:50:22.703229 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.fernet_utils [None req-294ee2ef-a25c-4353-98c6-3ba20259597a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:50:22.816276 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 1043/2044] 10.222.0.25 () {58 vars in 958 bytes} [Tue Sep 13 19:50:22 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 19:50:22.859415 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a80b3f-998d-4f98-9852-b77f01c084f2 admin admin] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:50:22.861607 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.fernet_utils [None req-14a80b3f-998d-4f98-9852-b77f01c084f2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:50:22.895022 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294ee2ef-a25c-4353-98c6-3ba20259597a None None] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:50:22.896766 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.fernet_utils [None req-294ee2ef-a25c-4353-98c6-3ba20259597a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:50:22.941847 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG dbcounter [-] [87935] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=87935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:50:23.009131 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a80b3f-998d-4f98-9852-b77f01c084f2 admin admin] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:50:23.014015 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18ae188-269c-42c9-8cb2-3dd9302b204d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cbb50c88b794a7f9f26844effde7d63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a10a4268f3c4cb29f4e00c292e2df62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:50:23.014638 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18ae188-269c-42c9-8cb2-3dd9302b204d service cinder] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:50:23.014977 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18ae188-269c-42c9-8cb2-3dd9302b204d service cinder] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:50:23.015258 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18ae188-269c-42c9-8cb2-3dd9302b204d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:50:23.025283 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a18ae188-269c-42c9-8cb2-3dd9302b204d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:50:23.026906 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a18ae188-269c-42c9-8cb2-3dd9302b204d service cinder] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:50:23.029203 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294ee2ef-a25c-4353-98c6-3ba20259597a None None] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:50:23.034843 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da1c539-098a-4afb-884f-c57598156a85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:50:23.035622 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da1c539-098a-4afb-884f-c57598156a85 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:50:23.035962 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da1c539-098a-4afb-884f-c57598156a85 admin admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:50:23.037634 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da1c539-098a-4afb-884f-c57598156a85 admin admin] PATH_INFO: `/v3/projects/d97362afd16940d7ba017d0d1961e53d` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:50:23.039169 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da1c539-098a-4afb-884f-c57598156a85 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d97362afd16940d7ba017d0d1961e53d)` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:50:23.040512 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 1002/2045] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Sep 13 19:50:22 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 181 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 19:50:23.041315 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da1c539-098a-4afb-884f-c57598156a85 admin admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:50:23.058822 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18ae188-269c-42c9-8cb2-3dd9302b204d service cinder] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:50:23.073873 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18ae188-269c-42c9-8cb2-3dd9302b204d service cinder] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:50:23.081199 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97333919-58a7-48ee-b6e6-174f524f1f98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:50:23.081961 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97333919-58a7-48ee-b6e6-174f524f1f98 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:50:23.082255 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97333919-58a7-48ee-b6e6-174f524f1f98 admin admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:50:23.082635 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97333919-58a7-48ee-b6e6-174f524f1f98 admin admin] PATH_INFO: `/v3/users/4da9adc7f2e44f4da042cd2fc06253be` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:50:23.084732 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97333919-58a7-48ee-b6e6-174f524f1f98 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4da9adc7f2e44f4da042cd2fc06253be)` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:50:23.088105 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97333919-58a7-48ee-b6e6-174f524f1f98 admin admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:50:23.139758 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.notifications [None req-5da1c539-098a-4afb-884f-c57598156a85 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd97362afd16940d7ba017d0d1961e53d', 'request_id': 'req-5da1c539-098a-4afb-884f-c57598156a85'} {{(pid=87934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:50:23.148004 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.notifications [None req-5da1c539-098a-4afb-884f-c57598156a85 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd97362afd16940d7ba017d0d1961e53d', 'request_id': 'req-5da1c539-098a-4afb-884f-c57598156a85'} {{(pid=87934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:50:23.157137 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.notifications [None req-5da1c539-098a-4afb-884f-c57598156a85 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd97362afd16940d7ba017d0d1961e53d', 'request_id': 'req-5da1c539-098a-4afb-884f-c57598156a85'} {{(pid=87934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:50:23.176994 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.notifications [None req-97333919-58a7-48ee-b6e6-174f524f1f98 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4da9adc7f2e44f4da042cd2fc06253be'} {{(pid=87935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:50:23.187084 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.notifications [None req-5da1c539-098a-4afb-884f-c57598156a85 admin admin] The token cache is being invalidate because project d97362afd16940d7ba017d0d1961e53d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87934) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 19:50:23.187521 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.notifications [None req-5da1c539-098a-4afb-884f-c57598156a85 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:50:23.188388 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.notifications [None req-5da1c539-098a-4afb-884f-c57598156a85 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:50:23.193943 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 1044/2046] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Sep 13 19:50:22 2022] DELETE /identity/v3/projects/d97362afd16940d7ba017d0d1961e53d => generated 0 bytes in 297 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 19:50:23.196348 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312784b6-bfba-4ff1-9a18-80d860349117 None None] REQUEST_METHOD: `POST` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:50:23.196730 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312784b6-bfba-4ff1-9a18-80d860349117 None None] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:50:23.197102 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312784b6-bfba-4ff1-9a18-80d860349117 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:50:23.203756 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.notifications [None req-97333919-58a7-48ee-b6e6-174f524f1f98 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4da9adc7f2e44f4da042cd2fc06253be'} {{(pid=87935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:50:23.219031 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.notifications [None req-97333919-58a7-48ee-b6e6-174f524f1f98 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4da9adc7f2e44f4da042cd2fc06253be'} {{(pid=87935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:50:23.221186 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.notifications [None req-97333919-58a7-48ee-b6e6-174f524f1f98 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4da9adc7f2e44f4da042cd2fc06253be'} {{(pid=87935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:50:23.222305 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.notifications [None req-97333919-58a7-48ee-b6e6-174f524f1f98 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4da9adc7f2e44f4da042cd2fc06253be'} {{(pid=87935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:50:23.240858 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 1003/2047] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Sep 13 19:50:23 2022] DELETE /identity/v3/users/4da9adc7f2e44f4da042cd2fc06253be => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 19:50:23.245035 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fbf52a-58e5-4670-b2fc-6c68d0c63fb8 None None] REQUEST_METHOD: `POST` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:50:23.245460 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fbf52a-58e5-4670-b2fc-6c68d0c63fb8 None None] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:50:23.245836 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fbf52a-58e5-4670-b2fc-6c68d0c63fb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:50:23.249206 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.auth.core [None req-312784b6-bfba-4ff1-9a18-80d860349117 None None] MFA Rules not processed for user `7b0aed92d02344acb92a0e4aa67c3068`. Rule list: `[]` (Enabled: `True`). {{(pid=87934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:50:23.251714 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.fernet_utils [None req-312784b6-bfba-4ff1-9a18-80d860349117 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:50:23.272111 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.auth.core [None req-e7fbf52a-58e5-4670-b2fc-6c68d0c63fb8 None None] MFA Rules not processed for user `7b0aed92d02344acb92a0e4aa67c3068`. Rule list: `[]` (Enabled: `True`). {{(pid=87935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:50:23.273786 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.fernet_utils [None req-e7fbf52a-58e5-4670-b2fc-6c68d0c63fb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:50:23.290807 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG dbcounter [-] [87934] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=87934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:50:23.337201 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 1045/2048] 10.222.0.25 () {58 vars in 958 bytes} [Tue Sep 13 19:50:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 19:50:23.346745 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c676e7-90e5-4f22-a114-28db905d542f None None] REQUEST_METHOD: `POST` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:50:23.347040 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c676e7-90e5-4f22-a114-28db905d542f None None] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:50:23.347338 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c676e7-90e5-4f22-a114-28db905d542f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:50:23.348173 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 1004/2049] 10.222.0.25 () {58 vars in 958 bytes} [Tue Sep 13 19:50:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 19:50:23.358605 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7fbf52a-58e5-4670-b2fc-6c68d0c63fb8 None None] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:50:23.360471 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.fernet_utils [None req-e7fbf52a-58e5-4670-b2fc-6c68d0c63fb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:50:23.367909 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.auth.core [None req-84c676e7-90e5-4f22-a114-28db905d542f None None] MFA Rules not processed for user `7b0aed92d02344acb92a0e4aa67c3068`. Rule list: `[]` (Enabled: `True`). {{(pid=87934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:50:23.369165 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.fernet_utils [None req-84c676e7-90e5-4f22-a114-28db905d542f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:50:23.382386 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 1046/2050] 10.222.0.25 () {58 vars in 958 bytes} [Tue Sep 13 19:50:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 19:50:23.383542 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c676e7-90e5-4f22-a114-28db905d542f None None] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:50:23.392852 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c676e7-90e5-4f22-a114-28db905d542f None None] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:50:23.397356 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e44d58a-68f3-4194-bb0a-a3d3225f4ce4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:50:23.397945 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e44d58a-68f3-4194-bb0a-a3d3225f4ce4 admin admin] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:50:23.398223 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e44d58a-68f3-4194-bb0a-a3d3225f4ce4 admin admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:50:23.398488 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e44d58a-68f3-4194-bb0a-a3d3225f4ce4 admin admin] PATH_INFO: `/v3/domains` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:50:23.399121 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e44d58a-68f3-4194-bb0a-a3d3225f4ce4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87934) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:50:23.399421 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e44d58a-68f3-4194-bb0a-a3d3225f4ce4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:50:23.401055 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e44d58a-68f3-4194-bb0a-a3d3225f4ce4 admin admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:50:23.407485 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG dbcounter [-] [87935] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:50:23.414374 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 1047/2051] 10.222.0.25 () {58 vars in 1153 bytes} [Tue Sep 13 19:50:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:50:23.417129 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e44d58a-68f3-4194-bb0a-a3d3225f4ce4 admin admin] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:50:23.418821 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.fernet_utils [None req-6e44d58a-68f3-4194-bb0a-a3d3225f4ce4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:50:23.429498 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7fbf52a-58e5-4670-b2fc-6c68d0c63fb8 None None] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:50:23.431701 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e44d58a-68f3-4194-bb0a-a3d3225f4ce4 admin admin] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:50:23.433173 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b2cbea-1082-462a-9252-397da8c0dcd8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1196a96e4a404f559600b69f929ea9da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a10a4268f3c4cb29f4e00c292e2df62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:50:23.433804 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b2cbea-1082-462a-9252-397da8c0dcd8 service neutron] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:50:23.434087 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b2cbea-1082-462a-9252-397da8c0dcd8 service neutron] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:50:23.434360 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b2cbea-1082-462a-9252-397da8c0dcd8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:50:23.436310 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c799d7-aa5b-41e0-9fcd-df2f80ec5498 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:50:23.436920 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c799d7-aa5b-41e0-9fcd-df2f80ec5498 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:50:23.437200 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c799d7-aa5b-41e0-9fcd-df2f80ec5498 admin admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:50:23.437473 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c799d7-aa5b-41e0-9fcd-df2f80ec5498 admin admin] PATH_INFO: `/v3/users/ea773a7d449d46d09b2a1977eae6faf2` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:50:23.438608 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c799d7-aa5b-41e0-9fcd-df2f80ec5498 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ea773a7d449d46d09b2a1977eae6faf2)` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:50:23.440593 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c799d7-aa5b-41e0-9fcd-df2f80ec5498 admin admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:50:23.444184 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b2cbea-1082-462a-9252-397da8c0dcd8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:50:23.445700 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b2cbea-1082-462a-9252-397da8c0dcd8 service neutron] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:50:23.455595 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 1005/2052] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Sep 13 19:50:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 13 19:50:23.456408 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b2cbea-1082-462a-9252-397da8c0dcd8 service neutron] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:50:23.467117 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b2cbea-1082-462a-9252-397da8c0dcd8 service neutron] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:50:23.473438 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10885c1b-f178-4aaf-852f-e93d9fb0678a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:50:23.474122 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10885c1b-f178-4aaf-852f-e93d9fb0678a admin admin] REQUEST_METHOD: `POST` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:50:23.474469 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10885c1b-f178-4aaf-852f-e93d9fb0678a admin admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:50:23.474743 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10885c1b-f178-4aaf-852f-e93d9fb0678a admin admin] PATH_INFO: `/v3/projects` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:50:23.475594 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10885c1b-f178-4aaf-852f-e93d9fb0678a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:50:23.477738 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10885c1b-f178-4aaf-852f-e93d9fb0678a admin admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:50:23.494036 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.notifications [None req-48c799d7-aa5b-41e0-9fcd-df2f80ec5498 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ea773a7d449d46d09b2a1977eae6faf2'} {{(pid=87934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:50:23.494750 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.notifications [None req-48c799d7-aa5b-41e0-9fcd-df2f80ec5498 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ea773a7d449d46d09b2a1977eae6faf2'} {{(pid=87934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:50:23.495377 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.notifications [None req-48c799d7-aa5b-41e0-9fcd-df2f80ec5498 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ea773a7d449d46d09b2a1977eae6faf2'} {{(pid=87934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:50:23.507668 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.notifications [None req-48c799d7-aa5b-41e0-9fcd-df2f80ec5498 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ea773a7d449d46d09b2a1977eae6faf2'} {{(pid=87934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:50:23.519885 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 1006/2053] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Sep 13 19:50:23 2022] POST /identity/v3/projects => generated 379 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 19:50:23.522849 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.notifications [None req-48c799d7-aa5b-41e0-9fcd-df2f80ec5498 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ea773a7d449d46d09b2a1977eae6faf2'} {{(pid=87934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:50:23.524748 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10885c1b-f178-4aaf-852f-e93d9fb0678a admin admin] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:50:23.527183 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.fernet_utils [None req-10885c1b-f178-4aaf-852f-e93d9fb0678a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:50:23.539520 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 1048/2054] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Sep 13 19:50:23 2022] DELETE /identity/v3/users/ea773a7d449d46d09b2a1977eae6faf2 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 19:50:23.543784 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5aad3cb-4ff9-41d0-957b-cc92f952a9bd None None] REQUEST_METHOD: `POST` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:50:23.544261 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5aad3cb-4ff9-41d0-957b-cc92f952a9bd None None] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:50:23.544849 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5aad3cb-4ff9-41d0-957b-cc92f952a9bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:50:23.569098 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.auth.core [None req-f5aad3cb-4ff9-41d0-957b-cc92f952a9bd None None] MFA Rules not processed for user `7b0aed92d02344acb92a0e4aa67c3068`. Rule list: `[]` (Enabled: `True`). {{(pid=87934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:50:23.570325 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.fernet_utils [None req-f5aad3cb-4ff9-41d0-957b-cc92f952a9bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:50:23.600611 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10885c1b-f178-4aaf-852f-e93d9fb0678a admin admin] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:50:23.645525 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 1049/2055] 10.222.0.25 () {58 vars in 958 bytes} [Tue Sep 13 19:50:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 19:50:23.668833 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5aad3cb-4ff9-41d0-957b-cc92f952a9bd None None] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:50:23.671201 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af069a4-97f4-4974-a110-9380bae64b55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:50:23.671641 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.fernet_utils [None req-f5aad3cb-4ff9-41d0-957b-cc92f952a9bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:50:23.671974 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af069a4-97f4-4974-a110-9380bae64b55 admin admin] REQUEST_METHOD: `POST` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:50:23.672341 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af069a4-97f4-4974-a110-9380bae64b55 admin admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:50:23.672683 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af069a4-97f4-4974-a110-9380bae64b55 admin admin] PATH_INFO: `/v3/users` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:50:23.673395 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af069a4-97f4-4974-a110-9380bae64b55 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:50:23.675894 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af069a4-97f4-4974-a110-9380bae64b55 admin admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:50:23.704130 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 1007/2056] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Sep 13 19:50:23 2022] POST /identity/v3/users => generated 290 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 13 19:50:23.708833 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af069a4-97f4-4974-a110-9380bae64b55 admin admin] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:50:23.712817 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG dbcounter [-] [87934] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:50:23.720120 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af069a4-97f4-4974-a110-9380bae64b55 admin admin] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:50:23.726990 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72306ca9-1226-427a-946a-670bdf136e80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:50:23.727606 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72306ca9-1226-427a-946a-670bdf136e80 admin admin] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:50:23.728234 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72306ca9-1226-427a-946a-670bdf136e80 admin admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:50:23.728493 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72306ca9-1226-427a-946a-670bdf136e80 admin admin] PATH_INFO: `/v3/roles` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:50:23.729106 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72306ca9-1226-427a-946a-670bdf136e80 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:50:23.731094 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72306ca9-1226-427a-946a-670bdf136e80 admin admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:50:23.746338 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 1008/2057] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Sep 13 19:50:23 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 19:50:23.749537 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72306ca9-1226-427a-946a-670bdf136e80 admin admin] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:50:23.764359 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5aad3cb-4ff9-41d0-957b-cc92f952a9bd None None] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:50:23.768629 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72306ca9-1226-427a-946a-670bdf136e80 admin admin] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:50:23.769800 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33207be3-055c-4385-9d27-b3a4f2ea8eff service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1196a96e4a404f559600b69f929ea9da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a10a4268f3c4cb29f4e00c292e2df62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:50:23.770425 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33207be3-055c-4385-9d27-b3a4f2ea8eff service neutron] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:50:23.770763 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33207be3-055c-4385-9d27-b3a4f2ea8eff service neutron] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:50:23.771040 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33207be3-055c-4385-9d27-b3a4f2ea8eff service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:50:23.776943 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4962e1f5-ba3b-42d5-83e5-a6ad19f6b94b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:50:23.778079 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4962e1f5-ba3b-42d5-83e5-a6ad19f6b94b admin admin] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:50:23.778683 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4962e1f5-ba3b-42d5-83e5-a6ad19f6b94b admin admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:50:23.779186 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4962e1f5-ba3b-42d5-83e5-a6ad19f6b94b admin admin] PATH_INFO: `/v3/roles` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:50:23.779941 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4962e1f5-ba3b-42d5-83e5-a6ad19f6b94b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:50:23.781363 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33207be3-055c-4385-9d27-b3a4f2ea8eff service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:50:23.782804 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33207be3-055c-4385-9d27-b3a4f2ea8eff service neutron] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:50:23.783032 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4962e1f5-ba3b-42d5-83e5-a6ad19f6b94b admin admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:50:23.794847 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 1050/2058] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Sep 13 19:50:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 19:50:23.796243 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 1009/2059] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Sep 13 19:50:23 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 19:50:23.800596 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33207be3-055c-4385-9d27-b3a4f2ea8eff service neutron] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:50:23.810295 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33207be3-055c-4385-9d27-b3a4f2ea8eff service neutron] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:50:23.815985 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc525907-c548-4111-a7a9-6c832ea106e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:50:23.816708 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc525907-c548-4111-a7a9-6c832ea106e1 admin admin] REQUEST_METHOD: `PUT` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:50:23.816986 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc525907-c548-4111-a7a9-6c832ea106e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:50:23.817258 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc525907-c548-4111-a7a9-6c832ea106e1 admin admin] PATH_INFO: `/v3/projects/1916268dcb0243659bd3d66b69936960/users/c89f4ec7766845f8bcb72cf86a37c1ba/roles/a259191f6d0e46fabd9f34536bb28747` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:50:23.833991 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc525907-c548-4111-a7a9-6c832ea106e1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1916268dcb0243659bd3d66b69936960, user_id=c89f4ec7766845f8bcb72cf86a37c1ba, role_id=a259191f6d0e46fabd9f34536bb28747)` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:50:23.836717 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc525907-c548-4111-a7a9-6c832ea106e1 admin admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:50:23.850413 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 1051/2060] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Sep 13 19:50:23 2022] PUT /identity/v3/projects/1916268dcb0243659bd3d66b69936960/users/c89f4ec7766845f8bcb72cf86a37c1ba/roles/a259191f6d0e46fabd9f34536bb28747 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 19:50:23.860533 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e604a26-c19b-4c38-87d8-8b0bab4c531f None None] REQUEST_METHOD: `POST` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:50:23.860822 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e604a26-c19b-4c38-87d8-8b0bab4c531f None None] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:50:23.861807 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e604a26-c19b-4c38-87d8-8b0bab4c531f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:50:23.891468 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.auth.core [None req-9e604a26-c19b-4c38-87d8-8b0bab4c531f None None] MFA Rules not processed for user `c89f4ec7766845f8bcb72cf86a37c1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=87935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:50:23.893036 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.fernet_utils [None req-9e604a26-c19b-4c38-87d8-8b0bab4c531f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:50:23.921681 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG dbcounter [-] [87935] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=87935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:50:23.941082 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc525907-c548-4111-a7a9-6c832ea106e1 admin admin] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:50:23.942853 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.fernet_utils [None req-dc525907-c548-4111-a7a9-6c832ea106e1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:50:23.994241 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 1010/2061] 10.222.0.25 () {58 vars in 958 bytes} [Tue Sep 13 19:50:23 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 19:50:23.999349 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e604a26-c19b-4c38-87d8-8b0bab4c531f None None] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:50:24.032735 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc525907-c548-4111-a7a9-6c832ea106e1 admin admin] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:50:24.040693 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80987f81-fdce-49ff-8ceb-92359ca59674 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:50:24.042267 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80987f81-fdce-49ff-8ceb-92359ca59674 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:50:24.042555 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80987f81-fdce-49ff-8ceb-92359ca59674 admin admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:50:24.042827 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80987f81-fdce-49ff-8ceb-92359ca59674 admin admin] PATH_INFO: `/v3/projects/7cfebf5cd37f430986b56d40814833ad` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:50:24.044047 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80987f81-fdce-49ff-8ceb-92359ca59674 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7cfebf5cd37f430986b56d40814833ad)` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:50:24.045991 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80987f81-fdce-49ff-8ceb-92359ca59674 admin admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:50:24.079964 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e604a26-c19b-4c38-87d8-8b0bab4c531f None None] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:50:24.086513 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95f7482-c509-4b52-bbd1-753423a54fa3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:50:24.087327 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95f7482-c509-4b52-bbd1-753423a54fa3 admin admin] REQUEST_METHOD: `POST` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:50:24.087710 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95f7482-c509-4b52-bbd1-753423a54fa3 admin admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:50:24.088083 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95f7482-c509-4b52-bbd1-753423a54fa3 admin admin] PATH_INFO: `/v3/projects` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:50:24.089423 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b95f7482-c509-4b52-bbd1-753423a54fa3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:50:24.091829 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b95f7482-c509-4b52-bbd1-753423a54fa3 admin admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:50:24.099235 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.notifications [None req-80987f81-fdce-49ff-8ceb-92359ca59674 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7cfebf5cd37f430986b56d40814833ad', 'request_id': 'req-80987f81-fdce-49ff-8ceb-92359ca59674'} {{(pid=87934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:50:24.106532 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.notifications [None req-80987f81-fdce-49ff-8ceb-92359ca59674 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7cfebf5cd37f430986b56d40814833ad', 'request_id': 'req-80987f81-fdce-49ff-8ceb-92359ca59674'} {{(pid=87934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:50:24.113091 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.notifications [None req-80987f81-fdce-49ff-8ceb-92359ca59674 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7cfebf5cd37f430986b56d40814833ad', 'request_id': 'req-80987f81-fdce-49ff-8ceb-92359ca59674'} {{(pid=87934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:50:24.129292 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.notifications [None req-80987f81-fdce-49ff-8ceb-92359ca59674 admin admin] The token cache is being invalidate because project 7cfebf5cd37f430986b56d40814833ad was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87934) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 19:50:24.129628 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.notifications [None req-80987f81-fdce-49ff-8ceb-92359ca59674 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:50:24.130421 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.notifications [None req-80987f81-fdce-49ff-8ceb-92359ca59674 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:50:24.132250 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 1052/2062] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Sep 13 19:50:23 2022] DELETE /identity/v3/projects/7cfebf5cd37f430986b56d40814833ad => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 19:50:24.133018 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 1011/2063] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Sep 13 19:50:23 2022] POST /identity/v3/projects => generated 381 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 13 19:50:24.137424 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80987f81-fdce-49ff-8ceb-92359ca59674 admin admin] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:50:24.146617 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.fernet_utils [None req-80987f81-fdce-49ff-8ceb-92359ca59674 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:50:24.210098 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95f7482-c509-4b52-bbd1-753423a54fa3 admin admin] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:50:24.212016 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.fernet_utils [None req-b95f7482-c509-4b52-bbd1-753423a54fa3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:50:24.218558 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG dbcounter [-] [87934] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=87934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:50:24.318436 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80987f81-fdce-49ff-8ceb-92359ca59674 admin admin] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:50:24.368723 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95f7482-c509-4b52-bbd1-753423a54fa3 admin admin] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:50:24.376386 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9037658d-7f35-4e87-84b2-32f3d3e8e183 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:50:24.377885 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9037658d-7f35-4e87-84b2-32f3d3e8e183 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:50:24.378419 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9037658d-7f35-4e87-84b2-32f3d3e8e183 admin admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:50:24.378832 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9037658d-7f35-4e87-84b2-32f3d3e8e183 admin admin] PATH_INFO: `/v3/projects/aa742d5df35b4e99861e8224cb23e241` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:50:24.380224 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9037658d-7f35-4e87-84b2-32f3d3e8e183 admin admin] RBAC: Authorizing `identity:delete_project(project_id=aa742d5df35b4e99861e8224cb23e241)` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:50:24.382819 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9037658d-7f35-4e87-84b2-32f3d3e8e183 admin admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:50:24.418206 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ea2ac3-e047-4216-8cba-d8d3c9763720 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:50:24.419839 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ea2ac3-e047-4216-8cba-d8d3c9763720 admin admin] REQUEST_METHOD: `POST` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:50:24.420655 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ea2ac3-e047-4216-8cba-d8d3c9763720 admin admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:50:24.421342 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ea2ac3-e047-4216-8cba-d8d3c9763720 admin admin] PATH_INFO: `/v3/users` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:50:24.422574 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ea2ac3-e047-4216-8cba-d8d3c9763720 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:50:24.426843 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ea2ac3-e047-4216-8cba-d8d3c9763720 admin admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:50:24.462686 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 1053/2064] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Sep 13 19:50:24 2022] POST /identity/v3/users => generated 297 bytes in 323 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 13 19:50:24.464426 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ea2ac3-e047-4216-8cba-d8d3c9763720 admin admin] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:50:24.476934 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ea2ac3-e047-4216-8cba-d8d3c9763720 admin admin] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:50:24.479000 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.notifications [None req-9037658d-7f35-4e87-84b2-32f3d3e8e183 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aa742d5df35b4e99861e8224cb23e241', 'request_id': 'req-9037658d-7f35-4e87-84b2-32f3d3e8e183'} {{(pid=87935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:50:24.483567 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG dbcounter [-] [87935] Writing DB stats keystone:SELECT=95,keystone:INSERT=1,keystone:DELETE=4 {{(pid=87935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:50:24.486628 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.notifications [None req-9037658d-7f35-4e87-84b2-32f3d3e8e183 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aa742d5df35b4e99861e8224cb23e241', 'request_id': 'req-9037658d-7f35-4e87-84b2-32f3d3e8e183'} {{(pid=87935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:50:24.500742 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.notifications [None req-9037658d-7f35-4e87-84b2-32f3d3e8e183 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aa742d5df35b4e99861e8224cb23e241', 'request_id': 'req-9037658d-7f35-4e87-84b2-32f3d3e8e183'} {{(pid=87935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:50:24.517937 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.notifications [None req-9037658d-7f35-4e87-84b2-32f3d3e8e183 admin admin] The token cache is being invalidate because project aa742d5df35b4e99861e8224cb23e241 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87935) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 19:50:24.518370 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.notifications [None req-9037658d-7f35-4e87-84b2-32f3d3e8e183 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:50:24.519149 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.notifications [None req-9037658d-7f35-4e87-84b2-32f3d3e8e183 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:50:24.524149 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 1012/2065] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Sep 13 19:50:24 2022] DELETE /identity/v3/projects/aa742d5df35b4e99861e8224cb23e241 => generated 0 bytes in 312 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 19:50:24.525107 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9037658d-7f35-4e87-84b2-32f3d3e8e183 admin admin] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:50:24.526544 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.fernet_utils [None req-9037658d-7f35-4e87-84b2-32f3d3e8e183 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:50:24.550303 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9d603f-99d3-4c18-8185-ca77ec227390 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:50:24.551316 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9d603f-99d3-4c18-8185-ca77ec227390 admin admin] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:50:24.551603 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9d603f-99d3-4c18-8185-ca77ec227390 admin admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:50:24.551875 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9d603f-99d3-4c18-8185-ca77ec227390 admin admin] PATH_INFO: `/v3/roles` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:50:24.552561 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d9d603f-99d3-4c18-8185-ca77ec227390 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:50:24.554491 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d9d603f-99d3-4c18-8185-ca77ec227390 admin admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:50:24.568283 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 1054/2066] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Sep 13 19:50:24 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 19:50:24.570072 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9d603f-99d3-4c18-8185-ca77ec227390 admin admin] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:50:24.571859 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.fernet_utils [None req-9d9d603f-99d3-4c18-8185-ca77ec227390 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:50:24.585726 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9d603f-99d3-4c18-8185-ca77ec227390 admin admin] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:50:24.590701 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d4121f-43fe-4998-8bda-ad0c855af286 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:50:24.591490 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d4121f-43fe-4998-8bda-ad0c855af286 admin admin] REQUEST_METHOD: `PUT` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:50:24.591777 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d4121f-43fe-4998-8bda-ad0c855af286 admin admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:50:24.592057 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d4121f-43fe-4998-8bda-ad0c855af286 admin admin] PATH_INFO: `/v3/projects/94d5a9258d854e4eb7ad9db3c773b595/users/82ba73ca1ab4439bbe2c06aef05c4284/roles/6ca1d4427ff64e0a9d25d96cfb1445f6` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:50:24.601776 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9037658d-7f35-4e87-84b2-32f3d3e8e183 admin admin] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:50:24.606542 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24de7eea-1679-4e67-ba84-43a7cc96579d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:50:24.607200 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24de7eea-1679-4e67-ba84-43a7cc96579d admin admin] REQUEST_METHOD: `DELETE` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:50:24.607479 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24de7eea-1679-4e67-ba84-43a7cc96579d admin admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:50:24.607645 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d4121f-43fe-4998-8bda-ad0c855af286 admin admin] RBAC: Authorizing `identity:create_grant(project_id=94d5a9258d854e4eb7ad9db3c773b595, user_id=82ba73ca1ab4439bbe2c06aef05c4284, role_id=6ca1d4427ff64e0a9d25d96cfb1445f6)` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:50:24.607751 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24de7eea-1679-4e67-ba84-43a7cc96579d admin admin] PATH_INFO: `/v3/users/31b4d194166e48d9a0c0b3d095f7dac3` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:50:24.608914 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24de7eea-1679-4e67-ba84-43a7cc96579d admin admin] RBAC: Authorizing `identity:delete_user(user_id=31b4d194166e48d9a0c0b3d095f7dac3)` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:50:24.610314 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d4121f-43fe-4998-8bda-ad0c855af286 admin admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:50:24.610811 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24de7eea-1679-4e67-ba84-43a7cc96579d admin admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:50:24.624923 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 1055/2067] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Sep 13 19:50:24 2022] PUT /identity/v3/projects/94d5a9258d854e4eb7ad9db3c773b595/users/82ba73ca1ab4439bbe2c06aef05c4284/roles/6ca1d4427ff64e0a9d25d96cfb1445f6 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 19:50:24.628978 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d4121f-43fe-4998-8bda-ad0c855af286 admin admin] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:50:24.661522 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.notifications [None req-24de7eea-1679-4e67-ba84-43a7cc96579d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '31b4d194166e48d9a0c0b3d095f7dac3'} {{(pid=87935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:50:24.669278 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.notifications [None req-24de7eea-1679-4e67-ba84-43a7cc96579d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '31b4d194166e48d9a0c0b3d095f7dac3'} {{(pid=87935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:50:24.674239 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG dbcounter [-] [87934] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=87934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:50:24.683801 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.notifications [None req-24de7eea-1679-4e67-ba84-43a7cc96579d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '31b4d194166e48d9a0c0b3d095f7dac3'} {{(pid=87935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:50:24.684619 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.notifications [None req-24de7eea-1679-4e67-ba84-43a7cc96579d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '31b4d194166e48d9a0c0b3d095f7dac3'} {{(pid=87935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:50:24.685612 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.notifications [None req-24de7eea-1679-4e67-ba84-43a7cc96579d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '31b4d194166e48d9a0c0b3d095f7dac3'} {{(pid=87935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:50:24.695932 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d4121f-43fe-4998-8bda-ad0c855af286 admin admin] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:50:24.698693 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 1013/2068] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Sep 13 19:50:24 2022] DELETE /identity/v3/users/31b4d194166e48d9a0c0b3d095f7dac3 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 19:50:24.700853 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486fc860-946d-42bc-9895-468bb999b225 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:50:24.701519 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486fc860-946d-42bc-9895-468bb999b225 admin admin] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:50:24.701797 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486fc860-946d-42bc-9895-468bb999b225 admin admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:50:24.702073 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486fc860-946d-42bc-9895-468bb999b225 admin admin] PATH_INFO: `/v3/roles` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:50:24.702685 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-486fc860-946d-42bc-9895-468bb999b225 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:50:24.704612 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-486fc860-946d-42bc-9895-468bb999b225 admin admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:50:24.715981 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 1056/2069] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Sep 13 19:50:24 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 13 19:50:24.719623 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24de7eea-1679-4e67-ba84-43a7cc96579d admin admin] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:50:24.721752 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.fernet_utils [None req-24de7eea-1679-4e67-ba84-43a7cc96579d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:50:24.795435 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG dbcounter [-] [87935] Writing DB stats keystone:DELETE=13,keystone:SELECT=85,keystone:INSERT=2 {{(pid=87935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:50:24.801767 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24de7eea-1679-4e67-ba84-43a7cc96579d admin admin] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:50:24.812122 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87454537-a494-48c5-9b22-fd5980d1ce09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:50:24.813226 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87454537-a494-48c5-9b22-fd5980d1ce09 admin admin] REQUEST_METHOD: `PUT` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:50:24.813898 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87454537-a494-48c5-9b22-fd5980d1ce09 admin admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:50:24.815089 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87454537-a494-48c5-9b22-fd5980d1ce09 admin admin] PATH_INFO: `/v3/projects/94d5a9258d854e4eb7ad9db3c773b595/users/82ba73ca1ab4439bbe2c06aef05c4284/roles/6ca1d4427ff64e0a9d25d96cfb1445f6` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:50:24.818039 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87454537-a494-48c5-9b22-fd5980d1ce09 admin admin] RBAC: Authorizing `identity:create_grant(project_id=94d5a9258d854e4eb7ad9db3c773b595, user_id=82ba73ca1ab4439bbe2c06aef05c4284, role_id=6ca1d4427ff64e0a9d25d96cfb1445f6)` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:50:24.821123 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87454537-a494-48c5-9b22-fd5980d1ce09 admin admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:50:24.833306 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 1014/2070] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Sep 13 19:50:24 2022] PUT /identity/v3/projects/94d5a9258d854e4eb7ad9db3c773b595/users/82ba73ca1ab4439bbe2c06aef05c4284/roles/6ca1d4427ff64e0a9d25d96cfb1445f6 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 19:50:24.844524 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e7b9ce-da8c-4cbe-ab3e-5bae8e9428df None None] REQUEST_METHOD: `POST` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:50:24.844888 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e7b9ce-da8c-4cbe-ab3e-5bae8e9428df None None] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:50:24.845252 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e7b9ce-da8c-4cbe-ab3e-5bae8e9428df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:50:24.876087 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.auth.core [None req-35e7b9ce-da8c-4cbe-ab3e-5bae8e9428df None None] MFA Rules not processed for user `82ba73ca1ab4439bbe2c06aef05c4284`. Rule list: `[]` (Enabled: `True`). {{(pid=87934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:50:24.877918 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.fernet_utils [None req-35e7b9ce-da8c-4cbe-ab3e-5bae8e9428df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:50:24.955870 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 1057/2071] 10.222.0.25 () {58 vars in 958 bytes} [Tue Sep 13 19:50:24 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 19:50:24.966712 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87454537-a494-48c5-9b22-fd5980d1ce09 admin admin] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:50:24.968936 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.fernet_utils [None req-87454537-a494-48c5-9b22-fd5980d1ce09 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:50:24.991135 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e7b9ce-da8c-4cbe-ab3e-5bae8e9428df None None] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:50:24.992678 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.fernet_utils [None req-35e7b9ce-da8c-4cbe-ab3e-5bae8e9428df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:50:25.040144 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87454537-a494-48c5-9b22-fd5980d1ce09 admin admin] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:50:25.043971 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16e655b-159b-4cb5-9c7b-b994bc9ea826 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cbb50c88b794a7f9f26844effde7d63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a10a4268f3c4cb29f4e00c292e2df62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:50:25.044660 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16e655b-159b-4cb5-9c7b-b994bc9ea826 service cinder] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:50:25.044945 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16e655b-159b-4cb5-9c7b-b994bc9ea826 service cinder] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:50:25.045254 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16e655b-159b-4cb5-9c7b-b994bc9ea826 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:50:25.057312 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e16e655b-159b-4cb5-9c7b-b994bc9ea826 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:50:25.058900 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e16e655b-159b-4cb5-9c7b-b994bc9ea826 service cinder] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:50:25.070997 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 1015/2072] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Sep 13 19:50:24 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 19:50:25.102337 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e7b9ce-da8c-4cbe-ab3e-5bae8e9428df None None] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:50:25.112550 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f410fae7-d88e-4a2f-b0ef-50d4712034e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:50:25.113660 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f410fae7-d88e-4a2f-b0ef-50d4712034e9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:50:25.114286 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f410fae7-d88e-4a2f-b0ef-50d4712034e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:50:25.114614 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f410fae7-d88e-4a2f-b0ef-50d4712034e9 admin admin] PATH_INFO: `/v3/projects/71c681da8b7b41bd8d77f910c8e0e973` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:50:25.116971 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f410fae7-d88e-4a2f-b0ef-50d4712034e9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=71c681da8b7b41bd8d77f910c8e0e973)` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:50:25.119480 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f410fae7-d88e-4a2f-b0ef-50d4712034e9 admin admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:50:25.193450 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.notifications [None req-f410fae7-d88e-4a2f-b0ef-50d4712034e9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '71c681da8b7b41bd8d77f910c8e0e973', 'request_id': 'req-f410fae7-d88e-4a2f-b0ef-50d4712034e9'} {{(pid=87934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:50:25.200297 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.notifications [None req-f410fae7-d88e-4a2f-b0ef-50d4712034e9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '71c681da8b7b41bd8d77f910c8e0e973', 'request_id': 'req-f410fae7-d88e-4a2f-b0ef-50d4712034e9'} {{(pid=87934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:50:25.208921 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.notifications [None req-f410fae7-d88e-4a2f-b0ef-50d4712034e9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '71c681da8b7b41bd8d77f910c8e0e973', 'request_id': 'req-f410fae7-d88e-4a2f-b0ef-50d4712034e9'} {{(pid=87934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:50:25.210656 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG dbcounter [-] [87934] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=87934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:50:25.224369 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.notifications [None req-f410fae7-d88e-4a2f-b0ef-50d4712034e9 admin admin] The token cache is being invalidate because project 71c681da8b7b41bd8d77f910c8e0e973 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87934) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 19:50:25.224659 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.notifications [None req-f410fae7-d88e-4a2f-b0ef-50d4712034e9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:50:25.225292 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.notifications [None req-f410fae7-d88e-4a2f-b0ef-50d4712034e9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:50:25.226998 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 1058/2073] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Sep 13 19:50:24 2022] DELETE /identity/v3/projects/71c681da8b7b41bd8d77f910c8e0e973 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 19:50:25.232879 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65e1aea-f3ba-4be6-aed2-7b603e5a9c21 None None] REQUEST_METHOD: `POST` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:50:25.233341 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65e1aea-f3ba-4be6-aed2-7b603e5a9c21 None None] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:50:25.233606 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65e1aea-f3ba-4be6-aed2-7b603e5a9c21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:50:25.258836 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.auth.core [None req-f65e1aea-f3ba-4be6-aed2-7b603e5a9c21 None None] MFA Rules not processed for user `7b0aed92d02344acb92a0e4aa67c3068`. Rule list: `[]` (Enabled: `True`). {{(pid=87935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:50:25.260046 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.fernet_utils [None req-f65e1aea-f3ba-4be6-aed2-7b603e5a9c21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:50:25.327422 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 1016/2074] 10.222.0.25 () {58 vars in 958 bytes} [Tue Sep 13 19:50:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 19:50:25.337262 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97b4604-82aa-410e-af85-5f6fb3dc6ae6 None None] REQUEST_METHOD: `POST` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:50:25.337582 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97b4604-82aa-410e-af85-5f6fb3dc6ae6 None None] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:50:25.337889 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97b4604-82aa-410e-af85-5f6fb3dc6ae6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:50:25.360564 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.auth.core [None req-e97b4604-82aa-410e-af85-5f6fb3dc6ae6 None None] MFA Rules not processed for user `7b0aed92d02344acb92a0e4aa67c3068`. Rule list: `[]` (Enabled: `True`). {{(pid=87934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:50:25.362380 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.fernet_utils [None req-e97b4604-82aa-410e-af85-5f6fb3dc6ae6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:50:25.370509 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 1059/2075] 10.222.0.25 () {58 vars in 958 bytes} [Tue Sep 13 19:50:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 19:50:25.374758 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65e1aea-f3ba-4be6-aed2-7b603e5a9c21 None None] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:50:25.384704 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65e1aea-f3ba-4be6-aed2-7b603e5a9c21 None None] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:50:25.389937 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680c97a5-6e1b-4757-9a76-5dde61655f12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:50:25.390546 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680c97a5-6e1b-4757-9a76-5dde61655f12 admin admin] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:50:25.390820 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680c97a5-6e1b-4757-9a76-5dde61655f12 admin admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:50:25.391083 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680c97a5-6e1b-4757-9a76-5dde61655f12 admin admin] PATH_INFO: `/v3/domains` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:50:25.391722 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-680c97a5-6e1b-4757-9a76-5dde61655f12 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87935) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:50:25.392020 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-680c97a5-6e1b-4757-9a76-5dde61655f12 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:50:25.394362 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-680c97a5-6e1b-4757-9a76-5dde61655f12 admin admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:50:25.410668 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 1017/2076] 10.222.0.25 () {58 vars in 1153 bytes} [Tue Sep 13 19:50:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:50:25.411751 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97b4604-82aa-410e-af85-5f6fb3dc6ae6 None None] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:50:25.423265 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97b4604-82aa-410e-af85-5f6fb3dc6ae6 None None] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:50:25.426820 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2e46a4-4e8c-4d2c-b80a-46851fe28e01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:50:25.427425 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2e46a4-4e8c-4d2c-b80a-46851fe28e01 admin admin] REQUEST_METHOD: `POST` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:50:25.427699 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2e46a4-4e8c-4d2c-b80a-46851fe28e01 admin admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:50:25.427963 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2e46a4-4e8c-4d2c-b80a-46851fe28e01 admin admin] PATH_INFO: `/v3/projects` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:50:25.428746 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b2e46a4-4e8c-4d2c-b80a-46851fe28e01 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:50:25.430710 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b2e46a4-4e8c-4d2c-b80a-46851fe28e01 admin admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:50:25.467215 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 1060/2077] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Sep 13 19:50:25 2022] POST /identity/v3/projects => generated 375 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 13 19:50:25.468293 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680c97a5-6e1b-4757-9a76-5dde61655f12 admin admin] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:50:25.478373 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680c97a5-6e1b-4757-9a76-5dde61655f12 admin admin] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:50:25.542444 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2e46a4-4e8c-4d2c-b80a-46851fe28e01 admin admin] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:50:25.544340 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.fernet_utils [None req-2b2e46a4-4e8c-4d2c-b80a-46851fe28e01 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:50:25.546486 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b4b324-4fdf-4ee6-98dc-abe13ef0e171 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:50:25.547126 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b4b324-4fdf-4ee6-98dc-abe13ef0e171 admin admin] REQUEST_METHOD: `POST` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:50:25.547402 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b4b324-4fdf-4ee6-98dc-abe13ef0e171 admin admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:50:25.547672 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b4b324-4fdf-4ee6-98dc-abe13ef0e171 admin admin] PATH_INFO: `/v3/users` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:50:25.548337 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b4b324-4fdf-4ee6-98dc-abe13ef0e171 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:50:25.551081 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b4b324-4fdf-4ee6-98dc-abe13ef0e171 admin admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:50:25.557764 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2e46a4-4e8c-4d2c-b80a-46851fe28e01 admin admin] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:50:25.563670 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40826ed3-1e7d-445b-a831-f58d3d0c3851 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:50:25.565044 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40826ed3-1e7d-445b-a831-f58d3d0c3851 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:50:25.565367 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40826ed3-1e7d-445b-a831-f58d3d0c3851 admin admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:50:25.565794 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40826ed3-1e7d-445b-a831-f58d3d0c3851 admin admin] PATH_INFO: `/v3/users/c89f4ec7766845f8bcb72cf86a37c1ba` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:50:25.567219 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40826ed3-1e7d-445b-a831-f58d3d0c3851 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c89f4ec7766845f8bcb72cf86a37c1ba)` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:50:25.569221 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40826ed3-1e7d-445b-a831-f58d3d0c3851 admin admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:50:25.575715 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 1018/2078] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Sep 13 19:50:25 2022] POST /identity/v3/users => generated 288 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 13 19:50:25.579879 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b4b324-4fdf-4ee6-98dc-abe13ef0e171 admin admin] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:50:25.592403 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b4b324-4fdf-4ee6-98dc-abe13ef0e171 admin admin] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:50:25.598414 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a7a1c8-1146-4a41-990e-66f3694ff237 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:50:25.599168 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a7a1c8-1146-4a41-990e-66f3694ff237 admin admin] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:50:25.599566 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a7a1c8-1146-4a41-990e-66f3694ff237 admin admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:50:25.599902 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a7a1c8-1146-4a41-990e-66f3694ff237 admin admin] PATH_INFO: `/v3/roles` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:50:25.600817 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a7a1c8-1146-4a41-990e-66f3694ff237 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:50:25.602984 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a7a1c8-1146-4a41-990e-66f3694ff237 admin admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:50:25.612698 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG dbcounter [-] [87935] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=87935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:50:25.620022 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 1019/2079] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Sep 13 19:50:25 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 19:50:25.626005 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a7a1c8-1146-4a41-990e-66f3694ff237 admin admin] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:50:25.640601 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a7a1c8-1146-4a41-990e-66f3694ff237 admin admin] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:50:25.640797 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.notifications [None req-40826ed3-1e7d-445b-a831-f58d3d0c3851 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c89f4ec7766845f8bcb72cf86a37c1ba'} {{(pid=87934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:50:25.641490 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.notifications [None req-40826ed3-1e7d-445b-a831-f58d3d0c3851 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c89f4ec7766845f8bcb72cf86a37c1ba'} {{(pid=87934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:50:25.642152 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.notifications [None req-40826ed3-1e7d-445b-a831-f58d3d0c3851 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c89f4ec7766845f8bcb72cf86a37c1ba'} {{(pid=87934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:50:25.648669 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a973dd02-e0cd-407c-8e46-64085ddee357 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:50:25.649427 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a973dd02-e0cd-407c-8e46-64085ddee357 admin admin] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:50:25.649982 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a973dd02-e0cd-407c-8e46-64085ddee357 admin admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:50:25.650356 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a973dd02-e0cd-407c-8e46-64085ddee357 admin admin] PATH_INFO: `/v3/roles` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:50:25.650485 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.notifications [None req-40826ed3-1e7d-445b-a831-f58d3d0c3851 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c89f4ec7766845f8bcb72cf86a37c1ba'} {{(pid=87934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:50:25.651192 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a973dd02-e0cd-407c-8e46-64085ddee357 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:50:25.653801 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a973dd02-e0cd-407c-8e46-64085ddee357 admin admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:50:25.671716 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 1020/2080] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Sep 13 19:50:25 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 13 19:50:25.671841 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.notifications [None req-40826ed3-1e7d-445b-a831-f58d3d0c3851 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c89f4ec7766845f8bcb72cf86a37c1ba'} {{(pid=87934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:50:25.673051 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a973dd02-e0cd-407c-8e46-64085ddee357 admin admin] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:50:25.675836 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.fernet_utils [None req-a973dd02-e0cd-407c-8e46-64085ddee357 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:50:25.694175 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a973dd02-e0cd-407c-8e46-64085ddee357 admin admin] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:50:25.697807 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 1061/2081] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Sep 13 19:50:25 2022] DELETE /identity/v3/users/c89f4ec7766845f8bcb72cf86a37c1ba => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 19:50:25.699337 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f1173a-de2d-4ac6-bb1a-952077b022b5 None None] REQUEST_METHOD: `POST` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:50:25.701726 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f1173a-de2d-4ac6-bb1a-952077b022b5 None None] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:50:25.701726 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f1173a-de2d-4ac6-bb1a-952077b022b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:50:25.731629 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.auth.core [None req-73f1173a-de2d-4ac6-bb1a-952077b022b5 None None] MFA Rules not processed for user `7b0aed92d02344acb92a0e4aa67c3068`. Rule list: `[]` (Enabled: `True`). {{(pid=87934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:50:25.733626 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.fernet_utils [None req-73f1173a-de2d-4ac6-bb1a-952077b022b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:50:25.807490 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0832e6e7-7113-400f-86f6-16eb9dc5ce63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:50:25.808183 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0832e6e7-7113-400f-86f6-16eb9dc5ce63 admin admin] REQUEST_METHOD: `PUT` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:50:25.808667 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0832e6e7-7113-400f-86f6-16eb9dc5ce63 admin admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:50:25.808854 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0832e6e7-7113-400f-86f6-16eb9dc5ce63 admin admin] PATH_INFO: `/v3/projects/19067d9171164b2fb7690bb1dbfa2bac/users/57fa5caec8f646dfbdaadb2da92e487f/roles/a259191f6d0e46fabd9f34536bb28747` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:50:25.811951 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 1062/2082] 10.222.0.25 () {58 vars in 958 bytes} [Tue Sep 13 19:50:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 19:50:25.821741 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f1173a-de2d-4ac6-bb1a-952077b022b5 None None] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:50:25.823122 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.fernet_utils [None req-73f1173a-de2d-4ac6-bb1a-952077b022b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:50:25.833888 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0832e6e7-7113-400f-86f6-16eb9dc5ce63 admin admin] RBAC: Authorizing `identity:create_grant(project_id=19067d9171164b2fb7690bb1dbfa2bac, user_id=57fa5caec8f646dfbdaadb2da92e487f, role_id=a259191f6d0e46fabd9f34536bb28747)` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:50:25.837239 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0832e6e7-7113-400f-86f6-16eb9dc5ce63 admin admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:50:25.852740 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 1021/2083] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Sep 13 19:50:25 2022] PUT /identity/v3/projects/19067d9171164b2fb7690bb1dbfa2bac/users/57fa5caec8f646dfbdaadb2da92e487f/roles/a259191f6d0e46fabd9f34536bb28747 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 19:50:25.866877 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG dbcounter [-] [87934] Writing DB stats keystone:INSERT=3,keystone:DELETE=11,keystone:SELECT=86 {{(pid=87934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:50:25.867060 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c294c4-b226-4bef-acf9-c3e22edacb87 None None] REQUEST_METHOD: `POST` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:50:25.867393 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c294c4-b226-4bef-acf9-c3e22edacb87 None None] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:50:25.867665 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c294c4-b226-4bef-acf9-c3e22edacb87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:50:25.890925 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f1173a-de2d-4ac6-bb1a-952077b022b5 None None] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:50:25.904386 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.auth.core [None req-c0c294c4-b226-4bef-acf9-c3e22edacb87 None None] MFA Rules not processed for user `57fa5caec8f646dfbdaadb2da92e487f`. Rule list: `[]` (Enabled: `True`). {{(pid=87935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:50:25.905587 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.fernet_utils [None req-c0c294c4-b226-4bef-acf9-c3e22edacb87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:50:25.958785 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f2ee38-70eb-47d8-a6c1-3e234259b92e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1196a96e4a404f559600b69f929ea9da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a10a4268f3c4cb29f4e00c292e2df62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:50:25.959467 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f2ee38-70eb-47d8-a6c1-3e234259b92e service neutron] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:50:25.959693 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f2ee38-70eb-47d8-a6c1-3e234259b92e service neutron] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:50:25.959964 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f2ee38-70eb-47d8-a6c1-3e234259b92e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:50:25.985356 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 1022/2084] 10.222.0.25 () {58 vars in 958 bytes} [Tue Sep 13 19:50:25 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 19:50:25.991068 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c294c4-b226-4bef-acf9-c3e22edacb87 None None] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:50:26.026462 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f2ee38-70eb-47d8-a6c1-3e234259b92e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:50:26.027905 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f2ee38-70eb-47d8-a6c1-3e234259b92e service neutron] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:50:26.038397 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 1063/2085] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Sep 13 19:50:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 217 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 13 19:50:26.061445 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c294c4-b226-4bef-acf9-c3e22edacb87 None None] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:50:26.066248 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2565d3b1-b2e6-4cca-903e-939b9e2fd3b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:50:26.066860 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2565d3b1-b2e6-4cca-903e-939b9e2fd3b8 admin admin] REQUEST_METHOD: `POST` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:50:26.067192 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2565d3b1-b2e6-4cca-903e-939b9e2fd3b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:50:26.067459 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2565d3b1-b2e6-4cca-903e-939b9e2fd3b8 admin admin] PATH_INFO: `/v3/projects` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:50:26.068096 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2565d3b1-b2e6-4cca-903e-939b9e2fd3b8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:50:26.070122 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2565d3b1-b2e6-4cca-903e-939b9e2fd3b8 admin admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:50:26.076826 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG dbcounter [-] [87935] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:50:26.111538 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 1023/2086] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Sep 13 19:50:25 2022] POST /identity/v3/projects => generated 375 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 13 19:50:26.116029 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f2ee38-70eb-47d8-a6c1-3e234259b92e service neutron] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:50:26.126094 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f2ee38-70eb-47d8-a6c1-3e234259b92e service neutron] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:50:26.201786 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdaef5a1-b0af-40d8-b1b9-6b268dc902dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:50:26.202520 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdaef5a1-b0af-40d8-b1b9-6b268dc902dd admin admin] REQUEST_METHOD: `POST` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:50:26.202929 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdaef5a1-b0af-40d8-b1b9-6b268dc902dd admin admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:50:26.203702 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdaef5a1-b0af-40d8-b1b9-6b268dc902dd admin admin] PATH_INFO: `/v3/users` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:50:26.204644 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdaef5a1-b0af-40d8-b1b9-6b268dc902dd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:50:26.207425 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdaef5a1-b0af-40d8-b1b9-6b268dc902dd admin admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:50:26.237105 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 1064/2087] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Sep 13 19:50:26 2022] POST /identity/v3/users => generated 288 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 19:50:26.239700 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2565d3b1-b2e6-4cca-903e-939b9e2fd3b8 admin admin] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:50:26.255631 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2565d3b1-b2e6-4cca-903e-939b9e2fd3b8 admin admin] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:50:26.265400 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84a811a-48fb-4a24-b8cc-0e321364a88a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:50:26.266097 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84a811a-48fb-4a24-b8cc-0e321364a88a admin admin] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:50:26.266702 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84a811a-48fb-4a24-b8cc-0e321364a88a admin admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:50:26.266702 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84a811a-48fb-4a24-b8cc-0e321364a88a admin admin] PATH_INFO: `/v3/roles` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:50:26.268057 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d84a811a-48fb-4a24-b8cc-0e321364a88a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:50:26.269920 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d84a811a-48fb-4a24-b8cc-0e321364a88a admin admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:50:26.284857 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 1024/2088] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Sep 13 19:50:26 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 19:50:26.288977 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdaef5a1-b0af-40d8-b1b9-6b268dc902dd admin admin] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:50:26.301536 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdaef5a1-b0af-40d8-b1b9-6b268dc902dd admin admin] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:50:26.307399 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d1c1d7-d600-4dac-80e3-02d207534abe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:50:26.308190 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d1c1d7-d600-4dac-80e3-02d207534abe admin admin] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:50:26.308603 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d1c1d7-d600-4dac-80e3-02d207534abe admin admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:50:26.308947 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d1c1d7-d600-4dac-80e3-02d207534abe admin admin] PATH_INFO: `/v3/roles` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:50:26.309668 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d1c1d7-d600-4dac-80e3-02d207534abe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:50:26.311339 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d1c1d7-d600-4dac-80e3-02d207534abe admin admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:50:26.322932 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 1065/2089] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Sep 13 19:50:26 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 19:50:26.326976 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84a811a-48fb-4a24-b8cc-0e321364a88a admin admin] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:50:26.339553 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84a811a-48fb-4a24-b8cc-0e321364a88a admin admin] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:50:26.345970 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba13403-ff22-4f95-9bb7-ccafede8628c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:50:26.347106 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba13403-ff22-4f95-9bb7-ccafede8628c admin admin] REQUEST_METHOD: `PUT` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:50:26.347549 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba13403-ff22-4f95-9bb7-ccafede8628c admin admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:50:26.348274 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba13403-ff22-4f95-9bb7-ccafede8628c admin admin] PATH_INFO: `/v3/projects/508a231414b34c75bfd16ddd0af467f6/users/92ed33ede06b46928fd0d7631db7c602/roles/a259191f6d0e46fabd9f34536bb28747` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:50:26.364687 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d1c1d7-d600-4dac-80e3-02d207534abe admin admin] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:50:26.366845 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.fernet_utils [None req-d1d1c1d7-d600-4dac-80e3-02d207534abe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:50:26.367352 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba13403-ff22-4f95-9bb7-ccafede8628c admin admin] RBAC: Authorizing `identity:create_grant(project_id=508a231414b34c75bfd16ddd0af467f6, user_id=92ed33ede06b46928fd0d7631db7c602, role_id=a259191f6d0e46fabd9f34536bb28747)` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:50:26.370123 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba13403-ff22-4f95-9bb7-ccafede8628c admin admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:50:26.381800 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d1c1d7-d600-4dac-80e3-02d207534abe admin admin] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:50:26.387412 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50f461b-b549-4f97-93e8-73986a8b3b96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:50:26.388307 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50f461b-b549-4f97-93e8-73986a8b3b96 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:50:26.388589 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50f461b-b549-4f97-93e8-73986a8b3b96 admin admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:50:26.388868 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50f461b-b549-4f97-93e8-73986a8b3b96 admin admin] PATH_INFO: `/v3/projects/1916268dcb0243659bd3d66b69936960` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:50:26.389987 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b50f461b-b549-4f97-93e8-73986a8b3b96 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1916268dcb0243659bd3d66b69936960)` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:50:26.391956 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b50f461b-b549-4f97-93e8-73986a8b3b96 admin admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:50:26.403174 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 1025/2090] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Sep 13 19:50:26 2022] PUT /identity/v3/projects/508a231414b34c75bfd16ddd0af467f6/users/92ed33ede06b46928fd0d7631db7c602/roles/a259191f6d0e46fabd9f34536bb28747 => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 19:50:26.405225 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7f8c2c-5810-4ea9-8221-b257d5d8f7d0 None None] REQUEST_METHOD: `POST` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:50:26.405508 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7f8c2c-5810-4ea9-8221-b257d5d8f7d0 None None] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:50:26.405775 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7f8c2c-5810-4ea9-8221-b257d5d8f7d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:50:26.441424 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.auth.core [None req-8d7f8c2c-5810-4ea9-8221-b257d5d8f7d0 None None] MFA Rules not processed for user `92ed33ede06b46928fd0d7631db7c602`. Rule list: `[]` (Enabled: `True`). {{(pid=87935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:50:26.442674 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.fernet_utils [None req-8d7f8c2c-5810-4ea9-8221-b257d5d8f7d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:50:26.444475 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG dbcounter [-] [87934] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:50:26.490834 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.notifications [None req-b50f461b-b549-4f97-93e8-73986a8b3b96 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1916268dcb0243659bd3d66b69936960', 'request_id': 'req-b50f461b-b549-4f97-93e8-73986a8b3b96'} {{(pid=87934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:50:26.499735 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.notifications [None req-b50f461b-b549-4f97-93e8-73986a8b3b96 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1916268dcb0243659bd3d66b69936960', 'request_id': 'req-b50f461b-b549-4f97-93e8-73986a8b3b96'} {{(pid=87934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:50:26.506587 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.notifications [None req-b50f461b-b549-4f97-93e8-73986a8b3b96 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1916268dcb0243659bd3d66b69936960', 'request_id': 'req-b50f461b-b549-4f97-93e8-73986a8b3b96'} {{(pid=87934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:50:26.518945 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 1026/2091] 10.222.0.25 () {58 vars in 958 bytes} [Tue Sep 13 19:50:26 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 19:50:26.523930 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.notifications [None req-b50f461b-b549-4f97-93e8-73986a8b3b96 admin admin] The token cache is being invalidate because project 1916268dcb0243659bd3d66b69936960 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87934) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 19:50:26.524118 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7f8c2c-5810-4ea9-8221-b257d5d8f7d0 None None] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:50:26.524565 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.notifications [None req-b50f461b-b549-4f97-93e8-73986a8b3b96 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:50:26.525369 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.notifications [None req-b50f461b-b549-4f97-93e8-73986a8b3b96 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:50:26.527002 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 1066/2092] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Sep 13 19:50:26 2022] DELETE /identity/v3/projects/1916268dcb0243659bd3d66b69936960 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 19:50:26.530991 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50f461b-b549-4f97-93e8-73986a8b3b96 admin admin] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:50:26.532454 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.fernet_utils [None req-b50f461b-b549-4f97-93e8-73986a8b3b96 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:50:26.603704 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7f8c2c-5810-4ea9-8221-b257d5d8f7d0 None None] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:50:26.608911 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8808f4-a889-40af-8385-c775cac06492 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:50:26.609552 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8808f4-a889-40af-8385-c775cac06492 admin admin] REQUEST_METHOD: `POST` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:50:26.609871 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8808f4-a889-40af-8385-c775cac06492 admin admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:50:26.610358 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8808f4-a889-40af-8385-c775cac06492 admin admin] PATH_INFO: `/v3/projects` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:50:26.611277 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50f461b-b549-4f97-93e8-73986a8b3b96 admin admin] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:50:26.611685 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b8808f4-a889-40af-8385-c775cac06492 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:50:26.613740 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b8808f4-a889-40af-8385-c775cac06492 admin admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:50:26.616450 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5a4bcd-f6ba-4311-95fb-a5b7c2706de8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:50:26.617084 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5a4bcd-f6ba-4311-95fb-a5b7c2706de8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:50:26.617365 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5a4bcd-f6ba-4311-95fb-a5b7c2706de8 admin admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:50:26.617639 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5a4bcd-f6ba-4311-95fb-a5b7c2706de8 admin admin] PATH_INFO: `/v3/users/82ba73ca1ab4439bbe2c06aef05c4284` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:50:26.618948 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac5a4bcd-f6ba-4311-95fb-a5b7c2706de8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=82ba73ca1ab4439bbe2c06aef05c4284)` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:50:26.621414 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac5a4bcd-f6ba-4311-95fb-a5b7c2706de8 admin admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:50:26.643794 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 1027/2093] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Sep 13 19:50:26 2022] POST /identity/v3/projects => generated 375 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 13 19:50:26.649282 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8808f4-a889-40af-8385-c775cac06492 admin admin] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:50:26.651175 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.fernet_utils [None req-5b8808f4-a889-40af-8385-c775cac06492 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:50:26.681660 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.notifications [None req-ac5a4bcd-f6ba-4311-95fb-a5b7c2706de8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '82ba73ca1ab4439bbe2c06aef05c4284'} {{(pid=87934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:50:26.682640 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.notifications [None req-ac5a4bcd-f6ba-4311-95fb-a5b7c2706de8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '82ba73ca1ab4439bbe2c06aef05c4284'} {{(pid=87934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:50:26.683283 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.notifications [None req-ac5a4bcd-f6ba-4311-95fb-a5b7c2706de8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '82ba73ca1ab4439bbe2c06aef05c4284'} {{(pid=87934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:50:26.686933 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG dbcounter [-] [87935] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:50:26.696446 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.notifications [None req-ac5a4bcd-f6ba-4311-95fb-a5b7c2706de8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '82ba73ca1ab4439bbe2c06aef05c4284'} {{(pid=87934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:50:26.714096 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.notifications [None req-ac5a4bcd-f6ba-4311-95fb-a5b7c2706de8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '82ba73ca1ab4439bbe2c06aef05c4284'} {{(pid=87934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:50:26.731010 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 1067/2094] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Sep 13 19:50:26 2022] DELETE /identity/v3/users/82ba73ca1ab4439bbe2c06aef05c4284 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 19:50:26.738370 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8808f4-a889-40af-8385-c775cac06492 admin admin] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:50:26.813319 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe2a568-37e8-47f3-a746-163038d0b89b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:50:26.813762 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe2a568-37e8-47f3-a746-163038d0b89b admin admin] REQUEST_METHOD: `POST` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:50:26.818566 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe2a568-37e8-47f3-a746-163038d0b89b admin admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:50:26.818566 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe2a568-37e8-47f3-a746-163038d0b89b admin admin] PATH_INFO: `/v3/users` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:50:26.819396 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe2a568-37e8-47f3-a746-163038d0b89b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:50:26.821438 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe2a568-37e8-47f3-a746-163038d0b89b admin admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:50:26.858958 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 1028/2095] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Sep 13 19:50:26 2022] POST /identity/v3/users => generated 294 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 19:50:26.863481 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5a4bcd-f6ba-4311-95fb-a5b7c2706de8 admin admin] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:50:26.865135 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.fernet_utils [None req-ac5a4bcd-f6ba-4311-95fb-a5b7c2706de8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:50:26.888325 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5a4bcd-f6ba-4311-95fb-a5b7c2706de8 admin admin] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:50:26.895005 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c1c3b3-90f1-4b25-8a94-c2d2fa413426 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:50:26.895850 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c1c3b3-90f1-4b25-8a94-c2d2fa413426 admin admin] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:50:26.895964 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c1c3b3-90f1-4b25-8a94-c2d2fa413426 admin admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:50:26.896163 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c1c3b3-90f1-4b25-8a94-c2d2fa413426 admin admin] PATH_INFO: `/v3/roles` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:50:26.896839 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c1c3b3-90f1-4b25-8a94-c2d2fa413426 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:50:26.898440 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c1c3b3-90f1-4b25-8a94-c2d2fa413426 admin admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:50:26.912529 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 1068/2096] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Sep 13 19:50:26 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 13 19:50:26.915972 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe2a568-37e8-47f3-a746-163038d0b89b admin admin] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:50:26.927107 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe2a568-37e8-47f3-a746-163038d0b89b admin admin] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:50:26.931995 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0926a784-2f83-4ce2-b98c-8a09691c1062 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:50:26.932712 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0926a784-2f83-4ce2-b98c-8a09691c1062 admin admin] REQUEST_METHOD: `PUT` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:50:26.932991 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0926a784-2f83-4ce2-b98c-8a09691c1062 admin admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:50:26.933264 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0926a784-2f83-4ce2-b98c-8a09691c1062 admin admin] PATH_INFO: `/v3/projects/57d725109fc34f7a80d36413b360330e/users/65c3cfcb48044bc3a7578d47f1829d05/roles/6ca1d4427ff64e0a9d25d96cfb1445f6` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:50:26.956172 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0926a784-2f83-4ce2-b98c-8a09691c1062 admin admin] RBAC: Authorizing `identity:create_grant(project_id=57d725109fc34f7a80d36413b360330e, user_id=65c3cfcb48044bc3a7578d47f1829d05, role_id=6ca1d4427ff64e0a9d25d96cfb1445f6)` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:50:26.961756 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0926a784-2f83-4ce2-b98c-8a09691c1062 admin admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:50:26.994679 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 1029/2097] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Sep 13 19:50:26 2022] PUT /identity/v3/projects/57d725109fc34f7a80d36413b360330e/users/65c3cfcb48044bc3a7578d47f1829d05/roles/6ca1d4427ff64e0a9d25d96cfb1445f6 => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 19:50:26.998877 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c1c3b3-90f1-4b25-8a94-c2d2fa413426 admin admin] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:50:27.017041 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c1c3b3-90f1-4b25-8a94-c2d2fa413426 admin admin] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:50:27.037144 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG dbcounter [-] [87934] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=87934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:50:27.101521 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d846f309-9248-4bc4-a17d-6cbe5999abe0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:50:27.102282 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d846f309-9248-4bc4-a17d-6cbe5999abe0 admin admin] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:50:27.103008 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d846f309-9248-4bc4-a17d-6cbe5999abe0 admin admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:50:27.103351 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d846f309-9248-4bc4-a17d-6cbe5999abe0 admin admin] PATH_INFO: `/v3/roles` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:50:27.104074 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d846f309-9248-4bc4-a17d-6cbe5999abe0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:50:27.106043 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d846f309-9248-4bc4-a17d-6cbe5999abe0 admin admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:50:27.116772 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 1069/2098] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Sep 13 19:50:26 2022] GET /identity/v3/roles => generated 1420 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 19:50:27.120939 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0926a784-2f83-4ce2-b98c-8a09691c1062 admin admin] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:50:27.132971 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0926a784-2f83-4ce2-b98c-8a09691c1062 admin admin] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:50:27.138877 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7faa7c3-f263-44ec-94fd-ba1027aea990 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:50:27.139771 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7faa7c3-f263-44ec-94fd-ba1027aea990 admin admin] REQUEST_METHOD: `PUT` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:50:27.140020 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7faa7c3-f263-44ec-94fd-ba1027aea990 admin admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:50:27.140328 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7faa7c3-f263-44ec-94fd-ba1027aea990 admin admin] PATH_INFO: `/v3/projects/57d725109fc34f7a80d36413b360330e/users/65c3cfcb48044bc3a7578d47f1829d05/roles/6ca1d4427ff64e0a9d25d96cfb1445f6` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:50:27.143337 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7faa7c3-f263-44ec-94fd-ba1027aea990 admin admin] RBAC: Authorizing `identity:create_grant(project_id=57d725109fc34f7a80d36413b360330e, user_id=65c3cfcb48044bc3a7578d47f1829d05, role_id=6ca1d4427ff64e0a9d25d96cfb1445f6)` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:50:27.145458 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7faa7c3-f263-44ec-94fd-ba1027aea990 admin admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:50:27.158508 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 1030/2099] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Sep 13 19:50:27 2022] PUT /identity/v3/projects/57d725109fc34f7a80d36413b360330e/users/65c3cfcb48044bc3a7578d47f1829d05/roles/6ca1d4427ff64e0a9d25d96cfb1445f6 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 19:50:27.169491 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2c9357-44a6-4a42-b2d3-e8d4629d313e None None] REQUEST_METHOD: `POST` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:50:27.169659 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2c9357-44a6-4a42-b2d3-e8d4629d313e None None] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:50:27.169992 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2c9357-44a6-4a42-b2d3-e8d4629d313e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:50:27.177475 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7faa7c3-f263-44ec-94fd-ba1027aea990 admin admin] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:50:27.179873 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.fernet_utils [None req-b7faa7c3-f263-44ec-94fd-ba1027aea990 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:50:27.204632 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.auth.core [None req-aa2c9357-44a6-4a42-b2d3-e8d4629d313e None None] MFA Rules not processed for user `65c3cfcb48044bc3a7578d47f1829d05`. Rule list: `[]` (Enabled: `True`). {{(pid=87934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:50:27.205558 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.fernet_utils [None req-aa2c9357-44a6-4a42-b2d3-e8d4629d313e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:50:27.279012 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7faa7c3-f263-44ec-94fd-ba1027aea990 admin admin] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:50:27.285221 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adbed65b-c252-4c92-b55b-26cbeb520aad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:50:27.286084 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbed65b-c252-4c92-b55b-26cbeb520aad admin admin] REQUEST_METHOD: `DELETE` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:50:27.286368 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbed65b-c252-4c92-b55b-26cbeb520aad admin admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:50:27.286653 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbed65b-c252-4c92-b55b-26cbeb520aad admin admin] PATH_INFO: `/v3/projects/94d5a9258d854e4eb7ad9db3c773b595` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:50:27.287972 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adbed65b-c252-4c92-b55b-26cbeb520aad admin admin] RBAC: Authorizing `identity:delete_project(project_id=94d5a9258d854e4eb7ad9db3c773b595)` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:50:27.289988 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adbed65b-c252-4c92-b55b-26cbeb520aad admin admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:50:27.301233 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 1070/2100] 10.222.0.25 () {58 vars in 958 bytes} [Tue Sep 13 19:50:27 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 19:50:27.312590 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2c9357-44a6-4a42-b2d3-e8d4629d313e None None] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:50:27.314377 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.fernet_utils [None req-aa2c9357-44a6-4a42-b2d3-e8d4629d313e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:50:27.336142 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG dbcounter [-] [87935] Writing DB stats keystone:SELECT=93,keystone:INSERT=5,keystone:DELETE=2 {{(pid=87935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:50:27.356258 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.notifications [None req-adbed65b-c252-4c92-b55b-26cbeb520aad admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '94d5a9258d854e4eb7ad9db3c773b595', 'request_id': 'req-adbed65b-c252-4c92-b55b-26cbeb520aad'} {{(pid=87935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:50:27.364486 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.notifications [None req-adbed65b-c252-4c92-b55b-26cbeb520aad admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '94d5a9258d854e4eb7ad9db3c773b595', 'request_id': 'req-adbed65b-c252-4c92-b55b-26cbeb520aad'} {{(pid=87935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:50:27.373314 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.notifications [None req-adbed65b-c252-4c92-b55b-26cbeb520aad admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '94d5a9258d854e4eb7ad9db3c773b595', 'request_id': 'req-adbed65b-c252-4c92-b55b-26cbeb520aad'} {{(pid=87935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:50:27.380772 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2c9357-44a6-4a42-b2d3-e8d4629d313e None None] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:50:27.387203 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.notifications [None req-adbed65b-c252-4c92-b55b-26cbeb520aad admin admin] The token cache is being invalidate because project 94d5a9258d854e4eb7ad9db3c773b595 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87935) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 19:50:27.387464 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.notifications [None req-adbed65b-c252-4c92-b55b-26cbeb520aad admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:50:27.388172 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.notifications [None req-adbed65b-c252-4c92-b55b-26cbeb520aad admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:50:27.390063 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 1031/2101] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Sep 13 19:50:27 2022] DELETE /identity/v3/projects/94d5a9258d854e4eb7ad9db3c773b595 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 19:50:27.395177 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd3c041-9ed4-45de-96af-3fe11ef10be2 None None] REQUEST_METHOD: `POST` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:50:27.395467 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd3c041-9ed4-45de-96af-3fe11ef10be2 None None] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:50:27.396152 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd3c041-9ed4-45de-96af-3fe11ef10be2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:50:27.419572 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.auth.core [None req-1dd3c041-9ed4-45de-96af-3fe11ef10be2 None None] MFA Rules not processed for user `7b0aed92d02344acb92a0e4aa67c3068`. Rule list: `[]` (Enabled: `True`). {{(pid=87935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:50:27.422110 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.fernet_utils [None req-1dd3c041-9ed4-45de-96af-3fe11ef10be2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:50:27.433124 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG dbcounter [-] [87934] Writing DB stats keystone:SELECT=100 {{(pid=87934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:50:27.439731 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea20050-c6a3-4e11-9ffc-8f9b3eda7598 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cbb50c88b794a7f9f26844effde7d63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a10a4268f3c4cb29f4e00c292e2df62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:50:27.440695 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea20050-c6a3-4e11-9ffc-8f9b3eda7598 service cinder] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:50:27.440899 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea20050-c6a3-4e11-9ffc-8f9b3eda7598 service cinder] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:50:27.441153 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea20050-c6a3-4e11-9ffc-8f9b3eda7598 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:50:27.443090 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.fernet_utils [None req-6ea20050-c6a3-4e11-9ffc-8f9b3eda7598 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:50:27.492989 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 1032/2102] 10.222.0.25 () {58 vars in 958 bytes} [Tue Sep 13 19:50:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 19:50:27.502618 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90827c6-1b54-472b-8e75-1004169dae6b None None] REQUEST_METHOD: `POST` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:50:27.503171 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90827c6-1b54-472b-8e75-1004169dae6b None None] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:50:27.503462 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90827c6-1b54-472b-8e75-1004169dae6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:50:27.509434 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea20050-c6a3-4e11-9ffc-8f9b3eda7598 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:50:27.510896 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea20050-c6a3-4e11-9ffc-8f9b3eda7598 service cinder] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:50:27.523702 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 1071/2103] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Sep 13 19:50:27 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 211 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 13 19:50:27.526649 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.auth.core [None req-a90827c6-1b54-472b-8e75-1004169dae6b None None] MFA Rules not processed for user `7b0aed92d02344acb92a0e4aa67c3068`. Rule list: `[]` (Enabled: `True`). {{(pid=87935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:50:27.527955 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.fernet_utils [None req-a90827c6-1b54-472b-8e75-1004169dae6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:50:27.537673 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 1033/2104] 10.222.0.25 () {58 vars in 958 bytes} [Tue Sep 13 19:50:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 19:50:27.542170 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea20050-c6a3-4e11-9ffc-8f9b3eda7598 service cinder] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:50:27.553156 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea20050-c6a3-4e11-9ffc-8f9b3eda7598 service cinder] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:50:27.559156 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4f52a9-cda6-4f11-8414-711070f3f4d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:50:27.559783 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4f52a9-cda6-4f11-8414-711070f3f4d6 admin admin] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:50:27.560061 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4f52a9-cda6-4f11-8414-711070f3f4d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:50:27.560368 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4f52a9-cda6-4f11-8414-711070f3f4d6 admin admin] PATH_INFO: `/v3/domains` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:50:27.561031 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e4f52a9-cda6-4f11-8414-711070f3f4d6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87934) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:50:27.561336 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e4f52a9-cda6-4f11-8414-711070f3f4d6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:50:27.562933 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e4f52a9-cda6-4f11-8414-711070f3f4d6 admin admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:50:27.580459 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 1072/2105] 10.222.0.25 () {58 vars in 1153 bytes} [Tue Sep 13 19:50:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:50:27.582095 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90827c6-1b54-472b-8e75-1004169dae6b None None] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:50:27.591940 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90827c6-1b54-472b-8e75-1004169dae6b None None] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:50:27.598772 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ef7c79-b60a-454b-88fc-b0aa97078dca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:50:27.599470 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ef7c79-b60a-454b-88fc-b0aa97078dca admin admin] REQUEST_METHOD: `POST` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:50:27.599756 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ef7c79-b60a-454b-88fc-b0aa97078dca admin admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:50:27.600057 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ef7c79-b60a-454b-88fc-b0aa97078dca admin admin] PATH_INFO: `/v3/projects` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:50:27.600814 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ef7c79-b60a-454b-88fc-b0aa97078dca admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:50:27.602706 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ef7c79-b60a-454b-88fc-b0aa97078dca admin admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:50:27.634307 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 1034/2106] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Sep 13 19:50:27 2022] POST /identity/v3/projects => generated 385 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 19:50:27.638355 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4f52a9-cda6-4f11-8414-711070f3f4d6 admin admin] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:50:27.649750 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4f52a9-cda6-4f11-8414-711070f3f4d6 admin admin] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:50:27.712834 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6198d7d3-0972-490b-b393-95b2874bb22e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:50:27.713509 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6198d7d3-0972-490b-b393-95b2874bb22e admin admin] REQUEST_METHOD: `POST` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:50:27.713953 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6198d7d3-0972-490b-b393-95b2874bb22e admin admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:50:27.713953 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6198d7d3-0972-490b-b393-95b2874bb22e admin admin] PATH_INFO: `/v3/users` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:50:27.714745 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6198d7d3-0972-490b-b393-95b2874bb22e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:50:27.716741 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6198d7d3-0972-490b-b393-95b2874bb22e admin admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:50:27.748023 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 1073/2107] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Sep 13 19:50:27 2022] POST /identity/v3/users => generated 293 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 19:50:27.752185 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ef7c79-b60a-454b-88fc-b0aa97078dca admin admin] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:50:27.763002 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ef7c79-b60a-454b-88fc-b0aa97078dca admin admin] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:50:27.768855 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80acd54e-dde4-4752-8f2a-70499101d576 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:50:27.769466 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80acd54e-dde4-4752-8f2a-70499101d576 admin admin] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:50:27.770297 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80acd54e-dde4-4752-8f2a-70499101d576 admin admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:50:27.770297 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80acd54e-dde4-4752-8f2a-70499101d576 admin admin] PATH_INFO: `/v3/roles` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:50:27.770653 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80acd54e-dde4-4752-8f2a-70499101d576 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:50:27.772251 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80acd54e-dde4-4752-8f2a-70499101d576 admin admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:50:27.784184 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 1035/2108] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Sep 13 19:50:27 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 19:50:27.788696 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6198d7d3-0972-490b-b393-95b2874bb22e admin admin] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:50:27.801880 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6198d7d3-0972-490b-b393-95b2874bb22e admin admin] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:50:27.808031 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52bede5-1189-4efa-a142-db2af6039596 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:50:27.808359 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52bede5-1189-4efa-a142-db2af6039596 admin admin] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:50:27.808642 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52bede5-1189-4efa-a142-db2af6039596 admin admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:50:27.808913 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52bede5-1189-4efa-a142-db2af6039596 admin admin] PATH_INFO: `/v3/roles` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:50:27.809942 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a52bede5-1189-4efa-a142-db2af6039596 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:50:27.811903 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a52bede5-1189-4efa-a142-db2af6039596 admin admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:50:27.826237 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 1074/2109] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Sep 13 19:50:27 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 19:50:27.830403 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80acd54e-dde4-4752-8f2a-70499101d576 admin admin] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:50:27.841496 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80acd54e-dde4-4752-8f2a-70499101d576 admin admin] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:50:27.848520 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28baeb03-825d-45d8-9408-36da8971785a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:50:27.849320 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28baeb03-825d-45d8-9408-36da8971785a admin admin] REQUEST_METHOD: `PUT` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:50:27.849662 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28baeb03-825d-45d8-9408-36da8971785a admin admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:50:27.850049 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28baeb03-825d-45d8-9408-36da8971785a admin admin] PATH_INFO: `/v3/projects/5dabf72a4ffa4a22ae041c9f625fb857/users/903152bfca5f47358809561c1bde873a/roles/a259191f6d0e46fabd9f34536bb28747` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:50:27.881955 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28baeb03-825d-45d8-9408-36da8971785a admin admin] RBAC: Authorizing `identity:create_grant(project_id=5dabf72a4ffa4a22ae041c9f625fb857, user_id=903152bfca5f47358809561c1bde873a, role_id=a259191f6d0e46fabd9f34536bb28747)` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:50:27.884624 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28baeb03-825d-45d8-9408-36da8971785a admin admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:50:27.900910 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 1036/2110] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Sep 13 19:50:27 2022] PUT /identity/v3/projects/5dabf72a4ffa4a22ae041c9f625fb857/users/903152bfca5f47358809561c1bde873a/roles/a259191f6d0e46fabd9f34536bb28747 => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 19:50:27.913899 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b41106e-54d5-4e56-967b-6153279486d3 None None] REQUEST_METHOD: `POST` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:50:27.914448 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b41106e-54d5-4e56-967b-6153279486d3 None None] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:50:27.914944 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b41106e-54d5-4e56-967b-6153279486d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:50:27.957884 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.auth.core [None req-4b41106e-54d5-4e56-967b-6153279486d3 None None] MFA Rules not processed for user `903152bfca5f47358809561c1bde873a`. Rule list: `[]` (Enabled: `True`). {{(pid=87934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:50:27.959549 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.fernet_utils [None req-4b41106e-54d5-4e56-967b-6153279486d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:50:28.032373 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG dbcounter [-] [87934] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:50:28.039418 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 1075/2111] 10.222.0.25 () {58 vars in 958 bytes} [Tue Sep 13 19:50:27 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 19:50:28.050386 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28baeb03-825d-45d8-9408-36da8971785a admin admin] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:50:28.052075 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.fernet_utils [None req-28baeb03-825d-45d8-9408-36da8971785a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:50:28.114298 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28baeb03-825d-45d8-9408-36da8971785a admin admin] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:50:28.118299 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6334d7-9f83-4e8f-bd0f-5bc97d471ea1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cbb50c88b794a7f9f26844effde7d63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a10a4268f3c4cb29f4e00c292e2df62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:50:28.119042 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6334d7-9f83-4e8f-bd0f-5bc97d471ea1 service cinder] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:50:28.119381 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6334d7-9f83-4e8f-bd0f-5bc97d471ea1 service cinder] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:50:28.119667 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6334d7-9f83-4e8f-bd0f-5bc97d471ea1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:50:28.132112 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG dbcounter [-] [87935] Writing DB stats keystone:SELECT=92,keystone:DELETE=5,keystone:INSERT=3 {{(pid=87935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:50:28.138267 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d6334d7-9f83-4e8f-bd0f-5bc97d471ea1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:50:28.140372 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d6334d7-9f83-4e8f-bd0f-5bc97d471ea1 service cinder] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:50:28.160593 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 1037/2112] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Sep 13 19:50:28 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 19:50:28.370413 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b41106e-54d5-4e56-967b-6153279486d3 None None] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:50:28.372656 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.fernet_utils [None req-4b41106e-54d5-4e56-967b-6153279486d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:50:28.386422 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b41106e-54d5-4e56-967b-6153279486d3 None None] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:50:28.390321 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43793bc4-042a-42fc-a395-fa27fb82e594 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cbb50c88b794a7f9f26844effde7d63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a10a4268f3c4cb29f4e00c292e2df62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:50:28.391043 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43793bc4-042a-42fc-a395-fa27fb82e594 service cinder] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:50:28.391356 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43793bc4-042a-42fc-a395-fa27fb82e594 service cinder] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:50:28.391692 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43793bc4-042a-42fc-a395-fa27fb82e594 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:50:28.394180 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.fernet_utils [None req-43793bc4-042a-42fc-a395-fa27fb82e594 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:50:28.496841 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43793bc4-042a-42fc-a395-fa27fb82e594 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:50:28.499199 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43793bc4-042a-42fc-a395-fa27fb82e594 service cinder] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:50:28.514892 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 1076/2113] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Sep 13 19:50:28 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 19:50:29.220813 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6334d7-9f83-4e8f-bd0f-5bc97d471ea1 service cinder] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:50:29.231204 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6334d7-9f83-4e8f-bd0f-5bc97d471ea1 service cinder] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:50:29.235626 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1510ecff-3e67-47f7-b785-7e5c58cc4a90 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cbb50c88b794a7f9f26844effde7d63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a10a4268f3c4cb29f4e00c292e2df62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:50:29.237174 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1510ecff-3e67-47f7-b785-7e5c58cc4a90 service cinder] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:50:29.237690 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1510ecff-3e67-47f7-b785-7e5c58cc4a90 service cinder] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:50:29.238427 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1510ecff-3e67-47f7-b785-7e5c58cc4a90 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:50:29.241334 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.fernet_utils [None req-1510ecff-3e67-47f7-b785-7e5c58cc4a90 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:50:29.343133 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1510ecff-3e67-47f7-b785-7e5c58cc4a90 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:50:29.344944 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1510ecff-3e67-47f7-b785-7e5c58cc4a90 service cinder] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:50:29.363066 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 1038/2114] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Sep 13 19:50:29 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 19:50:30.228515 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43793bc4-042a-42fc-a395-fa27fb82e594 service cinder] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:50:30.238370 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43793bc4-042a-42fc-a395-fa27fb82e594 service cinder] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:50:30.242328 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601479cc-5e1f-4bc3-aa3c-99af97123448 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cbb50c88b794a7f9f26844effde7d63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a10a4268f3c4cb29f4e00c292e2df62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:50:30.243053 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601479cc-5e1f-4bc3-aa3c-99af97123448 service cinder] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:50:30.243367 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601479cc-5e1f-4bc3-aa3c-99af97123448 service cinder] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:50:30.243630 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601479cc-5e1f-4bc3-aa3c-99af97123448 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:50:30.245369 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.fernet_utils [None req-601479cc-5e1f-4bc3-aa3c-99af97123448 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:50:30.340686 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-601479cc-5e1f-4bc3-aa3c-99af97123448 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:50:30.342321 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-601479cc-5e1f-4bc3-aa3c-99af97123448 service cinder] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:50:30.355474 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 1077/2115] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Sep 13 19:50:30 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 19:50:31.223801 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1510ecff-3e67-47f7-b785-7e5c58cc4a90 service cinder] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:50:31.294579 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1510ecff-3e67-47f7-b785-7e5c58cc4a90 service cinder] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:50:31.305836 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9a0c97-7ac9-4585-b939-edb99a5648d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:50:31.306508 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9a0c97-7ac9-4585-b939-edb99a5648d6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:50:31.306783 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9a0c97-7ac9-4585-b939-edb99a5648d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:50:31.307616 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9a0c97-7ac9-4585-b939-edb99a5648d6 admin admin] PATH_INFO: `/v3/users/903152bfca5f47358809561c1bde873a` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:50:31.308777 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f9a0c97-7ac9-4585-b939-edb99a5648d6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=903152bfca5f47358809561c1bde873a)` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:50:31.310814 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f9a0c97-7ac9-4585-b939-edb99a5648d6 admin admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:50:31.360583 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.notifications [None req-7f9a0c97-7ac9-4585-b939-edb99a5648d6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '903152bfca5f47358809561c1bde873a'} {{(pid=87935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:50:31.363706 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667ccce2-1fee-47aa-9a52-b36878e076e8 None None] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:50:31.364177 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667ccce2-1fee-47aa-9a52-b36878e076e8 None None] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:50:31.364293 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667ccce2-1fee-47aa-9a52-b36878e076e8 None None] PATH_INFO: `/` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:50:31.367443 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 1078/2116] 10.222.0.25 () {54 vars in 921 bytes} [Tue Sep 13 19:50:31 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:50:31.370844 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.notifications [None req-7f9a0c97-7ac9-4585-b939-edb99a5648d6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '903152bfca5f47358809561c1bde873a'} {{(pid=87935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:50:31.384866 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.notifications [None req-7f9a0c97-7ac9-4585-b939-edb99a5648d6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '903152bfca5f47358809561c1bde873a'} {{(pid=87935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:50:31.385537 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.notifications [None req-7f9a0c97-7ac9-4585-b939-edb99a5648d6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '903152bfca5f47358809561c1bde873a'} {{(pid=87935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:50:31.386132 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.notifications [None req-7f9a0c97-7ac9-4585-b939-edb99a5648d6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '903152bfca5f47358809561c1bde873a'} {{(pid=87935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:50:31.399135 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60867ac1-89b3-44fe-b1ff-d3f485cf6659 None None] REQUEST_METHOD: `POST` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:50:31.402047 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 1039/2117] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Sep 13 19:50:31 2022] DELETE /identity/v3/users/903152bfca5f47358809561c1bde873a => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 19:50:31.402540 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60867ac1-89b3-44fe-b1ff-d3f485cf6659 None None] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:50:31.402828 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60867ac1-89b3-44fe-b1ff-d3f485cf6659 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:50:31.403340 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d611dd-7ce3-4327-b8e8-5103e08c75c4 None None] REQUEST_METHOD: `POST` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:50:31.403668 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d611dd-7ce3-4327-b8e8-5103e08c75c4 None None] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:50:31.403942 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d611dd-7ce3-4327-b8e8-5103e08c75c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:50:31.425455 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.auth.core [None req-60867ac1-89b3-44fe-b1ff-d3f485cf6659 None None] MFA Rules not processed for user `02eb3d3173c1476cb83a72add0e878e2`. Rule list: `[]` (Enabled: `True`). {{(pid=87934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:50:31.426674 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.fernet_utils [None req-60867ac1-89b3-44fe-b1ff-d3f485cf6659 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:50:31.428063 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.auth.core [None req-76d611dd-7ce3-4327-b8e8-5103e08c75c4 None None] MFA Rules not processed for user `7b0aed92d02344acb92a0e4aa67c3068`. Rule list: `[]` (Enabled: `True`). {{(pid=87935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:50:31.429424 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.fernet_utils [None req-76d611dd-7ce3-4327-b8e8-5103e08c75c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:50:31.438449 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG dbcounter [-] [87935] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:50:31.524313 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 1040/2118] 10.222.0.25 () {58 vars in 958 bytes} [Tue Sep 13 19:50:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 19:50:31.524313 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d611dd-7ce3-4327-b8e8-5103e08c75c4 None None] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:50:31.524313 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.fernet_utils [None req-76d611dd-7ce3-4327-b8e8-5103e08c75c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:50:31.534462 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 1079/2119] 10.222.0.25 () {58 vars in 1018 bytes} [Tue Sep 13 19:50:31 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 19:50:31.536065 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60867ac1-89b3-44fe-b1ff-d3f485cf6659 None None] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:50:31.537622 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.fernet_utils [None req-60867ac1-89b3-44fe-b1ff-d3f485cf6659 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:50:31.537745 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d611dd-7ce3-4327-b8e8-5103e08c75c4 None None] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:50:31.542754 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6030651e-bbcc-496e-bf2c-a843a3dd7ee8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:50:31.543393 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6030651e-bbcc-496e-bf2c-a843a3dd7ee8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:50:31.543666 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6030651e-bbcc-496e-bf2c-a843a3dd7ee8 admin admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:50:31.544932 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6030651e-bbcc-496e-bf2c-a843a3dd7ee8 admin admin] PATH_INFO: `/v3/users/1c4a47ef1eb244ac95525df0c68e7deb` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:50:31.546162 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6030651e-bbcc-496e-bf2c-a843a3dd7ee8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1c4a47ef1eb244ac95525df0c68e7deb)` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:50:31.549499 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6030651e-bbcc-496e-bf2c-a843a3dd7ee8 admin admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:50:31.590236 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG dbcounter [-] [87934] Writing DB stats keystone:SELECT=100 {{(pid=87934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:50:31.621715 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.notifications [None req-6030651e-bbcc-496e-bf2c-a843a3dd7ee8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1c4a47ef1eb244ac95525df0c68e7deb'} {{(pid=87935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:50:31.631031 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.notifications [None req-6030651e-bbcc-496e-bf2c-a843a3dd7ee8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1c4a47ef1eb244ac95525df0c68e7deb'} {{(pid=87935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:50:31.638482 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60867ac1-89b3-44fe-b1ff-d3f485cf6659 None None] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:50:31.643792 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f680f23a-6997-41a1-b162-610d8ebff736 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1196a96e4a404f559600b69f929ea9da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a10a4268f3c4cb29f4e00c292e2df62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:50:31.644984 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f680f23a-6997-41a1-b162-610d8ebff736 service neutron] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:50:31.645585 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f680f23a-6997-41a1-b162-610d8ebff736 service neutron] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:50:31.646031 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f680f23a-6997-41a1-b162-610d8ebff736 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:50:31.655476 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.notifications [None req-6030651e-bbcc-496e-bf2c-a843a3dd7ee8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1c4a47ef1eb244ac95525df0c68e7deb'} {{(pid=87935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:50:31.656299 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.notifications [None req-6030651e-bbcc-496e-bf2c-a843a3dd7ee8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1c4a47ef1eb244ac95525df0c68e7deb'} {{(pid=87935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:50:31.657235 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.notifications [None req-6030651e-bbcc-496e-bf2c-a843a3dd7ee8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1c4a47ef1eb244ac95525df0c68e7deb'} {{(pid=87935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:50:31.661043 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f680f23a-6997-41a1-b162-610d8ebff736 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:50:31.663394 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f680f23a-6997-41a1-b162-610d8ebff736 service neutron] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:50:31.676902 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 1080/2120] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Sep 13 19:50:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 19:50:31.678820 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc72725-3d7e-4e01-aa92-eaeeb70e3c77 None None] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:50:31.679249 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc72725-3d7e-4e01-aa92-eaeeb70e3c77 None None] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:50:31.680643 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc72725-3d7e-4e01-aa92-eaeeb70e3c77 None None] PATH_INFO: `/` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:50:31.682643 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 1041/2121] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Sep 13 19:50:31 2022] DELETE /identity/v3/users/1c4a47ef1eb244ac95525df0c68e7deb => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 19:50:31.684365 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 1081/2122] 10.222.0.25 () {54 vars in 961 bytes} [Tue Sep 13 19:50:31 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:50:31.696423 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e3959f-9ceb-4720-a8b6-6da1d4425dfc None None] REQUEST_METHOD: `POST` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:50:31.696761 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e3959f-9ceb-4720-a8b6-6da1d4425dfc None None] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:50:31.696995 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e3959f-9ceb-4720-a8b6-6da1d4425dfc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:50:31.728884 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.auth.core [None req-70e3959f-9ceb-4720-a8b6-6da1d4425dfc None None] MFA Rules not processed for user `02eb3d3173c1476cb83a72add0e878e2`. Rule list: `[]` (Enabled: `True`). {{(pid=87935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:50:31.730290 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.fernet_utils [None req-70e3959f-9ceb-4720-a8b6-6da1d4425dfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:50:31.891670 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 1042/2123] 10.222.0.25 () {58 vars in 1058 bytes} [Tue Sep 13 19:50:31 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 19:50:31.892951 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc72725-3d7e-4e01-aa92-eaeeb70e3c77 None None] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:50:31.928002 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc72725-3d7e-4e01-aa92-eaeeb70e3c77 None None] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:50:31.946065 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee11702-e684-4998-963c-e61fe8bbfd13 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02eb3d3173c1476cb83a72add0e878e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a10a4268f3c4cb29f4e00c292e2df62', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:50:31.946693 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee11702-e684-4998-963c-e61fe8bbfd13 service placement] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:50:31.946976 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee11702-e684-4998-963c-e61fe8bbfd13 service placement] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:50:31.947253 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee11702-e684-4998-963c-e61fe8bbfd13 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:50:31.949364 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.fernet_utils [None req-3ee11702-e684-4998-963c-e61fe8bbfd13 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:50:31.974733 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee11702-e684-4998-963c-e61fe8bbfd13 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:50:31.976588 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee11702-e684-4998-963c-e61fe8bbfd13 service placement] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:50:32.008297 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 1082/2124] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Sep 13 19:50:31 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 19:50:32.265397 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e3959f-9ceb-4720-a8b6-6da1d4425dfc None None] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:50:32.267446 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.fernet_utils [None req-70e3959f-9ceb-4720-a8b6-6da1d4425dfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:50:32.312272 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG dbcounter [-] [87935] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:50:32.357491 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee11702-e684-4998-963c-e61fe8bbfd13 service placement] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:50:32.361117 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.fernet_utils [None req-3ee11702-e684-4998-963c-e61fe8bbfd13 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:50:32.367793 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e3959f-9ceb-4720-a8b6-6da1d4425dfc None None] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:50:32.373416 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818cb4aa-0e5b-47cd-ac43-52fc9123ee17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:50:32.374128 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818cb4aa-0e5b-47cd-ac43-52fc9123ee17 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:50:32.374628 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818cb4aa-0e5b-47cd-ac43-52fc9123ee17 admin admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:50:32.375234 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818cb4aa-0e5b-47cd-ac43-52fc9123ee17 admin admin] PATH_INFO: `/v3/projects/9ac9a2db00f74a4bbc8597b3fe1c60c2` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:50:32.377637 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-818cb4aa-0e5b-47cd-ac43-52fc9123ee17 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9ac9a2db00f74a4bbc8597b3fe1c60c2)` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:50:32.379806 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-818cb4aa-0e5b-47cd-ac43-52fc9123ee17 admin admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:50:32.390377 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee11702-e684-4998-963c-e61fe8bbfd13 service placement] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:50:32.397264 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553f5e56-dd51-4f59-9e64-cf0a1586f9bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:50:32.397898 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553f5e56-dd51-4f59-9e64-cf0a1586f9bd admin admin] REQUEST_METHOD: `DELETE` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:50:32.398180 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553f5e56-dd51-4f59-9e64-cf0a1586f9bd admin admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:50:32.398449 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553f5e56-dd51-4f59-9e64-cf0a1586f9bd admin admin] PATH_INFO: `/v3/projects/5dabf72a4ffa4a22ae041c9f625fb857` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:50:32.399593 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-553f5e56-dd51-4f59-9e64-cf0a1586f9bd admin admin] RBAC: Authorizing `identity:delete_project(project_id=5dabf72a4ffa4a22ae041c9f625fb857)` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:50:32.401813 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-553f5e56-dd51-4f59-9e64-cf0a1586f9bd admin admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:50:32.442235 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.notifications [None req-818cb4aa-0e5b-47cd-ac43-52fc9123ee17 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9ac9a2db00f74a4bbc8597b3fe1c60c2', 'request_id': 'req-818cb4aa-0e5b-47cd-ac43-52fc9123ee17'} {{(pid=87935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:50:32.449841 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.notifications [None req-818cb4aa-0e5b-47cd-ac43-52fc9123ee17 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9ac9a2db00f74a4bbc8597b3fe1c60c2', 'request_id': 'req-818cb4aa-0e5b-47cd-ac43-52fc9123ee17'} {{(pid=87935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:50:32.456656 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.notifications [None req-553f5e56-dd51-4f59-9e64-cf0a1586f9bd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5dabf72a4ffa4a22ae041c9f625fb857', 'request_id': 'req-553f5e56-dd51-4f59-9e64-cf0a1586f9bd'} {{(pid=87934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:50:32.458280 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.notifications [None req-818cb4aa-0e5b-47cd-ac43-52fc9123ee17 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9ac9a2db00f74a4bbc8597b3fe1c60c2', 'request_id': 'req-818cb4aa-0e5b-47cd-ac43-52fc9123ee17'} {{(pid=87935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:50:32.464388 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.notifications [None req-553f5e56-dd51-4f59-9e64-cf0a1586f9bd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5dabf72a4ffa4a22ae041c9f625fb857', 'request_id': 'req-553f5e56-dd51-4f59-9e64-cf0a1586f9bd'} {{(pid=87934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:50:32.469429 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.notifications [None req-818cb4aa-0e5b-47cd-ac43-52fc9123ee17 admin admin] The token cache is being invalidate because project 9ac9a2db00f74a4bbc8597b3fe1c60c2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87935) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 19:50:32.469715 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.notifications [None req-818cb4aa-0e5b-47cd-ac43-52fc9123ee17 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:50:32.470869 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.notifications [None req-553f5e56-dd51-4f59-9e64-cf0a1586f9bd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5dabf72a4ffa4a22ae041c9f625fb857', 'request_id': 'req-553f5e56-dd51-4f59-9e64-cf0a1586f9bd'} {{(pid=87934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:50:32.471180 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.notifications [None req-818cb4aa-0e5b-47cd-ac43-52fc9123ee17 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:50:32.472890 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 1043/2125] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Sep 13 19:50:32 2022] DELETE /identity/v3/projects/9ac9a2db00f74a4bbc8597b3fe1c60c2 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 19:50:32.477839 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a3aa75-a53f-48e2-ac15-80b255cafe83 None None] REQUEST_METHOD: `POST` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:50:32.478122 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a3aa75-a53f-48e2-ac15-80b255cafe83 None None] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:50:32.478828 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a3aa75-a53f-48e2-ac15-80b255cafe83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:50:32.489005 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.notifications [None req-553f5e56-dd51-4f59-9e64-cf0a1586f9bd admin admin] The token cache is being invalidate because project 5dabf72a4ffa4a22ae041c9f625fb857 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87934) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 19:50:32.489407 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.notifications [None req-553f5e56-dd51-4f59-9e64-cf0a1586f9bd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:50:32.490099 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.notifications [None req-553f5e56-dd51-4f59-9e64-cf0a1586f9bd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:50:32.491853 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 1083/2126] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Sep 13 19:50:32 2022] DELETE /identity/v3/projects/5dabf72a4ffa4a22ae041c9f625fb857 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 19:50:32.496496 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068f1296-eb9b-46ca-a96e-ee3596aac686 None None] REQUEST_METHOD: `POST` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:50:32.496829 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068f1296-eb9b-46ca-a96e-ee3596aac686 None None] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:50:32.497180 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068f1296-eb9b-46ca-a96e-ee3596aac686 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:50:32.505330 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.auth.core [None req-f1a3aa75-a53f-48e2-ac15-80b255cafe83 None None] MFA Rules not processed for user `7b0aed92d02344acb92a0e4aa67c3068`. Rule list: `[]` (Enabled: `True`). {{(pid=87935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:50:32.506637 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.fernet_utils [None req-f1a3aa75-a53f-48e2-ac15-80b255cafe83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:50:32.519322 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.auth.core [None req-068f1296-eb9b-46ca-a96e-ee3596aac686 None None] MFA Rules not processed for user `7b0aed92d02344acb92a0e4aa67c3068`. Rule list: `[]` (Enabled: `True`). {{(pid=87934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:50:32.520629 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.fernet_utils [None req-068f1296-eb9b-46ca-a96e-ee3596aac686 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:50:32.574806 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 1044/2127] 10.222.0.25 () {58 vars in 958 bytes} [Tue Sep 13 19:50:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 19:50:32.582939 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61358e82-fc6e-482d-ac8a-699111d9997a None None] REQUEST_METHOD: `POST` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:50:32.583126 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61358e82-fc6e-482d-ac8a-699111d9997a None None] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:50:32.583413 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61358e82-fc6e-482d-ac8a-699111d9997a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:50:32.586400 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 1084/2128] 10.222.0.25 () {58 vars in 958 bytes} [Tue Sep 13 19:50:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 19:50:32.594753 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f6c3ca-81ef-47b6-8299-fefe27520ff7 None None] REQUEST_METHOD: `POST` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:50:32.595569 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f6c3ca-81ef-47b6-8299-fefe27520ff7 None None] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:50:32.595853 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f6c3ca-81ef-47b6-8299-fefe27520ff7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:50:32.607134 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.auth.core [None req-61358e82-fc6e-482d-ac8a-699111d9997a None None] MFA Rules not processed for user `7b0aed92d02344acb92a0e4aa67c3068`. Rule list: `[]` (Enabled: `True`). {{(pid=87935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:50:32.608670 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.fernet_utils [None req-61358e82-fc6e-482d-ac8a-699111d9997a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:50:32.616891 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 1045/2129] 10.222.0.25 () {58 vars in 958 bytes} [Tue Sep 13 19:50:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 19:50:32.617030 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.auth.core [None req-c9f6c3ca-81ef-47b6-8299-fefe27520ff7 None None] MFA Rules not processed for user `7b0aed92d02344acb92a0e4aa67c3068`. Rule list: `[]` (Enabled: `True`). {{(pid=87934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:50:32.618299 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.fernet_utils [None req-c9f6c3ca-81ef-47b6-8299-fefe27520ff7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:50:32.621102 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61358e82-fc6e-482d-ac8a-699111d9997a None None] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:50:32.627313 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 1085/2130] 10.222.0.25 () {58 vars in 958 bytes} [Tue Sep 13 19:50:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 19:50:32.630816 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f6c3ca-81ef-47b6-8299-fefe27520ff7 None None] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:50:32.631153 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61358e82-fc6e-482d-ac8a-699111d9997a None None] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:50:32.635820 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d06095-9b6f-42ef-b41f-0f68b9c92c0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:50:32.636453 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d06095-9b6f-42ef-b41f-0f68b9c92c0f admin admin] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:50:32.636767 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d06095-9b6f-42ef-b41f-0f68b9c92c0f admin admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:50:32.637061 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d06095-9b6f-42ef-b41f-0f68b9c92c0f admin admin] PATH_INFO: `/v3/domains` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:50:32.637746 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d06095-9b6f-42ef-b41f-0f68b9c92c0f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87935) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:50:32.638047 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d06095-9b6f-42ef-b41f-0f68b9c92c0f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:50:32.639655 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d06095-9b6f-42ef-b41f-0f68b9c92c0f admin admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:50:32.640553 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f6c3ca-81ef-47b6-8299-fefe27520ff7 None None] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:50:32.646432 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e950b82-eb87-4fb4-abf5-a5361bff4746 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:50:32.647026 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e950b82-eb87-4fb4-abf5-a5361bff4746 admin admin] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:50:32.647312 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e950b82-eb87-4fb4-abf5-a5361bff4746 admin admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:50:32.647578 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e950b82-eb87-4fb4-abf5-a5361bff4746 admin admin] PATH_INFO: `/v3/domains` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:50:32.648236 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e950b82-eb87-4fb4-abf5-a5361bff4746 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87934) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:50:32.648543 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e950b82-eb87-4fb4-abf5-a5361bff4746 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:50:32.650115 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e950b82-eb87-4fb4-abf5-a5361bff4746 admin admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:50:32.653313 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 1046/2131] 10.222.0.25 () {58 vars in 1153 bytes} [Tue Sep 13 19:50:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:50:32.657914 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d06095-9b6f-42ef-b41f-0f68b9c92c0f admin admin] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:50:32.665754 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 1086/2132] 10.222.0.25 () {58 vars in 1153 bytes} [Tue Sep 13 19:50:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 19:50:32.666796 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e950b82-eb87-4fb4-abf5-a5361bff4746 admin admin] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:50:32.667915 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d06095-9b6f-42ef-b41f-0f68b9c92c0f admin admin] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:50:32.672542 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb84277-4c4d-4d64-85a5-bd7ea0d33f7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:50:32.673570 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb84277-4c4d-4d64-85a5-bd7ea0d33f7a admin admin] REQUEST_METHOD: `POST` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:50:32.673847 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb84277-4c4d-4d64-85a5-bd7ea0d33f7a admin admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:50:32.674112 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb84277-4c4d-4d64-85a5-bd7ea0d33f7a admin admin] PATH_INFO: `/v3/projects` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:50:32.674745 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb84277-4c4d-4d64-85a5-bd7ea0d33f7a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:50:32.676674 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e950b82-eb87-4fb4-abf5-a5361bff4746 admin admin] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:50:32.677036 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb84277-4c4d-4d64-85a5-bd7ea0d33f7a admin admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:50:32.681198 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d9efa5-fbbe-4de1-bcc2-a99884d18945 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:50:32.681776 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d9efa5-fbbe-4de1-bcc2-a99884d18945 admin admin] REQUEST_METHOD: `POST` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:50:32.682048 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d9efa5-fbbe-4de1-bcc2-a99884d18945 admin admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:50:32.682322 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d9efa5-fbbe-4de1-bcc2-a99884d18945 admin admin] PATH_INFO: `/v3/projects` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:50:32.682936 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d9efa5-fbbe-4de1-bcc2-a99884d18945 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:50:32.684873 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d9efa5-fbbe-4de1-bcc2-a99884d18945 admin admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:50:32.700704 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG dbcounter [-] [87934] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=87934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:50:32.707460 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 1047/2133] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Sep 13 19:50:32 2022] POST /identity/v3/projects => generated 363 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 13 19:50:32.712047 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb84277-4c4d-4d64-85a5-bd7ea0d33f7a admin admin] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:50:32.718800 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 1087/2134] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Sep 13 19:50:32 2022] POST /identity/v3/projects => generated 371 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 19:50:32.719821 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d9efa5-fbbe-4de1-bcc2-a99884d18945 admin admin] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:50:32.724932 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG dbcounter [-] [87935] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=87935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:50:32.780641 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb84277-4c4d-4d64-85a5-bd7ea0d33f7a admin admin] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:50:32.786408 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d9efa5-fbbe-4de1-bcc2-a99884d18945 admin admin] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:50:32.786825 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14beefab-5c4a-42e2-a356-6df680b1f61e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:50:32.787542 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14beefab-5c4a-42e2-a356-6df680b1f61e admin admin] REQUEST_METHOD: `POST` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:50:32.787826 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14beefab-5c4a-42e2-a356-6df680b1f61e admin admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:50:32.788092 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14beefab-5c4a-42e2-a356-6df680b1f61e admin admin] PATH_INFO: `/v3/users` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:50:32.788743 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14beefab-5c4a-42e2-a356-6df680b1f61e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:50:32.790798 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14beefab-5c4a-42e2-a356-6df680b1f61e admin admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:50:32.791249 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844f2a5c-b0d6-46b5-9cbc-430c8e73e136 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:50:32.791849 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844f2a5c-b0d6-46b5-9cbc-430c8e73e136 admin admin] REQUEST_METHOD: `POST` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:50:32.792158 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844f2a5c-b0d6-46b5-9cbc-430c8e73e136 admin admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:50:32.792565 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844f2a5c-b0d6-46b5-9cbc-430c8e73e136 admin admin] PATH_INFO: `/v3/users` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:50:32.793234 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-844f2a5c-b0d6-46b5-9cbc-430c8e73e136 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:50:32.795226 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-844f2a5c-b0d6-46b5-9cbc-430c8e73e136 admin admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:50:32.813542 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 1048/2135] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Sep 13 19:50:32 2022] POST /identity/v3/users => generated 282 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 13 19:50:32.817172 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 1088/2136] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Sep 13 19:50:32 2022] POST /identity/v3/users => generated 286 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 19:50:32.817567 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14beefab-5c4a-42e2-a356-6df680b1f61e admin admin] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:50:32.820725 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844f2a5c-b0d6-46b5-9cbc-430c8e73e136 admin admin] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:50:32.827294 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14beefab-5c4a-42e2-a356-6df680b1f61e admin admin] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:50:32.831087 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844f2a5c-b0d6-46b5-9cbc-430c8e73e136 admin admin] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:50:32.833122 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57961db6-b22c-4cdd-9c88-09a8383ff415 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:50:32.833708 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57961db6-b22c-4cdd-9c88-09a8383ff415 admin admin] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:50:32.833983 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57961db6-b22c-4cdd-9c88-09a8383ff415 admin admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:50:32.834248 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57961db6-b22c-4cdd-9c88-09a8383ff415 admin admin] PATH_INFO: `/v3/roles` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:50:32.834874 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57961db6-b22c-4cdd-9c88-09a8383ff415 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:50:32.836028 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69df323a-efbd-424c-954d-a85ee01d890c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:50:32.836476 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57961db6-b22c-4cdd-9c88-09a8383ff415 admin admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:50:32.836783 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69df323a-efbd-424c-954d-a85ee01d890c admin admin] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:50:32.837132 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69df323a-efbd-424c-954d-a85ee01d890c admin admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:50:32.837479 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69df323a-efbd-424c-954d-a85ee01d890c admin admin] PATH_INFO: `/v3/roles` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:50:32.838184 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69df323a-efbd-424c-954d-a85ee01d890c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:50:32.839744 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69df323a-efbd-424c-954d-a85ee01d890c admin admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:50:32.850715 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 1049/2137] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Sep 13 19:50:32 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 13 19:50:32.850867 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 1089/2138] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Sep 13 19:50:32 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 13 19:50:32.852048 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57961db6-b22c-4cdd-9c88-09a8383ff415 admin admin] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:50:32.853837 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69df323a-efbd-424c-954d-a85ee01d890c admin admin] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:50:32.862413 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57961db6-b22c-4cdd-9c88-09a8383ff415 admin admin] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:50:32.863543 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69df323a-efbd-424c-954d-a85ee01d890c admin admin] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:50:32.867004 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d604670e-2250-47b0-b266-81411258abc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:50:32.867579 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d604670e-2250-47b0-b266-81411258abc3 admin admin] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:50:32.867852 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d604670e-2250-47b0-b266-81411258abc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:50:32.868055 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f242a094-0683-4ac9-abf5-22e23388e38f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:50:32.868162 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d604670e-2250-47b0-b266-81411258abc3 admin admin] PATH_INFO: `/v3/roles` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:50:32.868662 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f242a094-0683-4ac9-abf5-22e23388e38f admin admin] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:50:32.868775 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d604670e-2250-47b0-b266-81411258abc3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:50:32.868936 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f242a094-0683-4ac9-abf5-22e23388e38f admin admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:50:32.869204 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f242a094-0683-4ac9-abf5-22e23388e38f admin admin] PATH_INFO: `/v3/roles` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:50:32.869894 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f242a094-0683-4ac9-abf5-22e23388e38f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:50:32.870470 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d604670e-2250-47b0-b266-81411258abc3 admin admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:50:32.871908 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f242a094-0683-4ac9-abf5-22e23388e38f admin admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:50:32.882617 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 1050/2139] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Sep 13 19:50:32 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 13 19:50:32.883688 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 1090/2140] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Sep 13 19:50:32 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 13 19:50:32.887191 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d604670e-2250-47b0-b266-81411258abc3 admin admin] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:50:32.887324 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f242a094-0683-4ac9-abf5-22e23388e38f admin admin] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:50:32.897594 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d604670e-2250-47b0-b266-81411258abc3 admin admin] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:50:32.897755 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f242a094-0683-4ac9-abf5-22e23388e38f admin admin] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:50:32.902107 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb486e0-7d09-4719-bafd-d9d460aece17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:50:32.902769 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb486e0-7d09-4719-bafd-d9d460aece17 admin admin] REQUEST_METHOD: `PUT` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:50:32.903042 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb486e0-7d09-4719-bafd-d9d460aece17 admin admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:50:32.903303 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb486e0-7d09-4719-bafd-d9d460aece17 admin admin] PATH_INFO: `/v3/projects/48aa775c691040df8e8da9981f83540e/users/93d45a881bda4d4a93e1582d38a200b9/roles/a259191f6d0e46fabd9f34536bb28747` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:50:32.904683 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98581cb3-411b-43f7-95b5-2ceaf6cf40f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:50:32.905326 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98581cb3-411b-43f7-95b5-2ceaf6cf40f4 admin admin] REQUEST_METHOD: `PUT` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:50:32.905600 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98581cb3-411b-43f7-95b5-2ceaf6cf40f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:50:32.905872 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98581cb3-411b-43f7-95b5-2ceaf6cf40f4 admin admin] PATH_INFO: `/v3/projects/96eb7062a5cb4017afd1b403b83d18bf/users/3d1730288fef461db89cb7470ceb423b/roles/a259191f6d0e46fabd9f34536bb28747` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:50:32.924234 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98581cb3-411b-43f7-95b5-2ceaf6cf40f4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=96eb7062a5cb4017afd1b403b83d18bf, user_id=3d1730288fef461db89cb7470ceb423b, role_id=a259191f6d0e46fabd9f34536bb28747)` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:50:32.926881 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98581cb3-411b-43f7-95b5-2ceaf6cf40f4 admin admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:50:32.930252 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb486e0-7d09-4719-bafd-d9d460aece17 admin admin] RBAC: Authorizing `identity:create_grant(project_id=48aa775c691040df8e8da9981f83540e, user_id=93d45a881bda4d4a93e1582d38a200b9, role_id=a259191f6d0e46fabd9f34536bb28747)` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:50:32.935290 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb486e0-7d09-4719-bafd-d9d460aece17 admin admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:50:32.957344 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 1051/2141] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Sep 13 19:50:32 2022] PUT /identity/v3/projects/48aa775c691040df8e8da9981f83540e/users/93d45a881bda4d4a93e1582d38a200b9/roles/a259191f6d0e46fabd9f34536bb28747 => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 19:50:32.959842 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 1091/2142] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Sep 13 19:50:32 2022] PUT /identity/v3/projects/96eb7062a5cb4017afd1b403b83d18bf/users/3d1730288fef461db89cb7470ceb423b/roles/a259191f6d0e46fabd9f34536bb28747 => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 19:50:32.968989 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a060601-f782-4efa-94dc-8022cdf55099 None None] REQUEST_METHOD: `POST` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:50:32.968989 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a060601-f782-4efa-94dc-8022cdf55099 None None] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:50:32.969302 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a060601-f782-4efa-94dc-8022cdf55099 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:50:32.970793 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322567de-b613-4ac6-93d2-1eb7a79620aa None None] REQUEST_METHOD: `POST` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:50:32.971081 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322567de-b613-4ac6-93d2-1eb7a79620aa None None] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:50:32.971354 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322567de-b613-4ac6-93d2-1eb7a79620aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:50:33.018704 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.auth.core [None req-322567de-b613-4ac6-93d2-1eb7a79620aa None None] MFA Rules not processed for user `3d1730288fef461db89cb7470ceb423b`. Rule list: `[]` (Enabled: `True`). {{(pid=87934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:50:33.024919 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.auth.core [None req-3a060601-f782-4efa-94dc-8022cdf55099 None None] MFA Rules not processed for user `93d45a881bda4d4a93e1582d38a200b9`. Rule list: `[]` (Enabled: `True`). {{(pid=87935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:50:33.027049 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.fernet_utils [None req-3a060601-f782-4efa-94dc-8022cdf55099 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:50:33.032622 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.fernet_utils [None req-322567de-b613-4ac6-93d2-1eb7a79620aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:50:33.125331 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 1052/2143] 10.222.0.25 () {58 vars in 958 bytes} [Tue Sep 13 19:50:32 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 19:50:33.130925 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a060601-f782-4efa-94dc-8022cdf55099 None None] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:50:33.136232 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 1092/2144] 10.222.0.25 () {58 vars in 958 bytes} [Tue Sep 13 19:50:32 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 19:50:33.150538 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322567de-b613-4ac6-93d2-1eb7a79620aa None None] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:50:33.151896 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.fernet_utils [None req-322567de-b613-4ac6-93d2-1eb7a79620aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:50:33.184648 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG dbcounter [-] [87934] Writing DB stats keystone:INSERT=5,keystone:SELECT=95 {{(pid=87934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:50:33.195970 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG dbcounter [-] [87935] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=87935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:50:33.218671 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322567de-b613-4ac6-93d2-1eb7a79620aa None None] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:50:33.218769 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a060601-f782-4efa-94dc-8022cdf55099 None None] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:50:33.222535 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb90e35-b977-4c80-9790-b418c5be6833 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cbb50c88b794a7f9f26844effde7d63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a10a4268f3c4cb29f4e00c292e2df62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:50:33.223442 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb90e35-b977-4c80-9790-b418c5be6833 service cinder] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:50:33.223745 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb90e35-b977-4c80-9790-b418c5be6833 service cinder] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:50:33.224121 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb90e35-b977-4c80-9790-b418c5be6833 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:50:33.225009 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ab1ea5-0d65-4342-9a29-064459a5025f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:50:33.225612 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ab1ea5-0d65-4342-9a29-064459a5025f admin admin] REQUEST_METHOD: `POST` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:50:33.225892 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ab1ea5-0d65-4342-9a29-064459a5025f admin admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:50:33.226160 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ab1ea5-0d65-4342-9a29-064459a5025f admin admin] PATH_INFO: `/v3/projects` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:50:33.226845 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ab1ea5-0d65-4342-9a29-064459a5025f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:50:33.228790 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ab1ea5-0d65-4342-9a29-064459a5025f admin admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:50:33.233237 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb90e35-b977-4c80-9790-b418c5be6833 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:50:33.234940 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb90e35-b977-4c80-9790-b418c5be6833 service cinder] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:50:33.252544 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 1093/2145] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Sep 13 19:50:33 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 13 19:50:33.274222 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 1053/2146] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Sep 13 19:50:33 2022] POST /identity/v3/projects => generated 365 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 19:50:33.277720 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb90e35-b977-4c80-9790-b418c5be6833 service cinder] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:50:33.291908 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ab1ea5-0d65-4342-9a29-064459a5025f admin admin] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:50:33.296136 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb90e35-b977-4c80-9790-b418c5be6833 service cinder] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:50:33.388593 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac7bed3-0093-41fc-97a8-a50632032877 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:50:33.389981 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac7bed3-0093-41fc-97a8-a50632032877 admin admin] REQUEST_METHOD: `POST` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:50:33.390273 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac7bed3-0093-41fc-97a8-a50632032877 admin admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:50:33.390547 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac7bed3-0093-41fc-97a8-a50632032877 admin admin] PATH_INFO: `/v3/users` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:50:33.392735 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac7bed3-0093-41fc-97a8-a50632032877 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:50:33.395014 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac7bed3-0093-41fc-97a8-a50632032877 admin admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:50:33.426976 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 1094/2147] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Sep 13 19:50:33 2022] POST /identity/v3/users => generated 289 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 19:50:33.431723 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac7bed3-0093-41fc-97a8-a50632032877 admin admin] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:50:33.443444 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac7bed3-0093-41fc-97a8-a50632032877 admin admin] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:50:33.449805 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ab1ea5-0d65-4342-9a29-064459a5025f admin admin] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:50:33.449953 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00cd4d3a-1b90-486c-9147-b483c64245f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:50:33.450456 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cd4d3a-1b90-486c-9147-b483c64245f4 admin admin] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:50:33.450733 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cd4d3a-1b90-486c-9147-b483c64245f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:50:33.451001 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cd4d3a-1b90-486c-9147-b483c64245f4 admin admin] PATH_INFO: `/v3/roles` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:50:33.452145 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00cd4d3a-1b90-486c-9147-b483c64245f4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:50:33.453627 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00cd4d3a-1b90-486c-9147-b483c64245f4 admin admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:50:33.459007 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b57c85-5aea-4eb9-9aee-26628156273b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:50:33.459796 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b57c85-5aea-4eb9-9aee-26628156273b admin admin] REQUEST_METHOD: `DELETE` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:50:33.460145 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b57c85-5aea-4eb9-9aee-26628156273b admin admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:50:33.460545 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b57c85-5aea-4eb9-9aee-26628156273b admin admin] PATH_INFO: `/v3/users/3d1730288fef461db89cb7470ceb423b` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:50:33.462464 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b57c85-5aea-4eb9-9aee-26628156273b admin admin] RBAC: Authorizing `identity:delete_user(user_id=3d1730288fef461db89cb7470ceb423b)` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:50:33.466858 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 1095/2148] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Sep 13 19:50:33 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 19:50:33.469845 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b57c85-5aea-4eb9-9aee-26628156273b admin admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:50:33.476552 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00cd4d3a-1b90-486c-9147-b483c64245f4 admin admin] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:50:33.489118 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00cd4d3a-1b90-486c-9147-b483c64245f4 admin admin] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:50:33.494601 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03052d11-7bd2-4ed8-ba73-f2586103dacf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:50:33.495259 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03052d11-7bd2-4ed8-ba73-f2586103dacf admin admin] REQUEST_METHOD: `PUT` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:50:33.495532 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03052d11-7bd2-4ed8-ba73-f2586103dacf admin admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:50:33.495802 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03052d11-7bd2-4ed8-ba73-f2586103dacf admin admin] PATH_INFO: `/v3/projects/8199c2f6de85400da6a7a553033f9dc2/users/935c428b31f74131abf0ba610cc85aa4/roles/6ca1d4427ff64e0a9d25d96cfb1445f6` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:50:33.514398 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03052d11-7bd2-4ed8-ba73-f2586103dacf admin admin] RBAC: Authorizing `identity:create_grant(project_id=8199c2f6de85400da6a7a553033f9dc2, user_id=935c428b31f74131abf0ba610cc85aa4, role_id=6ca1d4427ff64e0a9d25d96cfb1445f6)` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:50:33.518605 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03052d11-7bd2-4ed8-ba73-f2586103dacf admin admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:50:33.528370 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.notifications [None req-e5b57c85-5aea-4eb9-9aee-26628156273b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3d1730288fef461db89cb7470ceb423b'} {{(pid=87935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:50:33.535346 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 1096/2149] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Sep 13 19:50:33 2022] PUT /identity/v3/projects/8199c2f6de85400da6a7a553033f9dc2/users/935c428b31f74131abf0ba610cc85aa4/roles/6ca1d4427ff64e0a9d25d96cfb1445f6 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 19:50:33.539615 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03052d11-7bd2-4ed8-ba73-f2586103dacf admin admin] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:50:33.539777 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.notifications [None req-e5b57c85-5aea-4eb9-9aee-26628156273b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3d1730288fef461db89cb7470ceb423b'} {{(pid=87935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:50:33.555316 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.notifications [None req-e5b57c85-5aea-4eb9-9aee-26628156273b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3d1730288fef461db89cb7470ceb423b'} {{(pid=87935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:50:33.556071 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.notifications [None req-e5b57c85-5aea-4eb9-9aee-26628156273b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3d1730288fef461db89cb7470ceb423b'} {{(pid=87935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:50:33.557020 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.notifications [None req-e5b57c85-5aea-4eb9-9aee-26628156273b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3d1730288fef461db89cb7470ceb423b'} {{(pid=87935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:50:33.575852 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 1054/2150] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Sep 13 19:50:33 2022] DELETE /identity/v3/users/3d1730288fef461db89cb7470ceb423b => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 19:50:33.581683 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376f1d57-343c-4647-83d3-cc9891b9f68e None None] REQUEST_METHOD: `POST` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:50:33.581984 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376f1d57-343c-4647-83d3-cc9891b9f68e None None] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:50:33.582243 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376f1d57-343c-4647-83d3-cc9891b9f68e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:50:33.603363 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.auth.core [None req-376f1d57-343c-4647-83d3-cc9891b9f68e None None] MFA Rules not processed for user `7b0aed92d02344acb92a0e4aa67c3068`. Rule list: `[]` (Enabled: `True`). {{(pid=87935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:50:33.604952 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.fernet_utils [None req-376f1d57-343c-4647-83d3-cc9891b9f68e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:50:33.622962 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03052d11-7bd2-4ed8-ba73-f2586103dacf admin admin] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:50:33.660771 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG dbcounter [-] [87934] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=87934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:50:33.674803 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG dbcounter [-] [87935] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=87935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:50:33.697824 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 1055/2151] 10.222.0.25 () {58 vars in 958 bytes} [Tue Sep 13 19:50:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 19:50:33.705595 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6fbc253-a8f5-4f02-a554-bf7366242e20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:50:33.706139 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376f1d57-343c-4647-83d3-cc9891b9f68e None None] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:50:33.706320 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fbc253-a8f5-4f02-a554-bf7366242e20 admin admin] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:50:33.706676 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fbc253-a8f5-4f02-a554-bf7366242e20 admin admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:50:33.706953 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fbc253-a8f5-4f02-a554-bf7366242e20 admin admin] PATH_INFO: `/v3/roles` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:50:33.707606 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6fbc253-a8f5-4f02-a554-bf7366242e20 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:50:33.708644 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.fernet_utils [None req-376f1d57-343c-4647-83d3-cc9891b9f68e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:50:33.709864 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6fbc253-a8f5-4f02-a554-bf7366242e20 admin admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:50:33.722781 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 1097/2152] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Sep 13 19:50:33 2022] GET /identity/v3/roles => generated 1420 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 13 19:50:33.726855 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6fbc253-a8f5-4f02-a554-bf7366242e20 admin admin] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:50:33.731162 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.fernet_utils [None req-d6fbc253-a8f5-4f02-a554-bf7366242e20 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:50:33.755594 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6fbc253-a8f5-4f02-a554-bf7366242e20 admin admin] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:50:33.762911 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b3f679-39ec-44d7-8a72-83aa4b0fe71c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:50:33.764075 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b3f679-39ec-44d7-8a72-83aa4b0fe71c admin admin] REQUEST_METHOD: `PUT` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:50:33.764386 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b3f679-39ec-44d7-8a72-83aa4b0fe71c admin admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:50:33.764791 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b3f679-39ec-44d7-8a72-83aa4b0fe71c admin admin] PATH_INFO: `/v3/projects/8199c2f6de85400da6a7a553033f9dc2/users/935c428b31f74131abf0ba610cc85aa4/roles/6ca1d4427ff64e0a9d25d96cfb1445f6` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:50:33.766793 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b3f679-39ec-44d7-8a72-83aa4b0fe71c admin admin] RBAC: Authorizing `identity:create_grant(project_id=8199c2f6de85400da6a7a553033f9dc2, user_id=935c428b31f74131abf0ba610cc85aa4, role_id=6ca1d4427ff64e0a9d25d96cfb1445f6)` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:50:33.770664 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b3f679-39ec-44d7-8a72-83aa4b0fe71c admin admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:50:33.782238 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 1098/2153] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Sep 13 19:50:33 2022] PUT /identity/v3/projects/8199c2f6de85400da6a7a553033f9dc2/users/935c428b31f74131abf0ba610cc85aa4/roles/6ca1d4427ff64e0a9d25d96cfb1445f6 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 19:50:33.784385 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376f1d57-343c-4647-83d3-cc9891b9f68e None None] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:50:33.795468 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de02ac00-70fa-48b0-8f62-06e667c19e5d None None] REQUEST_METHOD: `POST` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:50:33.795689 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de02ac00-70fa-48b0-8f62-06e667c19e5d None None] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:50:33.795960 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de02ac00-70fa-48b0-8f62-06e667c19e5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:50:33.827354 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.auth.core [None req-de02ac00-70fa-48b0-8f62-06e667c19e5d None None] MFA Rules not processed for user `935c428b31f74131abf0ba610cc85aa4`. Rule list: `[]` (Enabled: `True`). {{(pid=87934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:50:33.828970 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.fernet_utils [None req-de02ac00-70fa-48b0-8f62-06e667c19e5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:50:33.857514 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249ff19a-2163-4ce5-87dc-af3e97d7f486 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1196a96e4a404f559600b69f929ea9da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a10a4268f3c4cb29f4e00c292e2df62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:50:33.858237 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249ff19a-2163-4ce5-87dc-af3e97d7f486 service neutron] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:50:33.858542 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249ff19a-2163-4ce5-87dc-af3e97d7f486 service neutron] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:50:33.859001 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249ff19a-2163-4ce5-87dc-af3e97d7f486 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:50:33.903479 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 1099/2154] 10.222.0.25 () {58 vars in 958 bytes} [Tue Sep 13 19:50:33 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 19:50:33.915560 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de02ac00-70fa-48b0-8f62-06e667c19e5d None None] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:50:33.917005 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.fernet_utils [None req-de02ac00-70fa-48b0-8f62-06e667c19e5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:50:33.921713 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-249ff19a-2163-4ce5-87dc-af3e97d7f486 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:50:33.923751 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-249ff19a-2163-4ce5-87dc-af3e97d7f486 service neutron] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:50:33.933567 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 1056/2155] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Sep 13 19:50:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 229 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 19:50:33.985313 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de02ac00-70fa-48b0-8f62-06e667c19e5d None None] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:50:33.990152 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9890d512-0d34-4542-823e-0392d6013046 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cbb50c88b794a7f9f26844effde7d63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a10a4268f3c4cb29f4e00c292e2df62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:50:33.990815 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9890d512-0d34-4542-823e-0392d6013046 service cinder] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:50:33.991067 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9890d512-0d34-4542-823e-0392d6013046 service cinder] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:50:33.991460 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9890d512-0d34-4542-823e-0392d6013046 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:50:34.001841 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9890d512-0d34-4542-823e-0392d6013046 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:50:34.003267 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9890d512-0d34-4542-823e-0392d6013046 service cinder] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:50:34.014149 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 1100/2156] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Sep 13 19:50:33 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 13 19:50:34.105106 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249ff19a-2163-4ce5-87dc-af3e97d7f486 service neutron] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:50:34.116988 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249ff19a-2163-4ce5-87dc-af3e97d7f486 service neutron] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:50:34.120781 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e890061-5fe7-4a55-90b9-a33a7e6f58e9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cbb50c88b794a7f9f26844effde7d63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a10a4268f3c4cb29f4e00c292e2df62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:50:34.121382 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e890061-5fe7-4a55-90b9-a33a7e6f58e9 service cinder] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:50:34.121673 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e890061-5fe7-4a55-90b9-a33a7e6f58e9 service cinder] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:50:34.121938 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e890061-5fe7-4a55-90b9-a33a7e6f58e9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:50:34.123855 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.fernet_utils [None req-7e890061-5fe7-4a55-90b9-a33a7e6f58e9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:50:34.182949 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG dbcounter [-] [87935] Writing DB stats keystone:SELECT=100 {{(pid=87935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:50:34.187541 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e890061-5fe7-4a55-90b9-a33a7e6f58e9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:50:34.189209 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e890061-5fe7-4a55-90b9-a33a7e6f58e9 service cinder] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:50:34.198615 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 1057/2157] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Sep 13 19:50:34 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 19:50:34.228083 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9890d512-0d34-4542-823e-0392d6013046 service cinder] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:50:34.229584 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.fernet_utils [None req-9890d512-0d34-4542-823e-0392d6013046 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:50:34.245479 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9890d512-0d34-4542-823e-0392d6013046 service cinder] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:50:34.254296 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a53b47-b427-40e9-8788-16d7da4e754f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:50:34.255090 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a53b47-b427-40e9-8788-16d7da4e754f admin admin] REQUEST_METHOD: `DELETE` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:50:34.255279 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a53b47-b427-40e9-8788-16d7da4e754f admin admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:50:34.255683 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a53b47-b427-40e9-8788-16d7da4e754f admin admin] PATH_INFO: `/v3/projects/96eb7062a5cb4017afd1b403b83d18bf` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:50:34.256887 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a53b47-b427-40e9-8788-16d7da4e754f admin admin] RBAC: Authorizing `identity:delete_project(project_id=96eb7062a5cb4017afd1b403b83d18bf)` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:50:34.259135 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a53b47-b427-40e9-8788-16d7da4e754f admin admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:50:34.307973 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG dbcounter [-] [87934] Writing DB stats keystone:SELECT=96,keystone:INSERT=1,keystone:DELETE=3 {{(pid=87934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:50:34.320202 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.notifications [None req-a8a53b47-b427-40e9-8788-16d7da4e754f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '96eb7062a5cb4017afd1b403b83d18bf', 'request_id': 'req-a8a53b47-b427-40e9-8788-16d7da4e754f'} {{(pid=87934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:50:34.327189 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.notifications [None req-a8a53b47-b427-40e9-8788-16d7da4e754f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '96eb7062a5cb4017afd1b403b83d18bf', 'request_id': 'req-a8a53b47-b427-40e9-8788-16d7da4e754f'} {{(pid=87934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:50:34.334795 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.notifications [None req-a8a53b47-b427-40e9-8788-16d7da4e754f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '96eb7062a5cb4017afd1b403b83d18bf', 'request_id': 'req-a8a53b47-b427-40e9-8788-16d7da4e754f'} {{(pid=87934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:50:34.349622 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.notifications [None req-a8a53b47-b427-40e9-8788-16d7da4e754f admin admin] The token cache is being invalidate because project 96eb7062a5cb4017afd1b403b83d18bf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87934) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 19:50:34.349923 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.notifications [None req-a8a53b47-b427-40e9-8788-16d7da4e754f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:50:34.350634 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.notifications [None req-a8a53b47-b427-40e9-8788-16d7da4e754f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:50:34.352265 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 1101/2158] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Sep 13 19:50:34 2022] DELETE /identity/v3/projects/96eb7062a5cb4017afd1b403b83d18bf => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 19:50:34.357430 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae84c686-5e64-414c-a397-1eebb1c9d0c3 None None] REQUEST_METHOD: `POST` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:50:34.357940 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae84c686-5e64-414c-a397-1eebb1c9d0c3 None None] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:50:34.358022 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae84c686-5e64-414c-a397-1eebb1c9d0c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:50:34.383701 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.auth.core [None req-ae84c686-5e64-414c-a397-1eebb1c9d0c3 None None] MFA Rules not processed for user `7b0aed92d02344acb92a0e4aa67c3068`. Rule list: `[]` (Enabled: `True`). {{(pid=87935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:50:34.384987 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.fernet_utils [None req-ae84c686-5e64-414c-a397-1eebb1c9d0c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:50:34.448720 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 1058/2159] 10.222.0.25 () {58 vars in 958 bytes} [Tue Sep 13 19:50:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 19:50:34.457640 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f7f3e8-d1b2-49be-92fe-d68c73a92e47 None None] REQUEST_METHOD: `POST` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:50:34.458084 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f7f3e8-d1b2-49be-92fe-d68c73a92e47 None None] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:50:34.458262 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f7f3e8-d1b2-49be-92fe-d68c73a92e47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:50:34.479543 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.auth.core [None req-96f7f3e8-d1b2-49be-92fe-d68c73a92e47 None None] MFA Rules not processed for user `7b0aed92d02344acb92a0e4aa67c3068`. Rule list: `[]` (Enabled: `True`). {{(pid=87934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:50:34.480765 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.fernet_utils [None req-96f7f3e8-d1b2-49be-92fe-d68c73a92e47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:50:34.491425 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 1102/2160] 10.222.0.25 () {58 vars in 958 bytes} [Tue Sep 13 19:50:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 19:50:34.495723 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae84c686-5e64-414c-a397-1eebb1c9d0c3 None None] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:50:34.506821 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae84c686-5e64-414c-a397-1eebb1c9d0c3 None None] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:50:34.511964 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2167d9-6b7b-4900-93e8-314e79be5f88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:50:34.512623 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2167d9-6b7b-4900-93e8-314e79be5f88 admin admin] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:50:34.513053 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2167d9-6b7b-4900-93e8-314e79be5f88 admin admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:50:34.513327 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2167d9-6b7b-4900-93e8-314e79be5f88 admin admin] PATH_INFO: `/v3/domains` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:50:34.513979 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad2167d9-6b7b-4900-93e8-314e79be5f88 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87935) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:50:34.514282 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad2167d9-6b7b-4900-93e8-314e79be5f88 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:50:34.515882 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad2167d9-6b7b-4900-93e8-314e79be5f88 admin admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:50:34.528234 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f7f3e8-d1b2-49be-92fe-d68c73a92e47 None None] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:50:34.529882 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.fernet_utils [None req-96f7f3e8-d1b2-49be-92fe-d68c73a92e47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:50:34.532396 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 1059/2161] 10.222.0.25 () {58 vars in 1153 bytes} [Tue Sep 13 19:50:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:50:34.537116 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2167d9-6b7b-4900-93e8-314e79be5f88 admin admin] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:50:34.544230 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f7f3e8-d1b2-49be-92fe-d68c73a92e47 None None] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:50:34.547276 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2167d9-6b7b-4900-93e8-314e79be5f88 admin admin] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:50:34.549614 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec87958c-6939-4060-88bd-2924a86a094a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:50:34.550249 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec87958c-6939-4060-88bd-2924a86a094a admin admin] REQUEST_METHOD: `DELETE` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:50:34.550528 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec87958c-6939-4060-88bd-2924a86a094a admin admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:50:34.550799 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec87958c-6939-4060-88bd-2924a86a094a admin admin] PATH_INFO: `/v3/users/57fa5caec8f646dfbdaadb2da92e487f` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:50:34.551926 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec87958c-6939-4060-88bd-2924a86a094a admin admin] RBAC: Authorizing `identity:delete_user(user_id=57fa5caec8f646dfbdaadb2da92e487f)` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:50:34.552712 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5b3e1e-10dd-42e5-bfa3-5a804a1e4153 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:50:34.553438 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5b3e1e-10dd-42e5-bfa3-5a804a1e4153 admin admin] REQUEST_METHOD: `POST` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:50:34.553776 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5b3e1e-10dd-42e5-bfa3-5a804a1e4153 admin admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:50:34.553907 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec87958c-6939-4060-88bd-2924a86a094a admin admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:50:34.554115 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5b3e1e-10dd-42e5-bfa3-5a804a1e4153 admin admin] PATH_INFO: `/v3/projects` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:50:34.554852 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d5b3e1e-10dd-42e5-bfa3-5a804a1e4153 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:50:34.556870 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d5b3e1e-10dd-42e5-bfa3-5a804a1e4153 admin admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:50:34.590452 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 1060/2162] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Sep 13 19:50:34 2022] POST /identity/v3/projects => generated 379 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 13 19:50:34.594189 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5b3e1e-10dd-42e5-bfa3-5a804a1e4153 admin admin] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:50:34.614600 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.notifications [None req-ec87958c-6939-4060-88bd-2924a86a094a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '57fa5caec8f646dfbdaadb2da92e487f'} {{(pid=87934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:50:34.615847 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.notifications [None req-ec87958c-6939-4060-88bd-2924a86a094a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '57fa5caec8f646dfbdaadb2da92e487f'} {{(pid=87934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:50:34.616511 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.notifications [None req-ec87958c-6939-4060-88bd-2924a86a094a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '57fa5caec8f646dfbdaadb2da92e487f'} {{(pid=87934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:50:34.625476 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.notifications [None req-ec87958c-6939-4060-88bd-2924a86a094a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '57fa5caec8f646dfbdaadb2da92e487f'} {{(pid=87934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:50:34.641129 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.notifications [None req-ec87958c-6939-4060-88bd-2924a86a094a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '57fa5caec8f646dfbdaadb2da92e487f'} {{(pid=87934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:50:34.658634 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 1103/2163] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Sep 13 19:50:34 2022] DELETE /identity/v3/users/57fa5caec8f646dfbdaadb2da92e487f => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 19:50:34.663833 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1867f31a-e420-4b93-9879-f3c0d600aa45 None None] REQUEST_METHOD: `POST` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:50:34.664687 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1867f31a-e420-4b93-9879-f3c0d600aa45 None None] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:50:34.665277 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1867f31a-e420-4b93-9879-f3c0d600aa45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:50:34.668438 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5b3e1e-10dd-42e5-bfa3-5a804a1e4153 admin admin] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:50:34.691702 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.auth.core [None req-1867f31a-e420-4b93-9879-f3c0d600aa45 None None] MFA Rules not processed for user `7b0aed92d02344acb92a0e4aa67c3068`. Rule list: `[]` (Enabled: `True`). {{(pid=87934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:50:34.692953 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.fernet_utils [None req-1867f31a-e420-4b93-9879-f3c0d600aa45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:50:34.736978 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff88979d-37a8-4305-9eed-798c8b884ad8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:50:34.737963 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff88979d-37a8-4305-9eed-798c8b884ad8 admin admin] REQUEST_METHOD: `POST` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:50:34.738527 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff88979d-37a8-4305-9eed-798c8b884ad8 admin admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:50:34.738814 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff88979d-37a8-4305-9eed-798c8b884ad8 admin admin] PATH_INFO: `/v3/users` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:50:34.739468 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff88979d-37a8-4305-9eed-798c8b884ad8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:50:34.741448 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff88979d-37a8-4305-9eed-798c8b884ad8 admin admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:50:34.753444 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG dbcounter [-] [87935] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=87935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:50:34.762778 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 1104/2164] 10.222.0.25 () {58 vars in 958 bytes} [Tue Sep 13 19:50:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 19:50:34.767754 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 1061/2165] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Sep 13 19:50:34 2022] POST /identity/v3/users => generated 290 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 13 19:50:34.771707 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1867f31a-e420-4b93-9879-f3c0d600aa45 None None] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:50:34.773154 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.fernet_utils [None req-1867f31a-e420-4b93-9879-f3c0d600aa45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:50:34.776849 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff88979d-37a8-4305-9eed-798c8b884ad8 admin admin] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:50:34.778590 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.fernet_utils [None req-ff88979d-37a8-4305-9eed-798c8b884ad8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:50:34.786258 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1867f31a-e420-4b93-9879-f3c0d600aa45 None None] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:50:34.791441 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9844d415-a62f-4bca-9055-b97f3588382f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:50:34.792044 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9844d415-a62f-4bca-9055-b97f3588382f admin admin] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:50:34.792355 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9844d415-a62f-4bca-9055-b97f3588382f admin admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:50:34.792622 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9844d415-a62f-4bca-9055-b97f3588382f admin admin] PATH_INFO: `/v3/roles` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:50:34.793257 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9844d415-a62f-4bca-9055-b97f3588382f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:50:34.794827 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9844d415-a62f-4bca-9055-b97f3588382f admin admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:50:34.806028 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 1105/2166] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Sep 13 19:50:34 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 19:50:34.809849 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9844d415-a62f-4bca-9055-b97f3588382f admin admin] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:50:34.820404 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9844d415-a62f-4bca-9055-b97f3588382f admin admin] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:50:34.825104 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8608ff01-d389-4cbc-8cab-6d2d8eb377ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:50:34.825832 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8608ff01-d389-4cbc-8cab-6d2d8eb377ee admin admin] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:50:34.826205 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8608ff01-d389-4cbc-8cab-6d2d8eb377ee admin admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:50:34.826543 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8608ff01-d389-4cbc-8cab-6d2d8eb377ee admin admin] PATH_INFO: `/v3/roles` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:50:34.827247 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8608ff01-d389-4cbc-8cab-6d2d8eb377ee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:50:34.829503 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8608ff01-d389-4cbc-8cab-6d2d8eb377ee admin admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:50:34.840062 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 1106/2167] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Sep 13 19:50:34 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 19:50:34.844109 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8608ff01-d389-4cbc-8cab-6d2d8eb377ee admin admin] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:50:34.855206 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8608ff01-d389-4cbc-8cab-6d2d8eb377ee admin admin] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:50:34.858737 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff88979d-37a8-4305-9eed-798c8b884ad8 admin admin] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:50:34.860119 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661d1cd2-a1d8-4aaf-b3e2-f2f0701aaa27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:50:34.861504 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661d1cd2-a1d8-4aaf-b3e2-f2f0701aaa27 admin admin] REQUEST_METHOD: `PUT` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:50:34.861997 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661d1cd2-a1d8-4aaf-b3e2-f2f0701aaa27 admin admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:50:34.862365 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661d1cd2-a1d8-4aaf-b3e2-f2f0701aaa27 admin admin] PATH_INFO: `/v3/projects/22025a1096ea4186bde3673521b43c3e/users/99d1fbe8157e47ffac2699d12e76e2c3/roles/a259191f6d0e46fabd9f34536bb28747` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:50:34.863933 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff5c45f-581f-45ff-af78-c17db50d9bcf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1196a96e4a404f559600b69f929ea9da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a10a4268f3c4cb29f4e00c292e2df62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:50:34.864653 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff5c45f-581f-45ff-af78-c17db50d9bcf service neutron] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:50:34.864929 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff5c45f-581f-45ff-af78-c17db50d9bcf service neutron] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:50:34.865196 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff5c45f-581f-45ff-af78-c17db50d9bcf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:50:34.867075 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG dbcounter [-] [87934] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=87934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:50:34.879814 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff5c45f-581f-45ff-af78-c17db50d9bcf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:50:34.881504 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff5c45f-581f-45ff-af78-c17db50d9bcf service neutron] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:50:34.883268 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-661d1cd2-a1d8-4aaf-b3e2-f2f0701aaa27 admin admin] RBAC: Authorizing `identity:create_grant(project_id=22025a1096ea4186bde3673521b43c3e, user_id=99d1fbe8157e47ffac2699d12e76e2c3, role_id=a259191f6d0e46fabd9f34536bb28747)` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:50:34.892248 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-661d1cd2-a1d8-4aaf-b3e2-f2f0701aaa27 admin admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:50:34.902846 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 1062/2168] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Sep 13 19:50:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 19:50:34.906954 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 1107/2169] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Sep 13 19:50:34 2022] PUT /identity/v3/projects/22025a1096ea4186bde3673521b43c3e/users/99d1fbe8157e47ffac2699d12e76e2c3/roles/a259191f6d0e46fabd9f34536bb28747 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 19:50:34.912958 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba7698c-bcb1-4dea-b248-d41e96203ff9 None None] REQUEST_METHOD: `POST` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:50:34.913262 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba7698c-bcb1-4dea-b248-d41e96203ff9 None None] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:50:34.913594 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba7698c-bcb1-4dea-b248-d41e96203ff9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:50:34.935493 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.auth.core [None req-eba7698c-bcb1-4dea-b248-d41e96203ff9 None None] MFA Rules not processed for user `7b0aed92d02344acb92a0e4aa67c3068`. Rule list: `[]` (Enabled: `True`). {{(pid=87935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:50:34.936931 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.fernet_utils [None req-eba7698c-bcb1-4dea-b248-d41e96203ff9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:50:35.012251 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 1063/2170] 10.222.0.25 () {58 vars in 958 bytes} [Tue Sep 13 19:50:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 19:50:35.023226 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661d1cd2-a1d8-4aaf-b3e2-f2f0701aaa27 admin admin] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:50:35.098514 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661d1cd2-a1d8-4aaf-b3e2-f2f0701aaa27 admin admin] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:50:35.102895 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bce9b8f-8da7-43d4-adb4-5f1e9f590ff2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1196a96e4a404f559600b69f929ea9da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a10a4268f3c4cb29f4e00c292e2df62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:50:35.103606 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bce9b8f-8da7-43d4-adb4-5f1e9f590ff2 service neutron] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:50:35.103916 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bce9b8f-8da7-43d4-adb4-5f1e9f590ff2 service neutron] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:50:35.104230 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bce9b8f-8da7-43d4-adb4-5f1e9f590ff2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:50:35.114481 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bce9b8f-8da7-43d4-adb4-5f1e9f590ff2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:50:35.115905 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bce9b8f-8da7-43d4-adb4-5f1e9f590ff2 service neutron] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:50:35.126440 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 1108/2171] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Sep 13 19:50:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 19:50:35.217081 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba7698c-bcb1-4dea-b248-d41e96203ff9 None None] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:50:35.217956 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.fernet_utils [None req-eba7698c-bcb1-4dea-b248-d41e96203ff9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:50:35.231553 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba7698c-bcb1-4dea-b248-d41e96203ff9 None None] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:50:35.237589 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30866bc8-ee3c-4d2b-9db7-2063d4f89bf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:50:35.238292 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30866bc8-ee3c-4d2b-9db7-2063d4f89bf4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:50:35.238571 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30866bc8-ee3c-4d2b-9db7-2063d4f89bf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:50:35.238841 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30866bc8-ee3c-4d2b-9db7-2063d4f89bf4 admin admin] PATH_INFO: `/v3/projects/19067d9171164b2fb7690bb1dbfa2bac` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:50:35.240187 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30866bc8-ee3c-4d2b-9db7-2063d4f89bf4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=19067d9171164b2fb7690bb1dbfa2bac)` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:50:35.242463 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30866bc8-ee3c-4d2b-9db7-2063d4f89bf4 admin admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:50:35.306717 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.notifications [None req-30866bc8-ee3c-4d2b-9db7-2063d4f89bf4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '19067d9171164b2fb7690bb1dbfa2bac', 'request_id': 'req-30866bc8-ee3c-4d2b-9db7-2063d4f89bf4'} {{(pid=87935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:50:35.312941 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.notifications [None req-30866bc8-ee3c-4d2b-9db7-2063d4f89bf4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '19067d9171164b2fb7690bb1dbfa2bac', 'request_id': 'req-30866bc8-ee3c-4d2b-9db7-2063d4f89bf4'} {{(pid=87935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:50:35.323045 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.notifications [None req-30866bc8-ee3c-4d2b-9db7-2063d4f89bf4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '19067d9171164b2fb7690bb1dbfa2bac', 'request_id': 'req-30866bc8-ee3c-4d2b-9db7-2063d4f89bf4'} {{(pid=87935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:50:35.336548 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.notifications [None req-30866bc8-ee3c-4d2b-9db7-2063d4f89bf4 admin admin] The token cache is being invalidate because project 19067d9171164b2fb7690bb1dbfa2bac was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87935) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 19:50:35.336896 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.notifications [None req-30866bc8-ee3c-4d2b-9db7-2063d4f89bf4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:50:35.337547 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.notifications [None req-30866bc8-ee3c-4d2b-9db7-2063d4f89bf4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:50:35.339018 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 1064/2172] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Sep 13 19:50:35 2022] DELETE /identity/v3/projects/19067d9171164b2fb7690bb1dbfa2bac => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 19:50:35.342931 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bce9b8f-8da7-43d4-adb4-5f1e9f590ff2 service neutron] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:50:35.355238 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bce9b8f-8da7-43d4-adb4-5f1e9f590ff2 service neutron] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:50:35.426286 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2110a227-41a7-4e30-8cbf-7dce0a691757 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:50:35.426926 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2110a227-41a7-4e30-8cbf-7dce0a691757 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:50:35.427205 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2110a227-41a7-4e30-8cbf-7dce0a691757 admin admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:50:35.427467 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2110a227-41a7-4e30-8cbf-7dce0a691757 admin admin] PATH_INFO: `/v3/users/92ed33ede06b46928fd0d7631db7c602` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:50:35.428635 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2110a227-41a7-4e30-8cbf-7dce0a691757 admin admin] RBAC: Authorizing `identity:delete_user(user_id=92ed33ede06b46928fd0d7631db7c602)` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:50:35.430623 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2110a227-41a7-4e30-8cbf-7dce0a691757 admin admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:50:35.485182 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.notifications [None req-2110a227-41a7-4e30-8cbf-7dce0a691757 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '92ed33ede06b46928fd0d7631db7c602'} {{(pid=87934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:50:35.486887 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.notifications [None req-2110a227-41a7-4e30-8cbf-7dce0a691757 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '92ed33ede06b46928fd0d7631db7c602'} {{(pid=87934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:50:35.487821 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.notifications [None req-2110a227-41a7-4e30-8cbf-7dce0a691757 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '92ed33ede06b46928fd0d7631db7c602'} {{(pid=87934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:50:35.496767 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.notifications [None req-2110a227-41a7-4e30-8cbf-7dce0a691757 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '92ed33ede06b46928fd0d7631db7c602'} {{(pid=87934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:50:35.517889 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.notifications [None req-2110a227-41a7-4e30-8cbf-7dce0a691757 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '92ed33ede06b46928fd0d7631db7c602'} {{(pid=87934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:50:35.535075 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 1109/2173] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Sep 13 19:50:35 2022] DELETE /identity/v3/users/92ed33ede06b46928fd0d7631db7c602 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 19:50:36.067082 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30866bc8-ee3c-4d2b-9db7-2063d4f89bf4 admin admin] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:50:36.069127 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.fernet_utils [None req-30866bc8-ee3c-4d2b-9db7-2063d4f89bf4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:50:36.097427 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30866bc8-ee3c-4d2b-9db7-2063d4f89bf4 admin admin] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:50:36.131249 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG dbcounter [-] [87935] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=87935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:50:36.185450 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2812482c-64dc-40ba-9fad-e530f8b7d44b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:50:36.186630 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2812482c-64dc-40ba-9fad-e530f8b7d44b admin admin] REQUEST_METHOD: `DELETE` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:50:36.187201 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2812482c-64dc-40ba-9fad-e530f8b7d44b admin admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:50:36.187690 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2812482c-64dc-40ba-9fad-e530f8b7d44b admin admin] PATH_INFO: `/v3/projects/508a231414b34c75bfd16ddd0af467f6` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:50:36.190144 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2812482c-64dc-40ba-9fad-e530f8b7d44b admin admin] RBAC: Authorizing `identity:delete_project(project_id=508a231414b34c75bfd16ddd0af467f6)` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:50:36.193436 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2812482c-64dc-40ba-9fad-e530f8b7d44b admin admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:50:36.278705 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.notifications [None req-2812482c-64dc-40ba-9fad-e530f8b7d44b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '508a231414b34c75bfd16ddd0af467f6', 'request_id': 'req-2812482c-64dc-40ba-9fad-e530f8b7d44b'} {{(pid=87935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:50:36.286229 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.notifications [None req-2812482c-64dc-40ba-9fad-e530f8b7d44b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '508a231414b34c75bfd16ddd0af467f6', 'request_id': 'req-2812482c-64dc-40ba-9fad-e530f8b7d44b'} {{(pid=87935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:50:36.298347 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.notifications [None req-2812482c-64dc-40ba-9fad-e530f8b7d44b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '508a231414b34c75bfd16ddd0af467f6', 'request_id': 'req-2812482c-64dc-40ba-9fad-e530f8b7d44b'} {{(pid=87935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:50:36.315628 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.notifications [None req-2812482c-64dc-40ba-9fad-e530f8b7d44b admin admin] The token cache is being invalidate because project 508a231414b34c75bfd16ddd0af467f6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87935) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 19:50:36.315947 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.notifications [None req-2812482c-64dc-40ba-9fad-e530f8b7d44b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:50:36.316654 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.notifications [None req-2812482c-64dc-40ba-9fad-e530f8b7d44b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:50:36.318409 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 1065/2174] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Sep 13 19:50:36 2022] DELETE /identity/v3/projects/508a231414b34c75bfd16ddd0af467f6 => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 19:50:36.323075 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2110a227-41a7-4e30-8cbf-7dce0a691757 admin admin] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:50:36.325720 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.fernet_utils [None req-2110a227-41a7-4e30-8cbf-7dce0a691757 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:50:36.345401 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2110a227-41a7-4e30-8cbf-7dce0a691757 admin admin] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:50:36.351112 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG dbcounter [-] [87934] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=87934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:50:36.429766 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02576e3d-ff66-49e8-9ee4-7f0e5bffc245 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:50:36.430425 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02576e3d-ff66-49e8-9ee4-7f0e5bffc245 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:50:36.430700 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02576e3d-ff66-49e8-9ee4-7f0e5bffc245 admin admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:50:36.430967 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02576e3d-ff66-49e8-9ee4-7f0e5bffc245 admin admin] PATH_INFO: `/v3/users/65c3cfcb48044bc3a7578d47f1829d05` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:50:36.432301 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02576e3d-ff66-49e8-9ee4-7f0e5bffc245 admin admin] RBAC: Authorizing `identity:delete_user(user_id=65c3cfcb48044bc3a7578d47f1829d05)` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:50:36.434355 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02576e3d-ff66-49e8-9ee4-7f0e5bffc245 admin admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:50:36.529460 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.notifications [None req-02576e3d-ff66-49e8-9ee4-7f0e5bffc245 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '65c3cfcb48044bc3a7578d47f1829d05'} {{(pid=87934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:50:36.530000 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.notifications [None req-02576e3d-ff66-49e8-9ee4-7f0e5bffc245 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '65c3cfcb48044bc3a7578d47f1829d05'} {{(pid=87934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:50:36.530981 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.notifications [None req-02576e3d-ff66-49e8-9ee4-7f0e5bffc245 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '65c3cfcb48044bc3a7578d47f1829d05'} {{(pid=87934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:50:36.539751 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.notifications [None req-02576e3d-ff66-49e8-9ee4-7f0e5bffc245 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '65c3cfcb48044bc3a7578d47f1829d05'} {{(pid=87934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:50:36.559096 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.notifications [None req-02576e3d-ff66-49e8-9ee4-7f0e5bffc245 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '65c3cfcb48044bc3a7578d47f1829d05'} {{(pid=87934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:50:36.574947 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 1110/2175] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Sep 13 19:50:36 2022] DELETE /identity/v3/users/65c3cfcb48044bc3a7578d47f1829d05 => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 19:50:37.050745 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2812482c-64dc-40ba-9fad-e530f8b7d44b admin admin] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:50:37.053666 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.fernet_utils [None req-2812482c-64dc-40ba-9fad-e530f8b7d44b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:50:37.069948 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2812482c-64dc-40ba-9fad-e530f8b7d44b admin admin] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:50:37.184899 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298ef13f-0697-471f-b6fa-282df2a987ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:50:37.188304 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298ef13f-0697-471f-b6fa-282df2a987ce admin admin] REQUEST_METHOD: `DELETE` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:50:37.192247 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298ef13f-0697-471f-b6fa-282df2a987ce admin admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:50:37.192860 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298ef13f-0697-471f-b6fa-282df2a987ce admin admin] PATH_INFO: `/v3/projects/57d725109fc34f7a80d36413b360330e` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:50:37.193921 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-298ef13f-0697-471f-b6fa-282df2a987ce admin admin] RBAC: Authorizing `identity:delete_project(project_id=57d725109fc34f7a80d36413b360330e)` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:50:37.196159 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-298ef13f-0697-471f-b6fa-282df2a987ce admin admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:50:37.265255 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.notifications [None req-298ef13f-0697-471f-b6fa-282df2a987ce admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '57d725109fc34f7a80d36413b360330e', 'request_id': 'req-298ef13f-0697-471f-b6fa-282df2a987ce'} {{(pid=87935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:50:37.271620 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG dbcounter [-] [87935] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=87935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:50:37.272665 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.notifications [None req-298ef13f-0697-471f-b6fa-282df2a987ce admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '57d725109fc34f7a80d36413b360330e', 'request_id': 'req-298ef13f-0697-471f-b6fa-282df2a987ce'} {{(pid=87935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:50:37.283925 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.notifications [None req-298ef13f-0697-471f-b6fa-282df2a987ce admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '57d725109fc34f7a80d36413b360330e', 'request_id': 'req-298ef13f-0697-471f-b6fa-282df2a987ce'} {{(pid=87935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:50:37.301727 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.notifications [None req-298ef13f-0697-471f-b6fa-282df2a987ce admin admin] The token cache is being invalidate because project 57d725109fc34f7a80d36413b360330e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87935) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 19:50:37.302100 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.notifications [None req-298ef13f-0697-471f-b6fa-282df2a987ce admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:50:37.303164 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.notifications [None req-298ef13f-0697-471f-b6fa-282df2a987ce admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:50:37.305117 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 1066/2176] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Sep 13 19:50:37 2022] DELETE /identity/v3/projects/57d725109fc34f7a80d36413b360330e => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 19:50:37.311193 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b09a190-32f7-4913-b45c-6dc4d01abb13 None None] REQUEST_METHOD: `POST` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:50:37.311493 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b09a190-32f7-4913-b45c-6dc4d01abb13 None None] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:50:37.311770 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b09a190-32f7-4913-b45c-6dc4d01abb13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:50:37.340118 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.auth.core [None req-3b09a190-32f7-4913-b45c-6dc4d01abb13 None None] MFA Rules not processed for user `7b0aed92d02344acb92a0e4aa67c3068`. Rule list: `[]` (Enabled: `True`). {{(pid=87934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:50:37.341149 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.fernet_utils [None req-3b09a190-32f7-4913-b45c-6dc4d01abb13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:50:37.415351 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 1111/2177] 10.222.0.25 () {58 vars in 958 bytes} [Tue Sep 13 19:50:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 19:50:37.417089 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0496b3-3ee8-4cf2-99e0-a555c58ce0ee None None] REQUEST_METHOD: `POST` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:50:37.417459 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0496b3-3ee8-4cf2-99e0-a555c58ce0ee None None] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:50:37.417799 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0496b3-3ee8-4cf2-99e0-a555c58ce0ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:50:37.442810 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.auth.core [None req-9d0496b3-3ee8-4cf2-99e0-a555c58ce0ee None None] MFA Rules not processed for user `7b0aed92d02344acb92a0e4aa67c3068`. Rule list: `[]` (Enabled: `True`). {{(pid=87935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:50:37.444298 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.fernet_utils [None req-9d0496b3-3ee8-4cf2-99e0-a555c58ce0ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:50:37.458346 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 1067/2178] 10.222.0.25 () {58 vars in 958 bytes} [Tue Sep 13 19:50:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 19:50:37.458950 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b09a190-32f7-4913-b45c-6dc4d01abb13 None None] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:50:37.468709 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b09a190-32f7-4913-b45c-6dc4d01abb13 None None] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:50:37.474005 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4d623b-75ae-40e6-876a-7c0bb0c14c4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:50:37.474871 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4d623b-75ae-40e6-876a-7c0bb0c14c4b admin admin] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:50:37.475320 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4d623b-75ae-40e6-876a-7c0bb0c14c4b admin admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:50:37.475685 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4d623b-75ae-40e6-876a-7c0bb0c14c4b admin admin] PATH_INFO: `/v3/domains` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:50:37.476724 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e4d623b-75ae-40e6-876a-7c0bb0c14c4b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87934) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:50:37.477119 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e4d623b-75ae-40e6-876a-7c0bb0c14c4b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:50:37.479071 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e4d623b-75ae-40e6-876a-7c0bb0c14c4b admin admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:50:37.492793 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 1112/2179] 10.222.0.25 () {58 vars in 1153 bytes} [Tue Sep 13 19:50:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:50:37.497181 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0496b3-3ee8-4cf2-99e0-a555c58ce0ee None None] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:50:37.509926 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0496b3-3ee8-4cf2-99e0-a555c58ce0ee None None] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:50:37.520011 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfcb517f-9ffd-4763-b083-1e3a7ee4b39a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:50:37.521110 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfcb517f-9ffd-4763-b083-1e3a7ee4b39a admin admin] REQUEST_METHOD: `POST` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:50:37.521564 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfcb517f-9ffd-4763-b083-1e3a7ee4b39a admin admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:50:37.522124 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfcb517f-9ffd-4763-b083-1e3a7ee4b39a admin admin] PATH_INFO: `/v3/projects` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:50:37.523071 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfcb517f-9ffd-4763-b083-1e3a7ee4b39a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:50:37.525790 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfcb517f-9ffd-4763-b083-1e3a7ee4b39a admin admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:50:37.570335 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 1068/2180] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Sep 13 19:50:37 2022] POST /identity/v3/projects => generated 371 bytes in 70 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 19:50:37.571838 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4d623b-75ae-40e6-876a-7c0bb0c14c4b admin admin] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:50:37.596652 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4d623b-75ae-40e6-876a-7c0bb0c14c4b admin admin] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:50:37.607478 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG dbcounter [-] [87934] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:50:37.721035 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a52a02-becf-40fc-91d7-1410343870ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:50:37.721809 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a52a02-becf-40fc-91d7-1410343870ee admin admin] REQUEST_METHOD: `POST` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:50:37.722833 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a52a02-becf-40fc-91d7-1410343870ee admin admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:50:37.723188 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a52a02-becf-40fc-91d7-1410343870ee admin admin] PATH_INFO: `/v3/users` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:50:37.725393 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a52a02-becf-40fc-91d7-1410343870ee admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:50:37.729925 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a52a02-becf-40fc-91d7-1410343870ee admin admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:50:37.790313 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 1113/2181] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Sep 13 19:50:37 2022] POST /identity/v3/users => generated 286 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 13 19:50:37.795981 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfcb517f-9ffd-4763-b083-1e3a7ee4b39a admin admin] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:50:37.812320 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfcb517f-9ffd-4763-b083-1e3a7ee4b39a admin admin] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:50:37.835811 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9995d321-28dc-40eb-b1c8-67843b8dd9f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:50:37.837015 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9995d321-28dc-40eb-b1c8-67843b8dd9f8 admin admin] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:50:37.837510 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9995d321-28dc-40eb-b1c8-67843b8dd9f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:50:37.837950 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9995d321-28dc-40eb-b1c8-67843b8dd9f8 admin admin] PATH_INFO: `/v3/roles` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:50:37.838821 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9995d321-28dc-40eb-b1c8-67843b8dd9f8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:50:37.847426 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9995d321-28dc-40eb-b1c8-67843b8dd9f8 admin admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:50:37.877570 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 1069/2182] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Sep 13 19:50:37 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 19:50:37.883854 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a52a02-becf-40fc-91d7-1410343870ee admin admin] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:50:37.897370 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a52a02-becf-40fc-91d7-1410343870ee admin admin] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:50:37.914781 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9356fd3a-4d6d-433d-839b-80f300d8b76a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:50:37.916733 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9356fd3a-4d6d-433d-839b-80f300d8b76a admin admin] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:50:37.917459 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9356fd3a-4d6d-433d-839b-80f300d8b76a admin admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:50:37.918228 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9356fd3a-4d6d-433d-839b-80f300d8b76a admin admin] PATH_INFO: `/v3/roles` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:50:37.919112 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9356fd3a-4d6d-433d-839b-80f300d8b76a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:50:37.923295 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9356fd3a-4d6d-433d-839b-80f300d8b76a admin admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:50:37.956843 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9995d321-28dc-40eb-b1c8-67843b8dd9f8 admin admin] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:50:37.963641 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 1114/2183] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Sep 13 19:50:37 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 19:50:37.970464 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9995d321-28dc-40eb-b1c8-67843b8dd9f8 admin admin] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:50:37.982229 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5252b834-c210-40ce-a56d-139988b666c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:50:37.986072 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5252b834-c210-40ce-a56d-139988b666c0 admin admin] REQUEST_METHOD: `PUT` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:50:37.986545 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5252b834-c210-40ce-a56d-139988b666c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:50:37.986789 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5252b834-c210-40ce-a56d-139988b666c0 admin admin] PATH_INFO: `/v3/projects/65927b0e2851422fb887353d468ef2ba/users/9bc5f13fb990475ab4594432ecf5cbc3/roles/a259191f6d0e46fabd9f34536bb28747` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:50:38.025380 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5252b834-c210-40ce-a56d-139988b666c0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=65927b0e2851422fb887353d468ef2ba, user_id=9bc5f13fb990475ab4594432ecf5cbc3, role_id=a259191f6d0e46fabd9f34536bb28747)` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:50:38.028566 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5252b834-c210-40ce-a56d-139988b666c0 admin admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:50:38.064105 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db58b2c-3f1e-4330-829a-4351ce60a5af None None] REQUEST_METHOD: `POST` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:50:38.064420 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db58b2c-3f1e-4330-829a-4351ce60a5af None None] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:50:38.064790 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db58b2c-3f1e-4330-829a-4351ce60a5af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:50:38.071609 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 1070/2184] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Sep 13 19:50:37 2022] PUT /identity/v3/projects/65927b0e2851422fb887353d468ef2ba/users/9bc5f13fb990475ab4594432ecf5cbc3/roles/a259191f6d0e46fabd9f34536bb28747 => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 19:50:38.097857 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.auth.core [None req-3db58b2c-3f1e-4330-829a-4351ce60a5af None None] MFA Rules not processed for user `9bc5f13fb990475ab4594432ecf5cbc3`. Rule list: `[]` (Enabled: `True`). {{(pid=87934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:50:38.099336 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.fernet_utils [None req-3db58b2c-3f1e-4330-829a-4351ce60a5af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:50:38.217999 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5252b834-c210-40ce-a56d-139988b666c0 admin admin] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:50:38.222206 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.fernet_utils [None req-5252b834-c210-40ce-a56d-139988b666c0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:50:38.232860 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 1115/2185] 10.222.0.25 () {58 vars in 958 bytes} [Tue Sep 13 19:50:38 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 19:50:38.336998 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5252b834-c210-40ce-a56d-139988b666c0 admin admin] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:50:38.341341 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59868194-34c1-4ac0-96b1-7cfc1f5f30b5 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '907d44d3b6944ccb83999d8e489871d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a10a4268f3c4cb29f4e00c292e2df62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:50:38.342098 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59868194-34c1-4ac0-96b1-7cfc1f5f30b5 service glance] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:50:38.342667 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59868194-34c1-4ac0-96b1-7cfc1f5f30b5 service glance] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:50:38.343016 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59868194-34c1-4ac0-96b1-7cfc1f5f30b5 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:50:38.353552 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59868194-34c1-4ac0-96b1-7cfc1f5f30b5 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:50:38.355052 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59868194-34c1-4ac0-96b1-7cfc1f5f30b5 service glance] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:50:38.365736 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 1071/2186] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Sep 13 19:50:38 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 13 19:50:40.380724 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff118c70-8a04-43ae-b4d4-a0e1cc22541c None None] REQUEST_METHOD: `POST` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:50:40.381810 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff118c70-8a04-43ae-b4d4-a0e1cc22541c None None] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:50:40.382401 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff118c70-8a04-43ae-b4d4-a0e1cc22541c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:50:40.412236 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.auth.core [None req-ff118c70-8a04-43ae-b4d4-a0e1cc22541c None None] MFA Rules not processed for user `99d1fbe8157e47ffac2699d12e76e2c3`. Rule list: `[]` (Enabled: `True`). {{(pid=87934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:50:40.413493 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.fernet_utils [None req-ff118c70-8a04-43ae-b4d4-a0e1cc22541c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:50:40.499000 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 1116/2187] 10.222.0.25 () {58 vars in 958 bytes} [Tue Sep 13 19:50:40 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 19:50:40.504287 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59868194-34c1-4ac0-96b1-7cfc1f5f30b5 service glance] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:50:40.505758 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.fernet_utils [None req-59868194-34c1-4ac0-96b1-7cfc1f5f30b5 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:50:40.605499 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59868194-34c1-4ac0-96b1-7cfc1f5f30b5 service glance] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:50:40.610256 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1154f5-eea4-48a0-ae52-1d456c00117d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:50:40.611530 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1154f5-eea4-48a0-ae52-1d456c00117d admin admin] REQUEST_METHOD: `POST` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:50:40.612101 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1154f5-eea4-48a0-ae52-1d456c00117d admin admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:50:40.612416 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1154f5-eea4-48a0-ae52-1d456c00117d admin admin] PATH_INFO: `/v3/projects` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:50:40.613179 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad1154f5-eea4-48a0-ae52-1d456c00117d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:50:40.615639 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad1154f5-eea4-48a0-ae52-1d456c00117d admin admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:50:40.622456 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG dbcounter [-] [87935] Writing DB stats keystone:DELETE=2,keystone:SELECT=95,keystone:INSERT=3 {{(pid=87935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:50:40.652921 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 1072/2188] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Sep 13 19:50:40 2022] POST /identity/v3/projects => generated 385 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 19:50:40.658269 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff118c70-8a04-43ae-b4d4-a0e1cc22541c None None] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:50:40.673775 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff118c70-8a04-43ae-b4d4-a0e1cc22541c None None] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:50:40.687274 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG dbcounter [-] [87934] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:50:40.778906 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9465825-7f35-4827-91e0-cc5c38519684 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:50:40.779524 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9465825-7f35-4827-91e0-cc5c38519684 admin admin] REQUEST_METHOD: `POST` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:50:40.779803 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9465825-7f35-4827-91e0-cc5c38519684 admin admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:50:40.780073 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9465825-7f35-4827-91e0-cc5c38519684 admin admin] PATH_INFO: `/v3/users` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:50:40.780743 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9465825-7f35-4827-91e0-cc5c38519684 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:50:40.783452 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9465825-7f35-4827-91e0-cc5c38519684 admin admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:50:40.808744 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 1117/2189] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Sep 13 19:50:40 2022] POST /identity/v3/users => generated 299 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 19:50:40.812773 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1154f5-eea4-48a0-ae52-1d456c00117d admin admin] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:50:40.823735 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1154f5-eea4-48a0-ae52-1d456c00117d admin admin] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:50:40.829790 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12c6eef-cc21-4849-8a98-54f8646dd1fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:50:40.830362 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12c6eef-cc21-4849-8a98-54f8646dd1fc admin admin] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:50:40.830635 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12c6eef-cc21-4849-8a98-54f8646dd1fc admin admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:50:40.830899 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12c6eef-cc21-4849-8a98-54f8646dd1fc admin admin] PATH_INFO: `/v3/roles` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:50:40.831534 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a12c6eef-cc21-4849-8a98-54f8646dd1fc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:50:40.833182 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a12c6eef-cc21-4849-8a98-54f8646dd1fc admin admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:50:40.844401 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 1073/2190] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Sep 13 19:50:40 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 19:50:40.849233 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9465825-7f35-4827-91e0-cc5c38519684 admin admin] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:50:40.859547 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9465825-7f35-4827-91e0-cc5c38519684 admin admin] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:50:40.865365 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca785e53-27fd-4034-a8d5-2cb7e5de971b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:50:40.866175 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca785e53-27fd-4034-a8d5-2cb7e5de971b admin admin] REQUEST_METHOD: `PUT` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:50:40.866467 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca785e53-27fd-4034-a8d5-2cb7e5de971b admin admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:50:40.866809 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca785e53-27fd-4034-a8d5-2cb7e5de971b admin admin] PATH_INFO: `/v3/projects/0c5b66aebe384564b6f247aba1256ea2/users/0b4c607b75614463b0e18da9a001b96b/roles/6ca1d4427ff64e0a9d25d96cfb1445f6` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:50:40.890497 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca785e53-27fd-4034-a8d5-2cb7e5de971b admin admin] RBAC: Authorizing `identity:create_grant(project_id=0c5b66aebe384564b6f247aba1256ea2, user_id=0b4c607b75614463b0e18da9a001b96b, role_id=6ca1d4427ff64e0a9d25d96cfb1445f6)` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:50:40.893383 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca785e53-27fd-4034-a8d5-2cb7e5de971b admin admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:50:40.908603 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 1118/2191] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Sep 13 19:50:40 2022] PUT /identity/v3/projects/0c5b66aebe384564b6f247aba1256ea2/users/0b4c607b75614463b0e18da9a001b96b/roles/6ca1d4427ff64e0a9d25d96cfb1445f6 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 19:50:40.912787 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12c6eef-cc21-4849-8a98-54f8646dd1fc admin admin] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:50:40.924681 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12c6eef-cc21-4849-8a98-54f8646dd1fc admin admin] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:50:41.036975 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8cd3ef-0a56-476c-8bc7-424622f3b6b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:50:41.037633 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8cd3ef-0a56-476c-8bc7-424622f3b6b6 admin admin] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:50:41.040385 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8cd3ef-0a56-476c-8bc7-424622f3b6b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:50:41.040881 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8cd3ef-0a56-476c-8bc7-424622f3b6b6 admin admin] PATH_INFO: `/v3/roles` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:50:41.041736 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a8cd3ef-0a56-476c-8bc7-424622f3b6b6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:50:41.043455 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a8cd3ef-0a56-476c-8bc7-424622f3b6b6 admin admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:50:41.064882 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 1074/2192] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Sep 13 19:50:40 2022] GET /identity/v3/roles => generated 1420 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 19:50:41.069070 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca785e53-27fd-4034-a8d5-2cb7e5de971b admin admin] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:50:41.083727 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca785e53-27fd-4034-a8d5-2cb7e5de971b admin admin] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:50:41.098988 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9800e4ae-abb4-4453-8f56-5cf853782c2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:50:41.099741 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9800e4ae-abb4-4453-8f56-5cf853782c2d admin admin] REQUEST_METHOD: `PUT` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:50:41.100166 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9800e4ae-abb4-4453-8f56-5cf853782c2d admin admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:50:41.100506 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9800e4ae-abb4-4453-8f56-5cf853782c2d admin admin] PATH_INFO: `/v3/projects/0c5b66aebe384564b6f247aba1256ea2/users/0b4c607b75614463b0e18da9a001b96b/roles/6ca1d4427ff64e0a9d25d96cfb1445f6` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:50:41.102834 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9800e4ae-abb4-4453-8f56-5cf853782c2d admin admin] RBAC: Authorizing `identity:create_grant(project_id=0c5b66aebe384564b6f247aba1256ea2, user_id=0b4c607b75614463b0e18da9a001b96b, role_id=6ca1d4427ff64e0a9d25d96cfb1445f6)` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:50:41.107142 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9800e4ae-abb4-4453-8f56-5cf853782c2d admin admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:50:41.130908 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 1119/2193] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Sep 13 19:50:41 2022] PUT /identity/v3/projects/0c5b66aebe384564b6f247aba1256ea2/users/0b4c607b75614463b0e18da9a001b96b/roles/6ca1d4427ff64e0a9d25d96cfb1445f6 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 19:50:41.238611 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8cd3ef-0a56-476c-8bc7-424622f3b6b6 admin admin] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:50:41.240487 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.fernet_utils [None req-4a8cd3ef-0a56-476c-8bc7-424622f3b6b6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:50:41.258462 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8cd3ef-0a56-476c-8bc7-424622f3b6b6 admin admin] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:50:41.347548 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f55f937-cd86-460f-bf5a-1a2cb6623d38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:50:41.348426 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f55f937-cd86-460f-bf5a-1a2cb6623d38 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:50:41.348710 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f55f937-cd86-460f-bf5a-1a2cb6623d38 admin admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:50:41.349132 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f55f937-cd86-460f-bf5a-1a2cb6623d38 admin admin] PATH_INFO: `/v3/users/93d45a881bda4d4a93e1582d38a200b9` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:50:41.350504 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f55f937-cd86-460f-bf5a-1a2cb6623d38 admin admin] RBAC: Authorizing `identity:delete_user(user_id=93d45a881bda4d4a93e1582d38a200b9)` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:50:41.352483 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f55f937-cd86-460f-bf5a-1a2cb6623d38 admin admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:50:41.422297 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.notifications [None req-9f55f937-cd86-460f-bf5a-1a2cb6623d38 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '93d45a881bda4d4a93e1582d38a200b9'} {{(pid=87935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:50:41.432340 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.notifications [None req-9f55f937-cd86-460f-bf5a-1a2cb6623d38 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '93d45a881bda4d4a93e1582d38a200b9'} {{(pid=87935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:50:41.451241 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.notifications [None req-9f55f937-cd86-460f-bf5a-1a2cb6623d38 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '93d45a881bda4d4a93e1582d38a200b9'} {{(pid=87935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:50:41.452811 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.notifications [None req-9f55f937-cd86-460f-bf5a-1a2cb6623d38 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '93d45a881bda4d4a93e1582d38a200b9'} {{(pid=87935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:50:41.453840 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.notifications [None req-9f55f937-cd86-460f-bf5a-1a2cb6623d38 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '93d45a881bda4d4a93e1582d38a200b9'} {{(pid=87935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:50:41.458368 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG dbcounter [-] [87935] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=87935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:50:41.474102 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 1075/2194] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Sep 13 19:50:41 2022] DELETE /identity/v3/users/93d45a881bda4d4a93e1582d38a200b9 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 19:50:41.478720 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2260af7f-e527-4abc-81b3-3db06ee07e13 None None] REQUEST_METHOD: `POST` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:50:41.479257 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2260af7f-e527-4abc-81b3-3db06ee07e13 None None] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:50:41.479367 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2260af7f-e527-4abc-81b3-3db06ee07e13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:50:41.502214 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.auth.core [None req-2260af7f-e527-4abc-81b3-3db06ee07e13 None None] MFA Rules not processed for user `7b0aed92d02344acb92a0e4aa67c3068`. Rule list: `[]` (Enabled: `True`). {{(pid=87934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:50:41.503426 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.fernet_utils [None req-2260af7f-e527-4abc-81b3-3db06ee07e13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:50:41.636374 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 1120/2195] 10.222.0.25 () {58 vars in 958 bytes} [Tue Sep 13 19:50:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 19:50:41.643849 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f55f937-cd86-460f-bf5a-1a2cb6623d38 admin admin] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:50:41.645552 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.fernet_utils [None req-9f55f937-cd86-460f-bf5a-1a2cb6623d38 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:50:41.746718 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f55f937-cd86-460f-bf5a-1a2cb6623d38 admin admin] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:50:41.750686 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126d5c6c-c625-4373-8e8b-ff8545c9794f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1196a96e4a404f559600b69f929ea9da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a10a4268f3c4cb29f4e00c292e2df62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:50:41.751643 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126d5c6c-c625-4373-8e8b-ff8545c9794f service neutron] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:50:41.751968 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126d5c6c-c625-4373-8e8b-ff8545c9794f service neutron] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:50:41.752267 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126d5c6c-c625-4373-8e8b-ff8545c9794f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:50:41.764020 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-126d5c6c-c625-4373-8e8b-ff8545c9794f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:50:41.765564 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-126d5c6c-c625-4373-8e8b-ff8545c9794f service neutron] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:50:41.794955 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 1076/2196] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Sep 13 19:50:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 19:50:42.483594 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2260af7f-e527-4abc-81b3-3db06ee07e13 None None] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:50:42.487028 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.fernet_utils [None req-2260af7f-e527-4abc-81b3-3db06ee07e13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:50:42.510402 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2260af7f-e527-4abc-81b3-3db06ee07e13 None None] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:50:42.524869 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d9f21e-aec2-4911-b08f-00c88496a18b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:50:42.531319 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d9f21e-aec2-4911-b08f-00c88496a18b admin admin] REQUEST_METHOD: `DELETE` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:50:42.531740 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d9f21e-aec2-4911-b08f-00c88496a18b admin admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:50:42.532025 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d9f21e-aec2-4911-b08f-00c88496a18b admin admin] PATH_INFO: `/v3/projects/48aa775c691040df8e8da9981f83540e` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:50:42.533834 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d9f21e-aec2-4911-b08f-00c88496a18b admin admin] RBAC: Authorizing `identity:delete_project(project_id=48aa775c691040df8e8da9981f83540e)` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:50:42.535850 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d9f21e-aec2-4911-b08f-00c88496a18b admin admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:50:42.680157 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.notifications [None req-17d9f21e-aec2-4911-b08f-00c88496a18b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '48aa775c691040df8e8da9981f83540e', 'request_id': 'req-17d9f21e-aec2-4911-b08f-00c88496a18b'} {{(pid=87934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:50:42.690730 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.notifications [None req-17d9f21e-aec2-4911-b08f-00c88496a18b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '48aa775c691040df8e8da9981f83540e', 'request_id': 'req-17d9f21e-aec2-4911-b08f-00c88496a18b'} {{(pid=87934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:50:42.695560 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG dbcounter [-] [87934] Writing DB stats keystone:SELECT=90,keystone:INSERT=5,keystone:DELETE=5 {{(pid=87934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:50:42.698633 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.notifications [None req-17d9f21e-aec2-4911-b08f-00c88496a18b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '48aa775c691040df8e8da9981f83540e', 'request_id': 'req-17d9f21e-aec2-4911-b08f-00c88496a18b'} {{(pid=87934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:50:42.719558 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.notifications [None req-17d9f21e-aec2-4911-b08f-00c88496a18b admin admin] The token cache is being invalidate because project 48aa775c691040df8e8da9981f83540e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87934) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 19:50:42.720272 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.notifications [None req-17d9f21e-aec2-4911-b08f-00c88496a18b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:50:42.721442 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.notifications [None req-17d9f21e-aec2-4911-b08f-00c88496a18b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:50:42.723591 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 1121/2197] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Sep 13 19:50:42 2022] DELETE /identity/v3/projects/48aa775c691040df8e8da9981f83540e => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 19:50:42.727702 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126d5c6c-c625-4373-8e8b-ff8545c9794f service neutron] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:50:42.742330 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126d5c6c-c625-4373-8e8b-ff8545c9794f service neutron] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:50:42.824860 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2869e1-87e1-4828-9d53-676fb7fc7967 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:50:42.825510 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2869e1-87e1-4828-9d53-676fb7fc7967 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:50:42.825938 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2869e1-87e1-4828-9d53-676fb7fc7967 admin admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:50:42.826215 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2869e1-87e1-4828-9d53-676fb7fc7967 admin admin] PATH_INFO: `/v3/users/935c428b31f74131abf0ba610cc85aa4` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:50:42.827446 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e2869e1-87e1-4828-9d53-676fb7fc7967 admin admin] RBAC: Authorizing `identity:delete_user(user_id=935c428b31f74131abf0ba610cc85aa4)` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:50:42.831151 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e2869e1-87e1-4828-9d53-676fb7fc7967 admin admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:50:42.898804 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.notifications [None req-3e2869e1-87e1-4828-9d53-676fb7fc7967 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '935c428b31f74131abf0ba610cc85aa4'} {{(pid=87935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:50:42.909543 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.notifications [None req-3e2869e1-87e1-4828-9d53-676fb7fc7967 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '935c428b31f74131abf0ba610cc85aa4'} {{(pid=87935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:50:42.926712 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.notifications [None req-3e2869e1-87e1-4828-9d53-676fb7fc7967 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '935c428b31f74131abf0ba610cc85aa4'} {{(pid=87935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:50:42.927934 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.notifications [None req-3e2869e1-87e1-4828-9d53-676fb7fc7967 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '935c428b31f74131abf0ba610cc85aa4'} {{(pid=87935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:50:42.931108 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.notifications [None req-3e2869e1-87e1-4828-9d53-676fb7fc7967 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '935c428b31f74131abf0ba610cc85aa4'} {{(pid=87935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:50:42.949672 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 1077/2198] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Sep 13 19:50:42 2022] DELETE /identity/v3/users/935c428b31f74131abf0ba610cc85aa4 => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 19:50:43.375372 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d9f21e-aec2-4911-b08f-00c88496a18b admin admin] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:50:43.377183 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.fernet_utils [None req-17d9f21e-aec2-4911-b08f-00c88496a18b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:50:43.413915 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d9f21e-aec2-4911-b08f-00c88496a18b admin admin] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:50:43.584751 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2770d75f-a548-4eac-babc-c6d78fa2d0f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:50:43.586327 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2770d75f-a548-4eac-babc-c6d78fa2d0f4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:50:43.586840 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2770d75f-a548-4eac-babc-c6d78fa2d0f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:50:43.587320 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2770d75f-a548-4eac-babc-c6d78fa2d0f4 admin admin] PATH_INFO: `/v3/projects/8199c2f6de85400da6a7a553033f9dc2` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:50:43.589055 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2770d75f-a548-4eac-babc-c6d78fa2d0f4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8199c2f6de85400da6a7a553033f9dc2)` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:50:43.592190 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2770d75f-a548-4eac-babc-c6d78fa2d0f4 admin admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:50:43.703189 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.notifications [None req-2770d75f-a548-4eac-babc-c6d78fa2d0f4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8199c2f6de85400da6a7a553033f9dc2', 'request_id': 'req-2770d75f-a548-4eac-babc-c6d78fa2d0f4'} {{(pid=87934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:50:43.713027 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.notifications [None req-2770d75f-a548-4eac-babc-c6d78fa2d0f4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8199c2f6de85400da6a7a553033f9dc2', 'request_id': 'req-2770d75f-a548-4eac-babc-c6d78fa2d0f4'} {{(pid=87934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:50:43.723267 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.notifications [None req-2770d75f-a548-4eac-babc-c6d78fa2d0f4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8199c2f6de85400da6a7a553033f9dc2', 'request_id': 'req-2770d75f-a548-4eac-babc-c6d78fa2d0f4'} {{(pid=87934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:50:43.785482 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.notifications [None req-2770d75f-a548-4eac-babc-c6d78fa2d0f4 admin admin] The token cache is being invalidate because project 8199c2f6de85400da6a7a553033f9dc2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87934) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 19:50:43.786123 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.notifications [None req-2770d75f-a548-4eac-babc-c6d78fa2d0f4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:50:43.787757 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.notifications [None req-2770d75f-a548-4eac-babc-c6d78fa2d0f4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:50:43.790475 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 1122/2199] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Sep 13 19:50:43 2022] DELETE /identity/v3/projects/8199c2f6de85400da6a7a553033f9dc2 => generated 0 bytes in 415 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 19:50:43.795103 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf688e40-2d83-487c-b8df-ee8885ad6ef0 None None] REQUEST_METHOD: `POST` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:50:43.795571 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf688e40-2d83-487c-b8df-ee8885ad6ef0 None None] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:50:43.795657 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf688e40-2d83-487c-b8df-ee8885ad6ef0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:50:43.844428 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.auth.core [None req-bf688e40-2d83-487c-b8df-ee8885ad6ef0 None None] MFA Rules not processed for user `7b0aed92d02344acb92a0e4aa67c3068`. Rule list: `[]` (Enabled: `True`). {{(pid=87935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:50:43.846117 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.fernet_utils [None req-bf688e40-2d83-487c-b8df-ee8885ad6ef0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:50:43.875452 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG dbcounter [-] [87935] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:50:43.996663 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 1078/2200] 10.222.0.25 () {58 vars in 958 bytes} [Tue Sep 13 19:50:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 19:50:44.004240 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863f4cfb-dd1a-47ed-9602-5a8914d899ef None None] REQUEST_METHOD: `POST` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:50:44.005034 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863f4cfb-dd1a-47ed-9602-5a8914d899ef None None] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:50:44.005034 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863f4cfb-dd1a-47ed-9602-5a8914d899ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:50:44.029850 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.auth.core [None req-863f4cfb-dd1a-47ed-9602-5a8914d899ef None None] MFA Rules not processed for user `7b0aed92d02344acb92a0e4aa67c3068`. Rule list: `[]` (Enabled: `True`). {{(pid=87934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:50:44.033935 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.fernet_utils [None req-863f4cfb-dd1a-47ed-9602-5a8914d899ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:50:44.045736 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 1123/2201] 10.222.0.25 () {58 vars in 958 bytes} [Tue Sep 13 19:50:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 19:50:44.052188 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf688e40-2d83-487c-b8df-ee8885ad6ef0 None None] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:50:44.068143 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf688e40-2d83-487c-b8df-ee8885ad6ef0 None None] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:50:44.074795 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8bf02e4-fa0e-402c-b855-6fe2701e85e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:50:44.075688 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bf02e4-fa0e-402c-b855-6fe2701e85e5 admin admin] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:50:44.076160 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bf02e4-fa0e-402c-b855-6fe2701e85e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:50:44.076670 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bf02e4-fa0e-402c-b855-6fe2701e85e5 admin admin] PATH_INFO: `/v3/domains` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:50:44.077639 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8bf02e4-fa0e-402c-b855-6fe2701e85e5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87935) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:50:44.078749 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8bf02e4-fa0e-402c-b855-6fe2701e85e5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:50:44.081238 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8bf02e4-fa0e-402c-b855-6fe2701e85e5 admin admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:50:44.099608 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 1079/2202] 10.222.0.25 () {58 vars in 1153 bytes} [Tue Sep 13 19:50:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:50:44.104819 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863f4cfb-dd1a-47ed-9602-5a8914d899ef None None] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:50:44.117988 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863f4cfb-dd1a-47ed-9602-5a8914d899ef None None] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:50:44.124738 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6b297f-f97c-454b-bffa-e2f724291d12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:50:44.125601 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6b297f-f97c-454b-bffa-e2f724291d12 admin admin] REQUEST_METHOD: `POST` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:50:44.126419 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6b297f-f97c-454b-bffa-e2f724291d12 admin admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:50:44.126895 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6b297f-f97c-454b-bffa-e2f724291d12 admin admin] PATH_INFO: `/v3/projects` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:50:44.127981 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa6b297f-f97c-454b-bffa-e2f724291d12 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:50:44.130391 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa6b297f-f97c-454b-bffa-e2f724291d12 admin admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:50:44.187836 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 1124/2203] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Sep 13 19:50:44 2022] POST /identity/v3/projects => generated 401 bytes in 84 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 13 19:50:44.188734 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8bf02e4-fa0e-402c-b855-6fe2701e85e5 admin admin] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:50:44.204017 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8bf02e4-fa0e-402c-b855-6fe2701e85e5 admin admin] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:50:44.367241 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d770121-1416-49bd-9559-4a0c3857fe93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:50:44.368427 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d770121-1416-49bd-9559-4a0c3857fe93 admin admin] REQUEST_METHOD: `POST` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:50:44.368912 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d770121-1416-49bd-9559-4a0c3857fe93 admin admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:50:44.369357 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d770121-1416-49bd-9559-4a0c3857fe93 admin admin] PATH_INFO: `/v3/users` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:50:44.370181 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d770121-1416-49bd-9559-4a0c3857fe93 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:50:44.372368 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d770121-1416-49bd-9559-4a0c3857fe93 admin admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:50:44.417077 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 1080/2204] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Sep 13 19:50:44 2022] POST /identity/v3/users => generated 301 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 13 19:50:44.421029 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6b297f-f97c-454b-bffa-e2f724291d12 admin admin] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:50:44.442445 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6b297f-f97c-454b-bffa-e2f724291d12 admin admin] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:50:44.459853 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743905ca-adb3-4dad-9998-d76e2fa2b8cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:50:44.460617 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743905ca-adb3-4dad-9998-d76e2fa2b8cd admin admin] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:50:44.460901 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743905ca-adb3-4dad-9998-d76e2fa2b8cd admin admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:50:44.461169 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743905ca-adb3-4dad-9998-d76e2fa2b8cd admin admin] PATH_INFO: `/v3/roles` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:50:44.462028 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-743905ca-adb3-4dad-9998-d76e2fa2b8cd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:50:44.482285 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-743905ca-adb3-4dad-9998-d76e2fa2b8cd admin admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:50:44.507077 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 1125/2205] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Sep 13 19:50:44 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 13 19:50:44.508293 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d770121-1416-49bd-9559-4a0c3857fe93 admin admin] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:50:44.521865 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d770121-1416-49bd-9559-4a0c3857fe93 admin admin] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:50:44.531081 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc78876b-ae98-4416-90da-1fc4920f5717 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:50:44.532137 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc78876b-ae98-4416-90da-1fc4920f5717 admin admin] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:50:44.532832 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc78876b-ae98-4416-90da-1fc4920f5717 admin admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:50:44.533324 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc78876b-ae98-4416-90da-1fc4920f5717 admin admin] PATH_INFO: `/v3/roles` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:50:44.534184 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc78876b-ae98-4416-90da-1fc4920f5717 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:50:44.536004 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc78876b-ae98-4416-90da-1fc4920f5717 admin admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:50:44.549074 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 1081/2206] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Sep 13 19:50:44 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 13 19:50:44.553084 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743905ca-adb3-4dad-9998-d76e2fa2b8cd admin admin] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:50:44.571276 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743905ca-adb3-4dad-9998-d76e2fa2b8cd admin admin] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:50:44.581221 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0d0221-1f98-44de-9a88-acde15fd0e63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:50:44.583212 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0d0221-1f98-44de-9a88-acde15fd0e63 admin admin] REQUEST_METHOD: `PUT` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:50:44.583721 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0d0221-1f98-44de-9a88-acde15fd0e63 admin admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:50:44.584670 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0d0221-1f98-44de-9a88-acde15fd0e63 admin admin] PATH_INFO: `/v3/projects/2a785363787c45798cbd470d50ebd36a/users/bdb07932211b40e0b459dae5fdd1421f/roles/a259191f6d0e46fabd9f34536bb28747` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:50:44.608730 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba0d0221-1f98-44de-9a88-acde15fd0e63 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2a785363787c45798cbd470d50ebd36a, user_id=bdb07932211b40e0b459dae5fdd1421f, role_id=a259191f6d0e46fabd9f34536bb28747)` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:50:44.619064 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba0d0221-1f98-44de-9a88-acde15fd0e63 admin admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:50:44.643741 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 1126/2207] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Sep 13 19:50:44 2022] PUT /identity/v3/projects/2a785363787c45798cbd470d50ebd36a/users/bdb07932211b40e0b459dae5fdd1421f/roles/a259191f6d0e46fabd9f34536bb28747 => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 19:50:44.654428 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7357bc46-1119-4e34-9333-9767fccdd508 None None] REQUEST_METHOD: `POST` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:50:44.655044 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7357bc46-1119-4e34-9333-9767fccdd508 None None] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:50:44.655201 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7357bc46-1119-4e34-9333-9767fccdd508 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:50:44.692798 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.auth.core [None req-7357bc46-1119-4e34-9333-9767fccdd508 None None] MFA Rules not processed for user `bdb07932211b40e0b459dae5fdd1421f`. Rule list: `[]` (Enabled: `True`). {{(pid=87935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:50:44.694346 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.fernet_utils [None req-7357bc46-1119-4e34-9333-9767fccdd508 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:50:44.799651 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 1082/2208] 10.222.0.25 () {58 vars in 958 bytes} [Tue Sep 13 19:50:44 2022] POST /identity/v3/auth/tokens => generated 3278 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 19:50:44.804244 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0d0221-1f98-44de-9a88-acde15fd0e63 admin admin] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:50:44.824091 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG dbcounter [-] [87934] Writing DB stats keystone:DELETE=9,keystone:SELECT=87,keystone:INSERT=4 {{(pid=87934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:50:44.912935 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0d0221-1f98-44de-9a88-acde15fd0e63 admin admin] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:50:44.918081 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0c36cb-78ab-48a9-8e3a-8395c51011cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:50:44.918704 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0c36cb-78ab-48a9-8e3a-8395c51011cb admin admin] REQUEST_METHOD: `POST` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:50:44.918983 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0c36cb-78ab-48a9-8e3a-8395c51011cb admin admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:50:44.919256 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0c36cb-78ab-48a9-8e3a-8395c51011cb admin admin] PATH_INFO: `/v3/projects` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:50:44.919973 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f0c36cb-78ab-48a9-8e3a-8395c51011cb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:50:44.922016 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f0c36cb-78ab-48a9-8e3a-8395c51011cb admin admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:50:44.969078 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 1127/2209] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Sep 13 19:50:44 2022] POST /identity/v3/projects => generated 401 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 19:50:44.974086 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7357bc46-1119-4e34-9333-9767fccdd508 None None] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:50:44.992930 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7357bc46-1119-4e34-9333-9767fccdd508 None None] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:50:45.002775 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG dbcounter [-] [87935] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:50:45.120928 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7286d8-4f79-47dd-900d-65bbbb60712e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:50:45.121748 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7286d8-4f79-47dd-900d-65bbbb60712e admin admin] REQUEST_METHOD: `POST` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:50:45.122006 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7286d8-4f79-47dd-900d-65bbbb60712e admin admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:50:45.122279 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7286d8-4f79-47dd-900d-65bbbb60712e admin admin] PATH_INFO: `/v3/users` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:50:45.125432 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e7286d8-4f79-47dd-900d-65bbbb60712e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:50:45.130164 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e7286d8-4f79-47dd-900d-65bbbb60712e admin admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:50:45.183745 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 1083/2210] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Sep 13 19:50:44 2022] POST /identity/v3/users => generated 307 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 19:50:45.188169 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0c36cb-78ab-48a9-8e3a-8395c51011cb admin admin] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:50:45.206460 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0c36cb-78ab-48a9-8e3a-8395c51011cb admin admin] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:50:45.219190 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab71981-f859-4b86-92b8-9b806a50d50a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:50:45.220140 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab71981-f859-4b86-92b8-9b806a50d50a admin admin] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:50:45.220568 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab71981-f859-4b86-92b8-9b806a50d50a admin admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:50:45.221039 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab71981-f859-4b86-92b8-9b806a50d50a admin admin] PATH_INFO: `/v3/roles` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:50:45.221785 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab71981-f859-4b86-92b8-9b806a50d50a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:50:45.223608 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab71981-f859-4b86-92b8-9b806a50d50a admin admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:50:45.243283 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7286d8-4f79-47dd-900d-65bbbb60712e admin admin] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:50:45.244664 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 1128/2211] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Sep 13 19:50:45 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 19:50:45.257172 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7286d8-4f79-47dd-900d-65bbbb60712e admin admin] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:50:45.265399 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0661cc6-c4e5-478a-b19e-2cf6ded538d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:50:45.268509 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0661cc6-c4e5-478a-b19e-2cf6ded538d4 admin admin] REQUEST_METHOD: `PUT` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:50:45.269767 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0661cc6-c4e5-478a-b19e-2cf6ded538d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:50:45.270224 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0661cc6-c4e5-478a-b19e-2cf6ded538d4 admin admin] PATH_INFO: `/v3/projects/9f2b99b1ae8447aeafaa2d7ec277f178/users/00bf2083dcc844e5a8dc4b6b88ff8132/roles/6ca1d4427ff64e0a9d25d96cfb1445f6` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:50:45.316274 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0661cc6-c4e5-478a-b19e-2cf6ded538d4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9f2b99b1ae8447aeafaa2d7ec277f178, user_id=00bf2083dcc844e5a8dc4b6b88ff8132, role_id=6ca1d4427ff64e0a9d25d96cfb1445f6)` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:50:45.319967 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0661cc6-c4e5-478a-b19e-2cf6ded538d4 admin admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:50:45.350800 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 1084/2212] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Sep 13 19:50:45 2022] PUT /identity/v3/projects/9f2b99b1ae8447aeafaa2d7ec277f178/users/00bf2083dcc844e5a8dc4b6b88ff8132/roles/6ca1d4427ff64e0a9d25d96cfb1445f6 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 19:50:45.356150 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab71981-f859-4b86-92b8-9b806a50d50a admin admin] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:50:45.373013 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab71981-f859-4b86-92b8-9b806a50d50a admin admin] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:50:45.508746 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44661e52-f7d7-40c5-bcbd-90e3a038ec9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:50:45.509682 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44661e52-f7d7-40c5-bcbd-90e3a038ec9e admin admin] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:50:45.510125 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44661e52-f7d7-40c5-bcbd-90e3a038ec9e admin admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:50:45.510538 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44661e52-f7d7-40c5-bcbd-90e3a038ec9e admin admin] PATH_INFO: `/v3/roles` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:50:45.511694 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44661e52-f7d7-40c5-bcbd-90e3a038ec9e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:50:45.513942 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44661e52-f7d7-40c5-bcbd-90e3a038ec9e admin admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:50:45.560501 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0661cc6-c4e5-478a-b19e-2cf6ded538d4 admin admin] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:50:45.572335 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 1129/2213] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Sep 13 19:50:45 2022] GET /identity/v3/roles => generated 1420 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 19:50:45.574442 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0661cc6-c4e5-478a-b19e-2cf6ded538d4 admin admin] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:50:45.580942 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f9a513-a1b2-4c63-8f10-63f135d02d17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:50:45.582118 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f9a513-a1b2-4c63-8f10-63f135d02d17 admin admin] REQUEST_METHOD: `PUT` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:50:45.582730 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f9a513-a1b2-4c63-8f10-63f135d02d17 admin admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:50:45.583194 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f9a513-a1b2-4c63-8f10-63f135d02d17 admin admin] PATH_INFO: `/v3/projects/9f2b99b1ae8447aeafaa2d7ec277f178/users/00bf2083dcc844e5a8dc4b6b88ff8132/roles/6ca1d4427ff64e0a9d25d96cfb1445f6` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:50:45.598056 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f9a513-a1b2-4c63-8f10-63f135d02d17 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9f2b99b1ae8447aeafaa2d7ec277f178, user_id=00bf2083dcc844e5a8dc4b6b88ff8132, role_id=6ca1d4427ff64e0a9d25d96cfb1445f6)` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:50:45.598056 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f9a513-a1b2-4c63-8f10-63f135d02d17 admin admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:50:45.613107 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 1085/2214] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Sep 13 19:50:45 2022] PUT /identity/v3/projects/9f2b99b1ae8447aeafaa2d7ec277f178/users/00bf2083dcc844e5a8dc4b6b88ff8132/roles/6ca1d4427ff64e0a9d25d96cfb1445f6 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 19:50:45.624606 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb49b8ae-25ac-4110-bf40-1997147f4abe None None] REQUEST_METHOD: `POST` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:50:45.625712 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb49b8ae-25ac-4110-bf40-1997147f4abe None None] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:50:45.626809 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb49b8ae-25ac-4110-bf40-1997147f4abe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:50:45.664000 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.auth.core [None req-bb49b8ae-25ac-4110-bf40-1997147f4abe None None] MFA Rules not processed for user `00bf2083dcc844e5a8dc4b6b88ff8132`. Rule list: `[]` (Enabled: `True`). {{(pid=87934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:50:45.665628 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.fernet_utils [None req-bb49b8ae-25ac-4110-bf40-1997147f4abe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:50:45.781369 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f9a513-a1b2-4c63-8f10-63f135d02d17 admin admin] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:50:45.784322 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.fernet_utils [None req-72f9a513-a1b2-4c63-8f10-63f135d02d17 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:50:45.784540 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 1130/2215] 10.222.0.25 () {58 vars in 958 bytes} [Tue Sep 13 19:50:45 2022] POST /identity/v3/auth/tokens => generated 3345 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 19:50:45.911446 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f9a513-a1b2-4c63-8f10-63f135d02d17 admin admin] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:50:45.916637 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd381f6-8e8a-4540-933b-e7b1a4bae6ff service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cbb50c88b794a7f9f26844effde7d63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a10a4268f3c4cb29f4e00c292e2df62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:50:45.917412 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd381f6-8e8a-4540-933b-e7b1a4bae6ff service cinder] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:50:45.918273 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd381f6-8e8a-4540-933b-e7b1a4bae6ff service cinder] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:50:45.918273 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd381f6-8e8a-4540-933b-e7b1a4bae6ff service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:50:45.939706 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd381f6-8e8a-4540-933b-e7b1a4bae6ff service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:50:45.941793 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd381f6-8e8a-4540-933b-e7b1a4bae6ff service cinder] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:50:45.971438 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 1086/2216] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Sep 13 19:50:45 2022] GET /identity/v3/auth/tokens => generated 3345 bytes in 191 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 13 19:50:46.092266 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb49b8ae-25ac-4110-bf40-1997147f4abe None None] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:50:46.108873 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb49b8ae-25ac-4110-bf40-1997147f4abe None None] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:50:46.117718 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177be51c-40b0-4adc-a580-0c84685df2bb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cbb50c88b794a7f9f26844effde7d63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a10a4268f3c4cb29f4e00c292e2df62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:50:46.118843 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177be51c-40b0-4adc-a580-0c84685df2bb service cinder] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:50:46.118843 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177be51c-40b0-4adc-a580-0c84685df2bb service cinder] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:50:46.119287 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177be51c-40b0-4adc-a580-0c84685df2bb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:50:46.136745 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG dbcounter [-] [87934] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:50:46.227635 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-177be51c-40b0-4adc-a580-0c84685df2bb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:50:46.230237 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-177be51c-40b0-4adc-a580-0c84685df2bb service cinder] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:50:46.300552 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 1131/2217] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Sep 13 19:50:46 2022] GET /identity/v3/auth/tokens => generated 3278 bytes in 200 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 19:50:47.664941 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e04eb1-4b27-4485-b067-08bf50ac1f37 None None] REQUEST_METHOD: `POST` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:50:47.665817 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e04eb1-4b27-4485-b067-08bf50ac1f37 None None] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:50:47.666090 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e04eb1-4b27-4485-b067-08bf50ac1f37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:50:47.696296 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.auth.core [None req-45e04eb1-4b27-4485-b067-08bf50ac1f37 None None] MFA Rules not processed for user `0b4c607b75614463b0e18da9a001b96b`. Rule list: `[]` (Enabled: `True`). {{(pid=87935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:50:47.697591 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.fernet_utils [None req-45e04eb1-4b27-4485-b067-08bf50ac1f37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:50:47.769041 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG dbcounter [-] [87935] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=87935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:50:47.795027 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 1087/2218] 10.222.0.25 () {58 vars in 958 bytes} [Tue Sep 13 19:50:47 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 19:50:47.818796 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177be51c-40b0-4adc-a580-0c84685df2bb service cinder] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:50:47.820372 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.fernet_utils [None req-177be51c-40b0-4adc-a580-0c84685df2bb service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:50:47.901233 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177be51c-40b0-4adc-a580-0c84685df2bb service cinder] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:50:47.906372 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9ce311-8bc4-420b-bb2a-a4657b729631 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '907d44d3b6944ccb83999d8e489871d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a10a4268f3c4cb29f4e00c292e2df62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:50:47.907674 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9ce311-8bc4-420b-bb2a-a4657b729631 service glance] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:50:47.908013 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9ce311-8bc4-420b-bb2a-a4657b729631 service glance] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:50:47.908486 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9ce311-8bc4-420b-bb2a-a4657b729631 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:50:47.910500 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.fernet_utils [None req-de9ce311-8bc4-420b-bb2a-a4657b729631 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:50:47.991674 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de9ce311-8bc4-420b-bb2a-a4657b729631 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:50:47.995048 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de9ce311-8bc4-420b-bb2a-a4657b729631 service glance] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:50:48.020384 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 1132/2219] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Sep 13 19:50:47 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 202 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 19:50:48.216407 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7498f843-e4fa-4889-abe5-99ff733adba9 None None] REQUEST_METHOD: `POST` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:50:48.216599 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7498f843-e4fa-4889-abe5-99ff733adba9 None None] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:50:48.217092 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7498f843-e4fa-4889-abe5-99ff733adba9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:50:48.268245 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.auth.core [None req-7498f843-e4fa-4889-abe5-99ff733adba9 None None] MFA Rules not processed for user `d44977a3225e43f19cdc4a84f0e170cd`. Rule list: `[]` (Enabled: `True`). {{(pid=87935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:50:48.269482 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.fernet_utils [None req-7498f843-e4fa-4889-abe5-99ff733adba9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:50:48.365419 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 1088/2220] 10.222.0.25 () {58 vars in 1009 bytes} [Tue Sep 13 19:50:48 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 19:50:48.417667 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9ce311-8bc4-420b-bb2a-a4657b729631 service glance] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:50:48.419236 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.fernet_utils [None req-de9ce311-8bc4-420b-bb2a-a4657b729631 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:50:48.498455 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG dbcounter [-] [87934] Writing DB stats keystone:SELECT=100 {{(pid=87934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:50:48.504135 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9ce311-8bc4-420b-bb2a-a4657b729631 service glance] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:50:48.509392 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc151f6f-8415-4359-8f04-02dd64e150e7 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb42d6ac6cdd4d97a80c3ee0c6f8e3f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a10a4268f3c4cb29f4e00c292e2df62', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:50:48.510344 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc151f6f-8415-4359-8f04-02dd64e150e7 service swift] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:50:48.510684 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc151f6f-8415-4359-8f04-02dd64e150e7 service swift] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:50:48.511139 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc151f6f-8415-4359-8f04-02dd64e150e7 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:50:48.522438 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc151f6f-8415-4359-8f04-02dd64e150e7 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:50:48.524360 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc151f6f-8415-4359-8f04-02dd64e150e7 service swift] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:50:48.534633 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 1133/2221] 10.222.0.25 () {60 vars in 1384 bytes} [Tue Sep 13 19:50:48 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 13 19:50:51.261651 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7498f843-e4fa-4889-abe5-99ff733adba9 None None] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:50:51.340709 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7498f843-e4fa-4889-abe5-99ff733adba9 None None] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:50:51.349432 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ebb87fd-daf6-4e47-85c2-6e1971ef2d28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:50:51.350415 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebb87fd-daf6-4e47-85c2-6e1971ef2d28 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:50:51.350858 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebb87fd-daf6-4e47-85c2-6e1971ef2d28 admin admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:50:51.351297 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebb87fd-daf6-4e47-85c2-6e1971ef2d28 admin admin] PATH_INFO: `/v3/users/bdb07932211b40e0b459dae5fdd1421f` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:50:51.352985 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ebb87fd-daf6-4e47-85c2-6e1971ef2d28 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bdb07932211b40e0b459dae5fdd1421f)` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:50:51.356089 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ebb87fd-daf6-4e47-85c2-6e1971ef2d28 admin admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:50:51.443144 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.notifications [None req-8ebb87fd-daf6-4e47-85c2-6e1971ef2d28 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bdb07932211b40e0b459dae5fdd1421f'} {{(pid=87935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:50:51.455484 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.notifications [None req-8ebb87fd-daf6-4e47-85c2-6e1971ef2d28 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bdb07932211b40e0b459dae5fdd1421f'} {{(pid=87935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:50:51.475063 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.notifications [None req-8ebb87fd-daf6-4e47-85c2-6e1971ef2d28 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bdb07932211b40e0b459dae5fdd1421f'} {{(pid=87935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:50:51.475814 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.notifications [None req-8ebb87fd-daf6-4e47-85c2-6e1971ef2d28 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bdb07932211b40e0b459dae5fdd1421f'} {{(pid=87935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:50:51.476492 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.notifications [None req-8ebb87fd-daf6-4e47-85c2-6e1971ef2d28 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bdb07932211b40e0b459dae5fdd1421f'} {{(pid=87935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:50:51.495024 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 1089/2222] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Sep 13 19:50:51 2022] DELETE /identity/v3/users/bdb07932211b40e0b459dae5fdd1421f => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 19:50:51.500495 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8293b1f6-ae56-4df7-91bd-14fd27b4f9d8 None None] REQUEST_METHOD: `POST` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:50:51.502428 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8293b1f6-ae56-4df7-91bd-14fd27b4f9d8 None None] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:50:51.502969 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8293b1f6-ae56-4df7-91bd-14fd27b4f9d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:50:51.558141 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.auth.core [None req-8293b1f6-ae56-4df7-91bd-14fd27b4f9d8 None None] MFA Rules not processed for user `7b0aed92d02344acb92a0e4aa67c3068`. Rule list: `[]` (Enabled: `True`). {{(pid=87934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:50:51.559722 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.fernet_utils [None req-8293b1f6-ae56-4df7-91bd-14fd27b4f9d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:50:51.714248 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 1134/2223] 10.222.0.25 () {58 vars in 958 bytes} [Tue Sep 13 19:50:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 19:50:51.725828 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ebb87fd-daf6-4e47-85c2-6e1971ef2d28 admin admin] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:50:51.729797 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.fernet_utils [None req-8ebb87fd-daf6-4e47-85c2-6e1971ef2d28 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:50:51.759452 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG dbcounter [-] [87935] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:50:51.840652 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ebb87fd-daf6-4e47-85c2-6e1971ef2d28 admin admin] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:50:51.849345 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4567050-aa5b-4633-8d23-aad30d7c3518 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1196a96e4a404f559600b69f929ea9da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a10a4268f3c4cb29f4e00c292e2df62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:50:51.849979 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4567050-aa5b-4633-8d23-aad30d7c3518 service neutron] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:50:51.850263 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4567050-aa5b-4633-8d23-aad30d7c3518 service neutron] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:50:51.852862 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4567050-aa5b-4633-8d23-aad30d7c3518 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:50:51.886142 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4567050-aa5b-4633-8d23-aad30d7c3518 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:50:51.887788 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4567050-aa5b-4633-8d23-aad30d7c3518 service neutron] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:50:51.901538 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 1090/2224] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Sep 13 19:50:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 19:50:52.082253 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9a48c6-37c6-4cd5-90cb-127217c2871c None None] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:50:52.082597 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9a48c6-37c6-4cd5-90cb-127217c2871c None None] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:50:52.082873 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9a48c6-37c6-4cd5-90cb-127217c2871c None None] PATH_INFO: `/` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:50:52.085402 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 1135/2225] 10.222.0.25 () {54 vars in 921 bytes} [Tue Sep 13 19:50:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:50:52.147096 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52175112-2a90-40ed-bc0e-418dcd25b954 None None] REQUEST_METHOD: `POST` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:50:52.147851 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52175112-2a90-40ed-bc0e-418dcd25b954 None None] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:50:52.148444 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52175112-2a90-40ed-bc0e-418dcd25b954 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:50:52.221524 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.auth.core [None req-52175112-2a90-40ed-bc0e-418dcd25b954 None None] MFA Rules not processed for user `02eb3d3173c1476cb83a72add0e878e2`. Rule list: `[]` (Enabled: `True`). {{(pid=87935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:50:52.225108 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.fernet_utils [None req-52175112-2a90-40ed-bc0e-418dcd25b954 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:50:52.253875 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9a48c6-37c6-4cd5-90cb-127217c2871c None None] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:50:52.255768 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.fernet_utils [None req-6a9a48c6-37c6-4cd5-90cb-127217c2871c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:50:52.305082 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9a48c6-37c6-4cd5-90cb-127217c2871c None None] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:50:52.325133 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb669f4-379c-4118-b23f-870eed8e1fe0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:50:52.326514 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb669f4-379c-4118-b23f-870eed8e1fe0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:50:52.326952 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb669f4-379c-4118-b23f-870eed8e1fe0 admin admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:50:52.327385 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb669f4-379c-4118-b23f-870eed8e1fe0 admin admin] PATH_INFO: `/v3/users/84cce4563f86421181f25655df396079` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:50:52.330236 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb669f4-379c-4118-b23f-870eed8e1fe0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=84cce4563f86421181f25655df396079)` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:50:52.333628 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb669f4-379c-4118-b23f-870eed8e1fe0 admin admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:50:52.442141 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 1091/2226] 10.222.0.25 () {58 vars in 1018 bytes} [Tue Sep 13 19:50:52 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 296 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 19:50:52.456935 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52175112-2a90-40ed-bc0e-418dcd25b954 None None] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:50:52.458781 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.fernet_utils [None req-52175112-2a90-40ed-bc0e-418dcd25b954 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:50:52.469476 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.notifications [None req-6eb669f4-379c-4118-b23f-870eed8e1fe0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '84cce4563f86421181f25655df396079'} {{(pid=87934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:50:52.474782 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.notifications [None req-6eb669f4-379c-4118-b23f-870eed8e1fe0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '84cce4563f86421181f25655df396079'} {{(pid=87934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:50:52.476780 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.notifications [None req-6eb669f4-379c-4118-b23f-870eed8e1fe0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '84cce4563f86421181f25655df396079'} {{(pid=87934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:50:52.482818 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52175112-2a90-40ed-bc0e-418dcd25b954 None None] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:50:52.491968 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dafafff4-aff7-497f-a586-40a1e4d56804 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02eb3d3173c1476cb83a72add0e878e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a10a4268f3c4cb29f4e00c292e2df62', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:50:52.493123 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafafff4-aff7-497f-a586-40a1e4d56804 service placement] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:50:52.493557 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafafff4-aff7-497f-a586-40a1e4d56804 service placement] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:50:52.493997 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafafff4-aff7-497f-a586-40a1e4d56804 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:50:52.496834 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.fernet_utils [None req-dafafff4-aff7-497f-a586-40a1e4d56804 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:50:52.505004 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.notifications [None req-6eb669f4-379c-4118-b23f-870eed8e1fe0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '84cce4563f86421181f25655df396079'} {{(pid=87934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:50:52.515872 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dafafff4-aff7-497f-a586-40a1e4d56804 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:50:52.519389 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dafafff4-aff7-497f-a586-40a1e4d56804 service placement] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:50:52.541848 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 1092/2227] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Sep 13 19:50:52 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 13 19:50:52.547133 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.notifications [None req-6eb669f4-379c-4118-b23f-870eed8e1fe0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '84cce4563f86421181f25655df396079'} {{(pid=87934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:50:52.569683 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 1136/2228] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Sep 13 19:50:52 2022] DELETE /identity/v3/users/84cce4563f86421181f25655df396079 => generated 0 bytes in 316 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 19:50:52.872883 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dafafff4-aff7-497f-a586-40a1e4d56804 service placement] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:50:52.876711 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.fernet_utils [None req-dafafff4-aff7-497f-a586-40a1e4d56804 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:50:52.906609 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dafafff4-aff7-497f-a586-40a1e4d56804 service placement] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:50:53.132299 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded61221-bff4-4bd9-93be-bc7d7de0717f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:50:53.132960 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded61221-bff4-4bd9-93be-bc7d7de0717f admin admin] REQUEST_METHOD: `DELETE` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:50:53.133238 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded61221-bff4-4bd9-93be-bc7d7de0717f admin admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:50:53.133510 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded61221-bff4-4bd9-93be-bc7d7de0717f admin admin] PATH_INFO: `/v3/projects/e6a73b5c8337430194fdeadb73007ad7` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:50:53.134667 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded61221-bff4-4bd9-93be-bc7d7de0717f admin admin] RBAC: Authorizing `identity:delete_project(project_id=e6a73b5c8337430194fdeadb73007ad7)` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:50:53.139511 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded61221-bff4-4bd9-93be-bc7d7de0717f admin admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:50:53.244913 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG dbcounter [-] [87935] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=87935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:50:53.268821 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.notifications [None req-ded61221-bff4-4bd9-93be-bc7d7de0717f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e6a73b5c8337430194fdeadb73007ad7', 'request_id': 'req-ded61221-bff4-4bd9-93be-bc7d7de0717f'} {{(pid=87935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:50:53.278947 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.notifications [None req-ded61221-bff4-4bd9-93be-bc7d7de0717f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e6a73b5c8337430194fdeadb73007ad7', 'request_id': 'req-ded61221-bff4-4bd9-93be-bc7d7de0717f'} {{(pid=87935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:50:53.292823 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.notifications [None req-ded61221-bff4-4bd9-93be-bc7d7de0717f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e6a73b5c8337430194fdeadb73007ad7', 'request_id': 'req-ded61221-bff4-4bd9-93be-bc7d7de0717f'} {{(pid=87935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:50:53.332708 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb669f4-379c-4118-b23f-870eed8e1fe0 admin admin] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:50:53.338137 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.fernet_utils [None req-6eb669f4-379c-4118-b23f-870eed8e1fe0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:50:53.339599 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.notifications [None req-ded61221-bff4-4bd9-93be-bc7d7de0717f admin admin] The token cache is being invalidate because project e6a73b5c8337430194fdeadb73007ad7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87935) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 19:50:53.339993 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.notifications [None req-ded61221-bff4-4bd9-93be-bc7d7de0717f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:50:53.340809 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.notifications [None req-ded61221-bff4-4bd9-93be-bc7d7de0717f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:50:53.346432 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 1093/2229] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Sep 13 19:50:52 2022] DELETE /identity/v3/projects/e6a73b5c8337430194fdeadb73007ad7 => generated 0 bytes in 471 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 19:50:53.348493 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded61221-bff4-4bd9-93be-bc7d7de0717f admin admin] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:50:53.351755 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.fernet_utils [None req-ded61221-bff4-4bd9-93be-bc7d7de0717f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:50:53.368685 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb669f4-379c-4118-b23f-870eed8e1fe0 admin admin] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:50:53.516111 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded61221-bff4-4bd9-93be-bc7d7de0717f admin admin] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:50:53.529063 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b34b380-eb15-4a71-9d75-0e630068a9a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:50:53.530558 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b34b380-eb15-4a71-9d75-0e630068a9a8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:50:53.531036 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230a88b2-c521-4f12-988d-79c033245141 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:50:53.531878 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230a88b2-c521-4f12-988d-79c033245141 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:50:53.532494 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b34b380-eb15-4a71-9d75-0e630068a9a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:50:53.532854 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230a88b2-c521-4f12-988d-79c033245141 admin admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:50:53.533199 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b34b380-eb15-4a71-9d75-0e630068a9a8 admin admin] PATH_INFO: `/v3/projects/2a785363787c45798cbd470d50ebd36a` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:50:53.533537 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230a88b2-c521-4f12-988d-79c033245141 admin admin] PATH_INFO: `/v3/users/e10a5398c5ac48889f2e35083cdae43d` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:50:53.535502 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b34b380-eb15-4a71-9d75-0e630068a9a8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2a785363787c45798cbd470d50ebd36a)` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:50:53.536286 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-230a88b2-c521-4f12-988d-79c033245141 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e10a5398c5ac48889f2e35083cdae43d)` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:50:53.538337 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b34b380-eb15-4a71-9d75-0e630068a9a8 admin admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:50:53.542112 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-230a88b2-c521-4f12-988d-79c033245141 admin admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:50:53.558228 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG dbcounter [-] [87934] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:50:53.655342 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.notifications [None req-230a88b2-c521-4f12-988d-79c033245141 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e10a5398c5ac48889f2e35083cdae43d'} {{(pid=87935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:50:53.658310 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.notifications [None req-9b34b380-eb15-4a71-9d75-0e630068a9a8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2a785363787c45798cbd470d50ebd36a', 'request_id': 'req-9b34b380-eb15-4a71-9d75-0e630068a9a8'} {{(pid=87934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:50:53.668341 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.notifications [None req-9b34b380-eb15-4a71-9d75-0e630068a9a8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2a785363787c45798cbd470d50ebd36a', 'request_id': 'req-9b34b380-eb15-4a71-9d75-0e630068a9a8'} {{(pid=87934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:50:53.672198 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.notifications [None req-230a88b2-c521-4f12-988d-79c033245141 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e10a5398c5ac48889f2e35083cdae43d'} {{(pid=87935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:50:53.679555 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.notifications [None req-9b34b380-eb15-4a71-9d75-0e630068a9a8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2a785363787c45798cbd470d50ebd36a', 'request_id': 'req-9b34b380-eb15-4a71-9d75-0e630068a9a8'} {{(pid=87934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:50:53.699705 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.notifications [None req-230a88b2-c521-4f12-988d-79c033245141 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e10a5398c5ac48889f2e35083cdae43d'} {{(pid=87935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:50:53.700705 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.notifications [None req-230a88b2-c521-4f12-988d-79c033245141 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e10a5398c5ac48889f2e35083cdae43d'} {{(pid=87935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:50:53.701489 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.notifications [None req-230a88b2-c521-4f12-988d-79c033245141 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e10a5398c5ac48889f2e35083cdae43d'} {{(pid=87935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:50:53.702652 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.notifications [None req-9b34b380-eb15-4a71-9d75-0e630068a9a8 admin admin] The token cache is being invalidate because project 2a785363787c45798cbd470d50ebd36a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87934) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 19:50:53.702957 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.notifications [None req-9b34b380-eb15-4a71-9d75-0e630068a9a8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:50:53.705028 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.notifications [None req-9b34b380-eb15-4a71-9d75-0e630068a9a8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:50:53.707531 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 1137/2230] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Sep 13 19:50:53 2022] DELETE /identity/v3/projects/2a785363787c45798cbd470d50ebd36a => generated 0 bytes in 376 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 19:50:53.711820 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b34b380-eb15-4a71-9d75-0e630068a9a8 admin admin] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:50:53.720626 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.fernet_utils [None req-9b34b380-eb15-4a71-9d75-0e630068a9a8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:50:53.732123 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 1094/2231] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Sep 13 19:50:53 2022] DELETE /identity/v3/users/e10a5398c5ac48889f2e35083cdae43d => generated 0 bytes in 381 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 19:50:53.861565 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b34b380-eb15-4a71-9d75-0e630068a9a8 admin admin] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:50:54.020960 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230a88b2-c521-4f12-988d-79c033245141 admin admin] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:50:54.023028 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.fernet_utils [None req-230a88b2-c521-4f12-988d-79c033245141 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:50:54.024635 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0e80e0-f192-4b2b-81bf-215650dae2be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:50:54.025604 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0e80e0-f192-4b2b-81bf-215650dae2be admin admin] REQUEST_METHOD: `DELETE` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:50:54.028324 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0e80e0-f192-4b2b-81bf-215650dae2be admin admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:50:54.028621 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0e80e0-f192-4b2b-81bf-215650dae2be admin admin] PATH_INFO: `/v3/users/00bf2083dcc844e5a8dc4b6b88ff8132` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:50:54.033026 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b0e80e0-f192-4b2b-81bf-215650dae2be admin admin] RBAC: Authorizing `identity:delete_user(user_id=00bf2083dcc844e5a8dc4b6b88ff8132)` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:50:54.035058 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b0e80e0-f192-4b2b-81bf-215650dae2be admin admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:50:54.046352 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230a88b2-c521-4f12-988d-79c033245141 admin admin] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:50:54.052190 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3849d243-9084-4856-b030-edd26703a9f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:50:54.053124 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3849d243-9084-4856-b030-edd26703a9f9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:50:54.053407 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3849d243-9084-4856-b030-edd26703a9f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:50:54.053682 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3849d243-9084-4856-b030-edd26703a9f9 admin admin] PATH_INFO: `/v3/projects/9ad0a5a472a945ddb510079825998453` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:50:54.055530 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3849d243-9084-4856-b030-edd26703a9f9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9ad0a5a472a945ddb510079825998453)` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:50:54.057672 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3849d243-9084-4856-b030-edd26703a9f9 admin admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:50:54.116106 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG dbcounter [-] [87934] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=87934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:50:54.126901 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.notifications [None req-7b0e80e0-f192-4b2b-81bf-215650dae2be admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '00bf2083dcc844e5a8dc4b6b88ff8132'} {{(pid=87934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:50:54.130824 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.notifications [None req-7b0e80e0-f192-4b2b-81bf-215650dae2be admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '00bf2083dcc844e5a8dc4b6b88ff8132'} {{(pid=87934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:50:54.132287 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.notifications [None req-7b0e80e0-f192-4b2b-81bf-215650dae2be admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '00bf2083dcc844e5a8dc4b6b88ff8132'} {{(pid=87934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:50:54.161495 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.notifications [None req-7b0e80e0-f192-4b2b-81bf-215650dae2be admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '00bf2083dcc844e5a8dc4b6b88ff8132'} {{(pid=87934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:50:54.172412 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG dbcounter [-] [87935] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=87935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:50:54.179201 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.notifications [None req-3849d243-9084-4856-b030-edd26703a9f9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9ad0a5a472a945ddb510079825998453', 'request_id': 'req-3849d243-9084-4856-b030-edd26703a9f9'} {{(pid=87935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:50:54.189327 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.notifications [None req-3849d243-9084-4856-b030-edd26703a9f9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9ad0a5a472a945ddb510079825998453', 'request_id': 'req-3849d243-9084-4856-b030-edd26703a9f9'} {{(pid=87935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:50:54.190973 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.notifications [None req-7b0e80e0-f192-4b2b-81bf-215650dae2be admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '00bf2083dcc844e5a8dc4b6b88ff8132'} {{(pid=87934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:50:54.200687 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.notifications [None req-3849d243-9084-4856-b030-edd26703a9f9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9ad0a5a472a945ddb510079825998453', 'request_id': 'req-3849d243-9084-4856-b030-edd26703a9f9'} {{(pid=87935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:50:54.225772 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.notifications [None req-3849d243-9084-4856-b030-edd26703a9f9 admin admin] The token cache is being invalidate because project 9ad0a5a472a945ddb510079825998453 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87935) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 19:50:54.227982 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.notifications [None req-3849d243-9084-4856-b030-edd26703a9f9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:50:54.228906 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.notifications [None req-3849d243-9084-4856-b030-edd26703a9f9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:50:54.230801 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 1095/2232] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Sep 13 19:50:54 2022] DELETE /identity/v3/projects/9ad0a5a472a945ddb510079825998453 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 19:50:54.233194 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 1138/2233] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Sep 13 19:50:53 2022] DELETE /identity/v3/users/00bf2083dcc844e5a8dc4b6b88ff8132 => generated 0 bytes in 521 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 19:50:54.239489 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef536a21-76dc-46f3-9c9a-0307a669a747 None None] REQUEST_METHOD: `POST` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:50:54.239929 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef536a21-76dc-46f3-9c9a-0307a669a747 None None] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:50:54.240330 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef536a21-76dc-46f3-9c9a-0307a669a747 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:50:54.265099 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.auth.core [None req-ef536a21-76dc-46f3-9c9a-0307a669a747 None None] MFA Rules not processed for user `7b0aed92d02344acb92a0e4aa67c3068`. Rule list: `[]` (Enabled: `True`). {{(pid=87935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:50:54.267980 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.fernet_utils [None req-ef536a21-76dc-46f3-9c9a-0307a669a747 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:50:54.337639 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 1096/2234] 10.222.0.25 () {58 vars in 958 bytes} [Tue Sep 13 19:50:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 19:50:54.346041 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daab3b03-a062-431b-bc47-ae91daf18978 None None] REQUEST_METHOD: `POST` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:50:54.348783 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daab3b03-a062-431b-bc47-ae91daf18978 None None] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:50:54.348783 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daab3b03-a062-431b-bc47-ae91daf18978 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:50:54.377560 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.auth.core [None req-daab3b03-a062-431b-bc47-ae91daf18978 None None] MFA Rules not processed for user `7b0aed92d02344acb92a0e4aa67c3068`. Rule list: `[]` (Enabled: `True`). {{(pid=87934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:50:54.380952 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.fernet_utils [None req-daab3b03-a062-431b-bc47-ae91daf18978 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:50:54.409961 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 1139/2235] 10.222.0.25 () {58 vars in 958 bytes} [Tue Sep 13 19:50:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 19:50:54.414896 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef536a21-76dc-46f3-9c9a-0307a669a747 None None] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:50:54.429739 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef536a21-76dc-46f3-9c9a-0307a669a747 None None] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:50:54.437636 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40fc915-82a7-4699-8b7c-964812fa93ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:50:54.438436 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40fc915-82a7-4699-8b7c-964812fa93ff admin admin] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:50:54.438819 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40fc915-82a7-4699-8b7c-964812fa93ff admin admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:50:54.439381 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40fc915-82a7-4699-8b7c-964812fa93ff admin admin] PATH_INFO: `/v3/domains` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:50:54.440135 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c40fc915-82a7-4699-8b7c-964812fa93ff admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87935) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:50:54.442089 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c40fc915-82a7-4699-8b7c-964812fa93ff admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:50:54.444115 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c40fc915-82a7-4699-8b7c-964812fa93ff admin admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:50:54.475052 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 1097/2236] 10.222.0.25 () {58 vars in 1153 bytes} [Tue Sep 13 19:50:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:50:54.476628 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daab3b03-a062-431b-bc47-ae91daf18978 None None] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:50:54.504102 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daab3b03-a062-431b-bc47-ae91daf18978 None None] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:50:54.514138 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14d5b17-e624-4d2c-b26f-86c49c34303e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:50:54.514757 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14d5b17-e624-4d2c-b26f-86c49c34303e admin admin] REQUEST_METHOD: `POST` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:50:54.515091 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14d5b17-e624-4d2c-b26f-86c49c34303e admin admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:50:54.515366 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14d5b17-e624-4d2c-b26f-86c49c34303e admin admin] PATH_INFO: `/v3/projects` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:50:54.516016 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f14d5b17-e624-4d2c-b26f-86c49c34303e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:50:54.518641 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f14d5b17-e624-4d2c-b26f-86c49c34303e admin admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:50:54.589374 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 1140/2237] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Sep 13 19:50:54 2022] POST /identity/v3/projects => generated 375 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 19:50:54.593389 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40fc915-82a7-4699-8b7c-964812fa93ff admin admin] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:50:54.606051 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40fc915-82a7-4699-8b7c-964812fa93ff admin admin] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:50:54.711115 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86d17df-3cd2-4cba-8e51-34284cd7d699 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:50:54.712242 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86d17df-3cd2-4cba-8e51-34284cd7d699 admin admin] REQUEST_METHOD: `POST` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:50:54.712651 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86d17df-3cd2-4cba-8e51-34284cd7d699 admin admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:50:54.713091 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86d17df-3cd2-4cba-8e51-34284cd7d699 admin admin] PATH_INFO: `/v3/users` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:50:54.715297 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f86d17df-3cd2-4cba-8e51-34284cd7d699 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:50:54.719525 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f86d17df-3cd2-4cba-8e51-34284cd7d699 admin admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:50:54.733421 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14d5b17-e624-4d2c-b26f-86c49c34303e admin admin] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:50:54.737049 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.fernet_utils [None req-f14d5b17-e624-4d2c-b26f-86c49c34303e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:50:54.767384 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14d5b17-e624-4d2c-b26f-86c49c34303e admin admin] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:50:54.779010 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c47ad1e-5255-4e09-973c-3518b145f36a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:50:54.779737 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c47ad1e-5255-4e09-973c-3518b145f36a admin admin] REQUEST_METHOD: `DELETE` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:50:54.781288 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c47ad1e-5255-4e09-973c-3518b145f36a admin admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:50:54.781632 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c47ad1e-5255-4e09-973c-3518b145f36a admin admin] PATH_INFO: `/v3/projects/9f2b99b1ae8447aeafaa2d7ec277f178` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:50:54.784287 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c47ad1e-5255-4e09-973c-3518b145f36a admin admin] RBAC: Authorizing `identity:delete_project(project_id=9f2b99b1ae8447aeafaa2d7ec277f178)` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:50:54.786184 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c47ad1e-5255-4e09-973c-3518b145f36a admin admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:50:54.795895 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 1098/2238] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Sep 13 19:50:54 2022] POST /identity/v3/users => generated 288 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 19:50:54.796928 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86d17df-3cd2-4cba-8e51-34284cd7d699 admin admin] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:50:54.809291 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86d17df-3cd2-4cba-8e51-34284cd7d699 admin admin] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:50:54.814259 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d8b903-817a-4387-b74d-03ee1500af7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:50:54.814871 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d8b903-817a-4387-b74d-03ee1500af7f admin admin] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:50:54.815145 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d8b903-817a-4387-b74d-03ee1500af7f admin admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:50:54.815569 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d8b903-817a-4387-b74d-03ee1500af7f admin admin] PATH_INFO: `/v3/roles` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:50:54.816236 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d8b903-817a-4387-b74d-03ee1500af7f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:50:54.817854 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d8b903-817a-4387-b74d-03ee1500af7f admin admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:50:54.838296 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 1099/2239] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Sep 13 19:50:54 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 19:50:54.844642 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d8b903-817a-4387-b74d-03ee1500af7f admin admin] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:50:54.855822 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d8b903-817a-4387-b74d-03ee1500af7f admin admin] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:50:54.857581 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.notifications [None req-3c47ad1e-5255-4e09-973c-3518b145f36a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9f2b99b1ae8447aeafaa2d7ec277f178', 'request_id': 'req-3c47ad1e-5255-4e09-973c-3518b145f36a'} {{(pid=87934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:50:54.865339 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.notifications [None req-3c47ad1e-5255-4e09-973c-3518b145f36a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9f2b99b1ae8447aeafaa2d7ec277f178', 'request_id': 'req-3c47ad1e-5255-4e09-973c-3518b145f36a'} {{(pid=87934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:50:54.872376 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.notifications [None req-3c47ad1e-5255-4e09-973c-3518b145f36a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9f2b99b1ae8447aeafaa2d7ec277f178', 'request_id': 'req-3c47ad1e-5255-4e09-973c-3518b145f36a'} {{(pid=87934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:50:54.891042 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.notifications [None req-3c47ad1e-5255-4e09-973c-3518b145f36a admin admin] The token cache is being invalidate because project 9f2b99b1ae8447aeafaa2d7ec277f178 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87934) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 19:50:54.892243 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.notifications [None req-3c47ad1e-5255-4e09-973c-3518b145f36a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:50:54.893391 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.notifications [None req-3c47ad1e-5255-4e09-973c-3518b145f36a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:50:54.899359 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 1141/2240] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Sep 13 19:50:54 2022] DELETE /identity/v3/projects/9f2b99b1ae8447aeafaa2d7ec277f178 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 19:50:54.900755 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59353bdd-2f05-4fcf-adb9-c825cf6f0a57 None None] REQUEST_METHOD: `POST` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:50:54.901044 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59353bdd-2f05-4fcf-adb9-c825cf6f0a57 None None] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:50:54.901319 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59353bdd-2f05-4fcf-adb9-c825cf6f0a57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:50:54.914006 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG dbcounter [-] [87935] Writing DB stats keystone:SELECT=92,keystone:DELETE=4,keystone:INSERT=4 {{(pid=87935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:50:54.932345 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.auth.core [None req-59353bdd-2f05-4fcf-adb9-c825cf6f0a57 None None] MFA Rules not processed for user `7b0aed92d02344acb92a0e4aa67c3068`. Rule list: `[]` (Enabled: `True`). {{(pid=87934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:50:54.932345 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.fernet_utils [None req-59353bdd-2f05-4fcf-adb9-c825cf6f0a57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:50:54.960457 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c635a21-de22-4512-bfe5-b4c3956f45f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:50:54.961058 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c635a21-de22-4512-bfe5-b4c3956f45f8 admin admin] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:50:54.961334 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c635a21-de22-4512-bfe5-b4c3956f45f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:50:54.961604 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c635a21-de22-4512-bfe5-b4c3956f45f8 admin admin] PATH_INFO: `/v3/roles` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:50:54.962241 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c635a21-de22-4512-bfe5-b4c3956f45f8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:50:54.963946 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c635a21-de22-4512-bfe5-b4c3956f45f8 admin admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:50:54.977440 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 1100/2241] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Sep 13 19:50:54 2022] GET /identity/v3/roles => generated 1420 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 19:50:54.985308 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c635a21-de22-4512-bfe5-b4c3956f45f8 admin admin] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:50:54.987588 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.fernet_utils [None req-4c635a21-de22-4512-bfe5-b4c3956f45f8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:50:55.005846 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c635a21-de22-4512-bfe5-b4c3956f45f8 admin admin] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:50:55.013813 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2efa5d46-d18e-4d30-9b2c-4bec62e5a38f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:50:55.014479 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efa5d46-d18e-4d30-9b2c-4bec62e5a38f admin admin] REQUEST_METHOD: `PUT` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:50:55.014816 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efa5d46-d18e-4d30-9b2c-4bec62e5a38f admin admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:50:55.015032 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efa5d46-d18e-4d30-9b2c-4bec62e5a38f admin admin] PATH_INFO: `/v3/projects/ca429972ef6a4aabae5ea90c4d306751/users/97181462fb3647979e18e2f24fc2efb2/roles/a259191f6d0e46fabd9f34536bb28747` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:50:55.023490 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 1142/2242] 10.222.0.25 () {58 vars in 958 bytes} [Tue Sep 13 19:50:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 19:50:55.033488 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c39b94e-0b3d-4bc3-97cf-05d24d60b833 None None] REQUEST_METHOD: `POST` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:50:55.034002 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c39b94e-0b3d-4bc3-97cf-05d24d60b833 None None] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:50:55.034367 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c39b94e-0b3d-4bc3-97cf-05d24d60b833 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:50:55.040238 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2efa5d46-d18e-4d30-9b2c-4bec62e5a38f admin admin] RBAC: Authorizing `identity:create_grant(project_id=ca429972ef6a4aabae5ea90c4d306751, user_id=97181462fb3647979e18e2f24fc2efb2, role_id=a259191f6d0e46fabd9f34536bb28747)` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:50:55.043031 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2efa5d46-d18e-4d30-9b2c-4bec62e5a38f admin admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:50:55.064677 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.auth.core [None req-8c39b94e-0b3d-4bc3-97cf-05d24d60b833 None None] MFA Rules not processed for user `7b0aed92d02344acb92a0e4aa67c3068`. Rule list: `[]` (Enabled: `True`). {{(pid=87934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:50:55.064677 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.fernet_utils [None req-8c39b94e-0b3d-4bc3-97cf-05d24d60b833 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:50:55.071639 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 1101/2243] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Sep 13 19:50:54 2022] PUT /identity/v3/projects/ca429972ef6a4aabae5ea90c4d306751/users/97181462fb3647979e18e2f24fc2efb2/roles/a259191f6d0e46fabd9f34536bb28747 => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 19:50:55.076639 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG dbcounter [-] [87934] Writing DB stats keystone:DELETE=11,keystone:SELECT=86,keystone:INSERT=3 {{(pid=87934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:50:55.085842 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519ad107-f26a-46aa-8eeb-087dcca1826d None None] REQUEST_METHOD: `POST` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:50:55.086712 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519ad107-f26a-46aa-8eeb-087dcca1826d None None] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:50:55.087520 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519ad107-f26a-46aa-8eeb-087dcca1826d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:50:55.129878 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.auth.core [None req-519ad107-f26a-46aa-8eeb-087dcca1826d None None] MFA Rules not processed for user `97181462fb3647979e18e2f24fc2efb2`. Rule list: `[]` (Enabled: `True`). {{(pid=87935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:50:55.131242 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.fernet_utils [None req-519ad107-f26a-46aa-8eeb-087dcca1826d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:50:55.153248 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 1143/2244] 10.222.0.25 () {58 vars in 958 bytes} [Tue Sep 13 19:50:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 19:50:55.158326 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c39b94e-0b3d-4bc3-97cf-05d24d60b833 None None] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:50:55.174230 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c39b94e-0b3d-4bc3-97cf-05d24d60b833 None None] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:50:55.181409 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e568f3da-6bfa-4516-8dbf-9fe657d58a72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:50:55.182197 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e568f3da-6bfa-4516-8dbf-9fe657d58a72 admin admin] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:50:55.182572 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e568f3da-6bfa-4516-8dbf-9fe657d58a72 admin admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:50:55.182974 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e568f3da-6bfa-4516-8dbf-9fe657d58a72 admin admin] PATH_INFO: `/v3/domains` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:50:55.183910 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e568f3da-6bfa-4516-8dbf-9fe657d58a72 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87934) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:50:55.184441 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e568f3da-6bfa-4516-8dbf-9fe657d58a72 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:50:55.188488 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e568f3da-6bfa-4516-8dbf-9fe657d58a72 admin admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:50:55.209989 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 1144/2245] 10.222.0.25 () {58 vars in 1153 bytes} [Tue Sep 13 19:50:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:50:55.212639 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e568f3da-6bfa-4516-8dbf-9fe657d58a72 admin admin] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:50:55.229069 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e568f3da-6bfa-4516-8dbf-9fe657d58a72 admin admin] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:50:55.236095 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908670a4-beb8-4cb4-8114-395c12ed5c42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:50:55.237071 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908670a4-beb8-4cb4-8114-395c12ed5c42 admin admin] REQUEST_METHOD: `POST` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:50:55.237663 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908670a4-beb8-4cb4-8114-395c12ed5c42 admin admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:50:55.237971 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908670a4-beb8-4cb4-8114-395c12ed5c42 admin admin] PATH_INFO: `/v3/projects` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:50:55.238904 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-908670a4-beb8-4cb4-8114-395c12ed5c42 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:50:55.241436 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-908670a4-beb8-4cb4-8114-395c12ed5c42 admin admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:50:55.248029 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 1102/2246] 10.222.0.25 () {58 vars in 958 bytes} [Tue Sep 13 19:50:55 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 19:50:55.254728 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519ad107-f26a-46aa-8eeb-087dcca1826d None None] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:50:55.265397 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519ad107-f26a-46aa-8eeb-087dcca1826d None None] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:50:55.271255 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e28f817-3900-44f7-ba50-30f3f67674d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:50:55.272067 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e28f817-3900-44f7-ba50-30f3f67674d2 admin admin] REQUEST_METHOD: `POST` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:50:55.272425 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e28f817-3900-44f7-ba50-30f3f67674d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:50:55.272959 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e28f817-3900-44f7-ba50-30f3f67674d2 admin admin] PATH_INFO: `/v3/projects` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:50:55.273761 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e28f817-3900-44f7-ba50-30f3f67674d2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:50:55.276067 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e28f817-3900-44f7-ba50-30f3f67674d2 admin admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:50:55.291416 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 1145/2247] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Sep 13 19:50:55 2022] POST /identity/v3/projects => generated 379 bytes in 76 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 19:50:55.292977 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908670a4-beb8-4cb4-8114-395c12ed5c42 admin admin] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:50:55.320930 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 1103/2248] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Sep 13 19:50:55 2022] POST /identity/v3/projects => generated 373 bytes in 72 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 19:50:55.325760 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e28f817-3900-44f7-ba50-30f3f67674d2 admin admin] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:50:55.396090 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908670a4-beb8-4cb4-8114-395c12ed5c42 admin admin] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:50:55.417590 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e28f817-3900-44f7-ba50-30f3f67674d2 admin admin] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:50:55.425064 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915336f0-6f3f-4806-ae62-5c208ba74408 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:50:55.425800 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915336f0-6f3f-4806-ae62-5c208ba74408 admin admin] REQUEST_METHOD: `POST` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:50:55.426155 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915336f0-6f3f-4806-ae62-5c208ba74408 admin admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:50:55.426501 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915336f0-6f3f-4806-ae62-5c208ba74408 admin admin] PATH_INFO: `/v3/users` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:50:55.427216 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-915336f0-6f3f-4806-ae62-5c208ba74408 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:50:55.429445 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-915336f0-6f3f-4806-ae62-5c208ba74408 admin admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:50:55.464262 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 1104/2249] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Sep 13 19:50:55 2022] POST /identity/v3/users => generated 293 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 19:50:55.467220 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915336f0-6f3f-4806-ae62-5c208ba74408 admin admin] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:50:55.469624 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80022e8d-1b25-461b-9478-2042ad7a21ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:50:55.470764 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80022e8d-1b25-461b-9478-2042ad7a21ae admin admin] REQUEST_METHOD: `POST` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:50:55.471117 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80022e8d-1b25-461b-9478-2042ad7a21ae admin admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:50:55.471586 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80022e8d-1b25-461b-9478-2042ad7a21ae admin admin] PATH_INFO: `/v3/users` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:50:55.472547 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80022e8d-1b25-461b-9478-2042ad7a21ae admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:50:55.475858 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80022e8d-1b25-461b-9478-2042ad7a21ae admin admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:50:55.479524 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915336f0-6f3f-4806-ae62-5c208ba74408 admin admin] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:50:55.496622 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9fe632-a617-4c62-bbb4-c96a05b13d9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:50:55.498145 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9fe632-a617-4c62-bbb4-c96a05b13d9c admin admin] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:50:55.498489 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9fe632-a617-4c62-bbb4-c96a05b13d9c admin admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:50:55.499534 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9fe632-a617-4c62-bbb4-c96a05b13d9c admin admin] PATH_INFO: `/v3/roles` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:50:55.500292 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df9fe632-a617-4c62-bbb4-c96a05b13d9c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:50:55.502672 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df9fe632-a617-4c62-bbb4-c96a05b13d9c admin admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:50:55.504463 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG dbcounter [-] [87935] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=87935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:50:55.509646 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 1146/2250] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Sep 13 19:50:55 2022] POST /identity/v3/users => generated 290 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 19:50:55.510809 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80022e8d-1b25-461b-9478-2042ad7a21ae admin admin] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:50:55.520676 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 1105/2251] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Sep 13 19:50:55 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 13 19:50:55.524192 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80022e8d-1b25-461b-9478-2042ad7a21ae admin admin] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:50:55.524523 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9fe632-a617-4c62-bbb4-c96a05b13d9c admin admin] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:50:55.529366 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b61a58-c545-40b0-af25-520afe7d4d5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:50:55.530200 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b61a58-c545-40b0-af25-520afe7d4d5e admin admin] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:50:55.530749 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b61a58-c545-40b0-af25-520afe7d4d5e admin admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:50:55.530994 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b61a58-c545-40b0-af25-520afe7d4d5e admin admin] PATH_INFO: `/v3/roles` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:50:55.531642 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b61a58-c545-40b0-af25-520afe7d4d5e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:50:55.535346 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b61a58-c545-40b0-af25-520afe7d4d5e admin admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:50:55.550109 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 1147/2252] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Sep 13 19:50:55 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 19:50:55.551369 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b61a58-c545-40b0-af25-520afe7d4d5e admin admin] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:50:55.555155 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9fe632-a617-4c62-bbb4-c96a05b13d9c admin admin] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:50:55.567128 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d741e1-c717-4ed8-bf31-6c6a0a25591c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:50:55.567884 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d741e1-c717-4ed8-bf31-6c6a0a25591c admin admin] REQUEST_METHOD: `PUT` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:50:55.568245 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d741e1-c717-4ed8-bf31-6c6a0a25591c admin admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:50:55.568592 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d741e1-c717-4ed8-bf31-6c6a0a25591c admin admin] PATH_INFO: `/v3/projects/a18af3d5bf084a04bd4e2c8ceab96e50/users/8cee93e13a69462a9852f44bb74ef7cd/roles/6ca1d4427ff64e0a9d25d96cfb1445f6` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:50:55.569013 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b61a58-c545-40b0-af25-520afe7d4d5e admin admin] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:50:55.577052 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5cde8f-3954-42ad-bd6c-68e1212698ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:50:55.577788 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5cde8f-3954-42ad-bd6c-68e1212698ae admin admin] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:50:55.578145 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5cde8f-3954-42ad-bd6c-68e1212698ae admin admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:50:55.578780 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5cde8f-3954-42ad-bd6c-68e1212698ae admin admin] PATH_INFO: `/v3/roles` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:50:55.579647 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a5cde8f-3954-42ad-bd6c-68e1212698ae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:50:55.581423 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a5cde8f-3954-42ad-bd6c-68e1212698ae admin admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:50:55.583095 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG dbcounter [-] [87934] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=87934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:50:55.604974 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 1148/2253] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Sep 13 19:50:55 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 19:50:55.606631 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d741e1-c717-4ed8-bf31-6c6a0a25591c admin admin] RBAC: Authorizing `identity:create_grant(project_id=a18af3d5bf084a04bd4e2c8ceab96e50, user_id=8cee93e13a69462a9852f44bb74ef7cd, role_id=6ca1d4427ff64e0a9d25d96cfb1445f6)` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:50:55.607071 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5cde8f-3954-42ad-bd6c-68e1212698ae admin admin] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:50:55.609727 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d741e1-c717-4ed8-bf31-6c6a0a25591c admin admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:50:55.619107 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5cde8f-3954-42ad-bd6c-68e1212698ae admin admin] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:50:55.624056 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78c35fd-c7e6-4366-940c-8473b9d324fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:50:55.624979 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78c35fd-c7e6-4366-940c-8473b9d324fa admin admin] REQUEST_METHOD: `PUT` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:50:55.625262 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78c35fd-c7e6-4366-940c-8473b9d324fa admin admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:50:55.625561 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78c35fd-c7e6-4366-940c-8473b9d324fa admin admin] PATH_INFO: `/v3/projects/f0930467d92b41a48a255301cdfdec0f/users/798731fe314a4ff08fce922212d7b77c/roles/a259191f6d0e46fabd9f34536bb28747` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:50:55.633145 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 1106/2254] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Sep 13 19:50:55 2022] PUT /identity/v3/projects/a18af3d5bf084a04bd4e2c8ceab96e50/users/8cee93e13a69462a9852f44bb74ef7cd/roles/6ca1d4427ff64e0a9d25d96cfb1445f6 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 19:50:55.637554 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d741e1-c717-4ed8-bf31-6c6a0a25591c admin admin] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:50:55.644900 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d78c35fd-c7e6-4366-940c-8473b9d324fa admin admin] RBAC: Authorizing `identity:create_grant(project_id=f0930467d92b41a48a255301cdfdec0f, user_id=798731fe314a4ff08fce922212d7b77c, role_id=a259191f6d0e46fabd9f34536bb28747)` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:50:55.651860 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d78c35fd-c7e6-4366-940c-8473b9d324fa admin admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:50:55.678692 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 1149/2255] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Sep 13 19:50:55 2022] PUT /identity/v3/projects/f0930467d92b41a48a255301cdfdec0f/users/798731fe314a4ff08fce922212d7b77c/roles/a259191f6d0e46fabd9f34536bb28747 => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 19:50:55.690328 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890d27a7-38f2-405c-8d0c-582fdcb466d7 None None] REQUEST_METHOD: `POST` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:50:55.692029 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890d27a7-38f2-405c-8d0c-582fdcb466d7 None None] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:50:55.692428 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890d27a7-38f2-405c-8d0c-582fdcb466d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:50:55.730371 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.auth.core [None req-890d27a7-38f2-405c-8d0c-582fdcb466d7 None None] MFA Rules not processed for user `798731fe314a4ff08fce922212d7b77c`. Rule list: `[]` (Enabled: `True`). {{(pid=87934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:50:55.732696 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.fernet_utils [None req-890d27a7-38f2-405c-8d0c-582fdcb466d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:50:55.747949 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d741e1-c717-4ed8-bf31-6c6a0a25591c admin admin] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:50:55.867188 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ac133c-da41-4261-8733-ba716a157649 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:50:55.867788 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ac133c-da41-4261-8733-ba716a157649 admin admin] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:50:55.868066 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ac133c-da41-4261-8733-ba716a157649 admin admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:50:55.868378 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ac133c-da41-4261-8733-ba716a157649 admin admin] PATH_INFO: `/v3/roles` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:50:55.869099 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ac133c-da41-4261-8733-ba716a157649 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:50:55.871383 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ac133c-da41-4261-8733-ba716a157649 admin admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:50:55.888313 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 1107/2256] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Sep 13 19:50:55 2022] GET /identity/v3/roles => generated 1420 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 19:50:55.892703 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ac133c-da41-4261-8733-ba716a157649 admin admin] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:50:55.905833 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ac133c-da41-4261-8733-ba716a157649 admin admin] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:50:55.913048 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a272282-6084-4e56-9c2b-f5dd6f7766c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:50:55.914171 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a272282-6084-4e56-9c2b-f5dd6f7766c4 admin admin] REQUEST_METHOD: `PUT` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:50:55.914823 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a272282-6084-4e56-9c2b-f5dd6f7766c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:50:55.915298 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a272282-6084-4e56-9c2b-f5dd6f7766c4 admin admin] PATH_INFO: `/v3/projects/a18af3d5bf084a04bd4e2c8ceab96e50/users/8cee93e13a69462a9852f44bb74ef7cd/roles/6ca1d4427ff64e0a9d25d96cfb1445f6` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:50:55.917253 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 1150/2257] 10.222.0.25 () {58 vars in 958 bytes} [Tue Sep 13 19:50:55 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 19:50:55.918120 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a272282-6084-4e56-9c2b-f5dd6f7766c4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a18af3d5bf084a04bd4e2c8ceab96e50, user_id=8cee93e13a69462a9852f44bb74ef7cd, role_id=6ca1d4427ff64e0a9d25d96cfb1445f6)` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:50:55.921450 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a272282-6084-4e56-9c2b-f5dd6f7766c4 admin admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:50:55.923430 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890d27a7-38f2-405c-8d0c-582fdcb466d7 None None] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:50:55.938683 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890d27a7-38f2-405c-8d0c-582fdcb466d7 None None] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:50:55.972923 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 1108/2258] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Sep 13 19:50:55 2022] PUT /identity/v3/projects/a18af3d5bf084a04bd4e2c8ceab96e50/users/8cee93e13a69462a9852f44bb74ef7cd/roles/6ca1d4427ff64e0a9d25d96cfb1445f6 => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 19:50:55.982787 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30c6e69-3b67-4790-a4cb-4271efc51db8 None None] REQUEST_METHOD: `POST` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:50:55.983069 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30c6e69-3b67-4790-a4cb-4271efc51db8 None None] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:50:55.983345 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30c6e69-3b67-4790-a4cb-4271efc51db8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:50:56.051718 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.auth.core [None req-f30c6e69-3b67-4790-a4cb-4271efc51db8 None None] MFA Rules not processed for user `8cee93e13a69462a9852f44bb74ef7cd`. Rule list: `[]` (Enabled: `True`). {{(pid=87935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:50:56.052756 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.fernet_utils [None req-f30c6e69-3b67-4790-a4cb-4271efc51db8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:50:56.083349 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d758437-e825-4301-9147-75fdcbef1cee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:50:56.084981 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d758437-e825-4301-9147-75fdcbef1cee admin admin] REQUEST_METHOD: `POST` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:50:56.085510 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d758437-e825-4301-9147-75fdcbef1cee admin admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:50:56.085978 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d758437-e825-4301-9147-75fdcbef1cee admin admin] PATH_INFO: `/v3/projects` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:50:56.087107 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d758437-e825-4301-9147-75fdcbef1cee admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:50:56.090193 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d758437-e825-4301-9147-75fdcbef1cee admin admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:50:56.149178 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 1151/2259] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Sep 13 19:50:55 2022] POST /identity/v3/projects => generated 377 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 19:50:56.153079 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d758437-e825-4301-9147-75fdcbef1cee admin admin] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:50:56.175246 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG dbcounter [-] [87935] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=87935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:50:56.207517 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 1109/2260] 10.222.0.25 () {58 vars in 958 bytes} [Tue Sep 13 19:50:55 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 19:50:56.226071 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG dbcounter [-] [87934] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=87934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:50:56.241186 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30c6e69-3b67-4790-a4cb-4271efc51db8 None None] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:50:56.247551 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.fernet_utils [None req-f30c6e69-3b67-4790-a4cb-4271efc51db8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:50:56.283847 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d758437-e825-4301-9147-75fdcbef1cee admin admin] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:50:56.293196 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b24206-3bb2-4968-93c5-f2825e5519a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:50:56.293973 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b24206-3bb2-4968-93c5-f2825e5519a4 admin admin] REQUEST_METHOD: `POST` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:50:56.294360 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b24206-3bb2-4968-93c5-f2825e5519a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:50:56.294749 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b24206-3bb2-4968-93c5-f2825e5519a4 admin admin] PATH_INFO: `/v3/users` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:50:56.296743 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b24206-3bb2-4968-93c5-f2825e5519a4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:50:56.298908 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b24206-3bb2-4968-93c5-f2825e5519a4 admin admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:50:56.355666 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 1152/2261] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Sep 13 19:50:56 2022] POST /identity/v3/users => generated 289 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 19:50:56.355908 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30c6e69-3b67-4790-a4cb-4271efc51db8 None None] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:50:56.357331 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b24206-3bb2-4968-93c5-f2825e5519a4 admin admin] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:50:56.370914 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b24206-3bb2-4968-93c5-f2825e5519a4 admin admin] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:50:56.376879 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f822f4-393b-44c9-ac6f-f1d8443e65d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:50:56.377492 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f822f4-393b-44c9-ac6f-f1d8443e65d6 admin admin] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:50:56.377772 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f822f4-393b-44c9-ac6f-f1d8443e65d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:50:56.378076 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f822f4-393b-44c9-ac6f-f1d8443e65d6 admin admin] PATH_INFO: `/v3/roles` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:50:56.378787 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f822f4-393b-44c9-ac6f-f1d8443e65d6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:50:56.380686 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f822f4-393b-44c9-ac6f-f1d8443e65d6 admin admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:50:56.402384 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 1153/2262] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Sep 13 19:50:56 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 19:50:56.404110 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f822f4-393b-44c9-ac6f-f1d8443e65d6 admin admin] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:50:56.416352 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84426f06-465c-4665-b4e4-61f9d14b0c60 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cbb50c88b794a7f9f26844effde7d63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a10a4268f3c4cb29f4e00c292e2df62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:50:56.417539 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84426f06-465c-4665-b4e4-61f9d14b0c60 service cinder] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:50:56.417919 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84426f06-465c-4665-b4e4-61f9d14b0c60 service cinder] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:50:56.418240 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84426f06-465c-4665-b4e4-61f9d14b0c60 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:50:56.425716 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f822f4-393b-44c9-ac6f-f1d8443e65d6 admin admin] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:50:56.430801 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379cc089-d187-4e70-8737-b256e3432854 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:50:56.431622 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379cc089-d187-4e70-8737-b256e3432854 admin admin] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:50:56.431916 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379cc089-d187-4e70-8737-b256e3432854 admin admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:50:56.432689 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379cc089-d187-4e70-8737-b256e3432854 admin admin] PATH_INFO: `/v3/roles` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:50:56.433486 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-379cc089-d187-4e70-8737-b256e3432854 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:50:56.435233 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-379cc089-d187-4e70-8737-b256e3432854 admin admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:50:56.447381 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 1154/2263] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Sep 13 19:50:56 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 19:50:56.452745 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379cc089-d187-4e70-8737-b256e3432854 admin admin] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:50:56.466264 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379cc089-d187-4e70-8737-b256e3432854 admin admin] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:50:56.471106 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02f40fb-146f-482f-893c-f1a57a372904 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:50:56.471894 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02f40fb-146f-482f-893c-f1a57a372904 admin admin] REQUEST_METHOD: `PUT` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:50:56.472175 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02f40fb-146f-482f-893c-f1a57a372904 admin admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:50:56.472475 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02f40fb-146f-482f-893c-f1a57a372904 admin admin] PATH_INFO: `/v3/projects/f30df5ea0c5941f190c519a0370fc50b/users/512cac0c9e744843bcff1c658acfba01/roles/a259191f6d0e46fabd9f34536bb28747` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:50:56.490980 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b02f40fb-146f-482f-893c-f1a57a372904 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f30df5ea0c5941f190c519a0370fc50b, user_id=512cac0c9e744843bcff1c658acfba01, role_id=a259191f6d0e46fabd9f34536bb28747)` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:50:56.493943 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b02f40fb-146f-482f-893c-f1a57a372904 admin admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:50:56.497578 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84426f06-465c-4665-b4e4-61f9d14b0c60 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:50:56.499078 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84426f06-465c-4665-b4e4-61f9d14b0c60 service cinder] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:50:56.512112 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 1110/2264] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Sep 13 19:50:56 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 274 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 19:50:56.512603 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 1155/2265] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Sep 13 19:50:56 2022] PUT /identity/v3/projects/f30df5ea0c5941f190c519a0370fc50b/users/512cac0c9e744843bcff1c658acfba01/roles/a259191f6d0e46fabd9f34536bb28747 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 19:50:56.523573 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c407b7d-3c2a-4fc7-add6-2f6c2e77c9df None None] REQUEST_METHOD: `POST` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:50:56.523890 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c407b7d-3c2a-4fc7-add6-2f6c2e77c9df None None] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:50:56.524172 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c407b7d-3c2a-4fc7-add6-2f6c2e77c9df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:50:56.555643 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.auth.core [None req-3c407b7d-3c2a-4fc7-add6-2f6c2e77c9df None None] MFA Rules not processed for user `512cac0c9e744843bcff1c658acfba01`. Rule list: `[]` (Enabled: `True`). {{(pid=87935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:50:56.556992 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.fernet_utils [None req-3c407b7d-3c2a-4fc7-add6-2f6c2e77c9df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:50:56.612623 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG dbcounter [-] [87935] Writing DB stats keystone:SELECT=100 {{(pid=87935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:50:56.639071 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 1111/2266] 10.222.0.25 () {58 vars in 958 bytes} [Tue Sep 13 19:50:56 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 19:50:56.645471 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02f40fb-146f-482f-893c-f1a57a372904 admin admin] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:50:56.734617 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02f40fb-146f-482f-893c-f1a57a372904 admin admin] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:50:56.741274 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2526907-2640-434d-8fba-6e3c2d46ff44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:50:56.741709 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2526907-2640-434d-8fba-6e3c2d46ff44 admin admin] REQUEST_METHOD: `POST` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:50:56.742001 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2526907-2640-434d-8fba-6e3c2d46ff44 admin admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:50:56.742257 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2526907-2640-434d-8fba-6e3c2d46ff44 admin admin] PATH_INFO: `/v3/projects` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:50:56.742970 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2526907-2640-434d-8fba-6e3c2d46ff44 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:50:56.744880 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2526907-2640-434d-8fba-6e3c2d46ff44 admin admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:50:56.778740 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 1156/2267] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Sep 13 19:50:56 2022] POST /identity/v3/projects => generated 377 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 19:50:56.783664 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c407b7d-3c2a-4fc7-add6-2f6c2e77c9df None None] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:50:56.796417 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c407b7d-3c2a-4fc7-add6-2f6c2e77c9df None None] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:50:56.896383 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44dbf8b-2007-4ba6-b9f6-7c4c98a63d96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:50:56.896753 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44dbf8b-2007-4ba6-b9f6-7c4c98a63d96 admin admin] REQUEST_METHOD: `POST` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:50:56.897034 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44dbf8b-2007-4ba6-b9f6-7c4c98a63d96 admin admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:50:56.897309 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44dbf8b-2007-4ba6-b9f6-7c4c98a63d96 admin admin] PATH_INFO: `/v3/users` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:50:56.897944 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b44dbf8b-2007-4ba6-b9f6-7c4c98a63d96 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:50:56.900093 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b44dbf8b-2007-4ba6-b9f6-7c4c98a63d96 admin admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:50:56.945958 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 1112/2268] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Sep 13 19:50:56 2022] POST /identity/v3/users => generated 295 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 13 19:50:56.959983 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2526907-2640-434d-8fba-6e3c2d46ff44 admin admin] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:50:56.972637 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2526907-2640-434d-8fba-6e3c2d46ff44 admin admin] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:50:56.977457 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e8e0a8-5b2b-4687-b525-c679eb9a95f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:50:56.978061 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e8e0a8-5b2b-4687-b525-c679eb9a95f3 admin admin] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:50:56.978344 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e8e0a8-5b2b-4687-b525-c679eb9a95f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:50:56.978621 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e8e0a8-5b2b-4687-b525-c679eb9a95f3 admin admin] PATH_INFO: `/v3/roles` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:50:56.979268 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e8e0a8-5b2b-4687-b525-c679eb9a95f3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:50:56.980932 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e8e0a8-5b2b-4687-b525-c679eb9a95f3 admin admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:50:56.994043 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 1157/2269] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Sep 13 19:50:56 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 19:50:56.998238 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44dbf8b-2007-4ba6-b9f6-7c4c98a63d96 admin admin] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:50:57.013359 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44dbf8b-2007-4ba6-b9f6-7c4c98a63d96 admin admin] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:50:57.019423 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7491b891-dd27-479c-8b44-79b377cd1eaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:50:57.019981 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7491b891-dd27-479c-8b44-79b377cd1eaf admin admin] REQUEST_METHOD: `PUT` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:50:57.020504 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7491b891-dd27-479c-8b44-79b377cd1eaf admin admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:50:57.020937 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7491b891-dd27-479c-8b44-79b377cd1eaf admin admin] PATH_INFO: `/v3/projects/86bc3a3fd7e54d60b20a91883e8975d9/users/47734d888da24b3bbf8dcac23f418fd9/roles/6ca1d4427ff64e0a9d25d96cfb1445f6` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:50:57.051704 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7491b891-dd27-479c-8b44-79b377cd1eaf admin admin] RBAC: Authorizing `identity:create_grant(project_id=86bc3a3fd7e54d60b20a91883e8975d9, user_id=47734d888da24b3bbf8dcac23f418fd9, role_id=6ca1d4427ff64e0a9d25d96cfb1445f6)` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:50:57.054918 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7491b891-dd27-479c-8b44-79b377cd1eaf admin admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:50:57.074378 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 1113/2270] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Sep 13 19:50:56 2022] PUT /identity/v3/projects/86bc3a3fd7e54d60b20a91883e8975d9/users/47734d888da24b3bbf8dcac23f418fd9/roles/6ca1d4427ff64e0a9d25d96cfb1445f6 => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 19:50:57.078691 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e8e0a8-5b2b-4687-b525-c679eb9a95f3 admin admin] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:50:57.093327 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e8e0a8-5b2b-4687-b525-c679eb9a95f3 admin admin] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:50:57.171862 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25715187-75a9-4d84-8227-2eb0c90e0fb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:50:57.173353 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25715187-75a9-4d84-8227-2eb0c90e0fb3 admin admin] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:50:57.173622 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25715187-75a9-4d84-8227-2eb0c90e0fb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:50:57.173980 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25715187-75a9-4d84-8227-2eb0c90e0fb3 admin admin] PATH_INFO: `/v3/roles` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:50:57.174858 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25715187-75a9-4d84-8227-2eb0c90e0fb3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:50:57.176639 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25715187-75a9-4d84-8227-2eb0c90e0fb3 admin admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:50:57.184315 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG dbcounter [-] [87934] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=87934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:50:57.193883 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 1158/2271] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Sep 13 19:50:57 2022] GET /identity/v3/roles => generated 1420 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 13 19:50:57.198498 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7491b891-dd27-479c-8b44-79b377cd1eaf admin admin] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:50:57.212095 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7491b891-dd27-479c-8b44-79b377cd1eaf admin admin] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:50:57.217809 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e406b7-2e38-4d1d-ba0c-25e0c3a2bf48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:50:57.218470 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e406b7-2e38-4d1d-ba0c-25e0c3a2bf48 admin admin] REQUEST_METHOD: `PUT` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:50:57.218761 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e406b7-2e38-4d1d-ba0c-25e0c3a2bf48 admin admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:50:57.219073 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e406b7-2e38-4d1d-ba0c-25e0c3a2bf48 admin admin] PATH_INFO: `/v3/projects/86bc3a3fd7e54d60b20a91883e8975d9/users/47734d888da24b3bbf8dcac23f418fd9/roles/6ca1d4427ff64e0a9d25d96cfb1445f6` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:50:57.222010 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e406b7-2e38-4d1d-ba0c-25e0c3a2bf48 admin admin] RBAC: Authorizing `identity:create_grant(project_id=86bc3a3fd7e54d60b20a91883e8975d9, user_id=47734d888da24b3bbf8dcac23f418fd9, role_id=6ca1d4427ff64e0a9d25d96cfb1445f6)` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:50:57.225216 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e406b7-2e38-4d1d-ba0c-25e0c3a2bf48 admin admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:50:57.243354 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 1114/2272] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Sep 13 19:50:57 2022] PUT /identity/v3/projects/86bc3a3fd7e54d60b20a91883e8975d9/users/47734d888da24b3bbf8dcac23f418fd9/roles/6ca1d4427ff64e0a9d25d96cfb1445f6 => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 19:50:57.257840 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c684dddc-e8ac-4847-b20f-fa06c972da4a None None] REQUEST_METHOD: `POST` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:50:57.258424 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c684dddc-e8ac-4847-b20f-fa06c972da4a None None] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:50:57.258874 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c684dddc-e8ac-4847-b20f-fa06c972da4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:50:57.294579 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.auth.core [None req-c684dddc-e8ac-4847-b20f-fa06c972da4a None None] MFA Rules not processed for user `47734d888da24b3bbf8dcac23f418fd9`. Rule list: `[]` (Enabled: `True`). {{(pid=87934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:50:57.304452 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.fernet_utils [None req-c684dddc-e8ac-4847-b20f-fa06c972da4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:50:57.429987 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 1159/2273] 10.222.0.25 () {58 vars in 958 bytes} [Tue Sep 13 19:50:57 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 19:50:57.446958 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e406b7-2e38-4d1d-ba0c-25e0c3a2bf48 admin admin] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:50:57.546070 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e406b7-2e38-4d1d-ba0c-25e0c3a2bf48 admin admin] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:50:57.552158 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ebb94a4-e165-46ab-ba30-0bd70b29d8f7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cbb50c88b794a7f9f26844effde7d63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a10a4268f3c4cb29f4e00c292e2df62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:50:57.552960 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebb94a4-e165-46ab-ba30-0bd70b29d8f7 service cinder] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:50:57.553334 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebb94a4-e165-46ab-ba30-0bd70b29d8f7 service cinder] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:50:57.553688 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebb94a4-e165-46ab-ba30-0bd70b29d8f7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:50:57.567177 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ebb94a4-e165-46ab-ba30-0bd70b29d8f7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:50:57.572260 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ebb94a4-e165-46ab-ba30-0bd70b29d8f7 service cinder] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:50:57.587873 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 1115/2274] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Sep 13 19:50:57 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 19:50:57.637224 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c684dddc-e8ac-4847-b20f-fa06c972da4a None None] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:50:57.638686 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.fernet_utils [None req-c684dddc-e8ac-4847-b20f-fa06c972da4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:50:57.656419 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c684dddc-e8ac-4847-b20f-fa06c972da4a None None] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:50:57.661061 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac550dfd-3009-45b5-855a-40cd03940175 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cbb50c88b794a7f9f26844effde7d63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a10a4268f3c4cb29f4e00c292e2df62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:50:57.661741 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac550dfd-3009-45b5-855a-40cd03940175 service cinder] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:50:57.662254 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac550dfd-3009-45b5-855a-40cd03940175 service cinder] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:50:57.662639 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac550dfd-3009-45b5-855a-40cd03940175 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:50:57.755601 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac550dfd-3009-45b5-855a-40cd03940175 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:50:57.757310 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac550dfd-3009-45b5-855a-40cd03940175 service cinder] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:50:57.769117 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 1160/2275] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Sep 13 19:50:57 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 19:50:59.234444 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ebb94a4-e165-46ab-ba30-0bd70b29d8f7 service cinder] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:50:59.287690 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG dbcounter [-] [87935] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=87935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:50:59.317683 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ebb94a4-e165-46ab-ba30-0bd70b29d8f7 service cinder] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:50:59.323516 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26cb2b9c-a818-4607-bb7c-389be610bc39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:50:59.324155 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cb2b9c-a818-4607-bb7c-389be610bc39 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:50:59.324476 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cb2b9c-a818-4607-bb7c-389be610bc39 admin admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:50:59.324746 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cb2b9c-a818-4607-bb7c-389be610bc39 admin admin] PATH_INFO: `/v3/users/97181462fb3647979e18e2f24fc2efb2` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:50:59.325868 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26cb2b9c-a818-4607-bb7c-389be610bc39 admin admin] RBAC: Authorizing `identity:delete_user(user_id=97181462fb3647979e18e2f24fc2efb2)` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:50:59.327797 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26cb2b9c-a818-4607-bb7c-389be610bc39 admin admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:50:59.393298 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.notifications [None req-26cb2b9c-a818-4607-bb7c-389be610bc39 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '97181462fb3647979e18e2f24fc2efb2'} {{(pid=87935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:50:59.412996 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.notifications [None req-26cb2b9c-a818-4607-bb7c-389be610bc39 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '97181462fb3647979e18e2f24fc2efb2'} {{(pid=87935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:50:59.431864 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.notifications [None req-26cb2b9c-a818-4607-bb7c-389be610bc39 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '97181462fb3647979e18e2f24fc2efb2'} {{(pid=87935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:50:59.432970 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.notifications [None req-26cb2b9c-a818-4607-bb7c-389be610bc39 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '97181462fb3647979e18e2f24fc2efb2'} {{(pid=87935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:50:59.433473 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.notifications [None req-26cb2b9c-a818-4607-bb7c-389be610bc39 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '97181462fb3647979e18e2f24fc2efb2'} {{(pid=87935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:50:59.465080 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 1116/2276] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Sep 13 19:50:59 2022] DELETE /identity/v3/users/97181462fb3647979e18e2f24fc2efb2 => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 19:50:59.470133 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af8ed75-563a-44ee-9d0e-65bfcc5df890 None None] REQUEST_METHOD: `POST` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:50:59.470744 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af8ed75-563a-44ee-9d0e-65bfcc5df890 None None] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:50:59.470744 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af8ed75-563a-44ee-9d0e-65bfcc5df890 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:50:59.498736 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.auth.core [None req-2af8ed75-563a-44ee-9d0e-65bfcc5df890 None None] MFA Rules not processed for user `7b0aed92d02344acb92a0e4aa67c3068`. Rule list: `[]` (Enabled: `True`). {{(pid=87934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:50:59.500105 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.fernet_utils [None req-2af8ed75-563a-44ee-9d0e-65bfcc5df890 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:50:59.576406 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 1161/2277] 10.222.0.25 () {58 vars in 958 bytes} [Tue Sep 13 19:50:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 19:50:59.587043 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26cb2b9c-a818-4607-bb7c-389be610bc39 admin admin] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:50:59.589250 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.fernet_utils [None req-26cb2b9c-a818-4607-bb7c-389be610bc39 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:50:59.675276 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26cb2b9c-a818-4607-bb7c-389be610bc39 admin admin] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:50:59.681485 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f3ec07-38ab-4e1d-9687-9cd6fa05632e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1196a96e4a404f559600b69f929ea9da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a10a4268f3c4cb29f4e00c292e2df62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:50:59.682102 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f3ec07-38ab-4e1d-9687-9cd6fa05632e service neutron] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:50:59.682380 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f3ec07-38ab-4e1d-9687-9cd6fa05632e service neutron] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:50:59.682648 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f3ec07-38ab-4e1d-9687-9cd6fa05632e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:50:59.695965 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f3ec07-38ab-4e1d-9687-9cd6fa05632e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:50:59.700968 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f3ec07-38ab-4e1d-9687-9cd6fa05632e service neutron] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:50:59.718460 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 1117/2278] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Sep 13 19:50:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 19:51:00.186939 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af8ed75-563a-44ee-9d0e-65bfcc5df890 None None] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:51:00.189172 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.fernet_utils [None req-2af8ed75-563a-44ee-9d0e-65bfcc5df890 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:51:00.219645 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af8ed75-563a-44ee-9d0e-65bfcc5df890 None None] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:51:00.224414 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2faa2a-36fd-4f7d-ba33-7aed58651455 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:51:00.225052 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2faa2a-36fd-4f7d-ba33-7aed58651455 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:51:00.225334 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2faa2a-36fd-4f7d-ba33-7aed58651455 admin admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:51:00.225608 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2faa2a-36fd-4f7d-ba33-7aed58651455 admin admin] PATH_INFO: `/v3/projects/ca429972ef6a4aabae5ea90c4d306751` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:51:00.226735 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b2faa2a-36fd-4f7d-ba33-7aed58651455 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ca429972ef6a4aabae5ea90c4d306751)` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:51:00.228972 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b2faa2a-36fd-4f7d-ba33-7aed58651455 admin admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:51:00.257897 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG dbcounter [-] [87934] Writing DB stats keystone:SELECT=100 {{(pid=87934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:51:00.301579 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.notifications [None req-4b2faa2a-36fd-4f7d-ba33-7aed58651455 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ca429972ef6a4aabae5ea90c4d306751', 'request_id': 'req-4b2faa2a-36fd-4f7d-ba33-7aed58651455'} {{(pid=87934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:51:00.308509 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.notifications [None req-4b2faa2a-36fd-4f7d-ba33-7aed58651455 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ca429972ef6a4aabae5ea90c4d306751', 'request_id': 'req-4b2faa2a-36fd-4f7d-ba33-7aed58651455'} {{(pid=87934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:51:00.318956 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.notifications [None req-4b2faa2a-36fd-4f7d-ba33-7aed58651455 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ca429972ef6a4aabae5ea90c4d306751', 'request_id': 'req-4b2faa2a-36fd-4f7d-ba33-7aed58651455'} {{(pid=87934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:51:00.337661 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.notifications [None req-4b2faa2a-36fd-4f7d-ba33-7aed58651455 admin admin] The token cache is being invalidate because project ca429972ef6a4aabae5ea90c4d306751 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87934) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 19:51:00.337959 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.notifications [None req-4b2faa2a-36fd-4f7d-ba33-7aed58651455 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:51:00.340576 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.notifications [None req-4b2faa2a-36fd-4f7d-ba33-7aed58651455 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:51:00.342769 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 1162/2279] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Sep 13 19:51:00 2022] DELETE /identity/v3/projects/ca429972ef6a4aabae5ea90c4d306751 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 19:51:00.347352 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f3ec07-38ab-4e1d-9687-9cd6fa05632e service neutron] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:51:00.357909 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f3ec07-38ab-4e1d-9687-9cd6fa05632e service neutron] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:51:00.433177 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d20dd9-cf26-4ecd-895d-32266517577d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:51:00.433729 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d20dd9-cf26-4ecd-895d-32266517577d admin admin] REQUEST_METHOD: `DELETE` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:51:00.434011 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d20dd9-cf26-4ecd-895d-32266517577d admin admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:51:00.434285 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d20dd9-cf26-4ecd-895d-32266517577d admin admin] PATH_INFO: `/v3/users/8cee93e13a69462a9852f44bb74ef7cd` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:51:00.435426 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d20dd9-cf26-4ecd-895d-32266517577d admin admin] RBAC: Authorizing `identity:delete_user(user_id=8cee93e13a69462a9852f44bb74ef7cd)` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:51:00.437456 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d20dd9-cf26-4ecd-895d-32266517577d admin admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:51:00.443016 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG dbcounter [-] [87935] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:51:00.501971 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.notifications [None req-61d20dd9-cf26-4ecd-895d-32266517577d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8cee93e13a69462a9852f44bb74ef7cd'} {{(pid=87935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:51:00.512958 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.notifications [None req-61d20dd9-cf26-4ecd-895d-32266517577d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8cee93e13a69462a9852f44bb74ef7cd'} {{(pid=87935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:51:00.527686 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.notifications [None req-61d20dd9-cf26-4ecd-895d-32266517577d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8cee93e13a69462a9852f44bb74ef7cd'} {{(pid=87935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:51:00.528425 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.notifications [None req-61d20dd9-cf26-4ecd-895d-32266517577d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8cee93e13a69462a9852f44bb74ef7cd'} {{(pid=87935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:51:00.529567 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.notifications [None req-61d20dd9-cf26-4ecd-895d-32266517577d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8cee93e13a69462a9852f44bb74ef7cd'} {{(pid=87935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:51:00.545658 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 1118/2280] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Sep 13 19:51:00 2022] DELETE /identity/v3/users/8cee93e13a69462a9852f44bb74ef7cd => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 19:51:00.853664 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2faa2a-36fd-4f7d-ba33-7aed58651455 admin admin] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:51:00.855098 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.fernet_utils [None req-4b2faa2a-36fd-4f7d-ba33-7aed58651455 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:51:00.896025 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2faa2a-36fd-4f7d-ba33-7aed58651455 admin admin] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:51:00.991562 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1926b5-c9af-4a9d-a12d-cd4038e1f138 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:51:00.992326 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1926b5-c9af-4a9d-a12d-cd4038e1f138 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:51:00.992606 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1926b5-c9af-4a9d-a12d-cd4038e1f138 admin admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:51:00.992873 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1926b5-c9af-4a9d-a12d-cd4038e1f138 admin admin] PATH_INFO: `/v3/projects/a18af3d5bf084a04bd4e2c8ceab96e50` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:51:00.994024 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c1926b5-c9af-4a9d-a12d-cd4038e1f138 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a18af3d5bf084a04bd4e2c8ceab96e50)` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:51:00.995970 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c1926b5-c9af-4a9d-a12d-cd4038e1f138 admin admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:51:01.064574 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.notifications [None req-5c1926b5-c9af-4a9d-a12d-cd4038e1f138 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a18af3d5bf084a04bd4e2c8ceab96e50', 'request_id': 'req-5c1926b5-c9af-4a9d-a12d-cd4038e1f138'} {{(pid=87934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:51:01.072786 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.notifications [None req-5c1926b5-c9af-4a9d-a12d-cd4038e1f138 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a18af3d5bf084a04bd4e2c8ceab96e50', 'request_id': 'req-5c1926b5-c9af-4a9d-a12d-cd4038e1f138'} {{(pid=87934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:51:01.084174 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.notifications [None req-5c1926b5-c9af-4a9d-a12d-cd4038e1f138 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a18af3d5bf084a04bd4e2c8ceab96e50', 'request_id': 'req-5c1926b5-c9af-4a9d-a12d-cd4038e1f138'} {{(pid=87934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:51:01.097769 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d20dd9-cf26-4ecd-895d-32266517577d admin admin] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:51:01.099566 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.fernet_utils [None req-61d20dd9-cf26-4ecd-895d-32266517577d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:51:01.106563 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.notifications [None req-5c1926b5-c9af-4a9d-a12d-cd4038e1f138 admin admin] The token cache is being invalidate because project a18af3d5bf084a04bd4e2c8ceab96e50 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87934) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 19:51:01.106856 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.notifications [None req-5c1926b5-c9af-4a9d-a12d-cd4038e1f138 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:51:01.107473 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.notifications [None req-5c1926b5-c9af-4a9d-a12d-cd4038e1f138 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:51:01.109288 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 1163/2281] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Sep 13 19:51:00 2022] DELETE /identity/v3/projects/a18af3d5bf084a04bd4e2c8ceab96e50 => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 19:51:01.115180 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d20dd9-cf26-4ecd-895d-32266517577d admin admin] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:51:01.115579 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05bcc16-21bb-47b9-8ab8-214526d7d0c6 None None] REQUEST_METHOD: `POST` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:51:01.115869 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05bcc16-21bb-47b9-8ab8-214526d7d0c6 None None] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:51:01.116258 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05bcc16-21bb-47b9-8ab8-214526d7d0c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:51:01.142713 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.auth.core [None req-c05bcc16-21bb-47b9-8ab8-214526d7d0c6 None None] MFA Rules not processed for user `7b0aed92d02344acb92a0e4aa67c3068`. Rule list: `[]` (Enabled: `True`). {{(pid=87934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:51:01.144144 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.fernet_utils [None req-c05bcc16-21bb-47b9-8ab8-214526d7d0c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:51:01.209004 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG dbcounter [-] [87934] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=87934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:51:01.250120 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 1164/2282] 10.222.0.25 () {58 vars in 958 bytes} [Tue Sep 13 19:51:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 19:51:01.252047 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad10b1d9-20ad-4123-bcaf-678b15751299 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:51:01.252861 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad10b1d9-20ad-4123-bcaf-678b15751299 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:51:01.253142 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad10b1d9-20ad-4123-bcaf-678b15751299 admin admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:51:01.253410 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad10b1d9-20ad-4123-bcaf-678b15751299 admin admin] PATH_INFO: `/v3/users/798731fe314a4ff08fce922212d7b77c` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:51:01.254860 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad10b1d9-20ad-4123-bcaf-678b15751299 admin admin] RBAC: Authorizing `identity:delete_user(user_id=798731fe314a4ff08fce922212d7b77c)` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:51:01.257764 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad10b1d9-20ad-4123-bcaf-678b15751299 admin admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:51:01.258824 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ab183b-79e2-4e52-a292-a17a86d6d435 None None] REQUEST_METHOD: `POST` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:51:01.259452 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ab183b-79e2-4e52-a292-a17a86d6d435 None None] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:51:01.259919 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ab183b-79e2-4e52-a292-a17a86d6d435 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:51:01.286489 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.auth.core [None req-89ab183b-79e2-4e52-a292-a17a86d6d435 None None] MFA Rules not processed for user `7b0aed92d02344acb92a0e4aa67c3068`. Rule list: `[]` (Enabled: `True`). {{(pid=87934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:51:01.290346 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.fernet_utils [None req-89ab183b-79e2-4e52-a292-a17a86d6d435 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:51:01.324430 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 1165/2283] 10.222.0.25 () {58 vars in 958 bytes} [Tue Sep 13 19:51:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 19:51:01.330466 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ab183b-79e2-4e52-a292-a17a86d6d435 None None] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:51:01.346509 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ab183b-79e2-4e52-a292-a17a86d6d435 None None] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:51:01.372938 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beed4861-5767-4e72-97e3-c3aaf5d4195a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:51:01.374149 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beed4861-5767-4e72-97e3-c3aaf5d4195a admin admin] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:51:01.374587 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beed4861-5767-4e72-97e3-c3aaf5d4195a admin admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:51:01.375133 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.notifications [None req-ad10b1d9-20ad-4123-bcaf-678b15751299 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '798731fe314a4ff08fce922212d7b77c'} {{(pid=87935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:51:01.375946 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beed4861-5767-4e72-97e3-c3aaf5d4195a admin admin] PATH_INFO: `/v3/domains` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:51:01.376788 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beed4861-5767-4e72-97e3-c3aaf5d4195a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87934) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:51:01.378022 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beed4861-5767-4e72-97e3-c3aaf5d4195a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:51:01.380009 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beed4861-5767-4e72-97e3-c3aaf5d4195a admin admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:51:01.393828 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.notifications [None req-ad10b1d9-20ad-4123-bcaf-678b15751299 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '798731fe314a4ff08fce922212d7b77c'} {{(pid=87935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:51:01.399402 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 1166/2284] 10.222.0.25 () {58 vars in 1153 bytes} [Tue Sep 13 19:51:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 19:51:01.403551 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beed4861-5767-4e72-97e3-c3aaf5d4195a admin admin] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:51:01.421226 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beed4861-5767-4e72-97e3-c3aaf5d4195a admin admin] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:51:01.429794 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.notifications [None req-ad10b1d9-20ad-4123-bcaf-678b15751299 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '798731fe314a4ff08fce922212d7b77c'} {{(pid=87935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:51:01.430859 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.notifications [None req-ad10b1d9-20ad-4123-bcaf-678b15751299 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '798731fe314a4ff08fce922212d7b77c'} {{(pid=87935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:51:01.432133 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.notifications [None req-ad10b1d9-20ad-4123-bcaf-678b15751299 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '798731fe314a4ff08fce922212d7b77c'} {{(pid=87935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:51:01.436677 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033d3749-db48-418a-b1ce-4279fd3ed114 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:51:01.437666 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033d3749-db48-418a-b1ce-4279fd3ed114 admin admin] REQUEST_METHOD: `POST` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:51:01.438954 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033d3749-db48-418a-b1ce-4279fd3ed114 admin admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:51:01.439377 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033d3749-db48-418a-b1ce-4279fd3ed114 admin admin] PATH_INFO: `/v3/projects` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:51:01.440351 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-033d3749-db48-418a-b1ce-4279fd3ed114 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:51:01.442698 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-033d3749-db48-418a-b1ce-4279fd3ed114 admin admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:51:01.457148 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 1119/2285] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Sep 13 19:51:01 2022] DELETE /identity/v3/users/798731fe314a4ff08fce922212d7b77c => generated 0 bytes in 361 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 19:51:01.462339 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8679a449-2ba4-42ca-a0bb-ed63df970b40 None None] REQUEST_METHOD: `POST` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:51:01.462631 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8679a449-2ba4-42ca-a0bb-ed63df970b40 None None] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:51:01.462908 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8679a449-2ba4-42ca-a0bb-ed63df970b40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:51:01.471389 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG dbcounter [-] [87935] Writing DB stats keystone:SELECT=78,keystone:DELETE=20,keystone:INSERT=2 {{(pid=87935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:51:01.487420 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.auth.core [None req-8679a449-2ba4-42ca-a0bb-ed63df970b40 None None] MFA Rules not processed for user `7b0aed92d02344acb92a0e4aa67c3068`. Rule list: `[]` (Enabled: `True`). {{(pid=87935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:51:01.488656 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.fernet_utils [None req-8679a449-2ba4-42ca-a0bb-ed63df970b40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:51:01.496386 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 1167/2286] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Sep 13 19:51:01 2022] POST /identity/v3/projects => generated 371 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 13 19:51:01.500258 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033d3749-db48-418a-b1ce-4279fd3ed114 admin admin] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:51:01.502920 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.fernet_utils [None req-033d3749-db48-418a-b1ce-4279fd3ed114 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:51:01.589151 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 1120/2287] 10.222.0.25 () {58 vars in 958 bytes} [Tue Sep 13 19:51:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 19:51:01.600226 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8679a449-2ba4-42ca-a0bb-ed63df970b40 None None] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:51:01.601671 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.fernet_utils [None req-8679a449-2ba4-42ca-a0bb-ed63df970b40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:51:01.621082 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033d3749-db48-418a-b1ce-4279fd3ed114 admin admin] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:51:01.639535 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07161514-befc-4c8f-a0c7-78ac0cb493fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:51:01.640445 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07161514-befc-4c8f-a0c7-78ac0cb493fc admin admin] REQUEST_METHOD: `POST` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:51:01.642557 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07161514-befc-4c8f-a0c7-78ac0cb493fc admin admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:51:01.642836 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07161514-befc-4c8f-a0c7-78ac0cb493fc admin admin] PATH_INFO: `/v3/users` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:51:01.643520 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07161514-befc-4c8f-a0c7-78ac0cb493fc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:51:01.646308 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07161514-befc-4c8f-a0c7-78ac0cb493fc admin admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:51:01.706917 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 1168/2288] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Sep 13 19:51:01 2022] POST /identity/v3/users => generated 286 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 19:51:01.713758 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07161514-befc-4c8f-a0c7-78ac0cb493fc admin admin] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:51:01.774252 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8679a449-2ba4-42ca-a0bb-ed63df970b40 None None] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:51:01.777069 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07161514-befc-4c8f-a0c7-78ac0cb493fc admin admin] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:51:01.778572 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1cc6bb4-d1db-4187-8003-4bd92987e401 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1196a96e4a404f559600b69f929ea9da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a10a4268f3c4cb29f4e00c292e2df62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:51:01.779380 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1cc6bb4-d1db-4187-8003-4bd92987e401 service neutron] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:51:01.779902 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1cc6bb4-d1db-4187-8003-4bd92987e401 service neutron] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:51:01.780474 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1cc6bb4-d1db-4187-8003-4bd92987e401 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:51:01.800854 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1cc6bb4-d1db-4187-8003-4bd92987e401 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:51:01.802315 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1cc6bb4-d1db-4187-8003-4bd92987e401 service neutron] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:51:01.807206 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d307f6-a592-4d6f-a8c8-436947fb08de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:51:01.807841 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d307f6-a592-4d6f-a8c8-436947fb08de admin admin] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:51:01.808123 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d307f6-a592-4d6f-a8c8-436947fb08de admin admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:51:01.808424 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d307f6-a592-4d6f-a8c8-436947fb08de admin admin] PATH_INFO: `/v3/roles` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:51:01.809088 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d307f6-a592-4d6f-a8c8-436947fb08de admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:51:01.810875 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d307f6-a592-4d6f-a8c8-436947fb08de admin admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:51:01.825461 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 1121/2289] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Sep 13 19:51:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 223 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 19:51:01.838483 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 1169/2290] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Sep 13 19:51:01 2022] GET /identity/v3/roles => generated 1420 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 19:51:01.845587 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1cc6bb4-d1db-4187-8003-4bd92987e401 service neutron] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:51:01.855491 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1cc6bb4-d1db-4187-8003-4bd92987e401 service neutron] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:51:01.865016 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c693702-2f0d-45ec-a7ed-3af2c49e4fb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:51:01.865737 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c693702-2f0d-45ec-a7ed-3af2c49e4fb9 admin admin] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:51:01.866040 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c693702-2f0d-45ec-a7ed-3af2c49e4fb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:51:01.866314 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c693702-2f0d-45ec-a7ed-3af2c49e4fb9 admin admin] PATH_INFO: `/v3/roles` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:51:01.867261 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c693702-2f0d-45ec-a7ed-3af2c49e4fb9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:51:01.869514 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c693702-2f0d-45ec-a7ed-3af2c49e4fb9 admin admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:51:01.886130 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 1122/2291] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Sep 13 19:51:01 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 19:51:01.891071 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d307f6-a592-4d6f-a8c8-436947fb08de admin admin] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:51:01.908827 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d307f6-a592-4d6f-a8c8-436947fb08de admin admin] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:51:01.918530 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1f6891-7c4a-43e2-be67-a3966a92b5c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:51:01.919860 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1f6891-7c4a-43e2-be67-a3966a92b5c3 admin admin] REQUEST_METHOD: `PUT` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:51:01.920372 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1f6891-7c4a-43e2-be67-a3966a92b5c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:51:01.920861 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1f6891-7c4a-43e2-be67-a3966a92b5c3 admin admin] PATH_INFO: `/v3/projects/cc7ea39c59444ac4a012fb7b687cf743/users/7055a86d737749ec8c6f85752f00b28e/roles/a259191f6d0e46fabd9f34536bb28747` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:51:01.948340 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad1f6891-7c4a-43e2-be67-a3966a92b5c3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cc7ea39c59444ac4a012fb7b687cf743, user_id=7055a86d737749ec8c6f85752f00b28e, role_id=a259191f6d0e46fabd9f34536bb28747)` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:51:01.952724 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad1f6891-7c4a-43e2-be67-a3966a92b5c3 admin admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:51:01.976682 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 1170/2292] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Sep 13 19:51:01 2022] PUT /identity/v3/projects/cc7ea39c59444ac4a012fb7b687cf743/users/7055a86d737749ec8c6f85752f00b28e/roles/a259191f6d0e46fabd9f34536bb28747 => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 19:51:01.978894 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60177c7-1e6d-43ad-9026-646d88b6e636 None None] REQUEST_METHOD: `POST` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:51:01.979720 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60177c7-1e6d-43ad-9026-646d88b6e636 None None] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:51:01.980017 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60177c7-1e6d-43ad-9026-646d88b6e636 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:51:02.018752 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.auth.core [None req-c60177c7-1e6d-43ad-9026-646d88b6e636 None None] MFA Rules not processed for user `7b0aed92d02344acb92a0e4aa67c3068`. Rule list: `[]` (Enabled: `True`). {{(pid=87935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:51:02.020027 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.fernet_utils [None req-c60177c7-1e6d-43ad-9026-646d88b6e636 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:51:02.112798 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 1123/2293] 10.222.0.25 () {58 vars in 958 bytes} [Tue Sep 13 19:51:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 19:51:02.126769 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1f6891-7c4a-43e2-be67-a3966a92b5c3 admin admin] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:51:02.261920 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60177c7-1e6d-43ad-9026-646d88b6e636 None None] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:51:02.263559 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.fernet_utils [None req-c60177c7-1e6d-43ad-9026-646d88b6e636 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:51:02.294248 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1f6891-7c4a-43e2-be67-a3966a92b5c3 admin admin] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:51:02.303678 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60177c7-1e6d-43ad-9026-646d88b6e636 None None] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:51:02.321929 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a83fffc-3790-4085-953f-c8f23740c280 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1196a96e4a404f559600b69f929ea9da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a10a4268f3c4cb29f4e00c292e2df62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:51:02.323329 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a83fffc-3790-4085-953f-c8f23740c280 service neutron] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:51:02.323718 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a83fffc-3790-4085-953f-c8f23740c280 service neutron] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:51:02.324092 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a83fffc-3790-4085-953f-c8f23740c280 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:51:02.337603 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31ef366-cd46-49ce-9063-b5511d7e0e36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:51:02.338489 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31ef366-cd46-49ce-9063-b5511d7e0e36 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:51:02.338872 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31ef366-cd46-49ce-9063-b5511d7e0e36 admin admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:51:02.340434 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG dbcounter [-] [87934] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=87934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:51:02.340561 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31ef366-cd46-49ce-9063-b5511d7e0e36 admin admin] PATH_INFO: `/v3/projects/f0930467d92b41a48a255301cdfdec0f` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:51:02.343538 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e31ef366-cd46-49ce-9063-b5511d7e0e36 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f0930467d92b41a48a255301cdfdec0f)` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:51:02.349782 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a83fffc-3790-4085-953f-c8f23740c280 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:51:02.350243 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e31ef366-cd46-49ce-9063-b5511d7e0e36 admin admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:51:02.351913 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a83fffc-3790-4085-953f-c8f23740c280 service neutron] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:51:02.374374 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 1171/2294] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Sep 13 19:51:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 249 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 19:51:02.406540 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG dbcounter [-] [87935] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=87935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:51:02.447367 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.notifications [None req-e31ef366-cd46-49ce-9063-b5511d7e0e36 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f0930467d92b41a48a255301cdfdec0f', 'request_id': 'req-e31ef366-cd46-49ce-9063-b5511d7e0e36'} {{(pid=87935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:51:02.459925 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.notifications [None req-e31ef366-cd46-49ce-9063-b5511d7e0e36 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f0930467d92b41a48a255301cdfdec0f', 'request_id': 'req-e31ef366-cd46-49ce-9063-b5511d7e0e36'} {{(pid=87935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:51:02.472374 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.notifications [None req-e31ef366-cd46-49ce-9063-b5511d7e0e36 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f0930467d92b41a48a255301cdfdec0f', 'request_id': 'req-e31ef366-cd46-49ce-9063-b5511d7e0e36'} {{(pid=87935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:51:02.502459 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.notifications [None req-e31ef366-cd46-49ce-9063-b5511d7e0e36 admin admin] The token cache is being invalidate because project f0930467d92b41a48a255301cdfdec0f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87935) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 19:51:02.502831 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.notifications [None req-e31ef366-cd46-49ce-9063-b5511d7e0e36 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:51:02.503949 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.notifications [None req-e31ef366-cd46-49ce-9063-b5511d7e0e36 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:51:02.506337 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 1124/2295] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Sep 13 19:51:02 2022] DELETE /identity/v3/projects/f0930467d92b41a48a255301cdfdec0f => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 19:51:02.510149 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a83fffc-3790-4085-953f-c8f23740c280 service neutron] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:51:02.522652 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a83fffc-3790-4085-953f-c8f23740c280 service neutron] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:51:02.694519 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3015e6f-7e99-4979-84f4-c2d1cff8ba6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:51:02.695892 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3015e6f-7e99-4979-84f4-c2d1cff8ba6c admin admin] REQUEST_METHOD: `DELETE` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:51:02.696486 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3015e6f-7e99-4979-84f4-c2d1cff8ba6c admin admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:51:02.697083 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3015e6f-7e99-4979-84f4-c2d1cff8ba6c admin admin] PATH_INFO: `/v3/users/512cac0c9e744843bcff1c658acfba01` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:51:02.701290 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3015e6f-7e99-4979-84f4-c2d1cff8ba6c admin admin] RBAC: Authorizing `identity:delete_user(user_id=512cac0c9e744843bcff1c658acfba01)` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:51:02.704984 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3015e6f-7e99-4979-84f4-c2d1cff8ba6c admin admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:51:02.779469 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.notifications [None req-b3015e6f-7e99-4979-84f4-c2d1cff8ba6c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '512cac0c9e744843bcff1c658acfba01'} {{(pid=87934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:51:02.789004 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.notifications [None req-b3015e6f-7e99-4979-84f4-c2d1cff8ba6c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '512cac0c9e744843bcff1c658acfba01'} {{(pid=87934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:51:02.789827 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.notifications [None req-b3015e6f-7e99-4979-84f4-c2d1cff8ba6c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '512cac0c9e744843bcff1c658acfba01'} {{(pid=87934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:51:02.812074 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.notifications [None req-b3015e6f-7e99-4979-84f4-c2d1cff8ba6c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '512cac0c9e744843bcff1c658acfba01'} {{(pid=87934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:51:02.831018 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.notifications [None req-b3015e6f-7e99-4979-84f4-c2d1cff8ba6c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '512cac0c9e744843bcff1c658acfba01'} {{(pid=87934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:51:02.849270 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 1172/2296] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Sep 13 19:51:02 2022] DELETE /identity/v3/users/512cac0c9e744843bcff1c658acfba01 => generated 0 bytes in 339 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 19:51:02.879809 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f42caa-a8de-4ded-aece-2438e6f20dbd None None] REQUEST_METHOD: `POST` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:51:02.880237 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f42caa-a8de-4ded-aece-2438e6f20dbd None None] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:51:02.880832 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f42caa-a8de-4ded-aece-2438e6f20dbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:51:02.903554 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.auth.core [None req-f9f42caa-a8de-4ded-aece-2438e6f20dbd None None] MFA Rules not processed for user `99d1fbe8157e47ffac2699d12e76e2c3`. Rule list: `[]` (Enabled: `True`). {{(pid=87935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:51:02.904984 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.fernet_utils [None req-f9f42caa-a8de-4ded-aece-2438e6f20dbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:51:02.996085 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 1125/2297] 10.222.0.25 () {58 vars in 958 bytes} [Tue Sep 13 19:51:02 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 19:51:03.387270 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3015e6f-7e99-4979-84f4-c2d1cff8ba6c admin admin] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:51:03.388864 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.fernet_utils [None req-b3015e6f-7e99-4979-84f4-c2d1cff8ba6c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:51:03.479357 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f853fce-7d13-44ac-ae4f-f2cfc769d596 None None] REQUEST_METHOD: `POST` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:51:03.479892 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f853fce-7d13-44ac-ae4f-f2cfc769d596 None None] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:51:03.479892 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f853fce-7d13-44ac-ae4f-f2cfc769d596 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:51:03.502835 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3015e6f-7e99-4979-84f4-c2d1cff8ba6c admin admin] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:51:03.517696 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3098c2f3-6c63-4b17-98dc-f09f0f2173a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:51:03.519348 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3098c2f3-6c63-4b17-98dc-f09f0f2173a3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:51:03.519708 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3098c2f3-6c63-4b17-98dc-f09f0f2173a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:51:03.520056 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3098c2f3-6c63-4b17-98dc-f09f0f2173a3 admin admin] PATH_INFO: `/v3/projects/f30df5ea0c5941f190c519a0370fc50b` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:51:03.521773 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3098c2f3-6c63-4b17-98dc-f09f0f2173a3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f30df5ea0c5941f190c519a0370fc50b)` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:51:03.523827 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3098c2f3-6c63-4b17-98dc-f09f0f2173a3 admin admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:51:03.529802 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.auth.core [None req-7f853fce-7d13-44ac-ae4f-f2cfc769d596 None None] MFA Rules not processed for user `7055a86d737749ec8c6f85752f00b28e`. Rule list: `[]` (Enabled: `True`). {{(pid=87935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:51:03.531728 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.fernet_utils [None req-7f853fce-7d13-44ac-ae4f-f2cfc769d596 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:51:03.564470 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG dbcounter [-] [87934] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:51:03.621815 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.notifications [None req-3098c2f3-6c63-4b17-98dc-f09f0f2173a3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f30df5ea0c5941f190c519a0370fc50b', 'request_id': 'req-3098c2f3-6c63-4b17-98dc-f09f0f2173a3'} {{(pid=87934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:51:03.647062 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.notifications [None req-3098c2f3-6c63-4b17-98dc-f09f0f2173a3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f30df5ea0c5941f190c519a0370fc50b', 'request_id': 'req-3098c2f3-6c63-4b17-98dc-f09f0f2173a3'} {{(pid=87934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:51:03.657391 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.notifications [None req-3098c2f3-6c63-4b17-98dc-f09f0f2173a3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f30df5ea0c5941f190c519a0370fc50b', 'request_id': 'req-3098c2f3-6c63-4b17-98dc-f09f0f2173a3'} {{(pid=87934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:51:03.673051 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 1126/2298] 10.222.0.25 () {58 vars in 958 bytes} [Tue Sep 13 19:51:03 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 19:51:03.685943 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f853fce-7d13-44ac-ae4f-f2cfc769d596 None None] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:51:03.687643 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.fernet_utils [None req-7f853fce-7d13-44ac-ae4f-f2cfc769d596 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:51:03.689586 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.notifications [None req-3098c2f3-6c63-4b17-98dc-f09f0f2173a3 admin admin] The token cache is being invalidate because project f30df5ea0c5941f190c519a0370fc50b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87934) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 19:51:03.689954 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.notifications [None req-3098c2f3-6c63-4b17-98dc-f09f0f2173a3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:51:03.690768 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.notifications [None req-3098c2f3-6c63-4b17-98dc-f09f0f2173a3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:51:03.692755 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 1173/2299] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Sep 13 19:51:03 2022] DELETE /identity/v3/projects/f30df5ea0c5941f190c519a0370fc50b => generated 0 bytes in 306 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 19:51:03.696804 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3098c2f3-6c63-4b17-98dc-f09f0f2173a3 admin admin] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:51:03.698897 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.fernet_utils [None req-3098c2f3-6c63-4b17-98dc-f09f0f2173a3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:51:03.868420 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f853fce-7d13-44ac-ae4f-f2cfc769d596 None None] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:51:03.881944 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG dbcounter [-] [87935] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=87935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:51:03.930480 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3098c2f3-6c63-4b17-98dc-f09f0f2173a3 admin admin] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:51:03.938507 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cced90c4-7bcd-4d15-b539-80b03254d156 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:51:03.940781 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cced90c4-7bcd-4d15-b539-80b03254d156 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:51:03.941212 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cced90c4-7bcd-4d15-b539-80b03254d156 admin admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:51:03.941655 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cced90c4-7bcd-4d15-b539-80b03254d156 admin admin] PATH_INFO: `/v3/users/47734d888da24b3bbf8dcac23f418fd9` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:51:03.943842 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cced90c4-7bcd-4d15-b539-80b03254d156 admin admin] RBAC: Authorizing `identity:delete_user(user_id=47734d888da24b3bbf8dcac23f418fd9)` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:51:03.946220 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cced90c4-7bcd-4d15-b539-80b03254d156 admin admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:51:04.010970 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a89d512-c15c-495f-b03a-03317f4a22e1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cbb50c88b794a7f9f26844effde7d63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a10a4268f3c4cb29f4e00c292e2df62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:51:04.028486 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a89d512-c15c-495f-b03a-03317f4a22e1 service cinder] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:51:04.028940 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a89d512-c15c-495f-b03a-03317f4a22e1 service cinder] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:51:04.029406 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a89d512-c15c-495f-b03a-03317f4a22e1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:51:04.040554 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.fernet_utils [None req-8a89d512-c15c-495f-b03a-03317f4a22e1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:51:04.052678 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.notifications [None req-cced90c4-7bcd-4d15-b539-80b03254d156 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '47734d888da24b3bbf8dcac23f418fd9'} {{(pid=87934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:51:04.053500 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.notifications [None req-cced90c4-7bcd-4d15-b539-80b03254d156 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '47734d888da24b3bbf8dcac23f418fd9'} {{(pid=87934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:51:04.054283 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.notifications [None req-cced90c4-7bcd-4d15-b539-80b03254d156 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '47734d888da24b3bbf8dcac23f418fd9'} {{(pid=87934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:51:04.068625 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.notifications [None req-cced90c4-7bcd-4d15-b539-80b03254d156 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '47734d888da24b3bbf8dcac23f418fd9'} {{(pid=87934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:51:04.097872 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.notifications [None req-cced90c4-7bcd-4d15-b539-80b03254d156 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '47734d888da24b3bbf8dcac23f418fd9'} {{(pid=87934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:51:04.117175 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 1174/2300] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Sep 13 19:51:03 2022] DELETE /identity/v3/users/47734d888da24b3bbf8dcac23f418fd9 => generated 0 bytes in 421 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 19:51:04.122393 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cced90c4-7bcd-4d15-b539-80b03254d156 admin admin] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:51:04.123870 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.fernet_utils [None req-cced90c4-7bcd-4d15-b539-80b03254d156 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:51:04.164854 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a89d512-c15c-495f-b03a-03317f4a22e1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:51:04.177818 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG dbcounter [-] [87934] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=87934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:51:04.177992 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a89d512-c15c-495f-b03a-03317f4a22e1 service cinder] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:51:04.193201 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 1127/2301] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Sep 13 19:51:03 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 507 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 13 19:51:04.233186 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cced90c4-7bcd-4d15-b539-80b03254d156 admin admin] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:51:04.242372 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a059b2-af8d-4adc-a001-a9279087b301 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:51:04.242531 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a059b2-af8d-4adc-a001-a9279087b301 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:51:04.242820 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a059b2-af8d-4adc-a001-a9279087b301 admin admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:51:04.243099 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a059b2-af8d-4adc-a001-a9279087b301 admin admin] PATH_INFO: `/v3/users/9bc5f13fb990475ab4594432ecf5cbc3` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:51:04.244411 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a059b2-af8d-4adc-a001-a9279087b301 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9bc5f13fb990475ab4594432ecf5cbc3)` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:51:04.247476 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a059b2-af8d-4adc-a001-a9279087b301 admin admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:51:04.330218 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.notifications [None req-f8a059b2-af8d-4adc-a001-a9279087b301 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9bc5f13fb990475ab4594432ecf5cbc3'} {{(pid=87934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:51:04.331191 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.notifications [None req-f8a059b2-af8d-4adc-a001-a9279087b301 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9bc5f13fb990475ab4594432ecf5cbc3'} {{(pid=87934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:51:04.332014 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.notifications [None req-f8a059b2-af8d-4adc-a001-a9279087b301 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9bc5f13fb990475ab4594432ecf5cbc3'} {{(pid=87934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:51:04.345240 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.notifications [None req-f8a059b2-af8d-4adc-a001-a9279087b301 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9bc5f13fb990475ab4594432ecf5cbc3'} {{(pid=87934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:51:04.367068 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.notifications [None req-f8a059b2-af8d-4adc-a001-a9279087b301 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9bc5f13fb990475ab4594432ecf5cbc3'} {{(pid=87934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:51:04.394601 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 1175/2302] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Sep 13 19:51:04 2022] DELETE /identity/v3/users/9bc5f13fb990475ab4594432ecf5cbc3 => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 19:51:04.396871 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836b75db-00ab-4fda-a343-dc29095c0dbc None None] REQUEST_METHOD: `POST` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:51:04.397916 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836b75db-00ab-4fda-a343-dc29095c0dbc None None] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:51:04.398313 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836b75db-00ab-4fda-a343-dc29095c0dbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:51:04.431583 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.auth.core [None req-836b75db-00ab-4fda-a343-dc29095c0dbc None None] MFA Rules not processed for user `7b0aed92d02344acb92a0e4aa67c3068`. Rule list: `[]` (Enabled: `True`). {{(pid=87935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:51:04.435209 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.fernet_utils [None req-836b75db-00ab-4fda-a343-dc29095c0dbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:51:04.534588 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 1128/2303] 10.222.0.25 () {58 vars in 958 bytes} [Tue Sep 13 19:51:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 19:51:04.545589 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a059b2-af8d-4adc-a001-a9279087b301 admin admin] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:51:04.548100 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.fernet_utils [None req-f8a059b2-af8d-4adc-a001-a9279087b301 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:51:04.588786 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836b75db-00ab-4fda-a343-dc29095c0dbc None None] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:51:04.591344 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.fernet_utils [None req-836b75db-00ab-4fda-a343-dc29095c0dbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:51:04.615915 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836b75db-00ab-4fda-a343-dc29095c0dbc None None] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:51:04.621246 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ccdfcf2-acdc-4693-8ed2-41bfca8e3585 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:51:04.621892 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ccdfcf2-acdc-4693-8ed2-41bfca8e3585 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:51:04.622173 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ccdfcf2-acdc-4693-8ed2-41bfca8e3585 admin admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:51:04.622834 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ccdfcf2-acdc-4693-8ed2-41bfca8e3585 admin admin] PATH_INFO: `/v3/projects/86bc3a3fd7e54d60b20a91883e8975d9` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:51:04.626769 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ccdfcf2-acdc-4693-8ed2-41bfca8e3585 admin admin] RBAC: Authorizing `identity:delete_project(project_id=86bc3a3fd7e54d60b20a91883e8975d9)` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:51:04.629333 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ccdfcf2-acdc-4693-8ed2-41bfca8e3585 admin admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:51:04.698805 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a059b2-af8d-4adc-a001-a9279087b301 admin admin] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:51:04.704990 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3d525a-15a2-4071-808b-8e03cdaed36c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1196a96e4a404f559600b69f929ea9da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a10a4268f3c4cb29f4e00c292e2df62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:51:04.705895 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3d525a-15a2-4071-808b-8e03cdaed36c service neutron] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:51:04.706231 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3d525a-15a2-4071-808b-8e03cdaed36c service neutron] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:51:04.706543 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3d525a-15a2-4071-808b-8e03cdaed36c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:51:04.718514 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d3d525a-15a2-4071-808b-8e03cdaed36c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:51:04.720159 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d3d525a-15a2-4071-808b-8e03cdaed36c service neutron] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:51:04.735164 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 1176/2304] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Sep 13 19:51:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 190 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 19:51:04.740919 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.notifications [None req-5ccdfcf2-acdc-4693-8ed2-41bfca8e3585 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '86bc3a3fd7e54d60b20a91883e8975d9', 'request_id': 'req-5ccdfcf2-acdc-4693-8ed2-41bfca8e3585'} {{(pid=87935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:51:04.747465 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.notifications [None req-5ccdfcf2-acdc-4693-8ed2-41bfca8e3585 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '86bc3a3fd7e54d60b20a91883e8975d9', 'request_id': 'req-5ccdfcf2-acdc-4693-8ed2-41bfca8e3585'} {{(pid=87935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:51:04.749649 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG dbcounter [-] [87935] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=87935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:51:04.775951 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.notifications [None req-5ccdfcf2-acdc-4693-8ed2-41bfca8e3585 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '86bc3a3fd7e54d60b20a91883e8975d9', 'request_id': 'req-5ccdfcf2-acdc-4693-8ed2-41bfca8e3585'} {{(pid=87935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:51:04.797883 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.notifications [None req-5ccdfcf2-acdc-4693-8ed2-41bfca8e3585 admin admin] The token cache is being invalidate because project 86bc3a3fd7e54d60b20a91883e8975d9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87935) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 19:51:04.798260 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.notifications [None req-5ccdfcf2-acdc-4693-8ed2-41bfca8e3585 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:51:04.799055 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.notifications [None req-5ccdfcf2-acdc-4693-8ed2-41bfca8e3585 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:51:04.800978 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 1129/2305] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Sep 13 19:51:04 2022] DELETE /identity/v3/projects/86bc3a3fd7e54d60b20a91883e8975d9 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 19:51:04.806775 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db15647-fc01-4bf8-adb9-b3f938110476 None None] REQUEST_METHOD: `POST` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:51:04.807052 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db15647-fc01-4bf8-adb9-b3f938110476 None None] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:51:04.807318 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db15647-fc01-4bf8-adb9-b3f938110476 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:51:04.855157 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.auth.core [None req-6db15647-fc01-4bf8-adb9-b3f938110476 None None] MFA Rules not processed for user `7b0aed92d02344acb92a0e4aa67c3068`. Rule list: `[]` (Enabled: `True`). {{(pid=87934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:51:04.856435 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.fernet_utils [None req-6db15647-fc01-4bf8-adb9-b3f938110476 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:51:04.982862 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG dbcounter [-] [87934] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:51:05.024286 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 1177/2306] 10.222.0.25 () {58 vars in 958 bytes} [Tue Sep 13 19:51:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 19:51:05.030326 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7dd90f3-9a8e-423c-b943-0336a9f14627 None None] REQUEST_METHOD: `POST` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:51:05.030692 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7dd90f3-9a8e-423c-b943-0336a9f14627 None None] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:51:05.031035 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7dd90f3-9a8e-423c-b943-0336a9f14627 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:51:05.052560 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.auth.core [None req-a7dd90f3-9a8e-423c-b943-0336a9f14627 None None] MFA Rules not processed for user `7b0aed92d02344acb92a0e4aa67c3068`. Rule list: `[]` (Enabled: `True`). {{(pid=87935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:51:05.053768 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.fernet_utils [None req-a7dd90f3-9a8e-423c-b943-0336a9f14627 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:51:05.061658 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 1130/2307] 10.222.0.25 () {58 vars in 958 bytes} [Tue Sep 13 19:51:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 19:51:05.075771 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db15647-fc01-4bf8-adb9-b3f938110476 None None] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:51:05.095449 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db15647-fc01-4bf8-adb9-b3f938110476 None None] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:51:05.102699 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556f6f06-26d2-4d36-9d42-43ffb3a9299b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:51:05.103325 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556f6f06-26d2-4d36-9d42-43ffb3a9299b admin admin] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:51:05.103604 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556f6f06-26d2-4d36-9d42-43ffb3a9299b admin admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:51:05.103876 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556f6f06-26d2-4d36-9d42-43ffb3a9299b admin admin] PATH_INFO: `/v3/domains` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:51:05.104565 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-556f6f06-26d2-4d36-9d42-43ffb3a9299b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87934) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:51:05.104869 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-556f6f06-26d2-4d36-9d42-43ffb3a9299b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:51:05.107755 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-556f6f06-26d2-4d36-9d42-43ffb3a9299b admin admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:51:05.132645 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 1178/2308] 10.222.0.25 () {58 vars in 1153 bytes} [Tue Sep 13 19:51:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:51:05.134053 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7dd90f3-9a8e-423c-b943-0336a9f14627 None None] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:51:05.146094 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7dd90f3-9a8e-423c-b943-0336a9f14627 None None] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:51:05.153151 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2af565-2f76-48c1-9f71-62af2cd1dd39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:51:05.154444 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2af565-2f76-48c1-9f71-62af2cd1dd39 admin admin] REQUEST_METHOD: `POST` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:51:05.154893 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2af565-2f76-48c1-9f71-62af2cd1dd39 admin admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:51:05.155167 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2af565-2f76-48c1-9f71-62af2cd1dd39 admin admin] PATH_INFO: `/v3/projects` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:51:05.155825 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e2af565-2f76-48c1-9f71-62af2cd1dd39 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:51:05.158434 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e2af565-2f76-48c1-9f71-62af2cd1dd39 admin admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:51:05.180998 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556f6f06-26d2-4d36-9d42-43ffb3a9299b admin admin] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:51:05.182989 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.fernet_utils [None req-556f6f06-26d2-4d36-9d42-43ffb3a9299b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:51:05.205930 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 1131/2309] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Sep 13 19:51:05 2022] POST /identity/v3/projects => generated 365 bytes in 71 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 13 19:51:05.208807 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556f6f06-26d2-4d36-9d42-43ffb3a9299b admin admin] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:51:05.210468 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2af565-2f76-48c1-9f71-62af2cd1dd39 admin admin] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:51:05.287977 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2af565-2f76-48c1-9f71-62af2cd1dd39 admin admin] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:51:05.293053 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959fb64c-2710-4ea9-ade9-d7b518a5a53a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:51:05.293591 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959fb64c-2710-4ea9-ade9-d7b518a5a53a admin admin] REQUEST_METHOD: `POST` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:51:05.293871 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959fb64c-2710-4ea9-ade9-d7b518a5a53a admin admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:51:05.294144 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959fb64c-2710-4ea9-ade9-d7b518a5a53a admin admin] PATH_INFO: `/v3/users` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:51:05.294809 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-959fb64c-2710-4ea9-ade9-d7b518a5a53a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:51:05.296790 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-959fb64c-2710-4ea9-ade9-d7b518a5a53a admin admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:51:05.298832 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c3b6b6-f4cf-4aa6-b1ca-983f9a67bccf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:51:05.299548 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c3b6b6-f4cf-4aa6-b1ca-983f9a67bccf admin admin] REQUEST_METHOD: `DELETE` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:51:05.299902 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c3b6b6-f4cf-4aa6-b1ca-983f9a67bccf admin admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:51:05.300305 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c3b6b6-f4cf-4aa6-b1ca-983f9a67bccf admin admin] PATH_INFO: `/v3/projects/65927b0e2851422fb887353d468ef2ba` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:51:05.301677 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c3b6b6-f4cf-4aa6-b1ca-983f9a67bccf admin admin] RBAC: Authorizing `identity:delete_project(project_id=65927b0e2851422fb887353d468ef2ba)` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:51:05.304376 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c3b6b6-f4cf-4aa6-b1ca-983f9a67bccf admin admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:51:05.320251 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 1132/2310] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Sep 13 19:51:05 2022] POST /identity/v3/users => generated 283 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 19:51:05.324425 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959fb64c-2710-4ea9-ade9-d7b518a5a53a admin admin] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:51:05.337162 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959fb64c-2710-4ea9-ade9-d7b518a5a53a admin admin] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:51:05.342462 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b35e9c-ddf8-4531-a907-8a037be1ee35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:51:05.343073 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b35e9c-ddf8-4531-a907-8a037be1ee35 admin admin] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:51:05.343431 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b35e9c-ddf8-4531-a907-8a037be1ee35 admin admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:51:05.343711 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b35e9c-ddf8-4531-a907-8a037be1ee35 admin admin] PATH_INFO: `/v3/roles` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:51:05.344997 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b35e9c-ddf8-4531-a907-8a037be1ee35 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:51:05.346612 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b35e9c-ddf8-4531-a907-8a037be1ee35 admin admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:51:05.357707 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 1133/2311] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Sep 13 19:51:05 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 19:51:05.362358 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b35e9c-ddf8-4531-a907-8a037be1ee35 admin admin] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:51:05.373304 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.notifications [None req-80c3b6b6-f4cf-4aa6-b1ca-983f9a67bccf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '65927b0e2851422fb887353d468ef2ba', 'request_id': 'req-80c3b6b6-f4cf-4aa6-b1ca-983f9a67bccf'} {{(pid=87934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:51:05.373998 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b35e9c-ddf8-4531-a907-8a037be1ee35 admin admin] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:51:05.385137 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.notifications [None req-80c3b6b6-f4cf-4aa6-b1ca-983f9a67bccf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '65927b0e2851422fb887353d468ef2ba', 'request_id': 'req-80c3b6b6-f4cf-4aa6-b1ca-983f9a67bccf'} {{(pid=87934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:51:05.398604 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.notifications [None req-80c3b6b6-f4cf-4aa6-b1ca-983f9a67bccf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '65927b0e2851422fb887353d468ef2ba', 'request_id': 'req-80c3b6b6-f4cf-4aa6-b1ca-983f9a67bccf'} {{(pid=87934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:51:05.425666 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.notifications [None req-80c3b6b6-f4cf-4aa6-b1ca-983f9a67bccf admin admin] The token cache is being invalidate because project 65927b0e2851422fb887353d468ef2ba was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87934) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 19:51:05.426243 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.notifications [None req-80c3b6b6-f4cf-4aa6-b1ca-983f9a67bccf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:51:05.427527 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.notifications [None req-80c3b6b6-f4cf-4aa6-b1ca-983f9a67bccf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:51:05.429547 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 1179/2312] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Sep 13 19:51:05 2022] DELETE /identity/v3/projects/65927b0e2851422fb887353d468ef2ba => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 19:51:05.450663 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063f4911-19e9-49ec-b624-9e19d7ef38f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:51:05.451304 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063f4911-19e9-49ec-b624-9e19d7ef38f2 admin admin] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:51:05.451584 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063f4911-19e9-49ec-b624-9e19d7ef38f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:51:05.451856 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063f4911-19e9-49ec-b624-9e19d7ef38f2 admin admin] PATH_INFO: `/v3/roles` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:51:05.452554 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-063f4911-19e9-49ec-b624-9e19d7ef38f2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:51:05.454580 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-063f4911-19e9-49ec-b624-9e19d7ef38f2 admin admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:51:05.466182 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 1134/2313] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Sep 13 19:51:05 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 13 19:51:05.471289 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c3b6b6-f4cf-4aa6-b1ca-983f9a67bccf admin admin] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:51:05.472800 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.fernet_utils [None req-80c3b6b6-f4cf-4aa6-b1ca-983f9a67bccf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:51:05.486958 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c3b6b6-f4cf-4aa6-b1ca-983f9a67bccf admin admin] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:51:05.491865 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef14169d-b184-4fb7-ae42-d710f9691ec5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:51:05.492644 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef14169d-b184-4fb7-ae42-d710f9691ec5 admin admin] REQUEST_METHOD: `PUT` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:51:05.492919 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef14169d-b184-4fb7-ae42-d710f9691ec5 admin admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:51:05.493186 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef14169d-b184-4fb7-ae42-d710f9691ec5 admin admin] PATH_INFO: `/v3/projects/fdbf71218dae422f85334ae65f02c3bd/users/3116c70a2e8d4220b1d8f3d57a2e8b3a/roles/a259191f6d0e46fabd9f34536bb28747` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:51:05.510269 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef14169d-b184-4fb7-ae42-d710f9691ec5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fdbf71218dae422f85334ae65f02c3bd, user_id=3116c70a2e8d4220b1d8f3d57a2e8b3a, role_id=a259191f6d0e46fabd9f34536bb28747)` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:51:05.513022 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef14169d-b184-4fb7-ae42-d710f9691ec5 admin admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:51:05.527664 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 1180/2314] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Sep 13 19:51:05 2022] PUT /identity/v3/projects/fdbf71218dae422f85334ae65f02c3bd/users/3116c70a2e8d4220b1d8f3d57a2e8b3a/roles/a259191f6d0e46fabd9f34536bb28747 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 19:51:05.539768 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91c9056-d00e-4d3e-afdf-a6c572a6c3ef None None] REQUEST_METHOD: `POST` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:51:05.540380 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91c9056-d00e-4d3e-afdf-a6c572a6c3ef None None] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:51:05.540475 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91c9056-d00e-4d3e-afdf-a6c572a6c3ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:51:05.573429 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.auth.core [None req-e91c9056-d00e-4d3e-afdf-a6c572a6c3ef None None] MFA Rules not processed for user `3116c70a2e8d4220b1d8f3d57a2e8b3a`. Rule list: `[]` (Enabled: `True`). {{(pid=87935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:51:05.574671 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.fernet_utils [None req-e91c9056-d00e-4d3e-afdf-a6c572a6c3ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:51:05.597231 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG dbcounter [-] [87935] Writing DB stats keystone:INSERT=5,keystone:DELETE=1,keystone:SELECT=94 {{(pid=87935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:51:05.646545 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 1135/2315] 10.222.0.25 () {58 vars in 958 bytes} [Tue Sep 13 19:51:05 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 19:51:05.651043 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef14169d-b184-4fb7-ae42-d710f9691ec5 admin admin] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:51:05.692679 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG dbcounter [-] [87934] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=87934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:51:05.715565 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef14169d-b184-4fb7-ae42-d710f9691ec5 admin admin] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:51:05.720965 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e299324a-f5f0-451d-8c95-43738a7427f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:51:05.721560 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e299324a-f5f0-451d-8c95-43738a7427f4 admin admin] REQUEST_METHOD: `POST` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:51:05.721836 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e299324a-f5f0-451d-8c95-43738a7427f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:51:05.722100 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e299324a-f5f0-451d-8c95-43738a7427f4 admin admin] PATH_INFO: `/v3/projects` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:51:05.722720 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e299324a-f5f0-451d-8c95-43738a7427f4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:51:05.725622 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e299324a-f5f0-451d-8c95-43738a7427f4 admin admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:51:05.755802 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 1181/2316] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Sep 13 19:51:05 2022] POST /identity/v3/projects => generated 367 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 19:51:05.759943 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91c9056-d00e-4d3e-afdf-a6c572a6c3ef None None] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:51:05.772622 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91c9056-d00e-4d3e-afdf-a6c572a6c3ef None None] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:51:05.833326 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee088775-0c4a-423e-b283-05967cc43026 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:51:05.833934 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee088775-0c4a-423e-b283-05967cc43026 admin admin] REQUEST_METHOD: `POST` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:51:05.834214 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee088775-0c4a-423e-b283-05967cc43026 admin admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:51:05.834480 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee088775-0c4a-423e-b283-05967cc43026 admin admin] PATH_INFO: `/v3/users` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:51:05.835113 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee088775-0c4a-423e-b283-05967cc43026 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:51:05.837087 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee088775-0c4a-423e-b283-05967cc43026 admin admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:51:05.860763 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 1136/2317] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Sep 13 19:51:05 2022] POST /identity/v3/users => generated 290 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 19:51:05.864866 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e299324a-f5f0-451d-8c95-43738a7427f4 admin admin] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:51:05.876180 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e299324a-f5f0-451d-8c95-43738a7427f4 admin admin] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:51:05.880311 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6d2342-17a7-4a48-a440-92b3b9a92997 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:51:05.880904 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6d2342-17a7-4a48-a440-92b3b9a92997 admin admin] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:51:05.881179 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6d2342-17a7-4a48-a440-92b3b9a92997 admin admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:51:05.881444 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6d2342-17a7-4a48-a440-92b3b9a92997 admin admin] PATH_INFO: `/v3/roles` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:51:05.882074 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c6d2342-17a7-4a48-a440-92b3b9a92997 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:51:05.883641 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c6d2342-17a7-4a48-a440-92b3b9a92997 admin admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:51:05.890038 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50c2b1c-c2e1-47d6-ba9c-307872aae902 None None] REQUEST_METHOD: `POST` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:51:05.890327 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50c2b1c-c2e1-47d6-ba9c-307872aae902 None None] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:51:05.890602 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50c2b1c-c2e1-47d6-ba9c-307872aae902 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:51:05.895417 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 1182/2318] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Sep 13 19:51:05 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 19:51:05.899574 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6d2342-17a7-4a48-a440-92b3b9a92997 admin admin] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:51:05.910193 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6d2342-17a7-4a48-a440-92b3b9a92997 admin admin] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:51:05.911974 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.auth.core [None req-b50c2b1c-c2e1-47d6-ba9c-307872aae902 None None] MFA Rules not processed for user `7055a86d737749ec8c6f85752f00b28e`. Rule list: `[]` (Enabled: `True`). {{(pid=87935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:51:05.913202 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.fernet_utils [None req-b50c2b1c-c2e1-47d6-ba9c-307872aae902 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:51:05.915115 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df531af6-176b-4f4a-a26d-4a55e1eadb69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:51:05.915755 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df531af6-176b-4f4a-a26d-4a55e1eadb69 admin admin] REQUEST_METHOD: `PUT` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:51:05.916037 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df531af6-176b-4f4a-a26d-4a55e1eadb69 admin admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:51:05.916350 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df531af6-176b-4f4a-a26d-4a55e1eadb69 admin admin] PATH_INFO: `/v3/projects/1c119698fac6464c9c9b1e89a9865a18/users/e626128acfb84ee88231b9aeca88d5c1/roles/6ca1d4427ff64e0a9d25d96cfb1445f6` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:51:05.931706 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df531af6-176b-4f4a-a26d-4a55e1eadb69 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1c119698fac6464c9c9b1e89a9865a18, user_id=e626128acfb84ee88231b9aeca88d5c1, role_id=6ca1d4427ff64e0a9d25d96cfb1445f6)` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:51:05.934441 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df531af6-176b-4f4a-a26d-4a55e1eadb69 admin admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:51:05.949649 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 1183/2319] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Sep 13 19:51:05 2022] PUT /identity/v3/projects/1c119698fac6464c9c9b1e89a9865a18/users/e626128acfb84ee88231b9aeca88d5c1/roles/6ca1d4427ff64e0a9d25d96cfb1445f6 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 19:51:05.953974 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df531af6-176b-4f4a-a26d-4a55e1eadb69 admin admin] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:51:05.994138 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 1137/2320] 10.222.0.25 () {58 vars in 958 bytes} [Tue Sep 13 19:51:05 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 19:51:06.067504 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df531af6-176b-4f4a-a26d-4a55e1eadb69 admin admin] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:51:06.090576 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aadc8d68-cf4e-449c-b114-01ec2bfc172b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:51:06.092008 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aadc8d68-cf4e-449c-b114-01ec2bfc172b admin admin] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:51:06.092774 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aadc8d68-cf4e-449c-b114-01ec2bfc172b admin admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:51:06.093189 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aadc8d68-cf4e-449c-b114-01ec2bfc172b admin admin] PATH_INFO: `/v3/roles` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:51:06.094968 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aadc8d68-cf4e-449c-b114-01ec2bfc172b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:51:06.097034 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aadc8d68-cf4e-449c-b114-01ec2bfc172b admin admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:51:06.117093 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 1184/2321] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Sep 13 19:51:05 2022] GET /identity/v3/roles => generated 1420 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 13 19:51:06.121283 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50c2b1c-c2e1-47d6-ba9c-307872aae902 None None] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:51:06.135493 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50c2b1c-c2e1-47d6-ba9c-307872aae902 None None] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:51:06.142534 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6c6dc2-4529-4a8f-a5b0-d226036d6f89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:51:06.143994 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6c6dc2-4529-4a8f-a5b0-d226036d6f89 admin admin] REQUEST_METHOD: `PUT` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:51:06.144514 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6c6dc2-4529-4a8f-a5b0-d226036d6f89 admin admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:51:06.144991 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6c6dc2-4529-4a8f-a5b0-d226036d6f89 admin admin] PATH_INFO: `/v3/projects/1c119698fac6464c9c9b1e89a9865a18/users/e626128acfb84ee88231b9aeca88d5c1/roles/6ca1d4427ff64e0a9d25d96cfb1445f6` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:51:06.152467 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f6c6dc2-4529-4a8f-a5b0-d226036d6f89 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1c119698fac6464c9c9b1e89a9865a18, user_id=e626128acfb84ee88231b9aeca88d5c1, role_id=6ca1d4427ff64e0a9d25d96cfb1445f6)` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:51:06.155714 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f6c6dc2-4529-4a8f-a5b0-d226036d6f89 admin admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:51:06.180473 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 1138/2322] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Sep 13 19:51:06 2022] PUT /identity/v3/projects/1c119698fac6464c9c9b1e89a9865a18/users/e626128acfb84ee88231b9aeca88d5c1/roles/6ca1d4427ff64e0a9d25d96cfb1445f6 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 19:51:06.186232 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf8a817-7737-4f40-a1af-714a2c5ec7db None None] REQUEST_METHOD: `POST` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:51:06.186547 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf8a817-7737-4f40-a1af-714a2c5ec7db None None] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:51:06.186864 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf8a817-7737-4f40-a1af-714a2c5ec7db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:51:06.257060 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.auth.core [None req-bdf8a817-7737-4f40-a1af-714a2c5ec7db None None] MFA Rules not processed for user `e626128acfb84ee88231b9aeca88d5c1`. Rule list: `[]` (Enabled: `True`). {{(pid=87934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:51:06.257904 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.fernet_utils [None req-bdf8a817-7737-4f40-a1af-714a2c5ec7db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:51:06.402706 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 1185/2323] 10.222.0.25 () {58 vars in 958 bytes} [Tue Sep 13 19:51:06 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 19:51:06.415900 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6c6dc2-4529-4a8f-a5b0-d226036d6f89 admin admin] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:51:06.418810 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.fernet_utils [None req-6f6c6dc2-4529-4a8f-a5b0-d226036d6f89 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:51:06.480839 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG dbcounter [-] [87935] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=87935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:51:06.494636 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6c6dc2-4529-4a8f-a5b0-d226036d6f89 admin admin] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:51:06.499198 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f85f25-14f5-4f92-88b2-dbfd3e1008b0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cbb50c88b794a7f9f26844effde7d63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a10a4268f3c4cb29f4e00c292e2df62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:51:06.499893 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f85f25-14f5-4f92-88b2-dbfd3e1008b0 service cinder] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:51:06.501439 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f85f25-14f5-4f92-88b2-dbfd3e1008b0 service cinder] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:51:06.501439 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f85f25-14f5-4f92-88b2-dbfd3e1008b0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:51:06.512034 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f85f25-14f5-4f92-88b2-dbfd3e1008b0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:51:06.513790 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f85f25-14f5-4f92-88b2-dbfd3e1008b0 service cinder] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:51:06.530609 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 1139/2324] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Sep 13 19:51:06 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 19:51:06.597124 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7caa11e3-2c99-435a-84f7-feec22cd8dc7 None None] REQUEST_METHOD: `POST` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:51:06.597727 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7caa11e3-2c99-435a-84f7-feec22cd8dc7 None None] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:51:06.598106 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7caa11e3-2c99-435a-84f7-feec22cd8dc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:51:06.633995 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.auth.core [None req-7caa11e3-2c99-435a-84f7-feec22cd8dc7 None None] MFA Rules not processed for user `d44977a3225e43f19cdc4a84f0e170cd`. Rule list: `[]` (Enabled: `True`). {{(pid=87934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:51:06.635254 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.fernet_utils [None req-7caa11e3-2c99-435a-84f7-feec22cd8dc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:51:06.654865 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG dbcounter [-] [87934] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=87934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:51:06.661229 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f85f25-14f5-4f92-88b2-dbfd3e1008b0 service cinder] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:51:06.674316 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f85f25-14f5-4f92-88b2-dbfd3e1008b0 service cinder] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:51:06.680121 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29867cb-69e7-40d0-ba2a-52d9d4be1210 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cbb50c88b794a7f9f26844effde7d63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a10a4268f3c4cb29f4e00c292e2df62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:51:06.683352 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29867cb-69e7-40d0-ba2a-52d9d4be1210 service cinder] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:51:06.683729 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29867cb-69e7-40d0-ba2a-52d9d4be1210 service cinder] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:51:06.684659 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29867cb-69e7-40d0-ba2a-52d9d4be1210 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:51:06.823333 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 1186/2325] 10.222.0.25 () {58 vars in 1009 bytes} [Tue Sep 13 19:51:06 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 19:51:06.843050 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7caa11e3-2c99-435a-84f7-feec22cd8dc7 None None] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:51:06.845341 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f29867cb-69e7-40d0-ba2a-52d9d4be1210 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:51:06.846978 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f29867cb-69e7-40d0-ba2a-52d9d4be1210 service cinder] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:51:06.847973 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.fernet_utils [None req-7caa11e3-2c99-435a-84f7-feec22cd8dc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:51:06.859241 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 1140/2326] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Sep 13 19:51:06 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 199 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 13 19:51:07.034828 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7caa11e3-2c99-435a-84f7-feec22cd8dc7 None None] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:51:07.065066 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531f3b44-1bf3-4257-9818-4ab3ec6a5040 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb42d6ac6cdd4d97a80c3ee0c6f8e3f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a10a4268f3c4cb29f4e00c292e2df62', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:51:07.065774 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531f3b44-1bf3-4257-9818-4ab3ec6a5040 service swift] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:51:07.066059 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531f3b44-1bf3-4257-9818-4ab3ec6a5040 service swift] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:51:07.066335 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531f3b44-1bf3-4257-9818-4ab3ec6a5040 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:51:07.082188 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-531f3b44-1bf3-4257-9818-4ab3ec6a5040 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:51:07.083939 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-531f3b44-1bf3-4257-9818-4ab3ec6a5040 service swift] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:51:07.095829 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 1187/2327] 10.222.0.25 () {60 vars in 1384 bytes} [Tue Sep 13 19:51:06 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 254 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 13 19:51:09.890266 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576f67f4-1808-4542-9086-cfa394bd74c5 None None] REQUEST_METHOD: `POST` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:51:09.891483 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576f67f4-1808-4542-9086-cfa394bd74c5 None None] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:51:09.891624 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576f67f4-1808-4542-9086-cfa394bd74c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:51:09.910561 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.auth.core [None req-576f67f4-1808-4542-9086-cfa394bd74c5 None None] MFA Rules not processed for user `066fb7f5f8a548ea99de513906a49cfe`. Rule list: `[]` (Enabled: `True`). {{(pid=87935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:51:09.911739 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.fernet_utils [None req-576f67f4-1808-4542-9086-cfa394bd74c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:51:09.967418 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 1141/2328] 10.222.0.25 () {58 vars in 958 bytes} [Tue Sep 13 19:51:09 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 19:51:13.000089 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531f3b44-1bf3-4257-9818-4ab3ec6a5040 service swift] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:51:13.137858 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531f3b44-1bf3-4257-9818-4ab3ec6a5040 service swift] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:51:13.172059 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aadc5c18-7126-492e-9996-fdbef6b4c315 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:51:13.172059 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aadc5c18-7126-492e-9996-fdbef6b4c315 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:51:13.172059 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aadc5c18-7126-492e-9996-fdbef6b4c315 admin admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:51:13.172059 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aadc5c18-7126-492e-9996-fdbef6b4c315 admin admin] PATH_INFO: `/v3/users/3116c70a2e8d4220b1d8f3d57a2e8b3a` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:51:13.173030 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aadc5c18-7126-492e-9996-fdbef6b4c315 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3116c70a2e8d4220b1d8f3d57a2e8b3a)` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:51:13.173030 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aadc5c18-7126-492e-9996-fdbef6b4c315 admin admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:51:13.244242 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG dbcounter [-] [87934] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=87934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:51:13.250037 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.notifications [None req-aadc5c18-7126-492e-9996-fdbef6b4c315 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3116c70a2e8d4220b1d8f3d57a2e8b3a'} {{(pid=87934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:51:13.250962 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.notifications [None req-aadc5c18-7126-492e-9996-fdbef6b4c315 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3116c70a2e8d4220b1d8f3d57a2e8b3a'} {{(pid=87934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:51:13.251455 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.notifications [None req-aadc5c18-7126-492e-9996-fdbef6b4c315 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3116c70a2e8d4220b1d8f3d57a2e8b3a'} {{(pid=87934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:51:13.262492 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.notifications [None req-aadc5c18-7126-492e-9996-fdbef6b4c315 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3116c70a2e8d4220b1d8f3d57a2e8b3a'} {{(pid=87934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:51:13.279842 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.notifications [None req-aadc5c18-7126-492e-9996-fdbef6b4c315 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3116c70a2e8d4220b1d8f3d57a2e8b3a'} {{(pid=87934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:51:13.299677 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 1188/2329] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Sep 13 19:51:12 2022] DELETE /identity/v3/users/3116c70a2e8d4220b1d8f3d57a2e8b3a => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 19:51:13.307559 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c504c1-4538-48ca-baf0-31aea49de608 None None] REQUEST_METHOD: `POST` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:51:13.308385 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c504c1-4538-48ca-baf0-31aea49de608 None None] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:51:13.308878 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c504c1-4538-48ca-baf0-31aea49de608 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:51:13.330901 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.auth.core [None req-57c504c1-4538-48ca-baf0-31aea49de608 None None] MFA Rules not processed for user `7b0aed92d02344acb92a0e4aa67c3068`. Rule list: `[]` (Enabled: `True`). {{(pid=87935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:51:13.332888 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.fernet_utils [None req-57c504c1-4538-48ca-baf0-31aea49de608 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:51:13.470880 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 1142/2330] 10.222.0.25 () {58 vars in 958 bytes} [Tue Sep 13 19:51:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 19:51:13.481588 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aadc5c18-7126-492e-9996-fdbef6b4c315 admin admin] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:51:13.483205 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.fernet_utils [None req-aadc5c18-7126-492e-9996-fdbef6b4c315 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:51:13.568319 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aadc5c18-7126-492e-9996-fdbef6b4c315 admin admin] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:51:13.572556 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2523c8-e0c3-4575-9f1a-d0e5f394c571 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1196a96e4a404f559600b69f929ea9da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a10a4268f3c4cb29f4e00c292e2df62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:51:13.573168 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2523c8-e0c3-4575-9f1a-d0e5f394c571 service neutron] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:51:13.573445 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2523c8-e0c3-4575-9f1a-d0e5f394c571 service neutron] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:51:13.573714 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2523c8-e0c3-4575-9f1a-d0e5f394c571 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:51:13.583760 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a2523c8-e0c3-4575-9f1a-d0e5f394c571 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:51:13.585258 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a2523c8-e0c3-4575-9f1a-d0e5f394c571 service neutron] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:51:13.595811 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 1189/2331] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Sep 13 19:51:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 19:51:13.997742 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c504c1-4538-48ca-baf0-31aea49de608 None None] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:51:13.999974 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.fernet_utils [None req-57c504c1-4538-48ca-baf0-31aea49de608 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:51:14.020957 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c504c1-4538-48ca-baf0-31aea49de608 None None] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:51:14.026208 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961c36ef-87c2-492e-a68d-854dd9fd54bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:51:14.027414 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961c36ef-87c2-492e-a68d-854dd9fd54bd admin admin] REQUEST_METHOD: `DELETE` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:51:14.027886 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961c36ef-87c2-492e-a68d-854dd9fd54bd admin admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:51:14.028370 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961c36ef-87c2-492e-a68d-854dd9fd54bd admin admin] PATH_INFO: `/v3/projects/fdbf71218dae422f85334ae65f02c3bd` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:51:14.029892 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-961c36ef-87c2-492e-a68d-854dd9fd54bd admin admin] RBAC: Authorizing `identity:delete_project(project_id=fdbf71218dae422f85334ae65f02c3bd)` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:51:14.032949 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-961c36ef-87c2-492e-a68d-854dd9fd54bd admin admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:51:14.094988 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG dbcounter [-] [87935] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=87935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:51:14.118905 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.notifications [None req-961c36ef-87c2-492e-a68d-854dd9fd54bd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fdbf71218dae422f85334ae65f02c3bd', 'request_id': 'req-961c36ef-87c2-492e-a68d-854dd9fd54bd'} {{(pid=87935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:51:14.129602 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.notifications [None req-961c36ef-87c2-492e-a68d-854dd9fd54bd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fdbf71218dae422f85334ae65f02c3bd', 'request_id': 'req-961c36ef-87c2-492e-a68d-854dd9fd54bd'} {{(pid=87935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:51:14.142706 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.notifications [None req-961c36ef-87c2-492e-a68d-854dd9fd54bd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fdbf71218dae422f85334ae65f02c3bd', 'request_id': 'req-961c36ef-87c2-492e-a68d-854dd9fd54bd'} {{(pid=87935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:51:14.156723 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.notifications [None req-961c36ef-87c2-492e-a68d-854dd9fd54bd admin admin] The token cache is being invalidate because project fdbf71218dae422f85334ae65f02c3bd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87935) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 19:51:14.157076 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.notifications [None req-961c36ef-87c2-492e-a68d-854dd9fd54bd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:51:14.157914 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.notifications [None req-961c36ef-87c2-492e-a68d-854dd9fd54bd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:51:14.163299 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 1143/2332] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Sep 13 19:51:13 2022] DELETE /identity/v3/projects/fdbf71218dae422f85334ae65f02c3bd => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 19:51:14.164924 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2523c8-e0c3-4575-9f1a-d0e5f394c571 service neutron] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:51:14.193306 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2523c8-e0c3-4575-9f1a-d0e5f394c571 service neutron] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:51:14.336673 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbbbaaa6-0d0b-49dc-b380-264fe120436c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:51:14.337327 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbbaaa6-0d0b-49dc-b380-264fe120436c admin admin] REQUEST_METHOD: `DELETE` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:51:14.337604 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbbaaa6-0d0b-49dc-b380-264fe120436c admin admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:51:14.337869 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbbaaa6-0d0b-49dc-b380-264fe120436c admin admin] PATH_INFO: `/v3/users/e626128acfb84ee88231b9aeca88d5c1` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:51:14.351680 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbbbaaa6-0d0b-49dc-b380-264fe120436c admin admin] RBAC: Authorizing `identity:delete_user(user_id=e626128acfb84ee88231b9aeca88d5c1)` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:51:14.353896 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbbbaaa6-0d0b-49dc-b380-264fe120436c admin admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:51:14.473475 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.notifications [None req-cbbbaaa6-0d0b-49dc-b380-264fe120436c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e626128acfb84ee88231b9aeca88d5c1'} {{(pid=87934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:51:14.476225 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.notifications [None req-cbbbaaa6-0d0b-49dc-b380-264fe120436c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e626128acfb84ee88231b9aeca88d5c1'} {{(pid=87934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:51:14.477668 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.notifications [None req-cbbbaaa6-0d0b-49dc-b380-264fe120436c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e626128acfb84ee88231b9aeca88d5c1'} {{(pid=87934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:51:14.500979 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.notifications [None req-cbbbaaa6-0d0b-49dc-b380-264fe120436c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e626128acfb84ee88231b9aeca88d5c1'} {{(pid=87934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:51:14.522686 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG dbcounter [-] [87934] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=87934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:51:14.532051 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.notifications [None req-cbbbaaa6-0d0b-49dc-b380-264fe120436c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e626128acfb84ee88231b9aeca88d5c1'} {{(pid=87934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:51:14.566952 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 1190/2333] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Sep 13 19:51:14 2022] DELETE /identity/v3/users/e626128acfb84ee88231b9aeca88d5c1 => generated 0 bytes in 403 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 19:51:15.266754 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961c36ef-87c2-492e-a68d-854dd9fd54bd admin admin] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:51:15.268570 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.fernet_utils [None req-961c36ef-87c2-492e-a68d-854dd9fd54bd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:51:15.289593 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961c36ef-87c2-492e-a68d-854dd9fd54bd admin admin] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:51:15.386722 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d893f4ce-1a6b-4d41-82bc-93e449e41902 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:51:15.388373 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d893f4ce-1a6b-4d41-82bc-93e449e41902 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:51:15.388986 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d893f4ce-1a6b-4d41-82bc-93e449e41902 admin admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:51:15.389450 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d893f4ce-1a6b-4d41-82bc-93e449e41902 admin admin] PATH_INFO: `/v3/projects/1c119698fac6464c9c9b1e89a9865a18` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:51:15.391469 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d893f4ce-1a6b-4d41-82bc-93e449e41902 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1c119698fac6464c9c9b1e89a9865a18)` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:51:15.394475 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d893f4ce-1a6b-4d41-82bc-93e449e41902 admin admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:51:15.463500 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.notifications [None req-d893f4ce-1a6b-4d41-82bc-93e449e41902 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1c119698fac6464c9c9b1e89a9865a18', 'request_id': 'req-d893f4ce-1a6b-4d41-82bc-93e449e41902'} {{(pid=87935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:51:15.484927 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.notifications [None req-d893f4ce-1a6b-4d41-82bc-93e449e41902 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1c119698fac6464c9c9b1e89a9865a18', 'request_id': 'req-d893f4ce-1a6b-4d41-82bc-93e449e41902'} {{(pid=87935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:51:15.493902 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.notifications [None req-d893f4ce-1a6b-4d41-82bc-93e449e41902 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1c119698fac6464c9c9b1e89a9865a18', 'request_id': 'req-d893f4ce-1a6b-4d41-82bc-93e449e41902'} {{(pid=87935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:51:15.511137 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.notifications [None req-d893f4ce-1a6b-4d41-82bc-93e449e41902 admin admin] The token cache is being invalidate because project 1c119698fac6464c9c9b1e89a9865a18 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87935) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 19:51:15.511458 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.notifications [None req-d893f4ce-1a6b-4d41-82bc-93e449e41902 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:51:15.512900 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.notifications [None req-d893f4ce-1a6b-4d41-82bc-93e449e41902 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:51:15.522933 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e7a2ff-e9ba-439c-87e8-85486fe20715 None None] REQUEST_METHOD: `POST` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:51:15.523536 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e7a2ff-e9ba-439c-87e8-85486fe20715 None None] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:51:15.523687 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e7a2ff-e9ba-439c-87e8-85486fe20715 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:51:15.526707 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 1144/2334] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Sep 13 19:51:15 2022] DELETE /identity/v3/projects/1c119698fac6464c9c9b1e89a9865a18 => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 19:51:15.545568 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.auth.core [None req-42e7a2ff-e9ba-439c-87e8-85486fe20715 None None] MFA Rules not processed for user `7b0aed92d02344acb92a0e4aa67c3068`. Rule list: `[]` (Enabled: `True`). {{(pid=87934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:51:15.549007 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.fernet_utils [None req-42e7a2ff-e9ba-439c-87e8-85486fe20715 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:51:15.647613 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 1191/2335] 10.222.0.25 () {58 vars in 958 bytes} [Tue Sep 13 19:51:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 19:51:15.656190 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c51b18-62cf-4f12-83b3-3e125d5de072 None None] REQUEST_METHOD: `POST` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:51:15.656512 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c51b18-62cf-4f12-83b3-3e125d5de072 None None] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:51:15.666921 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c51b18-62cf-4f12-83b3-3e125d5de072 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:51:15.714439 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.auth.core [None req-65c51b18-62cf-4f12-83b3-3e125d5de072 None None] MFA Rules not processed for user `7b0aed92d02344acb92a0e4aa67c3068`. Rule list: `[]` (Enabled: `True`). {{(pid=87935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:51:15.716294 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.fernet_utils [None req-65c51b18-62cf-4f12-83b3-3e125d5de072 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:51:15.737840 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 1145/2336] 10.222.0.25 () {58 vars in 958 bytes} [Tue Sep 13 19:51:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 19:51:15.743378 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e7a2ff-e9ba-439c-87e8-85486fe20715 None None] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:51:15.772139 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e7a2ff-e9ba-439c-87e8-85486fe20715 None None] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:51:15.777485 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbcc3505-d5e6-4186-ba55-a673257f06b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:51:15.778109 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcc3505-d5e6-4186-ba55-a673257f06b9 admin admin] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:51:15.778390 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcc3505-d5e6-4186-ba55-a673257f06b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:51:15.778665 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcc3505-d5e6-4186-ba55-a673257f06b9 admin admin] PATH_INFO: `/v3/domains` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:51:15.779318 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbcc3505-d5e6-4186-ba55-a673257f06b9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87934) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:51:15.779617 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbcc3505-d5e6-4186-ba55-a673257f06b9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:51:15.788686 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbcc3505-d5e6-4186-ba55-a673257f06b9 admin admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:51:15.817186 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 1192/2337] 10.222.0.25 () {58 vars in 1153 bytes} [Tue Sep 13 19:51:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:51:15.818532 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c51b18-62cf-4f12-83b3-3e125d5de072 None None] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:51:15.834204 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c51b18-62cf-4f12-83b3-3e125d5de072 None None] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:51:15.838952 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47c41c2-347e-4391-9c25-899d4610621c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:51:15.839569 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47c41c2-347e-4391-9c25-899d4610621c admin admin] REQUEST_METHOD: `POST` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:51:15.839848 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47c41c2-347e-4391-9c25-899d4610621c admin admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:51:15.840143 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47c41c2-347e-4391-9c25-899d4610621c admin admin] PATH_INFO: `/v3/projects` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:51:15.840816 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b47c41c2-347e-4391-9c25-899d4610621c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:51:15.842781 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b47c41c2-347e-4391-9c25-899d4610621c admin admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:51:15.880413 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 1146/2338] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Sep 13 19:51:15 2022] POST /identity/v3/projects => generated 367 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 13 19:51:15.880797 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbcc3505-d5e6-4186-ba55-a673257f06b9 admin admin] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:51:15.895247 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbcc3505-d5e6-4186-ba55-a673257f06b9 admin admin] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:51:15.957911 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9d109b-5e6b-4ca8-9995-d64ecc0dbf70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:51:15.958627 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9d109b-5e6b-4ca8-9995-d64ecc0dbf70 admin admin] REQUEST_METHOD: `POST` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:51:15.958962 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9d109b-5e6b-4ca8-9995-d64ecc0dbf70 admin admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:51:15.959303 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9d109b-5e6b-4ca8-9995-d64ecc0dbf70 admin admin] PATH_INFO: `/v3/users` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:51:15.960039 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c9d109b-5e6b-4ca8-9995-d64ecc0dbf70 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:51:15.962047 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c9d109b-5e6b-4ca8-9995-d64ecc0dbf70 admin admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:51:15.990386 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 1193/2339] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Sep 13 19:51:15 2022] POST /identity/v3/users => generated 284 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 13 19:51:15.994618 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47c41c2-347e-4391-9c25-899d4610621c admin admin] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:51:16.006605 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47c41c2-347e-4391-9c25-899d4610621c admin admin] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:51:16.011468 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408cd796-0267-41a5-861a-26a2175ba7c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:51:16.012148 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408cd796-0267-41a5-861a-26a2175ba7c7 admin admin] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:51:16.012519 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408cd796-0267-41a5-861a-26a2175ba7c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:51:16.012854 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408cd796-0267-41a5-861a-26a2175ba7c7 admin admin] PATH_INFO: `/v3/roles` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:51:16.013625 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-408cd796-0267-41a5-861a-26a2175ba7c7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:51:16.015372 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-408cd796-0267-41a5-861a-26a2175ba7c7 admin admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:51:16.030895 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 1147/2340] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Sep 13 19:51:15 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 19:51:16.032192 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9d109b-5e6b-4ca8-9995-d64ecc0dbf70 admin admin] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:51:16.042500 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9d109b-5e6b-4ca8-9995-d64ecc0dbf70 admin admin] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:51:16.047943 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2882fd46-766d-4d08-9305-1ed24c8edc66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:51:16.048739 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2882fd46-766d-4d08-9305-1ed24c8edc66 admin admin] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:51:16.049017 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2882fd46-766d-4d08-9305-1ed24c8edc66 admin admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:51:16.049506 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2882fd46-766d-4d08-9305-1ed24c8edc66 admin admin] PATH_INFO: `/v3/roles` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:51:16.050245 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2882fd46-766d-4d08-9305-1ed24c8edc66 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:51:16.052060 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2882fd46-766d-4d08-9305-1ed24c8edc66 admin admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:51:16.064565 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 1194/2341] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Sep 13 19:51:16 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 19:51:16.068919 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408cd796-0267-41a5-861a-26a2175ba7c7 admin admin] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:51:16.075645 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG dbcounter [-] [87935] Writing DB stats keystone:DELETE=13,keystone:SELECT=84,keystone:INSERT=3 {{(pid=87935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:51:16.081078 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408cd796-0267-41a5-861a-26a2175ba7c7 admin admin] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:51:16.088502 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3335f52b-19dd-4382-b0e2-d3b8c8af98b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:51:16.089264 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3335f52b-19dd-4382-b0e2-d3b8c8af98b0 admin admin] REQUEST_METHOD: `PUT` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:51:16.089718 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3335f52b-19dd-4382-b0e2-d3b8c8af98b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:51:16.090203 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3335f52b-19dd-4382-b0e2-d3b8c8af98b0 admin admin] PATH_INFO: `/v3/projects/2082de9a82ae4f7da0a1b5ca3c04fa62/users/f0d31da9e20a4d77b7465fa418913623/roles/a259191f6d0e46fabd9f34536bb28747` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:51:16.112321 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3335f52b-19dd-4382-b0e2-d3b8c8af98b0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2082de9a82ae4f7da0a1b5ca3c04fa62, user_id=f0d31da9e20a4d77b7465fa418913623, role_id=a259191f6d0e46fabd9f34536bb28747)` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:51:16.115584 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3335f52b-19dd-4382-b0e2-d3b8c8af98b0 admin admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:51:16.142246 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 1148/2342] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Sep 13 19:51:16 2022] PUT /identity/v3/projects/2082de9a82ae4f7da0a1b5ca3c04fa62/users/f0d31da9e20a4d77b7465fa418913623/roles/a259191f6d0e46fabd9f34536bb28747 => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 19:51:16.153230 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6ab03f-e41d-4701-919c-2a7e474497a1 None None] REQUEST_METHOD: `POST` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:51:16.153708 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6ab03f-e41d-4701-919c-2a7e474497a1 None None] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:51:16.154051 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6ab03f-e41d-4701-919c-2a7e474497a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:51:16.190198 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.auth.core [None req-fc6ab03f-e41d-4701-919c-2a7e474497a1 None None] MFA Rules not processed for user `f0d31da9e20a4d77b7465fa418913623`. Rule list: `[]` (Enabled: `True`). {{(pid=87934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:51:16.191424 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.fernet_utils [None req-fc6ab03f-e41d-4701-919c-2a7e474497a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:51:16.233418 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG dbcounter [-] [87934] Writing DB stats keystone:SELECT=94,keystone:DELETE=2,keystone:INSERT=4 {{(pid=87934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:51:16.279917 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 1195/2343] 10.222.0.25 () {58 vars in 958 bytes} [Tue Sep 13 19:51:16 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 19:51:16.293535 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3335f52b-19dd-4382-b0e2-d3b8c8af98b0 admin admin] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:51:16.301690 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.fernet_utils [None req-3335f52b-19dd-4382-b0e2-d3b8c8af98b0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:51:16.370311 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3335f52b-19dd-4382-b0e2-d3b8c8af98b0 admin admin] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:51:16.374190 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103865a3-3d9c-4739-95a8-357cf7277fee service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '907d44d3b6944ccb83999d8e489871d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a10a4268f3c4cb29f4e00c292e2df62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:51:16.375134 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103865a3-3d9c-4739-95a8-357cf7277fee service glance] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:51:16.375492 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103865a3-3d9c-4739-95a8-357cf7277fee service glance] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:51:16.375989 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103865a3-3d9c-4739-95a8-357cf7277fee service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:51:16.386266 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103865a3-3d9c-4739-95a8-357cf7277fee service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:51:16.387863 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103865a3-3d9c-4739-95a8-357cf7277fee service glance] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:51:16.398597 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 1149/2344] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Sep 13 19:51:16 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 19:51:26.275536 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG dbcounter [-] [87934] Writing DB stats keystone:SELECT=9 {{(pid=87934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:51:26.395284 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG dbcounter [-] [87935] Writing DB stats keystone:SELECT=34,keystone:INSERT=1 {{(pid=87935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:51:28.562793 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067d8215-e835-4bb0-9e30-9190dc1f9ea7 None None] REQUEST_METHOD: `POST` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:51:28.563332 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067d8215-e835-4bb0-9e30-9190dc1f9ea7 None None] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:51:28.564020 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067d8215-e835-4bb0-9e30-9190dc1f9ea7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:51:28.585966 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.auth.core [None req-067d8215-e835-4bb0-9e30-9190dc1f9ea7 None None] MFA Rules not processed for user `d44977a3225e43f19cdc4a84f0e170cd`. Rule list: `[]` (Enabled: `True`). {{(pid=87934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:51:28.587372 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.fernet_utils [None req-067d8215-e835-4bb0-9e30-9190dc1f9ea7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:51:28.705643 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 1196/2345] 10.222.0.25 () {58 vars in 1009 bytes} [Tue Sep 13 19:51:28 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 19:51:28.721276 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103865a3-3d9c-4739-95a8-357cf7277fee service glance] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:51:28.723538 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.fernet_utils [None req-103865a3-3d9c-4739-95a8-357cf7277fee service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:51:28.876463 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103865a3-3d9c-4739-95a8-357cf7277fee service glance] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:51:28.889152 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140ec5ea-c8df-40d0-9f62-7648bc2c2409 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb42d6ac6cdd4d97a80c3ee0c6f8e3f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a10a4268f3c4cb29f4e00c292e2df62', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:51:28.889793 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140ec5ea-c8df-40d0-9f62-7648bc2c2409 service swift] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:51:28.890128 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140ec5ea-c8df-40d0-9f62-7648bc2c2409 service swift] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:51:28.890755 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140ec5ea-c8df-40d0-9f62-7648bc2c2409 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:51:28.904735 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-140ec5ea-c8df-40d0-9f62-7648bc2c2409 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:51:28.907284 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-140ec5ea-c8df-40d0-9f62-7648bc2c2409 service swift] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:51:28.917453 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 1150/2346] 10.222.0.25 () {60 vars in 1384 bytes} [Tue Sep 13 19:51:28 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 197 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 13 19:51:30.406046 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce51db6-bfa6-4509-b8c1-12242265b16e None None] REQUEST_METHOD: `POST` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:51:30.407270 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce51db6-bfa6-4509-b8c1-12242265b16e None None] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:51:30.407801 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce51db6-bfa6-4509-b8c1-12242265b16e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:51:30.446630 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.auth.core [None req-1ce51db6-bfa6-4509-b8c1-12242265b16e None None] MFA Rules not processed for user `ef71a6041f2d4f7389796f0c4a491ea6`. Rule list: `[]` (Enabled: `True`). {{(pid=87934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:51:30.446630 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.fernet_utils [None req-1ce51db6-bfa6-4509-b8c1-12242265b16e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:51:30.569136 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 1197/2347] 10.222.0.25 () {58 vars in 958 bytes} [Tue Sep 13 19:51:30 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 19:51:38.913599 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG dbcounter [-] [87935] Writing DB stats keystone:SELECT=32 {{(pid=87935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:51:40.544952 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG dbcounter [-] [87934] Writing DB stats keystone:SELECT=50 {{(pid=87934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:51:40.862473 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140ec5ea-c8df-40d0-9f62-7648bc2c2409 service swift] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:51:40.864864 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.fernet_utils [None req-140ec5ea-c8df-40d0-9f62-7648bc2c2409 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:51:40.940437 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140ec5ea-c8df-40d0-9f62-7648bc2c2409 service swift] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:51:40.944200 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9aa09b-1a15-43bb-ab7d-ff12936cccce service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1196a96e4a404f559600b69f929ea9da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a10a4268f3c4cb29f4e00c292e2df62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:51:40.944861 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9aa09b-1a15-43bb-ab7d-ff12936cccce service neutron] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:51:40.945605 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9aa09b-1a15-43bb-ab7d-ff12936cccce service neutron] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:51:40.945746 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9aa09b-1a15-43bb-ab7d-ff12936cccce service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:51:40.947449 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.fernet_utils [None req-ae9aa09b-1a15-43bb-ab7d-ff12936cccce service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:51:41.034764 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae9aa09b-1a15-43bb-ab7d-ff12936cccce service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:51:41.040365 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae9aa09b-1a15-43bb-ab7d-ff12936cccce service neutron] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:51:41.054255 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 1151/2348] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Sep 13 19:51:40 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 192 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 19:51:41.321512 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad2b2b8-8fe6-458c-b07b-482e6deeb8fa None None] REQUEST_METHOD: `POST` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:51:41.324588 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad2b2b8-8fe6-458c-b07b-482e6deeb8fa None None] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:51:41.324879 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad2b2b8-8fe6-458c-b07b-482e6deeb8fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:51:41.385246 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.auth.core [None req-fad2b2b8-8fe6-458c-b07b-482e6deeb8fa None None] MFA Rules not processed for user `7055a86d737749ec8c6f85752f00b28e`. Rule list: `[]` (Enabled: `True`). {{(pid=87934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:51:41.387323 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.fernet_utils [None req-fad2b2b8-8fe6-458c-b07b-482e6deeb8fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:51:41.505428 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 1198/2349] 10.222.0.25 () {58 vars in 958 bytes} [Tue Sep 13 19:51:41 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 19:51:42.503389 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9aa09b-1a15-43bb-ab7d-ff12936cccce service neutron] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:51:42.728621 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9aa09b-1a15-43bb-ab7d-ff12936cccce service neutron] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:51:42.750824 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8985300c-be6b-41d6-a88c-a06e05673931 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:51:42.751773 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8985300c-be6b-41d6-a88c-a06e05673931 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:51:42.752240 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8985300c-be6b-41d6-a88c-a06e05673931 admin admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:51:42.752685 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8985300c-be6b-41d6-a88c-a06e05673931 admin admin] PATH_INFO: `/v3/users/f0d31da9e20a4d77b7465fa418913623` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:51:42.754179 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8985300c-be6b-41d6-a88c-a06e05673931 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f0d31da9e20a4d77b7465fa418913623)` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:51:42.756363 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8985300c-be6b-41d6-a88c-a06e05673931 admin admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:51:42.853449 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.notifications [None req-8985300c-be6b-41d6-a88c-a06e05673931 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f0d31da9e20a4d77b7465fa418913623'} {{(pid=87935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:51:42.858262 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG dbcounter [-] [87935] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=87935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:51:42.865140 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.notifications [None req-8985300c-be6b-41d6-a88c-a06e05673931 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f0d31da9e20a4d77b7465fa418913623'} {{(pid=87935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:51:42.897678 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.notifications [None req-8985300c-be6b-41d6-a88c-a06e05673931 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f0d31da9e20a4d77b7465fa418913623'} {{(pid=87935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:51:42.898656 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.notifications [None req-8985300c-be6b-41d6-a88c-a06e05673931 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f0d31da9e20a4d77b7465fa418913623'} {{(pid=87935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:51:42.899685 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.notifications [None req-8985300c-be6b-41d6-a88c-a06e05673931 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f0d31da9e20a4d77b7465fa418913623'} {{(pid=87935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:51:42.917468 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 1152/2350] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Sep 13 19:51:42 2022] DELETE /identity/v3/users/f0d31da9e20a4d77b7465fa418913623 => generated 0 bytes in 414 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 19:51:42.921918 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8e2943-eda1-4916-8d4a-4b5df2eeb8f1 None None] REQUEST_METHOD: `POST` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:51:42.922951 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8e2943-eda1-4916-8d4a-4b5df2eeb8f1 None None] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:51:42.923558 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8e2943-eda1-4916-8d4a-4b5df2eeb8f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:51:42.962845 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.auth.core [None req-2f8e2943-eda1-4916-8d4a-4b5df2eeb8f1 None None] MFA Rules not processed for user `7b0aed92d02344acb92a0e4aa67c3068`. Rule list: `[]` (Enabled: `True`). {{(pid=87934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:51:42.969226 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.fernet_utils [None req-2f8e2943-eda1-4916-8d4a-4b5df2eeb8f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:51:43.159526 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 1199/2351] 10.222.0.25 () {58 vars in 958 bytes} [Tue Sep 13 19:51:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 239 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 19:51:43.203286 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8985300c-be6b-41d6-a88c-a06e05673931 admin admin] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:51:43.205955 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.fernet_utils [None req-8985300c-be6b-41d6-a88c-a06e05673931 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:51:43.418259 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8985300c-be6b-41d6-a88c-a06e05673931 admin admin] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:51:43.424774 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929c20af-2cc7-4fd6-9134-814684469ec7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1196a96e4a404f559600b69f929ea9da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a10a4268f3c4cb29f4e00c292e2df62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:51:43.425513 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929c20af-2cc7-4fd6-9134-814684469ec7 service neutron] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:51:43.426297 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929c20af-2cc7-4fd6-9134-814684469ec7 service neutron] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:51:43.426297 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929c20af-2cc7-4fd6-9134-814684469ec7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:51:43.445774 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-929c20af-2cc7-4fd6-9134-814684469ec7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:51:43.447901 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-929c20af-2cc7-4fd6-9134-814684469ec7 service neutron] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:51:43.463998 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 1153/2352] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Sep 13 19:51:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 262 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 19:51:44.216138 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8e2943-eda1-4916-8d4a-4b5df2eeb8f1 None None] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:51:44.219077 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.fernet_utils [None req-2f8e2943-eda1-4916-8d4a-4b5df2eeb8f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:51:44.267396 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8e2943-eda1-4916-8d4a-4b5df2eeb8f1 None None] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:51:44.286346 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f681fb45-97cd-491b-a07b-7cd575c842e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:51:44.287196 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f681fb45-97cd-491b-a07b-7cd575c842e3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:51:44.287671 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f681fb45-97cd-491b-a07b-7cd575c842e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:51:44.288016 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f681fb45-97cd-491b-a07b-7cd575c842e3 admin admin] PATH_INFO: `/v3/projects/2082de9a82ae4f7da0a1b5ca3c04fa62` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:51:44.289449 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f681fb45-97cd-491b-a07b-7cd575c842e3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2082de9a82ae4f7da0a1b5ca3c04fa62)` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:51:44.291553 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f681fb45-97cd-491b-a07b-7cd575c842e3 admin admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:51:44.345262 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.notifications [None req-f681fb45-97cd-491b-a07b-7cd575c842e3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2082de9a82ae4f7da0a1b5ca3c04fa62', 'request_id': 'req-f681fb45-97cd-491b-a07b-7cd575c842e3'} {{(pid=87934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:51:44.352450 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.notifications [None req-f681fb45-97cd-491b-a07b-7cd575c842e3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2082de9a82ae4f7da0a1b5ca3c04fa62', 'request_id': 'req-f681fb45-97cd-491b-a07b-7cd575c842e3'} {{(pid=87934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:51:44.359107 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.notifications [None req-f681fb45-97cd-491b-a07b-7cd575c842e3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2082de9a82ae4f7da0a1b5ca3c04fa62', 'request_id': 'req-f681fb45-97cd-491b-a07b-7cd575c842e3'} {{(pid=87934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:51:44.374828 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.notifications [None req-f681fb45-97cd-491b-a07b-7cd575c842e3 admin admin] The token cache is being invalidate because project 2082de9a82ae4f7da0a1b5ca3c04fa62 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87934) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 19:51:44.375223 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.notifications [None req-f681fb45-97cd-491b-a07b-7cd575c842e3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:51:44.376152 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.notifications [None req-f681fb45-97cd-491b-a07b-7cd575c842e3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:51:44.377834 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 1200/2353] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Sep 13 19:51:44 2022] DELETE /identity/v3/projects/2082de9a82ae4f7da0a1b5ca3c04fa62 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 19:51:44.383007 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7197228-ae39-476c-aed4-71f9ba640f84 None None] REQUEST_METHOD: `POST` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:51:44.383477 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7197228-ae39-476c-aed4-71f9ba640f84 None None] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:51:44.383708 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7197228-ae39-476c-aed4-71f9ba640f84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:51:44.405698 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.auth.core [None req-b7197228-ae39-476c-aed4-71f9ba640f84 None None] MFA Rules not processed for user `7b0aed92d02344acb92a0e4aa67c3068`. Rule list: `[]` (Enabled: `True`). {{(pid=87935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:51:44.406943 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.fernet_utils [None req-b7197228-ae39-476c-aed4-71f9ba640f84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:51:44.492255 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 1154/2354] 10.222.0.25 () {58 vars in 958 bytes} [Tue Sep 13 19:51:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 19:51:44.499502 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1e586c-f584-454d-989a-cbeabd78fb35 None None] REQUEST_METHOD: `POST` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:51:44.499886 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1e586c-f584-454d-989a-cbeabd78fb35 None None] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:51:44.500167 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1e586c-f584-454d-989a-cbeabd78fb35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:51:44.524256 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.auth.core [None req-bd1e586c-f584-454d-989a-cbeabd78fb35 None None] MFA Rules not processed for user `7b0aed92d02344acb92a0e4aa67c3068`. Rule list: `[]` (Enabled: `True`). {{(pid=87934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:51:44.526163 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.fernet_utils [None req-bd1e586c-f584-454d-989a-cbeabd78fb35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:51:44.535115 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 1201/2355] 10.222.0.25 () {58 vars in 958 bytes} [Tue Sep 13 19:51:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 19:51:44.539624 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7197228-ae39-476c-aed4-71f9ba640f84 None None] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:51:44.550867 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7197228-ae39-476c-aed4-71f9ba640f84 None None] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:51:44.556381 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54409fba-44a4-4ba2-a5e7-ec792cc15c50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:51:44.557022 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54409fba-44a4-4ba2-a5e7-ec792cc15c50 admin admin] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:51:44.557327 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54409fba-44a4-4ba2-a5e7-ec792cc15c50 admin admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:51:44.557602 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54409fba-44a4-4ba2-a5e7-ec792cc15c50 admin admin] PATH_INFO: `/v3/domains` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:51:44.565667 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54409fba-44a4-4ba2-a5e7-ec792cc15c50 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87935) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:51:44.566527 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54409fba-44a4-4ba2-a5e7-ec792cc15c50 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:51:44.569586 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54409fba-44a4-4ba2-a5e7-ec792cc15c50 admin admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:51:44.590507 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 1155/2356] 10.222.0.25 () {58 vars in 1153 bytes} [Tue Sep 13 19:51:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:51:44.595297 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1e586c-f584-454d-989a-cbeabd78fb35 None None] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:51:44.609439 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1e586c-f584-454d-989a-cbeabd78fb35 None None] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:51:44.616031 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7cf41dd-6cf7-4794-903b-903ef6bc8558 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:51:44.616253 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7cf41dd-6cf7-4794-903b-903ef6bc8558 admin admin] REQUEST_METHOD: `POST` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:51:44.616625 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7cf41dd-6cf7-4794-903b-903ef6bc8558 admin admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:51:44.617059 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7cf41dd-6cf7-4794-903b-903ef6bc8558 admin admin] PATH_INFO: `/v3/projects` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:51:44.618220 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7cf41dd-6cf7-4794-903b-903ef6bc8558 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:51:44.620605 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7cf41dd-6cf7-4794-903b-903ef6bc8558 admin admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:51:44.652088 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG dbcounter [-] [87934] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=87934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:51:44.660597 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 1202/2357] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Sep 13 19:51:44 2022] POST /identity/v3/projects => generated 375 bytes in 66 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 19:51:44.664625 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54409fba-44a4-4ba2-a5e7-ec792cc15c50 admin admin] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:51:44.676088 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54409fba-44a4-4ba2-a5e7-ec792cc15c50 admin admin] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:51:44.737301 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a8af8d-56bb-4d9f-88eb-a1ffea9542a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:51:44.738010 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a8af8d-56bb-4d9f-88eb-a1ffea9542a5 admin admin] REQUEST_METHOD: `POST` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:51:44.738322 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a8af8d-56bb-4d9f-88eb-a1ffea9542a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:51:44.738617 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a8af8d-56bb-4d9f-88eb-a1ffea9542a5 admin admin] PATH_INFO: `/v3/users` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:51:44.739337 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a8af8d-56bb-4d9f-88eb-a1ffea9542a5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:51:44.741550 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a8af8d-56bb-4d9f-88eb-a1ffea9542a5 admin admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:51:44.751616 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG dbcounter [-] [87935] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=87935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:51:44.766966 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 1156/2358] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Sep 13 19:51:44 2022] POST /identity/v3/users => generated 288 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 19:51:44.771317 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7cf41dd-6cf7-4794-903b-903ef6bc8558 admin admin] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:51:44.783544 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7cf41dd-6cf7-4794-903b-903ef6bc8558 admin admin] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:51:44.788981 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d02a39d-6e76-4a91-a4e1-17e06f2283a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:51:44.789807 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d02a39d-6e76-4a91-a4e1-17e06f2283a9 admin admin] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:51:44.789962 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d02a39d-6e76-4a91-a4e1-17e06f2283a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:51:44.790229 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d02a39d-6e76-4a91-a4e1-17e06f2283a9 admin admin] PATH_INFO: `/v3/roles` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:51:44.790873 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d02a39d-6e76-4a91-a4e1-17e06f2283a9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:51:44.792563 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d02a39d-6e76-4a91-a4e1-17e06f2283a9 admin admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:51:44.805150 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 1203/2359] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Sep 13 19:51:44 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 13 19:51:44.810105 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a8af8d-56bb-4d9f-88eb-a1ffea9542a5 admin admin] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:51:44.821879 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a8af8d-56bb-4d9f-88eb-a1ffea9542a5 admin admin] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:51:44.827374 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5dd7323-8991-43ad-b0be-2cb8f9902df2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:51:44.828413 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5dd7323-8991-43ad-b0be-2cb8f9902df2 admin admin] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:51:44.828696 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5dd7323-8991-43ad-b0be-2cb8f9902df2 admin admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:51:44.829041 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5dd7323-8991-43ad-b0be-2cb8f9902df2 admin admin] PATH_INFO: `/v3/roles` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:51:44.829749 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5dd7323-8991-43ad-b0be-2cb8f9902df2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:51:44.831423 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5dd7323-8991-43ad-b0be-2cb8f9902df2 admin admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:51:44.843886 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 1157/2360] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Sep 13 19:51:44 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 19:51:44.848673 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d02a39d-6e76-4a91-a4e1-17e06f2283a9 admin admin] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:51:44.861516 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d02a39d-6e76-4a91-a4e1-17e06f2283a9 admin admin] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:51:44.869486 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a660448-ed96-4c8e-97f5-6a15e2a785be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:51:44.870511 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a660448-ed96-4c8e-97f5-6a15e2a785be admin admin] REQUEST_METHOD: `PUT` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:51:44.870863 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a660448-ed96-4c8e-97f5-6a15e2a785be admin admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:51:44.871341 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a660448-ed96-4c8e-97f5-6a15e2a785be admin admin] PATH_INFO: `/v3/projects/ae3a86a4744f48358b627a217a515ca9/users/392f3ba9e0e34e52ac838c108a7c531f/roles/a259191f6d0e46fabd9f34536bb28747` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:51:44.896353 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a660448-ed96-4c8e-97f5-6a15e2a785be admin admin] RBAC: Authorizing `identity:create_grant(project_id=ae3a86a4744f48358b627a217a515ca9, user_id=392f3ba9e0e34e52ac838c108a7c531f, role_id=a259191f6d0e46fabd9f34536bb28747)` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:51:44.899191 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a660448-ed96-4c8e-97f5-6a15e2a785be admin admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:51:44.929918 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 1204/2361] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Sep 13 19:51:44 2022] PUT /identity/v3/projects/ae3a86a4744f48358b627a217a515ca9/users/392f3ba9e0e34e52ac838c108a7c531f/roles/a259191f6d0e46fabd9f34536bb28747 => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 19:51:44.941284 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e9cf94-1a36-4f1f-9bc2-fde52a4c8315 None None] REQUEST_METHOD: `POST` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:51:44.941577 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e9cf94-1a36-4f1f-9bc2-fde52a4c8315 None None] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:51:44.941873 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e9cf94-1a36-4f1f-9bc2-fde52a4c8315 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:51:44.985919 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.auth.core [None req-18e9cf94-1a36-4f1f-9bc2-fde52a4c8315 None None] MFA Rules not processed for user `392f3ba9e0e34e52ac838c108a7c531f`. Rule list: `[]` (Enabled: `True`). {{(pid=87935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:51:44.986546 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.fernet_utils [None req-18e9cf94-1a36-4f1f-9bc2-fde52a4c8315 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:51:45.154508 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 1158/2362] 10.222.0.25 () {58 vars in 958 bytes} [Tue Sep 13 19:51:44 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 19:51:45.168023 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a660448-ed96-4c8e-97f5-6a15e2a785be admin admin] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:51:45.170141 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.fernet_utils [None req-1a660448-ed96-4c8e-97f5-6a15e2a785be admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:51:45.274545 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a660448-ed96-4c8e-97f5-6a15e2a785be admin admin] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:51:45.281858 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b52280-d54b-49b7-af06-ee3db94a5726 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cbb50c88b794a7f9f26844effde7d63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a10a4268f3c4cb29f4e00c292e2df62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:51:45.282801 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b52280-d54b-49b7-af06-ee3db94a5726 service cinder] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:51:45.283298 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b52280-d54b-49b7-af06-ee3db94a5726 service cinder] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:51:45.283768 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b52280-d54b-49b7-af06-ee3db94a5726 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:51:45.305048 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b52280-d54b-49b7-af06-ee3db94a5726 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:51:45.306706 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b52280-d54b-49b7-af06-ee3db94a5726 service cinder] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:51:45.319114 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 1205/2363] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Sep 13 19:51:45 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 19:51:46.969130 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f9eabe-fc3b-4f21-a435-2c4ed7af22f6 None None] REQUEST_METHOD: `POST` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:51:46.970163 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f9eabe-fc3b-4f21-a435-2c4ed7af22f6 None None] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:51:46.970640 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f9eabe-fc3b-4f21-a435-2c4ed7af22f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:51:47.004696 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.auth.core [None req-31f9eabe-fc3b-4f21-a435-2c4ed7af22f6 None None] MFA Rules not processed for user `392f3ba9e0e34e52ac838c108a7c531f`. Rule list: `[]` (Enabled: `True`). {{(pid=87935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:51:47.006961 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.fernet_utils [None req-31f9eabe-fc3b-4f21-a435-2c4ed7af22f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:51:47.015548 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 1159/2364] 10.222.0.25 () {58 vars in 958 bytes} [Tue Sep 13 19:51:46 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 19:51:49.739428 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d7ba5f-4363-47f0-998d-ca538d1c8ef3 None None] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:51:49.740030 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d7ba5f-4363-47f0-998d-ca538d1c8ef3 None None] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:51:49.742240 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d7ba5f-4363-47f0-998d-ca538d1c8ef3 None None] PATH_INFO: `/` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:51:49.743678 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 1206/2365] 10.222.0.25 () {54 vars in 921 bytes} [Tue Sep 13 19:51:49 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:51:49.752752 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f494b853-77a7-447e-82cc-96e0539a87b5 None None] REQUEST_METHOD: `POST` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:51:49.753303 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f494b853-77a7-447e-82cc-96e0539a87b5 None None] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:51:49.753382 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f494b853-77a7-447e-82cc-96e0539a87b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:51:49.782052 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.auth.core [None req-f494b853-77a7-447e-82cc-96e0539a87b5 None None] MFA Rules not processed for user `d71fe5a8275f4ea98555afdcefc902a0`. Rule list: `[]` (Enabled: `True`). {{(pid=87935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:51:49.783284 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.fernet_utils [None req-f494b853-77a7-447e-82cc-96e0539a87b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:51:49.934181 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 1160/2366] 10.222.0.25 () {58 vars in 1018 bytes} [Tue Sep 13 19:51:49 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 19:51:49.951541 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d7ba5f-4363-47f0-998d-ca538d1c8ef3 None None] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:51:49.955872 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.fernet_utils [None req-99d7ba5f-4363-47f0-998d-ca538d1c8ef3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:51:50.037221 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d7ba5f-4363-47f0-998d-ca538d1c8ef3 None None] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:51:50.040924 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567b67a7-ca54-41b3-9c61-36c416fc07b3 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '907d44d3b6944ccb83999d8e489871d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a10a4268f3c4cb29f4e00c292e2df62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:51:50.041568 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567b67a7-ca54-41b3-9c61-36c416fc07b3 service glance] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:51:50.041869 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567b67a7-ca54-41b3-9c61-36c416fc07b3 service glance] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:51:50.042156 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567b67a7-ca54-41b3-9c61-36c416fc07b3 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:51:50.054338 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-567b67a7-ca54-41b3-9c61-36c416fc07b3 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:51:50.055761 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-567b67a7-ca54-41b3-9c61-36c416fc07b3 service glance] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:51:50.073054 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 1207/2367] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Sep 13 19:51:49 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 19:51:50.143344 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5012ba9e-7c3c-49b3-a95a-b78c41e6c3b5 None None] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:51:50.143593 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5012ba9e-7c3c-49b3-a95a-b78c41e6c3b5 None None] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:51:50.143872 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5012ba9e-7c3c-49b3-a95a-b78c41e6c3b5 None None] PATH_INFO: `/` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:51:50.145430 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 1161/2368] 10.222.0.25 () {54 vars in 921 bytes} [Tue Sep 13 19:51:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:51:50.150232 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a56bf2-6c54-4a6b-8843-106536b239a4 None None] REQUEST_METHOD: `POST` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:51:50.150514 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a56bf2-6c54-4a6b-8843-106536b239a4 None None] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:51:50.150784 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a56bf2-6c54-4a6b-8843-106536b239a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:51:50.172528 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.auth.core [None req-33a56bf2-6c54-4a6b-8843-106536b239a4 None None] MFA Rules not processed for user `1196a96e4a404f559600b69f929ea9da`. Rule list: `[]` (Enabled: `True`). {{(pid=87934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:51:50.173851 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.fernet_utils [None req-33a56bf2-6c54-4a6b-8843-106536b239a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:51:50.226257 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 1208/2369] 10.222.0.25 () {58 vars in 1018 bytes} [Tue Sep 13 19:51:50 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 19:51:50.239019 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5012ba9e-7c3c-49b3-a95a-b78c41e6c3b5 None None] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:51:50.240753 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.fernet_utils [None req-5012ba9e-7c3c-49b3-a95a-b78c41e6c3b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:51:50.255961 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5012ba9e-7c3c-49b3-a95a-b78c41e6c3b5 None None] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:51:50.259656 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6432c0ea-1c07-42c5-88bd-1c5bd5b5ef92 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1196a96e4a404f559600b69f929ea9da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a10a4268f3c4cb29f4e00c292e2df62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:51:50.260294 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6432c0ea-1c07-42c5-88bd-1c5bd5b5ef92 service neutron] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:51:50.260575 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6432c0ea-1c07-42c5-88bd-1c5bd5b5ef92 service neutron] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:51:50.260847 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6432c0ea-1c07-42c5-88bd-1c5bd5b5ef92 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:51:50.268609 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6432c0ea-1c07-42c5-88bd-1c5bd5b5ef92 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:51:50.270154 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6432c0ea-1c07-42c5-88bd-1c5bd5b5ef92 service neutron] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:51:50.278240 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 1162/2370] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Sep 13 19:51:50 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 19:51:50.363809 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21c6c93-6fc7-45a1-a7eb-e359ca903a13 None None] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:51:50.364093 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21c6c93-6fc7-45a1-a7eb-e359ca903a13 None None] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:51:50.364395 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21c6c93-6fc7-45a1-a7eb-e359ca903a13 None None] PATH_INFO: `/` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:51:50.365793 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 1209/2371] 10.222.0.25 () {54 vars in 921 bytes} [Tue Sep 13 19:51:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 13 19:51:50.371066 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d60e59-9dfd-4691-b9a5-e664753946c4 None None] REQUEST_METHOD: `POST` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:51:50.371356 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d60e59-9dfd-4691-b9a5-e664753946c4 None None] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:51:50.371636 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d60e59-9dfd-4691-b9a5-e664753946c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:51:50.393799 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.auth.core [None req-99d60e59-9dfd-4691-b9a5-e664753946c4 None None] MFA Rules not processed for user `d71fe5a8275f4ea98555afdcefc902a0`. Rule list: `[]` (Enabled: `True`). {{(pid=87935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:51:50.395045 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.fernet_utils [None req-99d60e59-9dfd-4691-b9a5-e664753946c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:51:50.405996 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 1163/2372] 10.222.0.25 () {58 vars in 1018 bytes} [Tue Sep 13 19:51:50 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 19:51:50.429823 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21c6c93-6fc7-45a1-a7eb-e359ca903a13 None None] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:51:50.431414 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.fernet_utils [None req-b21c6c93-6fc7-45a1-a7eb-e359ca903a13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:51:50.459504 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21c6c93-6fc7-45a1-a7eb-e359ca903a13 None None] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:51:50.463243 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9614233a-1cce-4aeb-bf66-f26b0e342051 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1196a96e4a404f559600b69f929ea9da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a10a4268f3c4cb29f4e00c292e2df62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:51:50.463926 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9614233a-1cce-4aeb-bf66-f26b0e342051 service neutron] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:51:50.464314 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9614233a-1cce-4aeb-bf66-f26b0e342051 service neutron] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:51:50.464659 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9614233a-1cce-4aeb-bf66-f26b0e342051 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:51:50.480432 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9614233a-1cce-4aeb-bf66-f26b0e342051 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:51:50.482244 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9614233a-1cce-4aeb-bf66-f26b0e342051 service neutron] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:51:50.497461 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 1210/2373] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Sep 13 19:51:50 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 68 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 19:51:55.315567 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f646227a-f726-4eff-9e49-0813a58ec0a1 None None] REQUEST_METHOD: `POST` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:51:55.316433 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f646227a-f726-4eff-9e49-0813a58ec0a1 None None] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:51:55.316902 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f646227a-f726-4eff-9e49-0813a58ec0a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:51:55.341062 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.auth.core [None req-f646227a-f726-4eff-9e49-0813a58ec0a1 None None] MFA Rules not processed for user `d44977a3225e43f19cdc4a84f0e170cd`. Rule list: `[]` (Enabled: `True`). {{(pid=87935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:51:55.342649 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.fernet_utils [None req-f646227a-f726-4eff-9e49-0813a58ec0a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:51:55.380747 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG dbcounter [-] [87935] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=87935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:51:55.414966 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 1164/2374] 10.222.0.25 () {58 vars in 1009 bytes} [Tue Sep 13 19:51:55 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 19:51:55.442702 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9614233a-1cce-4aeb-bf66-f26b0e342051 service neutron] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:51:55.444378 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.fernet_utils [None req-9614233a-1cce-4aeb-bf66-f26b0e342051 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:51:55.456900 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG dbcounter [-] [87934] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:51:55.550248 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9614233a-1cce-4aeb-bf66-f26b0e342051 service neutron] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:51:55.556858 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db882621-205e-469b-909f-5366aba9db0c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb42d6ac6cdd4d97a80c3ee0c6f8e3f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a10a4268f3c4cb29f4e00c292e2df62', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:51:55.558063 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db882621-205e-469b-909f-5366aba9db0c service swift] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:51:55.558521 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db882621-205e-469b-909f-5366aba9db0c service swift] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:51:55.558938 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db882621-205e-469b-909f-5366aba9db0c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:51:55.570146 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db882621-205e-469b-909f-5366aba9db0c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:51:55.572298 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db882621-205e-469b-909f-5366aba9db0c service swift] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:51:55.582458 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 1211/2375] 10.222.0.25 () {60 vars in 1384 bytes} [Tue Sep 13 19:51:55 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 13 19:52:05.407564 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG dbcounter [-] [87935] Writing DB stats keystone:SELECT=10 {{(pid=87935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:52:05.580171 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG dbcounter [-] [87934] Writing DB stats keystone:SELECT=29 {{(pid=87934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:52:13.482280 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4823553-b010-4917-bdf4-aecf843cdf81 None None] REQUEST_METHOD: `POST` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:52:13.482790 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4823553-b010-4917-bdf4-aecf843cdf81 None None] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:52:13.482983 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4823553-b010-4917-bdf4-aecf843cdf81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:52:13.505534 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.auth.core [None req-d4823553-b010-4917-bdf4-aecf843cdf81 None None] MFA Rules not processed for user `d44977a3225e43f19cdc4a84f0e170cd`. Rule list: `[]` (Enabled: `True`). {{(pid=87935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:52:13.506879 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.fernet_utils [None req-d4823553-b010-4917-bdf4-aecf843cdf81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:52:13.516518 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 1165/2376] 10.222.0.25 () {58 vars in 967 bytes} [Tue Sep 13 19:52:13 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 19:52:13.530480 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db882621-205e-469b-909f-5366aba9db0c service swift] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:52:13.540716 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db882621-205e-469b-909f-5366aba9db0c service swift] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:52:13.545834 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6703d5-b64d-4b5a-8bc7-8fc85a541102 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb42d6ac6cdd4d97a80c3ee0c6f8e3f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a10a4268f3c4cb29f4e00c292e2df62', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:52:13.546429 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6703d5-b64d-4b5a-8bc7-8fc85a541102 service swift] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:52:13.546703 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6703d5-b64d-4b5a-8bc7-8fc85a541102 service swift] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:52:13.546967 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6703d5-b64d-4b5a-8bc7-8fc85a541102 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:52:13.555172 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac6703d5-b64d-4b5a-8bc7-8fc85a541102 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:52:13.556779 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac6703d5-b64d-4b5a-8bc7-8fc85a541102 service swift] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:52:13.565053 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 1212/2377] 10.222.0.25 () {60 vars in 1384 bytes} [Tue Sep 13 19:52:13 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 13 19:52:16.604793 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4823553-b010-4917-bdf4-aecf843cdf81 None None] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:52:16.606213 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.fernet_utils [None req-d4823553-b010-4917-bdf4-aecf843cdf81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:52:16.680585 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4823553-b010-4917-bdf4-aecf843cdf81 None None] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:52:16.686396 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd838141-110a-4b81-bba4-73c6464f990d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02eb3d3173c1476cb83a72add0e878e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a10a4268f3c4cb29f4e00c292e2df62', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:52:16.686994 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd838141-110a-4b81-bba4-73c6464f990d service placement] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:52:16.687290 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd838141-110a-4b81-bba4-73c6464f990d service placement] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:52:16.687559 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd838141-110a-4b81-bba4-73c6464f990d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:52:16.689302 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.fernet_utils [None req-fd838141-110a-4b81-bba4-73c6464f990d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:52:16.700920 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd838141-110a-4b81-bba4-73c6464f990d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:52:16.702669 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd838141-110a-4b81-bba4-73c6464f990d service placement] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:52:16.713244 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 1166/2378] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Sep 13 19:52:16 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 19:52:19.352366 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d1c462-27f5-42ff-8ebf-742b72cc3a7a None None] REQUEST_METHOD: `POST` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:52:19.352827 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d1c462-27f5-42ff-8ebf-742b72cc3a7a None None] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:52:19.352949 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d1c462-27f5-42ff-8ebf-742b72cc3a7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:52:19.372784 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.auth.core [None req-48d1c462-27f5-42ff-8ebf-742b72cc3a7a None None] MFA Rules not processed for user `d44977a3225e43f19cdc4a84f0e170cd`. Rule list: `[]` (Enabled: `True`). {{(pid=87934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:52:19.374297 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.fernet_utils [None req-48d1c462-27f5-42ff-8ebf-742b72cc3a7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:52:19.381473 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 1213/2379] 10.222.0.25 () {58 vars in 1009 bytes} [Tue Sep 13 19:52:19 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 19:52:19.394658 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd838141-110a-4b81-bba4-73c6464f990d service placement] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:52:19.411558 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd838141-110a-4b81-bba4-73c6464f990d service placement] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:52:19.417034 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210d6e6a-acd6-4011-80ce-afc1d91d5314 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb42d6ac6cdd4d97a80c3ee0c6f8e3f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a10a4268f3c4cb29f4e00c292e2df62', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:52:19.417659 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210d6e6a-acd6-4011-80ce-afc1d91d5314 service swift] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:52:19.417939 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210d6e6a-acd6-4011-80ce-afc1d91d5314 service swift] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:52:19.418209 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210d6e6a-acd6-4011-80ce-afc1d91d5314 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:52:19.431118 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-210d6e6a-acd6-4011-80ce-afc1d91d5314 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:52:19.432788 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-210d6e6a-acd6-4011-80ce-afc1d91d5314 service swift] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:52:19.441441 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 1167/2380] 10.222.0.25 () {60 vars in 1384 bytes} [Tue Sep 13 19:52:19 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Sep 13 19:52:22.531941 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43c2035-1d83-4d9b-a8d5-9006dc2e2cb7 None None] REQUEST_METHOD: `POST` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:52:22.532699 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43c2035-1d83-4d9b-a8d5-9006dc2e2cb7 None None] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:52:22.534395 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43c2035-1d83-4d9b-a8d5-9006dc2e2cb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:52:22.566194 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.auth.core [None req-c43c2035-1d83-4d9b-a8d5-9006dc2e2cb7 None None] MFA Rules not processed for user `d44977a3225e43f19cdc4a84f0e170cd`. Rule list: `[]` (Enabled: `True`). {{(pid=87934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:52:22.567580 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.fernet_utils [None req-c43c2035-1d83-4d9b-a8d5-9006dc2e2cb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:52:22.583071 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 1214/2381] 10.222.0.25 () {58 vars in 1009 bytes} [Tue Sep 13 19:52:22 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 19:52:22.599732 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210d6e6a-acd6-4011-80ce-afc1d91d5314 service swift] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:52:22.610804 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210d6e6a-acd6-4011-80ce-afc1d91d5314 service swift] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:52:22.618375 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7bec016-250f-4e97-b3e6-e3e6aaa7c23d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb42d6ac6cdd4d97a80c3ee0c6f8e3f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a10a4268f3c4cb29f4e00c292e2df62', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:52:22.619247 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bec016-250f-4e97-b3e6-e3e6aaa7c23d service swift] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:52:22.619683 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bec016-250f-4e97-b3e6-e3e6aaa7c23d service swift] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:52:22.620105 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bec016-250f-4e97-b3e6-e3e6aaa7c23d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:52:22.630456 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7bec016-250f-4e97-b3e6-e3e6aaa7c23d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:52:22.632038 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7bec016-250f-4e97-b3e6-e3e6aaa7c23d service swift] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:52:22.642265 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 1168/2382] 10.222.0.25 () {60 vars in 1384 bytes} [Tue Sep 13 19:52:22 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 13 19:52:23.295156 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5376f7f8-66a2-4250-bacf-d8eb2eb50ddb None None] REQUEST_METHOD: `POST` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:52:23.298337 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5376f7f8-66a2-4250-bacf-d8eb2eb50ddb None None] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:52:23.298694 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5376f7f8-66a2-4250-bacf-d8eb2eb50ddb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:52:23.327855 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.auth.core [None req-5376f7f8-66a2-4250-bacf-d8eb2eb50ddb None None] MFA Rules not processed for user `d44977a3225e43f19cdc4a84f0e170cd`. Rule list: `[]` (Enabled: `True`). {{(pid=87934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:52:23.329943 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.fernet_utils [None req-5376f7f8-66a2-4250-bacf-d8eb2eb50ddb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:52:23.338941 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 1215/2383] 10.222.0.25 () {58 vars in 967 bytes} [Tue Sep 13 19:52:23 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 19:52:23.354407 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7bec016-250f-4e97-b3e6-e3e6aaa7c23d service swift] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:52:23.366069 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7bec016-250f-4e97-b3e6-e3e6aaa7c23d service swift] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:52:23.371572 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e39f346-91e1-4edc-8174-ea197f31d8d2 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb42d6ac6cdd4d97a80c3ee0c6f8e3f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a10a4268f3c4cb29f4e00c292e2df62', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:52:23.372225 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e39f346-91e1-4edc-8174-ea197f31d8d2 service swift] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:52:23.373184 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e39f346-91e1-4edc-8174-ea197f31d8d2 service swift] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:52:23.373897 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e39f346-91e1-4edc-8174-ea197f31d8d2 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:52:23.382934 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e39f346-91e1-4edc-8174-ea197f31d8d2 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:52:23.384914 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e39f346-91e1-4edc-8174-ea197f31d8d2 service swift] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:52:23.395305 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 1169/2384] 10.222.0.25 () {60 vars in 1384 bytes} [Tue Sep 13 19:52:23 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Sep 13 19:52:23.677718 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68042ed-e73d-4356-886a-a681933943a4 None None] REQUEST_METHOD: `POST` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:52:23.678171 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68042ed-e73d-4356-886a-a681933943a4 None None] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:52:23.678281 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68042ed-e73d-4356-886a-a681933943a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:52:23.702417 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.auth.core [None req-f68042ed-e73d-4356-886a-a681933943a4 None None] MFA Rules not processed for user `d44977a3225e43f19cdc4a84f0e170cd`. Rule list: `[]` (Enabled: `True`). {{(pid=87934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:52:23.703923 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.fernet_utils [None req-f68042ed-e73d-4356-886a-a681933943a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:52:23.712489 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 1216/2385] 10.222.0.25 () {58 vars in 1009 bytes} [Tue Sep 13 19:52:23 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 19:52:23.729636 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e39f346-91e1-4edc-8174-ea197f31d8d2 service swift] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:52:23.742086 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e39f346-91e1-4edc-8174-ea197f31d8d2 service swift] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:52:23.747831 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7fc583d-a198-4108-8411-6179d4885df7 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb42d6ac6cdd4d97a80c3ee0c6f8e3f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a10a4268f3c4cb29f4e00c292e2df62', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:52:23.748762 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fc583d-a198-4108-8411-6179d4885df7 service swift] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:52:23.749251 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fc583d-a198-4108-8411-6179d4885df7 service swift] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:52:23.749860 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fc583d-a198-4108-8411-6179d4885df7 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:52:23.759503 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7fc583d-a198-4108-8411-6179d4885df7 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:52:23.761688 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7fc583d-a198-4108-8411-6179d4885df7 service swift] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:52:23.772048 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 1170/2386] 10.222.0.25 () {60 vars in 1384 bytes} [Tue Sep 13 19:52:23 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 13 19:52:24.202797 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e861e21e-08b7-461b-ba83-06014bbf38bd None None] REQUEST_METHOD: `POST` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:52:24.203422 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e861e21e-08b7-461b-ba83-06014bbf38bd None None] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:52:24.203768 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e861e21e-08b7-461b-ba83-06014bbf38bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:52:24.225133 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.auth.core [None req-e861e21e-08b7-461b-ba83-06014bbf38bd None None] MFA Rules not processed for user `d44977a3225e43f19cdc4a84f0e170cd`. Rule list: `[]` (Enabled: `True`). {{(pid=87934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:52:24.226381 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.fernet_utils [None req-e861e21e-08b7-461b-ba83-06014bbf38bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:52:24.234193 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 1217/2387] 10.222.0.25 () {58 vars in 967 bytes} [Tue Sep 13 19:52:24 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 19:52:24.250109 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7fc583d-a198-4108-8411-6179d4885df7 service swift] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:52:24.261876 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7fc583d-a198-4108-8411-6179d4885df7 service swift] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:52:24.267658 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71bedf4a-44ac-45a3-b493-c467b6439d2b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb42d6ac6cdd4d97a80c3ee0c6f8e3f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a10a4268f3c4cb29f4e00c292e2df62', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:52:24.268463 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bedf4a-44ac-45a3-b493-c467b6439d2b service swift] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:52:24.268893 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bedf4a-44ac-45a3-b493-c467b6439d2b service swift] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:52:24.269323 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bedf4a-44ac-45a3-b493-c467b6439d2b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:52:24.278500 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71bedf4a-44ac-45a3-b493-c467b6439d2b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:52:24.280823 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71bedf4a-44ac-45a3-b493-c467b6439d2b service swift] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:52:24.289177 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 1171/2388] 10.222.0.25 () {60 vars in 1384 bytes} [Tue Sep 13 19:52:24 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 13 19:52:26.735845 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e861e21e-08b7-461b-ba83-06014bbf38bd None None] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:52:26.822693 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e861e21e-08b7-461b-ba83-06014bbf38bd None None] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:52:26.829707 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e979b8b8-e9b9-4461-89fe-8b62b650f152 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:52:26.830700 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e979b8b8-e9b9-4461-89fe-8b62b650f152 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:52:26.831219 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e979b8b8-e9b9-4461-89fe-8b62b650f152 admin admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:52:26.831726 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e979b8b8-e9b9-4461-89fe-8b62b650f152 admin admin] PATH_INFO: `/v3/users/392f3ba9e0e34e52ac838c108a7c531f` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:52:26.833441 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e979b8b8-e9b9-4461-89fe-8b62b650f152 admin admin] RBAC: Authorizing `identity:delete_user(user_id=392f3ba9e0e34e52ac838c108a7c531f)` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:52:26.835934 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e979b8b8-e9b9-4461-89fe-8b62b650f152 admin admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:52:26.960978 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.notifications [None req-e979b8b8-e9b9-4461-89fe-8b62b650f152 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '392f3ba9e0e34e52ac838c108a7c531f'} {{(pid=87934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:52:26.964162 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.notifications [None req-e979b8b8-e9b9-4461-89fe-8b62b650f152 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '392f3ba9e0e34e52ac838c108a7c531f'} {{(pid=87934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:52:26.964962 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.notifications [None req-e979b8b8-e9b9-4461-89fe-8b62b650f152 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '392f3ba9e0e34e52ac838c108a7c531f'} {{(pid=87934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:52:26.984610 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.notifications [None req-e979b8b8-e9b9-4461-89fe-8b62b650f152 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '392f3ba9e0e34e52ac838c108a7c531f'} {{(pid=87934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:52:27.012917 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.notifications [None req-e979b8b8-e9b9-4461-89fe-8b62b650f152 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '392f3ba9e0e34e52ac838c108a7c531f'} {{(pid=87934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:52:27.044106 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 1218/2389] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Sep 13 19:52:26 2022] DELETE /identity/v3/users/392f3ba9e0e34e52ac838c108a7c531f => generated 0 bytes in 309 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 19:52:27.049346 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a43c841-7825-4926-a4b2-9a10d994734c None None] REQUEST_METHOD: `POST` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:52:27.049853 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a43c841-7825-4926-a4b2-9a10d994734c None None] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:52:27.049853 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a43c841-7825-4926-a4b2-9a10d994734c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:52:27.078585 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.auth.core [None req-2a43c841-7825-4926-a4b2-9a10d994734c None None] MFA Rules not processed for user `7b0aed92d02344acb92a0e4aa67c3068`. Rule list: `[]` (Enabled: `True`). {{(pid=87935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:52:27.079872 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.fernet_utils [None req-2a43c841-7825-4926-a4b2-9a10d994734c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:52:27.157553 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 1172/2390] 10.222.0.25 () {58 vars in 958 bytes} [Tue Sep 13 19:52:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 19:52:27.168347 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e979b8b8-e9b9-4461-89fe-8b62b650f152 admin admin] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:52:27.170742 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.fernet_utils [None req-e979b8b8-e9b9-4461-89fe-8b62b650f152 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:52:27.217539 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG dbcounter [-] [87934] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:52:27.251195 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e979b8b8-e9b9-4461-89fe-8b62b650f152 admin admin] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:52:27.256189 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3808c042-b82c-4d24-99e2-035ad46595b5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1196a96e4a404f559600b69f929ea9da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a10a4268f3c4cb29f4e00c292e2df62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:52:27.256611 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3808c042-b82c-4d24-99e2-035ad46595b5 service neutron] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:52:27.256936 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3808c042-b82c-4d24-99e2-035ad46595b5 service neutron] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:52:27.257167 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3808c042-b82c-4d24-99e2-035ad46595b5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:52:27.268230 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3808c042-b82c-4d24-99e2-035ad46595b5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:52:27.269655 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3808c042-b82c-4d24-99e2-035ad46595b5 service neutron] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:52:27.280009 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 1219/2391] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Sep 13 19:52:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 19:52:27.485563 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a43c841-7825-4926-a4b2-9a10d994734c None None] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:52:27.487378 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.fernet_utils [None req-2a43c841-7825-4926-a4b2-9a10d994734c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:52:27.505292 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a43c841-7825-4926-a4b2-9a10d994734c None None] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:52:27.511699 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1109b18-003c-4566-b440-afa75a152ced admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:52:27.512655 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1109b18-003c-4566-b440-afa75a152ced admin admin] REQUEST_METHOD: `DELETE` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:52:27.513815 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1109b18-003c-4566-b440-afa75a152ced admin admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:52:27.514261 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1109b18-003c-4566-b440-afa75a152ced admin admin] PATH_INFO: `/v3/projects/ae3a86a4744f48358b627a217a515ca9` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:52:27.516704 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1109b18-003c-4566-b440-afa75a152ced admin admin] RBAC: Authorizing `identity:delete_project(project_id=ae3a86a4744f48358b627a217a515ca9)` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:52:27.519439 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1109b18-003c-4566-b440-afa75a152ced admin admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:52:27.550912 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG dbcounter [-] [87935] Writing DB stats keystone:SELECT=100 {{(pid=87935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:52:27.598564 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.notifications [None req-e1109b18-003c-4566-b440-afa75a152ced admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ae3a86a4744f48358b627a217a515ca9', 'request_id': 'req-e1109b18-003c-4566-b440-afa75a152ced'} {{(pid=87935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:52:27.608308 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.notifications [None req-e1109b18-003c-4566-b440-afa75a152ced admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ae3a86a4744f48358b627a217a515ca9', 'request_id': 'req-e1109b18-003c-4566-b440-afa75a152ced'} {{(pid=87935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:52:27.618402 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.notifications [None req-e1109b18-003c-4566-b440-afa75a152ced admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ae3a86a4744f48358b627a217a515ca9', 'request_id': 'req-e1109b18-003c-4566-b440-afa75a152ced'} {{(pid=87935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:52:27.642001 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.notifications [None req-e1109b18-003c-4566-b440-afa75a152ced admin admin] The token cache is being invalidate because project ae3a86a4744f48358b627a217a515ca9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87935) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 19:52:27.642843 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.notifications [None req-e1109b18-003c-4566-b440-afa75a152ced admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:52:27.643845 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.notifications [None req-e1109b18-003c-4566-b440-afa75a152ced admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:52:27.645749 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 1173/2392] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Sep 13 19:52:27 2022] DELETE /identity/v3/projects/ae3a86a4744f48358b627a217a515ca9 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 19:52:27.650722 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467f62bc-5539-4946-b8af-ac0831030b39 None None] REQUEST_METHOD: `POST` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:52:27.651004 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467f62bc-5539-4946-b8af-ac0831030b39 None None] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:52:27.651288 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467f62bc-5539-4946-b8af-ac0831030b39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:52:27.677788 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.auth.core [None req-467f62bc-5539-4946-b8af-ac0831030b39 None None] MFA Rules not processed for user `7b0aed92d02344acb92a0e4aa67c3068`. Rule list: `[]` (Enabled: `True`). {{(pid=87934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:52:27.678854 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.fernet_utils [None req-467f62bc-5539-4946-b8af-ac0831030b39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:52:27.768239 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 1220/2393] 10.222.0.25 () {58 vars in 958 bytes} [Tue Sep 13 19:52:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 19:52:27.774667 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a90ea6-b23a-4dfe-acea-b2b58aa7875b None None] REQUEST_METHOD: `POST` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:52:27.775027 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a90ea6-b23a-4dfe-acea-b2b58aa7875b None None] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:52:27.775307 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a90ea6-b23a-4dfe-acea-b2b58aa7875b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:52:27.799752 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.auth.core [None req-c3a90ea6-b23a-4dfe-acea-b2b58aa7875b None None] MFA Rules not processed for user `7b0aed92d02344acb92a0e4aa67c3068`. Rule list: `[]` (Enabled: `True`). {{(pid=87935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:52:27.801220 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.fernet_utils [None req-c3a90ea6-b23a-4dfe-acea-b2b58aa7875b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:52:27.811358 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 1174/2394] 10.222.0.25 () {58 vars in 958 bytes} [Tue Sep 13 19:52:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 19:52:27.820996 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467f62bc-5539-4946-b8af-ac0831030b39 None None] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:52:27.833253 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467f62bc-5539-4946-b8af-ac0831030b39 None None] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:52:27.839302 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac37aa8-e919-4666-b9ca-706a77d863f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:52:27.840084 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac37aa8-e919-4666-b9ca-706a77d863f5 admin admin] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:52:27.840575 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac37aa8-e919-4666-b9ca-706a77d863f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:52:27.840846 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac37aa8-e919-4666-b9ca-706a77d863f5 admin admin] PATH_INFO: `/v3/domains` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:52:27.842330 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac37aa8-e919-4666-b9ca-706a77d863f5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87934) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:52:27.842662 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac37aa8-e919-4666-b9ca-706a77d863f5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:52:27.844305 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac37aa8-e919-4666-b9ca-706a77d863f5 admin admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:52:27.858796 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 1221/2395] 10.222.0.25 () {58 vars in 1153 bytes} [Tue Sep 13 19:52:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:52:27.863084 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a90ea6-b23a-4dfe-acea-b2b58aa7875b None None] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:52:27.873743 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a90ea6-b23a-4dfe-acea-b2b58aa7875b None None] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:52:27.879606 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a128dc1-338a-4623-b78f-68ab4b0537ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:52:27.880403 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a128dc1-338a-4623-b78f-68ab4b0537ab admin admin] REQUEST_METHOD: `POST` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:52:27.880795 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a128dc1-338a-4623-b78f-68ab4b0537ab admin admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:52:27.881146 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a128dc1-338a-4623-b78f-68ab4b0537ab admin admin] PATH_INFO: `/v3/projects` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:52:27.881860 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a128dc1-338a-4623-b78f-68ab4b0537ab admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:52:27.883888 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a128dc1-338a-4623-b78f-68ab4b0537ab admin admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:52:27.917251 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 1175/2396] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Sep 13 19:52:27 2022] POST /identity/v3/projects => generated 397 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 19:52:27.922564 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac37aa8-e919-4666-b9ca-706a77d863f5 admin admin] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:52:27.933843 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac37aa8-e919-4666-b9ca-706a77d863f5 admin admin] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:52:28.005332 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70fa519-a8c8-4ce3-8c76-c72161aaf0dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:52:28.005950 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70fa519-a8c8-4ce3-8c76-c72161aaf0dc admin admin] REQUEST_METHOD: `POST` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:52:28.006240 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70fa519-a8c8-4ce3-8c76-c72161aaf0dc admin admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:52:28.006514 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70fa519-a8c8-4ce3-8c76-c72161aaf0dc admin admin] PATH_INFO: `/v3/users` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:52:28.007149 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b70fa519-a8c8-4ce3-8c76-c72161aaf0dc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:52:28.009111 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b70fa519-a8c8-4ce3-8c76-c72161aaf0dc admin admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:52:28.035097 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 1222/2397] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Sep 13 19:52:27 2022] POST /identity/v3/users => generated 299 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 19:52:28.039271 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a128dc1-338a-4623-b78f-68ab4b0537ab admin admin] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:52:28.051053 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a128dc1-338a-4623-b78f-68ab4b0537ab admin admin] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:52:28.056168 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6563b07-80d0-45d8-b671-b1d914e057e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:52:28.056820 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6563b07-80d0-45d8-b671-b1d914e057e7 admin admin] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:52:28.057100 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6563b07-80d0-45d8-b671-b1d914e057e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:52:28.057370 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6563b07-80d0-45d8-b671-b1d914e057e7 admin admin] PATH_INFO: `/v3/roles` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:52:28.058473 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6563b07-80d0-45d8-b671-b1d914e057e7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:52:28.060897 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6563b07-80d0-45d8-b671-b1d914e057e7 admin admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:52:28.071397 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 1176/2398] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Sep 13 19:52:28 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 19:52:28.075323 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70fa519-a8c8-4ce3-8c76-c72161aaf0dc admin admin] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:52:28.093849 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70fa519-a8c8-4ce3-8c76-c72161aaf0dc admin admin] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:52:28.101495 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd652727-2c9f-48fc-b0b8-3c0068e1cee3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:52:28.101865 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd652727-2c9f-48fc-b0b8-3c0068e1cee3 admin admin] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:52:28.102213 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd652727-2c9f-48fc-b0b8-3c0068e1cee3 admin admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:52:28.102648 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd652727-2c9f-48fc-b0b8-3c0068e1cee3 admin admin] PATH_INFO: `/v3/roles` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:52:28.103658 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd652727-2c9f-48fc-b0b8-3c0068e1cee3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:52:28.105873 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd652727-2c9f-48fc-b0b8-3c0068e1cee3 admin admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:52:28.123980 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 1223/2399] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Sep 13 19:52:28 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 19:52:28.135775 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6563b07-80d0-45d8-b671-b1d914e057e7 admin admin] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:52:28.150456 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6563b07-80d0-45d8-b671-b1d914e057e7 admin admin] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:52:28.158596 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c393b7c-6c5b-4d08-b243-8abb861db918 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:52:28.159291 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c393b7c-6c5b-4d08-b243-8abb861db918 admin admin] REQUEST_METHOD: `PUT` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:52:28.159572 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c393b7c-6c5b-4d08-b243-8abb861db918 admin admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:52:28.159847 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c393b7c-6c5b-4d08-b243-8abb861db918 admin admin] PATH_INFO: `/v3/projects/8d40c31527604734b0403811e2d21ebd/users/a1cc09852c9b4afaa3e3680ff3f85ac2/roles/a259191f6d0e46fabd9f34536bb28747` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:52:28.189713 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c393b7c-6c5b-4d08-b243-8abb861db918 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8d40c31527604734b0403811e2d21ebd, user_id=a1cc09852c9b4afaa3e3680ff3f85ac2, role_id=a259191f6d0e46fabd9f34536bb28747)` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:52:28.192582 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c393b7c-6c5b-4d08-b243-8abb861db918 admin admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:52:28.211057 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 1177/2400] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Sep 13 19:52:28 2022] PUT /identity/v3/projects/8d40c31527604734b0403811e2d21ebd/users/a1cc09852c9b4afaa3e3680ff3f85ac2/roles/a259191f6d0e46fabd9f34536bb28747 => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 19:52:28.289126 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26cde03-3076-4fa1-bf12-d3537d60ba4c None None] REQUEST_METHOD: `POST` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:52:28.289414 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26cde03-3076-4fa1-bf12-d3537d60ba4c None None] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:52:28.289687 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26cde03-3076-4fa1-bf12-d3537d60ba4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:52:28.334418 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.auth.core [None req-c26cde03-3076-4fa1-bf12-d3537d60ba4c None None] MFA Rules not processed for user `a1cc09852c9b4afaa3e3680ff3f85ac2`. Rule list: `[]` (Enabled: `True`). {{(pid=87934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:52:28.335810 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.fernet_utils [None req-c26cde03-3076-4fa1-bf12-d3537d60ba4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:52:28.371509 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG dbcounter [-] [87934] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:52:28.430686 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 1224/2401] 10.222.0.25 () {58 vars in 958 bytes} [Tue Sep 13 19:52:28 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 19:52:28.443742 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c393b7c-6c5b-4d08-b243-8abb861db918 admin admin] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:52:28.445924 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.fernet_utils [None req-0c393b7c-6c5b-4d08-b243-8abb861db918 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:52:28.519388 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c393b7c-6c5b-4d08-b243-8abb861db918 admin admin] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:52:28.525955 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e375e81-a351-434e-9b39-e779e5b89b30 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cbb50c88b794a7f9f26844effde7d63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a10a4268f3c4cb29f4e00c292e2df62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:52:28.526717 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e375e81-a351-434e-9b39-e779e5b89b30 service cinder] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:52:28.527097 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e375e81-a351-434e-9b39-e779e5b89b30 service cinder] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:52:28.527469 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e375e81-a351-434e-9b39-e779e5b89b30 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:52:28.537573 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e375e81-a351-434e-9b39-e779e5b89b30 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:52:28.539247 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e375e81-a351-434e-9b39-e779e5b89b30 service cinder] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:52:28.549588 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 1178/2402] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Sep 13 19:52:28 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 19:52:34.164803 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26cde03-3076-4fa1-bf12-d3537d60ba4c None None] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:52:34.295259 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26cde03-3076-4fa1-bf12-d3537d60ba4c None None] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:52:34.304411 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef16986f-eda3-4fbb-9349-031fc34c8170 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:52:34.305239 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef16986f-eda3-4fbb-9349-031fc34c8170 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:52:34.305753 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef16986f-eda3-4fbb-9349-031fc34c8170 admin admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:52:34.306184 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef16986f-eda3-4fbb-9349-031fc34c8170 admin admin] PATH_INFO: `/v3/users/a1cc09852c9b4afaa3e3680ff3f85ac2` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:52:34.307622 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef16986f-eda3-4fbb-9349-031fc34c8170 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a1cc09852c9b4afaa3e3680ff3f85ac2)` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:52:34.310506 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef16986f-eda3-4fbb-9349-031fc34c8170 admin admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:52:34.397893 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.notifications [None req-ef16986f-eda3-4fbb-9349-031fc34c8170 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a1cc09852c9b4afaa3e3680ff3f85ac2'} {{(pid=87934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:52:34.398674 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.notifications [None req-ef16986f-eda3-4fbb-9349-031fc34c8170 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a1cc09852c9b4afaa3e3680ff3f85ac2'} {{(pid=87934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:52:34.399558 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.notifications [None req-ef16986f-eda3-4fbb-9349-031fc34c8170 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a1cc09852c9b4afaa3e3680ff3f85ac2'} {{(pid=87934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:52:34.410586 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.notifications [None req-ef16986f-eda3-4fbb-9349-031fc34c8170 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a1cc09852c9b4afaa3e3680ff3f85ac2'} {{(pid=87934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:52:34.431095 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.notifications [None req-ef16986f-eda3-4fbb-9349-031fc34c8170 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a1cc09852c9b4afaa3e3680ff3f85ac2'} {{(pid=87934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:52:34.472907 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 1225/2403] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Sep 13 19:52:34 2022] DELETE /identity/v3/users/a1cc09852c9b4afaa3e3680ff3f85ac2 => generated 0 bytes in 306 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 19:52:34.474594 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63107a70-43f4-40db-bc5f-a114bfadcb69 None None] REQUEST_METHOD: `POST` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:52:34.475087 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63107a70-43f4-40db-bc5f-a114bfadcb69 None None] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:52:34.475183 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63107a70-43f4-40db-bc5f-a114bfadcb69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:52:34.507953 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.auth.core [None req-63107a70-43f4-40db-bc5f-a114bfadcb69 None None] MFA Rules not processed for user `7b0aed92d02344acb92a0e4aa67c3068`. Rule list: `[]` (Enabled: `True`). {{(pid=87935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:52:34.509231 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.fernet_utils [None req-63107a70-43f4-40db-bc5f-a114bfadcb69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:52:34.571652 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG dbcounter [-] [87935] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=87935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:52:34.644022 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 1179/2404] 10.222.0.25 () {58 vars in 958 bytes} [Tue Sep 13 19:52:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 19:52:34.651020 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef16986f-eda3-4fbb-9349-031fc34c8170 admin admin] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:52:34.653091 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.fernet_utils [None req-ef16986f-eda3-4fbb-9349-031fc34c8170 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:52:34.750794 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef16986f-eda3-4fbb-9349-031fc34c8170 admin admin] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:52:34.754912 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1299b847-9d18-4eb2-9cd3-fbde7461454f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1196a96e4a404f559600b69f929ea9da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a10a4268f3c4cb29f4e00c292e2df62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:52:34.755917 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1299b847-9d18-4eb2-9cd3-fbde7461454f service neutron] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:52:34.755917 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1299b847-9d18-4eb2-9cd3-fbde7461454f service neutron] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:52:34.756152 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1299b847-9d18-4eb2-9cd3-fbde7461454f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:52:34.765105 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG dbcounter [-] [87934] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:52:34.769265 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1299b847-9d18-4eb2-9cd3-fbde7461454f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:52:34.771276 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1299b847-9d18-4eb2-9cd3-fbde7461454f service neutron] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:52:34.787036 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 1226/2405] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Sep 13 19:52:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 19:52:35.145873 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63107a70-43f4-40db-bc5f-a114bfadcb69 None None] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:52:35.147466 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.fernet_utils [None req-63107a70-43f4-40db-bc5f-a114bfadcb69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:52:35.165326 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63107a70-43f4-40db-bc5f-a114bfadcb69 None None] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:52:35.170862 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652264f2-89e1-454b-b747-2315c9f818fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:52:35.171991 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652264f2-89e1-454b-b747-2315c9f818fd admin admin] REQUEST_METHOD: `DELETE` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:52:35.171991 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652264f2-89e1-454b-b747-2315c9f818fd admin admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:52:35.172237 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652264f2-89e1-454b-b747-2315c9f818fd admin admin] PATH_INFO: `/v3/projects/8d40c31527604734b0403811e2d21ebd` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:52:35.173387 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-652264f2-89e1-454b-b747-2315c9f818fd admin admin] RBAC: Authorizing `identity:delete_project(project_id=8d40c31527604734b0403811e2d21ebd)` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:52:35.175539 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-652264f2-89e1-454b-b747-2315c9f818fd admin admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:52:35.253066 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.notifications [None req-652264f2-89e1-454b-b747-2315c9f818fd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8d40c31527604734b0403811e2d21ebd', 'request_id': 'req-652264f2-89e1-454b-b747-2315c9f818fd'} {{(pid=87935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:52:35.262187 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.notifications [None req-652264f2-89e1-454b-b747-2315c9f818fd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8d40c31527604734b0403811e2d21ebd', 'request_id': 'req-652264f2-89e1-454b-b747-2315c9f818fd'} {{(pid=87935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:52:35.273411 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.notifications [None req-652264f2-89e1-454b-b747-2315c9f818fd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8d40c31527604734b0403811e2d21ebd', 'request_id': 'req-652264f2-89e1-454b-b747-2315c9f818fd'} {{(pid=87935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:52:35.288191 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.notifications [None req-652264f2-89e1-454b-b747-2315c9f818fd admin admin] The token cache is being invalidate because project 8d40c31527604734b0403811e2d21ebd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87935) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 19:52:35.288562 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.notifications [None req-652264f2-89e1-454b-b747-2315c9f818fd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:52:35.289162 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.notifications [None req-652264f2-89e1-454b-b747-2315c9f818fd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:52:35.290875 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 1180/2406] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Sep 13 19:52:35 2022] DELETE /identity/v3/projects/8d40c31527604734b0403811e2d21ebd => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 19:52:37.512040 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233b484d-a717-4598-8c23-ec3b81df45c3 None None] REQUEST_METHOD: `POST` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:52:37.513045 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233b484d-a717-4598-8c23-ec3b81df45c3 None None] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:52:37.513316 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233b484d-a717-4598-8c23-ec3b81df45c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:52:37.538423 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.auth.core [None req-233b484d-a717-4598-8c23-ec3b81df45c3 None None] MFA Rules not processed for user `d44977a3225e43f19cdc4a84f0e170cd`. Rule list: `[]` (Enabled: `True`). {{(pid=87934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:52:37.539990 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.fernet_utils [None req-233b484d-a717-4598-8c23-ec3b81df45c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:52:37.625915 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 1227/2407] 10.222.0.25 () {58 vars in 967 bytes} [Tue Sep 13 19:52:37 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 19:52:37.643535 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652264f2-89e1-454b-b747-2315c9f818fd admin admin] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:52:37.647521 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.fernet_utils [None req-652264f2-89e1-454b-b747-2315c9f818fd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:52:37.741090 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652264f2-89e1-454b-b747-2315c9f818fd admin admin] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:52:37.748956 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90ce0bc-1f12-4ab1-9ba2-198478af5161 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb42d6ac6cdd4d97a80c3ee0c6f8e3f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a10a4268f3c4cb29f4e00c292e2df62', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:52:37.750304 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90ce0bc-1f12-4ab1-9ba2-198478af5161 service swift] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:52:37.750772 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90ce0bc-1f12-4ab1-9ba2-198478af5161 service swift] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:52:37.751149 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90ce0bc-1f12-4ab1-9ba2-198478af5161 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:52:37.761481 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a90ce0bc-1f12-4ab1-9ba2-198478af5161 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:52:37.763395 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a90ce0bc-1f12-4ab1-9ba2-198478af5161 service swift] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:52:37.773061 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 1181/2408] 10.222.0.25 () {60 vars in 1384 bytes} [Tue Sep 13 19:52:37 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 13 19:52:40.319223 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233b484d-a717-4598-8c23-ec3b81df45c3 None None] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:52:40.320672 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.fernet_utils [None req-233b484d-a717-4598-8c23-ec3b81df45c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:52:40.387543 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233b484d-a717-4598-8c23-ec3b81df45c3 None None] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:52:40.392098 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97ae8a8-6970-4840-8b4c-f9ec4a74a09a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:52:40.392756 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97ae8a8-6970-4840-8b4c-f9ec4a74a09a admin admin] REQUEST_METHOD: `DELETE` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:52:40.393039 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97ae8a8-6970-4840-8b4c-f9ec4a74a09a admin admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:52:40.393304 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97ae8a8-6970-4840-8b4c-f9ec4a74a09a admin admin] PATH_INFO: `/v3/users/7055a86d737749ec8c6f85752f00b28e` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:52:40.394421 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d97ae8a8-6970-4840-8b4c-f9ec4a74a09a admin admin] RBAC: Authorizing `identity:delete_user(user_id=7055a86d737749ec8c6f85752f00b28e)` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:52:40.396518 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d97ae8a8-6970-4840-8b4c-f9ec4a74a09a admin admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:52:40.445121 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.notifications [None req-d97ae8a8-6970-4840-8b4c-f9ec4a74a09a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7055a86d737749ec8c6f85752f00b28e'} {{(pid=87934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:52:40.445697 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.notifications [None req-d97ae8a8-6970-4840-8b4c-f9ec4a74a09a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7055a86d737749ec8c6f85752f00b28e'} {{(pid=87934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:52:40.446421 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.notifications [None req-d97ae8a8-6970-4840-8b4c-f9ec4a74a09a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7055a86d737749ec8c6f85752f00b28e'} {{(pid=87934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:52:40.456184 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.notifications [None req-d97ae8a8-6970-4840-8b4c-f9ec4a74a09a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7055a86d737749ec8c6f85752f00b28e'} {{(pid=87934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:52:40.469398 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.notifications [None req-d97ae8a8-6970-4840-8b4c-f9ec4a74a09a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7055a86d737749ec8c6f85752f00b28e'} {{(pid=87934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:52:40.488712 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 1228/2409] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Sep 13 19:52:40 2022] DELETE /identity/v3/users/7055a86d737749ec8c6f85752f00b28e => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 19:52:40.716892 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90ce0bc-1f12-4ab1-9ba2-198478af5161 service swift] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:52:40.733530 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90ce0bc-1f12-4ab1-9ba2-198478af5161 service swift] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:52:40.804494 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG dbcounter [-] [87935] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=87935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:52:40.822552 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4982065c-34a8-4b40-828e-df381ff4eeed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:52:40.823565 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4982065c-34a8-4b40-828e-df381ff4eeed admin admin] REQUEST_METHOD: `DELETE` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:52:40.823977 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4982065c-34a8-4b40-828e-df381ff4eeed admin admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:52:40.825205 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4982065c-34a8-4b40-828e-df381ff4eeed admin admin] PATH_INFO: `/v3/projects/cc7ea39c59444ac4a012fb7b687cf743` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:52:40.826640 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4982065c-34a8-4b40-828e-df381ff4eeed admin admin] RBAC: Authorizing `identity:delete_project(project_id=cc7ea39c59444ac4a012fb7b687cf743)` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:52:40.829296 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4982065c-34a8-4b40-828e-df381ff4eeed admin admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:52:40.889558 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.notifications [None req-4982065c-34a8-4b40-828e-df381ff4eeed admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cc7ea39c59444ac4a012fb7b687cf743', 'request_id': 'req-4982065c-34a8-4b40-828e-df381ff4eeed'} {{(pid=87935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:52:40.896411 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.notifications [None req-4982065c-34a8-4b40-828e-df381ff4eeed admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cc7ea39c59444ac4a012fb7b687cf743', 'request_id': 'req-4982065c-34a8-4b40-828e-df381ff4eeed'} {{(pid=87935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:52:40.906991 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.notifications [None req-4982065c-34a8-4b40-828e-df381ff4eeed admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cc7ea39c59444ac4a012fb7b687cf743', 'request_id': 'req-4982065c-34a8-4b40-828e-df381ff4eeed'} {{(pid=87935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:52:40.924395 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.notifications [None req-4982065c-34a8-4b40-828e-df381ff4eeed admin admin] The token cache is being invalidate because project cc7ea39c59444ac4a012fb7b687cf743 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87935) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 19:52:40.924691 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.notifications [None req-4982065c-34a8-4b40-828e-df381ff4eeed admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:52:40.925358 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.notifications [None req-4982065c-34a8-4b40-828e-df381ff4eeed admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:52:40.927095 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 1182/2410] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Sep 13 19:52:40 2022] DELETE /identity/v3/projects/cc7ea39c59444ac4a012fb7b687cf743 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 19:52:40.932825 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6611d6-aec4-4692-b08b-cc6c278de86d None None] REQUEST_METHOD: `POST` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:52:40.933290 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6611d6-aec4-4692-b08b-cc6c278de86d None None] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:52:40.933570 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6611d6-aec4-4692-b08b-cc6c278de86d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:52:40.958598 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.auth.core [None req-1f6611d6-aec4-4692-b08b-cc6c278de86d None None] MFA Rules not processed for user `7b0aed92d02344acb92a0e4aa67c3068`. Rule list: `[]` (Enabled: `True`). {{(pid=87934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:52:40.960111 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.fernet_utils [None req-1f6611d6-aec4-4692-b08b-cc6c278de86d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:52:40.976496 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG dbcounter [-] [87934] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:52:41.078192 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 1229/2411] 10.222.0.25 () {58 vars in 958 bytes} [Tue Sep 13 19:52:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 19:52:41.086351 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66af335c-4eea-4c0b-9f79-1026ac4815f9 None None] REQUEST_METHOD: `POST` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:52:41.086643 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66af335c-4eea-4c0b-9f79-1026ac4815f9 None None] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:52:41.086916 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66af335c-4eea-4c0b-9f79-1026ac4815f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:52:41.109523 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.auth.core [None req-66af335c-4eea-4c0b-9f79-1026ac4815f9 None None] MFA Rules not processed for user `7b0aed92d02344acb92a0e4aa67c3068`. Rule list: `[]` (Enabled: `True`). {{(pid=87935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:52:41.111088 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.fernet_utils [None req-66af335c-4eea-4c0b-9f79-1026ac4815f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:52:41.124200 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 1183/2412] 10.222.0.25 () {58 vars in 958 bytes} [Tue Sep 13 19:52:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 19:52:41.128412 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6611d6-aec4-4692-b08b-cc6c278de86d None None] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:52:41.139980 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6611d6-aec4-4692-b08b-cc6c278de86d None None] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:52:41.145616 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aabec73c-75b6-4af9-b20f-db45d9e99c35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:52:41.146612 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabec73c-75b6-4af9-b20f-db45d9e99c35 admin admin] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:52:41.147047 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabec73c-75b6-4af9-b20f-db45d9e99c35 admin admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:52:41.147450 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabec73c-75b6-4af9-b20f-db45d9e99c35 admin admin] PATH_INFO: `/v3/domains` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:52:41.148287 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aabec73c-75b6-4af9-b20f-db45d9e99c35 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87934) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:52:41.148726 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aabec73c-75b6-4af9-b20f-db45d9e99c35 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:52:41.150684 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aabec73c-75b6-4af9-b20f-db45d9e99c35 admin admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:52:41.166089 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 1230/2413] 10.222.0.25 () {58 vars in 1153 bytes} [Tue Sep 13 19:52:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 19:52:41.172113 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66af335c-4eea-4c0b-9f79-1026ac4815f9 None None] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:52:41.183818 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66af335c-4eea-4c0b-9f79-1026ac4815f9 None None] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:52:41.189862 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b3b05c-925d-4b91-b558-7e428be96051 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:52:41.190699 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b3b05c-925d-4b91-b558-7e428be96051 admin admin] REQUEST_METHOD: `POST` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:52:41.190979 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b3b05c-925d-4b91-b558-7e428be96051 admin admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:52:41.191253 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b3b05c-925d-4b91-b558-7e428be96051 admin admin] PATH_INFO: `/v3/projects` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:52:41.191894 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b3b05c-925d-4b91-b558-7e428be96051 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:52:41.195793 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b3b05c-925d-4b91-b558-7e428be96051 admin admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:52:41.242189 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 1184/2414] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Sep 13 19:52:41 2022] POST /identity/v3/projects => generated 373 bytes in 71 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 19:52:41.246730 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aabec73c-75b6-4af9-b20f-db45d9e99c35 admin admin] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:52:41.260087 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aabec73c-75b6-4af9-b20f-db45d9e99c35 admin admin] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:52:41.333929 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f06766f-09a0-47c8-832b-95bbe881a13e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:52:41.334748 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f06766f-09a0-47c8-832b-95bbe881a13e admin admin] REQUEST_METHOD: `POST` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:52:41.335003 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f06766f-09a0-47c8-832b-95bbe881a13e admin admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:52:41.335300 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f06766f-09a0-47c8-832b-95bbe881a13e admin admin] PATH_INFO: `/v3/users` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:52:41.336873 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f06766f-09a0-47c8-832b-95bbe881a13e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:52:41.338174 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f06766f-09a0-47c8-832b-95bbe881a13e admin admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:52:41.367258 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 1231/2415] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Sep 13 19:52:41 2022] POST /identity/v3/users => generated 287 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 19:52:41.369132 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b3b05c-925d-4b91-b558-7e428be96051 admin admin] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:52:41.380502 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b3b05c-925d-4b91-b558-7e428be96051 admin admin] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:52:41.385825 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45ceb3f-26d5-47e4-9ad4-6d116cd68c6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:52:41.386433 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45ceb3f-26d5-47e4-9ad4-6d116cd68c6e admin admin] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:52:41.386715 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45ceb3f-26d5-47e4-9ad4-6d116cd68c6e admin admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:52:41.386986 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45ceb3f-26d5-47e4-9ad4-6d116cd68c6e admin admin] PATH_INFO: `/v3/roles` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:52:41.387667 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e45ceb3f-26d5-47e4-9ad4-6d116cd68c6e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:52:41.389669 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e45ceb3f-26d5-47e4-9ad4-6d116cd68c6e admin admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:52:41.401400 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 1185/2416] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Sep 13 19:52:41 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 19:52:41.406164 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f06766f-09a0-47c8-832b-95bbe881a13e admin admin] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:52:41.417464 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f06766f-09a0-47c8-832b-95bbe881a13e admin admin] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:52:41.423637 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa079165-ec75-4fa4-a46d-718911bcb8ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:52:41.424527 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa079165-ec75-4fa4-a46d-718911bcb8ff admin admin] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:52:41.425022 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa079165-ec75-4fa4-a46d-718911bcb8ff admin admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:52:41.425544 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa079165-ec75-4fa4-a46d-718911bcb8ff admin admin] PATH_INFO: `/v3/roles` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:52:41.426395 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa079165-ec75-4fa4-a46d-718911bcb8ff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:52:41.428229 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa079165-ec75-4fa4-a46d-718911bcb8ff admin admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:52:41.441351 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 1232/2417] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Sep 13 19:52:41 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 19:52:41.445713 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45ceb3f-26d5-47e4-9ad4-6d116cd68c6e admin admin] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:52:41.456458 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45ceb3f-26d5-47e4-9ad4-6d116cd68c6e admin admin] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:52:41.461725 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c26d93-d7bb-4aea-bcb7-d6c0ad2347b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:52:41.462317 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c26d93-d7bb-4aea-bcb7-d6c0ad2347b4 admin admin] REQUEST_METHOD: `PUT` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:52:41.462599 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c26d93-d7bb-4aea-bcb7-d6c0ad2347b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:52:41.462874 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c26d93-d7bb-4aea-bcb7-d6c0ad2347b4 admin admin] PATH_INFO: `/v3/projects/4b4e7f2c405340da91425b0fef68ec5d/users/8ad8ca68986744cbab21e19cb185d55b/roles/a259191f6d0e46fabd9f34536bb28747` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:52:41.479864 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c26d93-d7bb-4aea-bcb7-d6c0ad2347b4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4b4e7f2c405340da91425b0fef68ec5d, user_id=8ad8ca68986744cbab21e19cb185d55b, role_id=a259191f6d0e46fabd9f34536bb28747)` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:52:41.483310 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c26d93-d7bb-4aea-bcb7-d6c0ad2347b4 admin admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:52:41.502776 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 1186/2418] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Sep 13 19:52:41 2022] PUT /identity/v3/projects/4b4e7f2c405340da91425b0fef68ec5d/users/8ad8ca68986744cbab21e19cb185d55b/roles/a259191f6d0e46fabd9f34536bb28747 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 19:52:41.571435 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b77dd8d-8b52-4adf-be58-58234a9726af None None] REQUEST_METHOD: `POST` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:52:41.571966 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b77dd8d-8b52-4adf-be58-58234a9726af None None] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:52:41.572425 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b77dd8d-8b52-4adf-be58-58234a9726af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:52:41.610810 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.auth.core [None req-5b77dd8d-8b52-4adf-be58-58234a9726af None None] MFA Rules not processed for user `8ad8ca68986744cbab21e19cb185d55b`. Rule list: `[]` (Enabled: `True`). {{(pid=87934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:52:41.612322 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.fernet_utils [None req-5b77dd8d-8b52-4adf-be58-58234a9726af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:52:41.689343 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 1233/2419] 10.222.0.25 () {58 vars in 958 bytes} [Tue Sep 13 19:52:41 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 19:52:41.700683 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c26d93-d7bb-4aea-bcb7-d6c0ad2347b4 admin admin] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:52:41.702569 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.fernet_utils [None req-21c26d93-d7bb-4aea-bcb7-d6c0ad2347b4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:52:41.764581 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c26d93-d7bb-4aea-bcb7-d6c0ad2347b4 admin admin] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:52:41.768272 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b55a16-2391-4a5b-b987-86b45157e306 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cbb50c88b794a7f9f26844effde7d63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a10a4268f3c4cb29f4e00c292e2df62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:52:41.768881 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b55a16-2391-4a5b-b987-86b45157e306 service cinder] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:52:41.769154 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b55a16-2391-4a5b-b987-86b45157e306 service cinder] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:52:41.769470 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b55a16-2391-4a5b-b987-86b45157e306 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:52:41.778525 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b55a16-2391-4a5b-b987-86b45157e306 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:52:41.780093 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b55a16-2391-4a5b-b987-86b45157e306 service cinder] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:52:41.789884 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 1187/2420] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Sep 13 19:52:41 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 19:52:42.182538 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2139494-b0b6-4ec3-b958-df9c2e0ff941 None None] REQUEST_METHOD: `POST` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:52:42.182905 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2139494-b0b6-4ec3-b958-df9c2e0ff941 None None] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:52:42.183295 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2139494-b0b6-4ec3-b958-df9c2e0ff941 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:52:42.203548 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.auth.core [None req-e2139494-b0b6-4ec3-b958-df9c2e0ff941 None None] MFA Rules not processed for user `066fb7f5f8a548ea99de513906a49cfe`. Rule list: `[]` (Enabled: `True`). {{(pid=87934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:52:42.204776 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.fernet_utils [None req-e2139494-b0b6-4ec3-b958-df9c2e0ff941 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:52:42.213026 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG dbcounter [-] [87934] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:52:42.268886 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 1234/2421] 10.222.0.25 () {58 vars in 958 bytes} [Tue Sep 13 19:52:42 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 19:52:51.785361 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG dbcounter [-] [87935] Writing DB stats keystone:SELECT=80,keystone:DELETE=7,keystone:INSERT=3 {{(pid=87935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:52:52.032373 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b55a16-2391-4a5b-b987-86b45157e306 service cinder] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:52:52.093928 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b55a16-2391-4a5b-b987-86b45157e306 service cinder] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:52:52.098397 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d383addd-b87b-4b29-99e6-c309cbb24a12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:52:52.099010 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d383addd-b87b-4b29-99e6-c309cbb24a12 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:52:52.099287 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d383addd-b87b-4b29-99e6-c309cbb24a12 admin admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:52:52.099555 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d383addd-b87b-4b29-99e6-c309cbb24a12 admin admin] PATH_INFO: `/v3/users/8ad8ca68986744cbab21e19cb185d55b` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:52:52.100679 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d383addd-b87b-4b29-99e6-c309cbb24a12 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8ad8ca68986744cbab21e19cb185d55b)` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:52:52.102590 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d383addd-b87b-4b29-99e6-c309cbb24a12 admin admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:52:52.148756 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.notifications [None req-d383addd-b87b-4b29-99e6-c309cbb24a12 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8ad8ca68986744cbab21e19cb185d55b'} {{(pid=87935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:52:52.156362 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.notifications [None req-d383addd-b87b-4b29-99e6-c309cbb24a12 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8ad8ca68986744cbab21e19cb185d55b'} {{(pid=87935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:52:52.168156 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.notifications [None req-d383addd-b87b-4b29-99e6-c309cbb24a12 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8ad8ca68986744cbab21e19cb185d55b'} {{(pid=87935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:52:52.168797 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.notifications [None req-d383addd-b87b-4b29-99e6-c309cbb24a12 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8ad8ca68986744cbab21e19cb185d55b'} {{(pid=87935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:52:52.169993 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.notifications [None req-d383addd-b87b-4b29-99e6-c309cbb24a12 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8ad8ca68986744cbab21e19cb185d55b'} {{(pid=87935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:52:52.181835 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 1188/2422] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Sep 13 19:52:52 2022] DELETE /identity/v3/users/8ad8ca68986744cbab21e19cb185d55b => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 19:52:52.186448 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74ab485-cc1a-42e8-bfea-5913b25218cf None None] REQUEST_METHOD: `POST` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:52:52.186909 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74ab485-cc1a-42e8-bfea-5913b25218cf None None] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:52:52.187023 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74ab485-cc1a-42e8-bfea-5913b25218cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:52:52.206253 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.auth.core [None req-d74ab485-cc1a-42e8-bfea-5913b25218cf None None] MFA Rules not processed for user `7b0aed92d02344acb92a0e4aa67c3068`. Rule list: `[]` (Enabled: `True`). {{(pid=87934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:52:52.207426 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.fernet_utils [None req-d74ab485-cc1a-42e8-bfea-5913b25218cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:52:52.274223 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 1235/2423] 10.222.0.25 () {58 vars in 958 bytes} [Tue Sep 13 19:52:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 19:52:52.285902 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d383addd-b87b-4b29-99e6-c309cbb24a12 admin admin] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:52:52.287380 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.fernet_utils [None req-d383addd-b87b-4b29-99e6-c309cbb24a12 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:52:52.347530 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d383addd-b87b-4b29-99e6-c309cbb24a12 admin admin] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:52:52.350925 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2119670c-9e68-453d-ad69-cd850a776ff3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1196a96e4a404f559600b69f929ea9da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a10a4268f3c4cb29f4e00c292e2df62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:52:52.351520 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2119670c-9e68-453d-ad69-cd850a776ff3 service neutron] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:52:52.351790 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2119670c-9e68-453d-ad69-cd850a776ff3 service neutron] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:52:52.352057 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2119670c-9e68-453d-ad69-cd850a776ff3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:52:52.361487 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2119670c-9e68-453d-ad69-cd850a776ff3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:52:52.362919 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2119670c-9e68-453d-ad69-cd850a776ff3 service neutron] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:52:52.372832 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 1189/2424] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Sep 13 19:52:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 19:52:52.649536 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74ab485-cc1a-42e8-bfea-5913b25218cf None None] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:52:52.651145 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.fernet_utils [None req-d74ab485-cc1a-42e8-bfea-5913b25218cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:52:52.664182 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74ab485-cc1a-42e8-bfea-5913b25218cf None None] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:52:52.668740 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abdae5b5-2c12-4b18-bea9-5c45516e1672 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:52:52.669460 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdae5b5-2c12-4b18-bea9-5c45516e1672 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:52:52.669939 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdae5b5-2c12-4b18-bea9-5c45516e1672 admin admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:52:52.670346 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdae5b5-2c12-4b18-bea9-5c45516e1672 admin admin] PATH_INFO: `/v3/projects/4b4e7f2c405340da91425b0fef68ec5d` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:52:52.671478 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abdae5b5-2c12-4b18-bea9-5c45516e1672 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4b4e7f2c405340da91425b0fef68ec5d)` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:52:52.673429 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abdae5b5-2c12-4b18-bea9-5c45516e1672 admin admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:52:52.721465 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.notifications [None req-abdae5b5-2c12-4b18-bea9-5c45516e1672 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4b4e7f2c405340da91425b0fef68ec5d', 'request_id': 'req-abdae5b5-2c12-4b18-bea9-5c45516e1672'} {{(pid=87934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:52:52.727631 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.notifications [None req-abdae5b5-2c12-4b18-bea9-5c45516e1672 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4b4e7f2c405340da91425b0fef68ec5d', 'request_id': 'req-abdae5b5-2c12-4b18-bea9-5c45516e1672'} {{(pid=87934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:52:52.733441 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.notifications [None req-abdae5b5-2c12-4b18-bea9-5c45516e1672 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4b4e7f2c405340da91425b0fef68ec5d', 'request_id': 'req-abdae5b5-2c12-4b18-bea9-5c45516e1672'} {{(pid=87934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:52:52.745215 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.notifications [None req-abdae5b5-2c12-4b18-bea9-5c45516e1672 admin admin] The token cache is being invalidate because project 4b4e7f2c405340da91425b0fef68ec5d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87934) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 19:52:52.745504 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.notifications [None req-abdae5b5-2c12-4b18-bea9-5c45516e1672 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:52:52.746119 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.notifications [None req-abdae5b5-2c12-4b18-bea9-5c45516e1672 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:52:52.748380 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 1236/2425] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Sep 13 19:52:52 2022] DELETE /identity/v3/projects/4b4e7f2c405340da91425b0fef68ec5d => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 19:52:55.557749 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe02d48-e368-43ec-ba34-1027ea4b05b6 None None] REQUEST_METHOD: `POST` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:52:55.558288 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe02d48-e368-43ec-ba34-1027ea4b05b6 None None] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:52:55.558411 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe02d48-e368-43ec-ba34-1027ea4b05b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:52:55.580409 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.auth.core [None req-3fe02d48-e368-43ec-ba34-1027ea4b05b6 None None] MFA Rules not processed for user `ef71a6041f2d4f7389796f0c4a491ea6`. Rule list: `[]` (Enabled: `True`). {{(pid=87935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:52:55.581647 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.fernet_utils [None req-3fe02d48-e368-43ec-ba34-1027ea4b05b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:52:55.598523 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG dbcounter [-] [87935] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:52:55.641743 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 1190/2426] 10.222.0.25 () {58 vars in 958 bytes} [Tue Sep 13 19:52:55 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 19:53:02.742243 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG dbcounter [-] [87934] Writing DB stats keystone:SELECT=73,keystone:DELETE=7,keystone:INSERT=1 {{(pid=87934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:53:05.379064 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5246e345-da6a-406c-a125-569ce38a4b87 None None] REQUEST_METHOD: `POST` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:53:05.379847 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5246e345-da6a-406c-a125-569ce38a4b87 None None] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:53:05.379847 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5246e345-da6a-406c-a125-569ce38a4b87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:53:05.398570 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.auth.core [None req-5246e345-da6a-406c-a125-569ce38a4b87 None None] MFA Rules not processed for user `2658bb3ed0fd42948a1b471816e29301`. Rule list: `[]` (Enabled: `True`). {{(pid=87934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:53:05.399763 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.fernet_utils [None req-5246e345-da6a-406c-a125-569ce38a4b87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:53:05.454836 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 1237/2427] 10.222.0.25 () {58 vars in 958 bytes} [Tue Sep 13 19:53:05 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 19:53:05.633843 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG dbcounter [-] [87935] Writing DB stats keystone:SELECT=15 {{(pid=87935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:53:15.447914 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG dbcounter [-] [87934] Writing DB stats keystone:SELECT=25 {{(pid=87934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:53:25.064981 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb1db30-dd7c-4aa5-bc21-f839085dc7ae None None] REQUEST_METHOD: `POST` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:53:25.065433 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb1db30-dd7c-4aa5-bc21-f839085dc7ae None None] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:53:25.065549 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb1db30-dd7c-4aa5-bc21-f839085dc7ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:53:25.085111 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.auth.core [None req-8fb1db30-dd7c-4aa5-bc21-f839085dc7ae None None] MFA Rules not processed for user `d44977a3225e43f19cdc4a84f0e170cd`. Rule list: `[]` (Enabled: `True`). {{(pid=87935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:53:25.086242 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.fernet_utils [None req-8fb1db30-dd7c-4aa5-bc21-f839085dc7ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:53:25.139808 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 1191/2428] 10.222.0.25 () {58 vars in 967 bytes} [Tue Sep 13 19:53:25 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 19:53:25.163594 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5246e345-da6a-406c-a125-569ce38a4b87 None None] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:53:25.165017 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.fernet_utils [None req-5246e345-da6a-406c-a125-569ce38a4b87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:53:25.233367 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5246e345-da6a-406c-a125-569ce38a4b87 None None] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:53:25.238381 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82324da8-df55-43b9-b122-b27822539899 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb42d6ac6cdd4d97a80c3ee0c6f8e3f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a10a4268f3c4cb29f4e00c292e2df62', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:53:25.238980 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82324da8-df55-43b9-b122-b27822539899 service swift] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:53:25.239257 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82324da8-df55-43b9-b122-b27822539899 service swift] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:53:25.239527 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82324da8-df55-43b9-b122-b27822539899 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:53:25.247412 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82324da8-df55-43b9-b122-b27822539899 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:53:25.249020 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82324da8-df55-43b9-b122-b27822539899 service swift] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:53:25.257177 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 1238/2429] 10.222.0.25 () {60 vars in 1384 bytes} [Tue Sep 13 19:53:25 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 13 19:53:31.665198 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb1db30-dd7c-4aa5-bc21-f839085dc7ae None None] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:53:31.666658 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.fernet_utils [None req-8fb1db30-dd7c-4aa5-bc21-f839085dc7ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:53:31.736091 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb1db30-dd7c-4aa5-bc21-f839085dc7ae None None] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:53:31.740518 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a696b6b-1882-46ee-b8bb-3ff632fb607b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:53:31.741145 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a696b6b-1882-46ee-b8bb-3ff632fb607b admin admin] REQUEST_METHOD: `DELETE` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:53:31.741419 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a696b6b-1882-46ee-b8bb-3ff632fb607b admin admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:53:31.741686 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a696b6b-1882-46ee-b8bb-3ff632fb607b admin admin] PATH_INFO: `/v3/users/99d1fbe8157e47ffac2699d12e76e2c3` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:53:31.742808 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a696b6b-1882-46ee-b8bb-3ff632fb607b admin admin] RBAC: Authorizing `identity:delete_user(user_id=99d1fbe8157e47ffac2699d12e76e2c3)` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:53:31.744829 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a696b6b-1882-46ee-b8bb-3ff632fb607b admin admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:53:31.792607 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.notifications [None req-2a696b6b-1882-46ee-b8bb-3ff632fb607b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '99d1fbe8157e47ffac2699d12e76e2c3'} {{(pid=87935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:53:31.799893 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.notifications [None req-2a696b6b-1882-46ee-b8bb-3ff632fb607b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '99d1fbe8157e47ffac2699d12e76e2c3'} {{(pid=87935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:53:31.811926 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.notifications [None req-2a696b6b-1882-46ee-b8bb-3ff632fb607b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '99d1fbe8157e47ffac2699d12e76e2c3'} {{(pid=87935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:53:31.813069 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.notifications [None req-2a696b6b-1882-46ee-b8bb-3ff632fb607b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '99d1fbe8157e47ffac2699d12e76e2c3'} {{(pid=87935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:53:31.813867 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.notifications [None req-2a696b6b-1882-46ee-b8bb-3ff632fb607b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '99d1fbe8157e47ffac2699d12e76e2c3'} {{(pid=87935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:53:31.825762 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 1192/2430] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Sep 13 19:53:31 2022] DELETE /identity/v3/users/99d1fbe8157e47ffac2699d12e76e2c3 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 19:53:31.998309 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82324da8-df55-43b9-b122-b27822539899 service swift] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:53:32.013162 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82324da8-df55-43b9-b122-b27822539899 service swift] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:53:32.074476 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99908750-ad47-43ee-9587-f9214aba67f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:53:32.075112 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99908750-ad47-43ee-9587-f9214aba67f1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:53:32.075395 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99908750-ad47-43ee-9587-f9214aba67f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:53:32.075670 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99908750-ad47-43ee-9587-f9214aba67f1 admin admin] PATH_INFO: `/v3/projects/22025a1096ea4186bde3673521b43c3e` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:53:32.076811 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99908750-ad47-43ee-9587-f9214aba67f1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=22025a1096ea4186bde3673521b43c3e)` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:53:32.078966 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99908750-ad47-43ee-9587-f9214aba67f1 admin admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:53:32.124524 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.notifications [None req-99908750-ad47-43ee-9587-f9214aba67f1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '22025a1096ea4186bde3673521b43c3e', 'request_id': 'req-99908750-ad47-43ee-9587-f9214aba67f1'} {{(pid=87934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:53:32.131432 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.notifications [None req-99908750-ad47-43ee-9587-f9214aba67f1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '22025a1096ea4186bde3673521b43c3e', 'request_id': 'req-99908750-ad47-43ee-9587-f9214aba67f1'} {{(pid=87934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:53:32.136961 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.notifications [None req-99908750-ad47-43ee-9587-f9214aba67f1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '22025a1096ea4186bde3673521b43c3e', 'request_id': 'req-99908750-ad47-43ee-9587-f9214aba67f1'} {{(pid=87934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:53:32.158418 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.notifications [None req-99908750-ad47-43ee-9587-f9214aba67f1 admin admin] The token cache is being invalidate because project 22025a1096ea4186bde3673521b43c3e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87934) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 19:53:32.158751 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.notifications [None req-99908750-ad47-43ee-9587-f9214aba67f1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:53:32.159857 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.notifications [None req-99908750-ad47-43ee-9587-f9214aba67f1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:53:32.161658 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 1239/2431] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Sep 13 19:53:31 2022] DELETE /identity/v3/projects/22025a1096ea4186bde3673521b43c3e => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 19:53:32.165525 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a696b6b-1882-46ee-b8bb-3ff632fb607b admin admin] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:53:32.166929 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.fernet_utils [None req-2a696b6b-1882-46ee-b8bb-3ff632fb607b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:53:32.180096 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a696b6b-1882-46ee-b8bb-3ff632fb607b admin admin] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:53:32.199849 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG dbcounter [-] [87935] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:53:32.240588 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521b6dc1-f72b-4653-b3ec-58d0962e558f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:53:32.241218 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521b6dc1-f72b-4653-b3ec-58d0962e558f admin admin] REQUEST_METHOD: `DELETE` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:53:32.241487 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521b6dc1-f72b-4653-b3ec-58d0962e558f admin admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:53:32.241759 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521b6dc1-f72b-4653-b3ec-58d0962e558f admin admin] PATH_INFO: `/v3/users/0b4c607b75614463b0e18da9a001b96b` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:53:32.242868 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-521b6dc1-f72b-4653-b3ec-58d0962e558f admin admin] RBAC: Authorizing `identity:delete_user(user_id=0b4c607b75614463b0e18da9a001b96b)` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:53:32.244932 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-521b6dc1-f72b-4653-b3ec-58d0962e558f admin admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:53:32.293272 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.notifications [None req-521b6dc1-f72b-4653-b3ec-58d0962e558f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0b4c607b75614463b0e18da9a001b96b'} {{(pid=87935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:53:32.301723 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.notifications [None req-521b6dc1-f72b-4653-b3ec-58d0962e558f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0b4c607b75614463b0e18da9a001b96b'} {{(pid=87935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:53:32.315042 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.notifications [None req-521b6dc1-f72b-4653-b3ec-58d0962e558f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0b4c607b75614463b0e18da9a001b96b'} {{(pid=87935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:53:32.315678 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.notifications [None req-521b6dc1-f72b-4653-b3ec-58d0962e558f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0b4c607b75614463b0e18da9a001b96b'} {{(pid=87935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:53:32.316306 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.notifications [None req-521b6dc1-f72b-4653-b3ec-58d0962e558f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0b4c607b75614463b0e18da9a001b96b'} {{(pid=87935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:53:32.329267 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 1193/2432] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Sep 13 19:53:32 2022] DELETE /identity/v3/users/0b4c607b75614463b0e18da9a001b96b => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 19:53:32.501055 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99908750-ad47-43ee-9587-f9214aba67f1 admin admin] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:53:32.502498 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.fernet_utils [None req-99908750-ad47-43ee-9587-f9214aba67f1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:53:32.521279 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99908750-ad47-43ee-9587-f9214aba67f1 admin admin] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:53:32.538845 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG dbcounter [-] [87934] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=87934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:53:32.579786 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207a39c5-e50c-462e-a9c7-2254b77ecca3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:53:32.580446 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207a39c5-e50c-462e-a9c7-2254b77ecca3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:53:32.580723 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207a39c5-e50c-462e-a9c7-2254b77ecca3 admin admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:53:32.580989 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207a39c5-e50c-462e-a9c7-2254b77ecca3 admin admin] PATH_INFO: `/v3/projects/0c5b66aebe384564b6f247aba1256ea2` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:53:32.582082 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-207a39c5-e50c-462e-a9c7-2254b77ecca3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0c5b66aebe384564b6f247aba1256ea2)` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:53:32.583961 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-207a39c5-e50c-462e-a9c7-2254b77ecca3 admin admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:53:32.630089 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.notifications [None req-207a39c5-e50c-462e-a9c7-2254b77ecca3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0c5b66aebe384564b6f247aba1256ea2', 'request_id': 'req-207a39c5-e50c-462e-a9c7-2254b77ecca3'} {{(pid=87934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:53:32.635954 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.notifications [None req-207a39c5-e50c-462e-a9c7-2254b77ecca3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0c5b66aebe384564b6f247aba1256ea2', 'request_id': 'req-207a39c5-e50c-462e-a9c7-2254b77ecca3'} {{(pid=87934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:53:32.641580 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.notifications [None req-207a39c5-e50c-462e-a9c7-2254b77ecca3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0c5b66aebe384564b6f247aba1256ea2', 'request_id': 'req-207a39c5-e50c-462e-a9c7-2254b77ecca3'} {{(pid=87934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:53:32.653879 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.notifications [None req-207a39c5-e50c-462e-a9c7-2254b77ecca3 admin admin] The token cache is being invalidate because project 0c5b66aebe384564b6f247aba1256ea2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87934) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 19:53:32.654193 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.notifications [None req-207a39c5-e50c-462e-a9c7-2254b77ecca3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:53:32.654818 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.notifications [None req-207a39c5-e50c-462e-a9c7-2254b77ecca3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:53:32.656320 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 1240/2433] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Sep 13 19:53:32 2022] DELETE /identity/v3/projects/0c5b66aebe384564b6f247aba1256ea2 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 19:53:42.324675 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG dbcounter [-] [87935] Writing DB stats keystone:SELECT=42,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:53:42.650729 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG dbcounter [-] [87934] Writing DB stats keystone:SELECT=42,keystone:DELETE=7,keystone:INSERT=1 {{(pid=87934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:53:51.826796 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6475b4-91c2-40ef-9136-5e1ed8ac602c None None] REQUEST_METHOD: `POST` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:53:51.827387 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6475b4-91c2-40ef-9136-5e1ed8ac602c None None] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:53:51.827387 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6475b4-91c2-40ef-9136-5e1ed8ac602c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:53:51.847113 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.auth.core [None req-da6475b4-91c2-40ef-9136-5e1ed8ac602c None None] MFA Rules not processed for user `066fb7f5f8a548ea99de513906a49cfe`. Rule list: `[]` (Enabled: `True`). {{(pid=87935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:53:51.848327 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.fernet_utils [None req-da6475b4-91c2-40ef-9136-5e1ed8ac602c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:53:51.902271 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 1194/2434] 10.222.0.25 () {58 vars in 958 bytes} [Tue Sep 13 19:53:51 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 19:53:58.059268 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207a39c5-e50c-462e-a9c7-2254b77ecca3 admin admin] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:53:58.061189 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.fernet_utils [None req-207a39c5-e50c-462e-a9c7-2254b77ecca3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:53:58.131240 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207a39c5-e50c-462e-a9c7-2254b77ecca3 admin admin] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:53:58.136793 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2a1f08-9f67-4ff3-86c6-9224d03d0d94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:53:58.137426 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2a1f08-9f67-4ff3-86c6-9224d03d0d94 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:53:58.137704 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2a1f08-9f67-4ff3-86c6-9224d03d0d94 admin admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:53:58.137998 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2a1f08-9f67-4ff3-86c6-9224d03d0d94 admin admin] PATH_INFO: `/v3/users/ef71a6041f2d4f7389796f0c4a491ea6` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:53:58.139475 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f2a1f08-9f67-4ff3-86c6-9224d03d0d94 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ef71a6041f2d4f7389796f0c4a491ea6)` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:53:58.142279 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f2a1f08-9f67-4ff3-86c6-9224d03d0d94 admin admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:53:58.189472 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.notifications [None req-7f2a1f08-9f67-4ff3-86c6-9224d03d0d94 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ef71a6041f2d4f7389796f0c4a491ea6'} {{(pid=87934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:53:58.190115 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.notifications [None req-7f2a1f08-9f67-4ff3-86c6-9224d03d0d94 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ef71a6041f2d4f7389796f0c4a491ea6'} {{(pid=87934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:53:58.190703 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.notifications [None req-7f2a1f08-9f67-4ff3-86c6-9224d03d0d94 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ef71a6041f2d4f7389796f0c4a491ea6'} {{(pid=87934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:53:58.197463 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.notifications [None req-7f2a1f08-9f67-4ff3-86c6-9224d03d0d94 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ef71a6041f2d4f7389796f0c4a491ea6'} {{(pid=87934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:53:58.211726 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.notifications [None req-7f2a1f08-9f67-4ff3-86c6-9224d03d0d94 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ef71a6041f2d4f7389796f0c4a491ea6'} {{(pid=87934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:53:58.226352 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 1241/2435] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Sep 13 19:53:58 2022] DELETE /identity/v3/users/ef71a6041f2d4f7389796f0c4a491ea6 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 19:53:58.415953 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6475b4-91c2-40ef-9136-5e1ed8ac602c None None] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:53:58.430037 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6475b4-91c2-40ef-9136-5e1ed8ac602c None None] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:53:58.516449 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac55d12-c261-4d3b-a470-76b6dc0b177b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:53:58.517185 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac55d12-c261-4d3b-a470-76b6dc0b177b admin admin] REQUEST_METHOD: `DELETE` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:53:58.517454 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac55d12-c261-4d3b-a470-76b6dc0b177b admin admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:53:58.517721 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac55d12-c261-4d3b-a470-76b6dc0b177b admin admin] PATH_INFO: `/v3/projects/fe21071f015e4c33a44b401af6eada61` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:53:58.518880 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac55d12-c261-4d3b-a470-76b6dc0b177b admin admin] RBAC: Authorizing `identity:delete_project(project_id=fe21071f015e4c33a44b401af6eada61)` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:53:58.520832 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac55d12-c261-4d3b-a470-76b6dc0b177b admin admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:53:58.578110 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.notifications [None req-bac55d12-c261-4d3b-a470-76b6dc0b177b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fe21071f015e4c33a44b401af6eada61', 'request_id': 'req-bac55d12-c261-4d3b-a470-76b6dc0b177b'} {{(pid=87935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:53:58.585712 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.notifications [None req-bac55d12-c261-4d3b-a470-76b6dc0b177b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fe21071f015e4c33a44b401af6eada61', 'request_id': 'req-bac55d12-c261-4d3b-a470-76b6dc0b177b'} {{(pid=87935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:53:58.597100 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.notifications [None req-bac55d12-c261-4d3b-a470-76b6dc0b177b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fe21071f015e4c33a44b401af6eada61', 'request_id': 'req-bac55d12-c261-4d3b-a470-76b6dc0b177b'} {{(pid=87935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:53:58.612371 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.notifications [None req-bac55d12-c261-4d3b-a470-76b6dc0b177b admin admin] The token cache is being invalidate because project fe21071f015e4c33a44b401af6eada61 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87935) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 19:53:58.612668 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.notifications [None req-bac55d12-c261-4d3b-a470-76b6dc0b177b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:53:58.613340 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.notifications [None req-bac55d12-c261-4d3b-a470-76b6dc0b177b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:53:58.618472 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 1195/2436] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Sep 13 19:53:58 2022] DELETE /identity/v3/projects/fe21071f015e4c33a44b401af6eada61 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 19:53:58.637065 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028a8bd2-8395-4770-be18-f44b664084a3 None None] REQUEST_METHOD: `POST` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:53:58.637065 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028a8bd2-8395-4770-be18-f44b664084a3 None None] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:53:58.637065 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028a8bd2-8395-4770-be18-f44b664084a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:53:58.656147 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.auth.core [None req-028a8bd2-8395-4770-be18-f44b664084a3 None None] MFA Rules not processed for user `7b0aed92d02344acb92a0e4aa67c3068`. Rule list: `[]` (Enabled: `True`). {{(pid=87934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:53:58.658112 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.fernet_utils [None req-028a8bd2-8395-4770-be18-f44b664084a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:53:58.716884 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 1242/2437] 10.222.0.25 () {58 vars in 958 bytes} [Tue Sep 13 19:53:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 19:53:58.725375 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e12284d-d6ef-4a7c-92f3-205849e5b015 None None] REQUEST_METHOD: `POST` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:53:58.725662 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e12284d-d6ef-4a7c-92f3-205849e5b015 None None] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:53:58.725939 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e12284d-d6ef-4a7c-92f3-205849e5b015 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:53:58.747181 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.auth.core [None req-7e12284d-d6ef-4a7c-92f3-205849e5b015 None None] MFA Rules not processed for user `7b0aed92d02344acb92a0e4aa67c3068`. Rule list: `[]` (Enabled: `True`). {{(pid=87935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:53:58.748407 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.fernet_utils [None req-7e12284d-d6ef-4a7c-92f3-205849e5b015 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:53:58.756277 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 1196/2438] 10.222.0.25 () {58 vars in 958 bytes} [Tue Sep 13 19:53:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 19:53:58.760445 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028a8bd2-8395-4770-be18-f44b664084a3 None None] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:53:58.770136 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028a8bd2-8395-4770-be18-f44b664084a3 None None] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:53:58.774691 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76724d2-61ea-457f-b7a1-9c5ff098f231 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:53:58.775283 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76724d2-61ea-457f-b7a1-9c5ff098f231 admin admin] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:53:58.775559 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76724d2-61ea-457f-b7a1-9c5ff098f231 admin admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:53:58.775828 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76724d2-61ea-457f-b7a1-9c5ff098f231 admin admin] PATH_INFO: `/v3/domains` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:53:58.776504 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f76724d2-61ea-457f-b7a1-9c5ff098f231 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87934) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:53:58.776804 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f76724d2-61ea-457f-b7a1-9c5ff098f231 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:53:58.778381 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f76724d2-61ea-457f-b7a1-9c5ff098f231 admin admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:53:58.790625 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 1243/2439] 10.222.0.25 () {58 vars in 1153 bytes} [Tue Sep 13 19:53:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 19:53:58.794913 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e12284d-d6ef-4a7c-92f3-205849e5b015 None None] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:53:58.805117 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e12284d-d6ef-4a7c-92f3-205849e5b015 None None] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:53:58.810091 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69cc7c97-df82-46b0-85a7-8c1b22e1b84e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:53:58.810735 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cc7c97-df82-46b0-85a7-8c1b22e1b84e admin admin] REQUEST_METHOD: `POST` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:53:58.811020 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cc7c97-df82-46b0-85a7-8c1b22e1b84e admin admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:53:58.811290 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cc7c97-df82-46b0-85a7-8c1b22e1b84e admin admin] PATH_INFO: `/v3/projects` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:53:58.811922 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69cc7c97-df82-46b0-85a7-8c1b22e1b84e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:53:58.813893 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69cc7c97-df82-46b0-85a7-8c1b22e1b84e admin admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:53:58.840775 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 1197/2440] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Sep 13 19:53:58 2022] POST /identity/v3/projects => generated 373 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 19:53:58.845883 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76724d2-61ea-457f-b7a1-9c5ff098f231 admin admin] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:53:58.855764 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76724d2-61ea-457f-b7a1-9c5ff098f231 admin admin] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:53:58.859260 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG dbcounter [-] [87934] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:53:58.914767 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d19ca0-a359-4c08-a011-6ea39bf8fc43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:53:58.915369 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d19ca0-a359-4c08-a011-6ea39bf8fc43 admin admin] REQUEST_METHOD: `POST` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:53:58.915650 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d19ca0-a359-4c08-a011-6ea39bf8fc43 admin admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:53:58.915923 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d19ca0-a359-4c08-a011-6ea39bf8fc43 admin admin] PATH_INFO: `/v3/users` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:53:58.916576 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d19ca0-a359-4c08-a011-6ea39bf8fc43 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:53:58.918489 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d19ca0-a359-4c08-a011-6ea39bf8fc43 admin admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:53:58.939978 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 1244/2441] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Sep 13 19:53:58 2022] POST /identity/v3/users => generated 287 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 19:53:58.944046 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69cc7c97-df82-46b0-85a7-8c1b22e1b84e admin admin] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:53:58.955204 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69cc7c97-df82-46b0-85a7-8c1b22e1b84e admin admin] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:53:58.959705 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920c1c49-528d-41dd-93e4-2f40f13bcde3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:53:58.960316 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920c1c49-528d-41dd-93e4-2f40f13bcde3 admin admin] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:53:58.960591 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920c1c49-528d-41dd-93e4-2f40f13bcde3 admin admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:53:58.961137 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920c1c49-528d-41dd-93e4-2f40f13bcde3 admin admin] PATH_INFO: `/v3/roles` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:53:58.961767 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-920c1c49-528d-41dd-93e4-2f40f13bcde3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:53:58.963337 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-920c1c49-528d-41dd-93e4-2f40f13bcde3 admin admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:53:58.964608 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG dbcounter [-] [87935] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=87935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:53:58.976608 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 1198/2442] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Sep 13 19:53:58 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 19:53:58.980240 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d19ca0-a359-4c08-a011-6ea39bf8fc43 admin admin] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:53:58.990533 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d19ca0-a359-4c08-a011-6ea39bf8fc43 admin admin] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:53:58.995318 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1383cc2d-226f-4e41-9a7d-36bcda166598 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:53:58.995914 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1383cc2d-226f-4e41-9a7d-36bcda166598 admin admin] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:53:58.996195 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1383cc2d-226f-4e41-9a7d-36bcda166598 admin admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:53:58.996496 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1383cc2d-226f-4e41-9a7d-36bcda166598 admin admin] PATH_INFO: `/v3/roles` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:53:58.997164 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1383cc2d-226f-4e41-9a7d-36bcda166598 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:53:58.998759 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1383cc2d-226f-4e41-9a7d-36bcda166598 admin admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:53:59.009361 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 1245/2443] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Sep 13 19:53:58 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 19:53:59.013720 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920c1c49-528d-41dd-93e4-2f40f13bcde3 admin admin] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:53:59.024152 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920c1c49-528d-41dd-93e4-2f40f13bcde3 admin admin] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:53:59.028857 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a573ee74-f890-4588-84d7-ae2b7af68b30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:53:59.029499 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a573ee74-f890-4588-84d7-ae2b7af68b30 admin admin] REQUEST_METHOD: `PUT` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:53:59.029773 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a573ee74-f890-4588-84d7-ae2b7af68b30 admin admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:53:59.030044 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a573ee74-f890-4588-84d7-ae2b7af68b30 admin admin] PATH_INFO: `/v3/projects/05f93e36261249219594bd70879ad7f5/users/c3d0284cd284495b979ba6036421441c/roles/a259191f6d0e46fabd9f34536bb28747` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:53:59.044490 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a573ee74-f890-4588-84d7-ae2b7af68b30 admin admin] RBAC: Authorizing `identity:create_grant(project_id=05f93e36261249219594bd70879ad7f5, user_id=c3d0284cd284495b979ba6036421441c, role_id=a259191f6d0e46fabd9f34536bb28747)` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:53:59.047178 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a573ee74-f890-4588-84d7-ae2b7af68b30 admin admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:53:59.060295 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 1199/2444] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Sep 13 19:53:59 2022] PUT /identity/v3/projects/05f93e36261249219594bd70879ad7f5/users/c3d0284cd284495b979ba6036421441c/roles/a259191f6d0e46fabd9f34536bb28747 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 19:53:59.070838 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5704d9ad-9016-4986-942a-b145fdd3d7b4 None None] REQUEST_METHOD: `POST` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:53:59.071353 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5704d9ad-9016-4986-942a-b145fdd3d7b4 None None] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:53:59.071353 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5704d9ad-9016-4986-942a-b145fdd3d7b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:53:59.101365 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.auth.core [None req-5704d9ad-9016-4986-942a-b145fdd3d7b4 None None] MFA Rules not processed for user `c3d0284cd284495b979ba6036421441c`. Rule list: `[]` (Enabled: `True`). {{(pid=87934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:53:59.102581 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.fernet_utils [None req-5704d9ad-9016-4986-942a-b145fdd3d7b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:53:59.165186 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 1246/2445] 10.222.0.25 () {58 vars in 958 bytes} [Tue Sep 13 19:53:59 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 19:53:59.176494 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a573ee74-f890-4588-84d7-ae2b7af68b30 admin admin] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:53:59.178285 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.fernet_utils [None req-a573ee74-f890-4588-84d7-ae2b7af68b30 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:53:59.250877 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a573ee74-f890-4588-84d7-ae2b7af68b30 admin admin] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:53:59.256411 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82446858-ae35-4c3c-9b80-04c613c4429d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd71fe5a8275f4ea98555afdcefc902a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a10a4268f3c4cb29f4e00c292e2df62', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:53:59.257008 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82446858-ae35-4c3c-9b80-04c613c4429d service nova] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:53:59.257282 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82446858-ae35-4c3c-9b80-04c613c4429d service nova] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:53:59.257554 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82446858-ae35-4c3c-9b80-04c613c4429d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:53:59.265460 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82446858-ae35-4c3c-9b80-04c613c4429d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:53:59.267211 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82446858-ae35-4c3c-9b80-04c613c4429d service nova] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:53:59.275749 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 1200/2446] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Sep 13 19:53:59 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 19:54:01.052587 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5704d9ad-9016-4986-942a-b145fdd3d7b4 None None] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:54:01.123070 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5704d9ad-9016-4986-942a-b145fdd3d7b4 None None] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:54:01.127717 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08a63cc-dde3-4e44-88f6-54be862f5667 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:54:01.128384 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08a63cc-dde3-4e44-88f6-54be862f5667 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:54:01.128664 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08a63cc-dde3-4e44-88f6-54be862f5667 admin admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:54:01.128933 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08a63cc-dde3-4e44-88f6-54be862f5667 admin admin] PATH_INFO: `/v3/users/c3d0284cd284495b979ba6036421441c` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:54:01.130170 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c08a63cc-dde3-4e44-88f6-54be862f5667 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c3d0284cd284495b979ba6036421441c)` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:54:01.132065 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c08a63cc-dde3-4e44-88f6-54be862f5667 admin admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:54:01.148460 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG dbcounter [-] [87934] Writing DB stats keystone:SELECT=96,keystone:INSERT=3,keystone:DELETE=1 {{(pid=87934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:54:01.177406 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.notifications [None req-c08a63cc-dde3-4e44-88f6-54be862f5667 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c3d0284cd284495b979ba6036421441c'} {{(pid=87934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:54:01.178044 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.notifications [None req-c08a63cc-dde3-4e44-88f6-54be862f5667 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c3d0284cd284495b979ba6036421441c'} {{(pid=87934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:54:01.178632 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.notifications [None req-c08a63cc-dde3-4e44-88f6-54be862f5667 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c3d0284cd284495b979ba6036421441c'} {{(pid=87934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:54:01.186015 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.notifications [None req-c08a63cc-dde3-4e44-88f6-54be862f5667 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c3d0284cd284495b979ba6036421441c'} {{(pid=87934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:54:01.198081 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.notifications [None req-c08a63cc-dde3-4e44-88f6-54be862f5667 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c3d0284cd284495b979ba6036421441c'} {{(pid=87934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:54:01.211638 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 1247/2447] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Sep 13 19:54:01 2022] DELETE /identity/v3/users/c3d0284cd284495b979ba6036421441c => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 19:54:01.216139 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ae0521-d0e2-4da4-9566-4cfb2ffe125e None None] REQUEST_METHOD: `POST` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:54:01.216747 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ae0521-d0e2-4da4-9566-4cfb2ffe125e None None] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:54:01.216747 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ae0521-d0e2-4da4-9566-4cfb2ffe125e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:54:01.236060 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.auth.core [None req-a0ae0521-d0e2-4da4-9566-4cfb2ffe125e None None] MFA Rules not processed for user `7b0aed92d02344acb92a0e4aa67c3068`. Rule list: `[]` (Enabled: `True`). {{(pid=87935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:54:01.237270 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.fernet_utils [None req-a0ae0521-d0e2-4da4-9566-4cfb2ffe125e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:54:01.296177 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 1201/2448] 10.222.0.25 () {58 vars in 958 bytes} [Tue Sep 13 19:54:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 19:54:01.306355 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08a63cc-dde3-4e44-88f6-54be862f5667 admin admin] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:54:01.307771 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.fernet_utils [None req-c08a63cc-dde3-4e44-88f6-54be862f5667 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:54:01.365323 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08a63cc-dde3-4e44-88f6-54be862f5667 admin admin] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:54:01.368884 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ca0587-7556-471d-a51a-faa42e01151e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1196a96e4a404f559600b69f929ea9da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a10a4268f3c4cb29f4e00c292e2df62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:54:01.369489 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ca0587-7556-471d-a51a-faa42e01151e service neutron] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:54:01.369768 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ca0587-7556-471d-a51a-faa42e01151e service neutron] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:54:01.370031 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ca0587-7556-471d-a51a-faa42e01151e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:54:01.378921 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ca0587-7556-471d-a51a-faa42e01151e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:54:01.380368 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ca0587-7556-471d-a51a-faa42e01151e service neutron] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:54:01.390165 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 1248/2449] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Sep 13 19:54:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 19:54:01.664193 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ae0521-d0e2-4da4-9566-4cfb2ffe125e None None] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:54:01.665726 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.fernet_utils [None req-a0ae0521-d0e2-4da4-9566-4cfb2ffe125e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:54:01.678466 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ae0521-d0e2-4da4-9566-4cfb2ffe125e None None] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:54:01.683247 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2066a0-8178-4d9d-820b-d99b80bda5cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:54:01.683879 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2066a0-8178-4d9d-820b-d99b80bda5cb admin admin] REQUEST_METHOD: `DELETE` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:54:01.684153 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2066a0-8178-4d9d-820b-d99b80bda5cb admin admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:54:01.684506 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2066a0-8178-4d9d-820b-d99b80bda5cb admin admin] PATH_INFO: `/v3/projects/05f93e36261249219594bd70879ad7f5` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:54:01.685586 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a2066a0-8178-4d9d-820b-d99b80bda5cb admin admin] RBAC: Authorizing `identity:delete_project(project_id=05f93e36261249219594bd70879ad7f5)` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:54:01.687485 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a2066a0-8178-4d9d-820b-d99b80bda5cb admin admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:54:01.741402 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.notifications [None req-0a2066a0-8178-4d9d-820b-d99b80bda5cb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '05f93e36261249219594bd70879ad7f5', 'request_id': 'req-0a2066a0-8178-4d9d-820b-d99b80bda5cb'} {{(pid=87935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:54:01.743424 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG dbcounter [-] [87935] Writing DB stats keystone:SELECT=94,keystone:INSERT=1,keystone:DELETE=5 {{(pid=87935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:54:01.748189 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.notifications [None req-0a2066a0-8178-4d9d-820b-d99b80bda5cb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '05f93e36261249219594bd70879ad7f5', 'request_id': 'req-0a2066a0-8178-4d9d-820b-d99b80bda5cb'} {{(pid=87935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:54:01.756916 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.notifications [None req-0a2066a0-8178-4d9d-820b-d99b80bda5cb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '05f93e36261249219594bd70879ad7f5', 'request_id': 'req-0a2066a0-8178-4d9d-820b-d99b80bda5cb'} {{(pid=87935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:54:01.768585 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.notifications [None req-0a2066a0-8178-4d9d-820b-d99b80bda5cb admin admin] The token cache is being invalidate because project 05f93e36261249219594bd70879ad7f5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87935) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 19:54:01.768876 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.notifications [None req-0a2066a0-8178-4d9d-820b-d99b80bda5cb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:54:01.770016 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.notifications [None req-0a2066a0-8178-4d9d-820b-d99b80bda5cb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:54:01.771485 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 1202/2450] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Sep 13 19:54:01 2022] DELETE /identity/v3/projects/05f93e36261249219594bd70879ad7f5 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 19:54:01.776478 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7efba6-1baa-4750-a5ce-a742163aee3f None None] REQUEST_METHOD: `POST` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:54:01.776765 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7efba6-1baa-4750-a5ce-a742163aee3f None None] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:54:01.777068 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7efba6-1baa-4750-a5ce-a742163aee3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:54:01.796597 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.auth.core [None req-3e7efba6-1baa-4750-a5ce-a742163aee3f None None] MFA Rules not processed for user `7b0aed92d02344acb92a0e4aa67c3068`. Rule list: `[]` (Enabled: `True`). {{(pid=87934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:54:01.797912 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.fernet_utils [None req-3e7efba6-1baa-4750-a5ce-a742163aee3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:54:01.856821 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 1249/2451] 10.222.0.25 () {58 vars in 958 bytes} [Tue Sep 13 19:54:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 19:54:01.866171 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f80ebb0-931b-49a3-96eb-a613aa94eb2d None None] REQUEST_METHOD: `POST` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:54:01.866454 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f80ebb0-931b-49a3-96eb-a613aa94eb2d None None] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:54:01.866724 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f80ebb0-931b-49a3-96eb-a613aa94eb2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:54:01.886675 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.auth.core [None req-3f80ebb0-931b-49a3-96eb-a613aa94eb2d None None] MFA Rules not processed for user `7b0aed92d02344acb92a0e4aa67c3068`. Rule list: `[]` (Enabled: `True`). {{(pid=87935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:54:01.887856 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.fernet_utils [None req-3f80ebb0-931b-49a3-96eb-a613aa94eb2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:54:01.895577 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 1203/2452] 10.222.0.25 () {58 vars in 958 bytes} [Tue Sep 13 19:54:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 19:54:01.899693 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7efba6-1baa-4750-a5ce-a742163aee3f None None] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:54:01.909710 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7efba6-1baa-4750-a5ce-a742163aee3f None None] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:54:01.914261 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05be99b-c453-45a8-8f8c-53e11a6f2894 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:54:01.914862 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05be99b-c453-45a8-8f8c-53e11a6f2894 admin admin] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:54:01.915141 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05be99b-c453-45a8-8f8c-53e11a6f2894 admin admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:54:01.915411 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05be99b-c453-45a8-8f8c-53e11a6f2894 admin admin] PATH_INFO: `/v3/domains` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:54:01.916047 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a05be99b-c453-45a8-8f8c-53e11a6f2894 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87934) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:54:01.916389 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a05be99b-c453-45a8-8f8c-53e11a6f2894 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:54:01.917967 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a05be99b-c453-45a8-8f8c-53e11a6f2894 admin admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:54:01.931103 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 1250/2453] 10.222.0.25 () {58 vars in 1153 bytes} [Tue Sep 13 19:54:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:54:01.935239 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f80ebb0-931b-49a3-96eb-a613aa94eb2d None None] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:54:01.945856 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f80ebb0-931b-49a3-96eb-a613aa94eb2d None None] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:54:01.950701 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa616e5-5828-434b-9fc6-7b5108e9ea71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:54:01.951299 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa616e5-5828-434b-9fc6-7b5108e9ea71 admin admin] REQUEST_METHOD: `POST` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:54:01.951579 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa616e5-5828-434b-9fc6-7b5108e9ea71 admin admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:54:01.951849 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa616e5-5828-434b-9fc6-7b5108e9ea71 admin admin] PATH_INFO: `/v3/projects` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:54:01.952512 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa616e5-5828-434b-9fc6-7b5108e9ea71 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:54:01.954714 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa616e5-5828-434b-9fc6-7b5108e9ea71 admin admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:54:01.981657 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 1204/2454] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Sep 13 19:54:01 2022] POST /identity/v3/projects => generated 365 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 19:54:01.986344 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05be99b-c453-45a8-8f8c-53e11a6f2894 admin admin] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:54:01.996272 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05be99b-c453-45a8-8f8c-53e11a6f2894 admin admin] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:54:02.017030 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG dbcounter [-] [87934] Writing DB stats keystone:DELETE=9,keystone:SELECT=90,keystone:INSERT=1 {{(pid=87934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:54:02.057725 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40563fa5-0795-4efb-a6b8-d6ac27f194f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:54:02.058464 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40563fa5-0795-4efb-a6b8-d6ac27f194f2 admin admin] REQUEST_METHOD: `POST` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:54:02.058807 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40563fa5-0795-4efb-a6b8-d6ac27f194f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:54:02.059142 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40563fa5-0795-4efb-a6b8-d6ac27f194f2 admin admin] PATH_INFO: `/v3/users` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:54:02.059835 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40563fa5-0795-4efb-a6b8-d6ac27f194f2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:54:02.061847 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40563fa5-0795-4efb-a6b8-d6ac27f194f2 admin admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:54:02.094351 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 1251/2455] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Sep 13 19:54:01 2022] POST /identity/v3/users => generated 283 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 19:54:02.099091 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa616e5-5828-434b-9fc6-7b5108e9ea71 admin admin] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:54:02.114451 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa616e5-5828-434b-9fc6-7b5108e9ea71 admin admin] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:54:02.119445 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af594c1-1f7a-4f1b-acba-efd6532b760d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:54:02.120199 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af594c1-1f7a-4f1b-acba-efd6532b760d admin admin] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:54:02.120584 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af594c1-1f7a-4f1b-acba-efd6532b760d admin admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:54:02.120953 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af594c1-1f7a-4f1b-acba-efd6532b760d admin admin] PATH_INFO: `/v3/roles` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:54:02.131995 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af594c1-1f7a-4f1b-acba-efd6532b760d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:54:02.133748 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af594c1-1f7a-4f1b-acba-efd6532b760d admin admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:54:02.146991 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 1205/2456] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Sep 13 19:54:02 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 19:54:02.150860 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40563fa5-0795-4efb-a6b8-d6ac27f194f2 admin admin] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:54:02.170453 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40563fa5-0795-4efb-a6b8-d6ac27f194f2 admin admin] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:54:02.179059 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4cbb31-50a1-4dc3-a3dc-f5da6a3a7802 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:54:02.179962 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4cbb31-50a1-4dc3-a3dc-f5da6a3a7802 admin admin] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:54:02.180750 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4cbb31-50a1-4dc3-a3dc-f5da6a3a7802 admin admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:54:02.181298 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4cbb31-50a1-4dc3-a3dc-f5da6a3a7802 admin admin] PATH_INFO: `/v3/roles` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:54:02.182376 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b4cbb31-50a1-4dc3-a3dc-f5da6a3a7802 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:54:02.184764 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b4cbb31-50a1-4dc3-a3dc-f5da6a3a7802 admin admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:54:02.199997 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 1252/2457] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Sep 13 19:54:02 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 13 19:54:02.205429 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af594c1-1f7a-4f1b-acba-efd6532b760d admin admin] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:54:02.217018 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af594c1-1f7a-4f1b-acba-efd6532b760d admin admin] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:54:02.222876 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a141fa-f958-46c1-8111-43387344d75e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:54:02.223826 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a141fa-f958-46c1-8111-43387344d75e admin admin] REQUEST_METHOD: `PUT` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:54:02.224505 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a141fa-f958-46c1-8111-43387344d75e admin admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:54:02.232053 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a141fa-f958-46c1-8111-43387344d75e admin admin] PATH_INFO: `/v3/projects/ae3833675e2c4986aa0018f49529c79e/users/33de6a2db5c044f1a3d8d5b4a6168458/roles/a259191f6d0e46fabd9f34536bb28747` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:54:02.263767 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a141fa-f958-46c1-8111-43387344d75e admin admin] RBAC: Authorizing `identity:create_grant(project_id=ae3833675e2c4986aa0018f49529c79e, user_id=33de6a2db5c044f1a3d8d5b4a6168458, role_id=a259191f6d0e46fabd9f34536bb28747)` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:54:02.263767 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a141fa-f958-46c1-8111-43387344d75e admin admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:54:02.278007 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 1206/2458] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Sep 13 19:54:02 2022] PUT /identity/v3/projects/ae3833675e2c4986aa0018f49529c79e/users/33de6a2db5c044f1a3d8d5b4a6168458/roles/a259191f6d0e46fabd9f34536bb28747 => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 19:54:02.289489 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4fb32c-1ae2-4d40-9423-4b18fca65bb3 None None] REQUEST_METHOD: `POST` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:54:02.289774 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4fb32c-1ae2-4d40-9423-4b18fca65bb3 None None] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:54:02.290043 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4fb32c-1ae2-4d40-9423-4b18fca65bb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:54:02.321119 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.auth.core [None req-ad4fb32c-1ae2-4d40-9423-4b18fca65bb3 None None] MFA Rules not processed for user `33de6a2db5c044f1a3d8d5b4a6168458`. Rule list: `[]` (Enabled: `True`). {{(pid=87934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:54:02.322348 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.fernet_utils [None req-ad4fb32c-1ae2-4d40-9423-4b18fca65bb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:54:02.397152 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 1253/2459] 10.222.0.25 () {58 vars in 958 bytes} [Tue Sep 13 19:54:02 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 19:54:02.408164 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a141fa-f958-46c1-8111-43387344d75e admin admin] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:54:02.410532 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.fernet_utils [None req-18a141fa-f958-46c1-8111-43387344d75e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:54:02.473466 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a141fa-f958-46c1-8111-43387344d75e admin admin] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:54:02.477687 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308184e9-ad22-4065-a91d-41e171804f3f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cbb50c88b794a7f9f26844effde7d63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a10a4268f3c4cb29f4e00c292e2df62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:54:02.478513 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308184e9-ad22-4065-a91d-41e171804f3f service cinder] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:54:02.478783 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308184e9-ad22-4065-a91d-41e171804f3f service cinder] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:54:02.479049 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308184e9-ad22-4065-a91d-41e171804f3f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:54:02.489491 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-308184e9-ad22-4065-a91d-41e171804f3f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:54:02.491012 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-308184e9-ad22-4065-a91d-41e171804f3f service cinder] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:54:02.501881 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 1207/2460] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Sep 13 19:54:02 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 19:54:10.923662 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4fb32c-1ae2-4d40-9423-4b18fca65bb3 None None] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:54:10.987189 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4fb32c-1ae2-4d40-9423-4b18fca65bb3 None None] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:54:10.991678 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53e06a0-07af-4f7f-ab2a-161cb6f0437f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:54:10.992358 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53e06a0-07af-4f7f-ab2a-161cb6f0437f admin admin] REQUEST_METHOD: `DELETE` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:54:10.992637 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53e06a0-07af-4f7f-ab2a-161cb6f0437f admin admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:54:10.992902 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53e06a0-07af-4f7f-ab2a-161cb6f0437f admin admin] PATH_INFO: `/v3/users/33de6a2db5c044f1a3d8d5b4a6168458` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:54:10.994044 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e53e06a0-07af-4f7f-ab2a-161cb6f0437f admin admin] RBAC: Authorizing `identity:delete_user(user_id=33de6a2db5c044f1a3d8d5b4a6168458)` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:54:10.995997 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e53e06a0-07af-4f7f-ab2a-161cb6f0437f admin admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:54:11.034166 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG dbcounter [-] [87934] Writing DB stats keystone:SELECT=92,keystone:INSERT=3,keystone:DELETE=5 {{(pid=87934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:54:11.044313 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.notifications [None req-e53e06a0-07af-4f7f-ab2a-161cb6f0437f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '33de6a2db5c044f1a3d8d5b4a6168458'} {{(pid=87934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:54:11.044957 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.notifications [None req-e53e06a0-07af-4f7f-ab2a-161cb6f0437f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '33de6a2db5c044f1a3d8d5b4a6168458'} {{(pid=87934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:54:11.045655 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.notifications [None req-e53e06a0-07af-4f7f-ab2a-161cb6f0437f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '33de6a2db5c044f1a3d8d5b4a6168458'} {{(pid=87934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:54:11.053155 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.notifications [None req-e53e06a0-07af-4f7f-ab2a-161cb6f0437f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '33de6a2db5c044f1a3d8d5b4a6168458'} {{(pid=87934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:54:11.065544 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.notifications [None req-e53e06a0-07af-4f7f-ab2a-161cb6f0437f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '33de6a2db5c044f1a3d8d5b4a6168458'} {{(pid=87934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:54:11.078307 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 1254/2461] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Sep 13 19:54:10 2022] DELETE /identity/v3/users/33de6a2db5c044f1a3d8d5b4a6168458 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 19:54:11.082793 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda1099b-a61f-487f-a046-9deb9de57641 None None] REQUEST_METHOD: `POST` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:54:11.083294 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda1099b-a61f-487f-a046-9deb9de57641 None None] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:54:11.083392 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda1099b-a61f-487f-a046-9deb9de57641 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:54:11.102118 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.auth.core [None req-fda1099b-a61f-487f-a046-9deb9de57641 None None] MFA Rules not processed for user `7b0aed92d02344acb92a0e4aa67c3068`. Rule list: `[]` (Enabled: `True`). {{(pid=87935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:54:11.103295 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.fernet_utils [None req-fda1099b-a61f-487f-a046-9deb9de57641 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:54:11.162502 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 1208/2462] 10.222.0.25 () {58 vars in 958 bytes} [Tue Sep 13 19:54:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 19:54:11.172227 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53e06a0-07af-4f7f-ab2a-161cb6f0437f admin admin] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:54:11.173644 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.fernet_utils [None req-e53e06a0-07af-4f7f-ab2a-161cb6f0437f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:54:11.231429 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53e06a0-07af-4f7f-ab2a-161cb6f0437f admin admin] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:54:11.235141 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef40c0c-c98c-441e-9baa-b37b65e23adf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1196a96e4a404f559600b69f929ea9da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a10a4268f3c4cb29f4e00c292e2df62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:54:11.235738 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef40c0c-c98c-441e-9baa-b37b65e23adf service neutron] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:54:11.236015 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef40c0c-c98c-441e-9baa-b37b65e23adf service neutron] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:54:11.236315 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef40c0c-c98c-441e-9baa-b37b65e23adf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:54:11.245858 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef40c0c-c98c-441e-9baa-b37b65e23adf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:54:11.247281 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef40c0c-c98c-441e-9baa-b37b65e23adf service neutron] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:54:11.256975 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 1255/2463] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Sep 13 19:54:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 19:54:11.525148 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda1099b-a61f-487f-a046-9deb9de57641 None None] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:54:11.526585 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.fernet_utils [None req-fda1099b-a61f-487f-a046-9deb9de57641 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:54:11.540088 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda1099b-a61f-487f-a046-9deb9de57641 None None] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:54:11.544790 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e303904-c657-4757-9656-709748ab84e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:54:11.545420 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e303904-c657-4757-9656-709748ab84e2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:54:11.545700 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e303904-c657-4757-9656-709748ab84e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:54:11.545976 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e303904-c657-4757-9656-709748ab84e2 admin admin] PATH_INFO: `/v3/projects/ae3833675e2c4986aa0018f49529c79e` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:54:11.547069 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e303904-c657-4757-9656-709748ab84e2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ae3833675e2c4986aa0018f49529c79e)` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:54:11.549077 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e303904-c657-4757-9656-709748ab84e2 admin admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:54:11.565399 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG dbcounter [-] [87935] Writing DB stats keystone:SELECT=95,keystone:DELETE=2,keystone:INSERT=3 {{(pid=87935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:54:11.599507 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.notifications [None req-6e303904-c657-4757-9656-709748ab84e2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ae3833675e2c4986aa0018f49529c79e', 'request_id': 'req-6e303904-c657-4757-9656-709748ab84e2'} {{(pid=87935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:54:11.605260 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.notifications [None req-6e303904-c657-4757-9656-709748ab84e2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ae3833675e2c4986aa0018f49529c79e', 'request_id': 'req-6e303904-c657-4757-9656-709748ab84e2'} {{(pid=87935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:54:11.612569 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.notifications [None req-6e303904-c657-4757-9656-709748ab84e2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ae3833675e2c4986aa0018f49529c79e', 'request_id': 'req-6e303904-c657-4757-9656-709748ab84e2'} {{(pid=87935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:54:11.623464 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.notifications [None req-6e303904-c657-4757-9656-709748ab84e2 admin admin] The token cache is being invalidate because project ae3833675e2c4986aa0018f49529c79e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87935) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 19:54:11.623755 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.notifications [None req-6e303904-c657-4757-9656-709748ab84e2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:54:11.624389 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.notifications [None req-6e303904-c657-4757-9656-709748ab84e2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:54:11.625846 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 1209/2464] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Sep 13 19:54:11 2022] DELETE /identity/v3/projects/ae3833675e2c4986aa0018f49529c79e => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 19:54:11.631095 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d3f713-e40f-405d-ad2b-6cd3b4398e10 None None] REQUEST_METHOD: `POST` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:54:11.631406 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d3f713-e40f-405d-ad2b-6cd3b4398e10 None None] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:54:11.631753 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d3f713-e40f-405d-ad2b-6cd3b4398e10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:54:11.651782 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.auth.core [None req-84d3f713-e40f-405d-ad2b-6cd3b4398e10 None None] MFA Rules not processed for user `7b0aed92d02344acb92a0e4aa67c3068`. Rule list: `[]` (Enabled: `True`). {{(pid=87934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:54:11.653181 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.fernet_utils [None req-84d3f713-e40f-405d-ad2b-6cd3b4398e10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:54:11.719121 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 1256/2465] 10.222.0.25 () {58 vars in 958 bytes} [Tue Sep 13 19:54:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 19:54:11.728132 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1d042d-3005-439f-a7a1-a77473f130a3 None None] REQUEST_METHOD: `POST` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:54:11.728589 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1d042d-3005-439f-a7a1-a77473f130a3 None None] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:54:11.728863 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1d042d-3005-439f-a7a1-a77473f130a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:54:11.749095 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.auth.core [None req-9a1d042d-3005-439f-a7a1-a77473f130a3 None None] MFA Rules not processed for user `7b0aed92d02344acb92a0e4aa67c3068`. Rule list: `[]` (Enabled: `True`). {{(pid=87935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:54:11.750322 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.fernet_utils [None req-9a1d042d-3005-439f-a7a1-a77473f130a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:54:11.759250 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 1210/2466] 10.222.0.25 () {58 vars in 958 bytes} [Tue Sep 13 19:54:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 19:54:11.763662 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d3f713-e40f-405d-ad2b-6cd3b4398e10 None None] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:54:11.774036 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d3f713-e40f-405d-ad2b-6cd3b4398e10 None None] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:54:11.778998 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ba4d01-bb45-487d-87b8-ae49c262f0f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:54:11.779606 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ba4d01-bb45-487d-87b8-ae49c262f0f2 admin admin] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:54:11.779918 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ba4d01-bb45-487d-87b8-ae49c262f0f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:54:11.780185 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ba4d01-bb45-487d-87b8-ae49c262f0f2 admin admin] PATH_INFO: `/v3/domains` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:54:11.780884 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ba4d01-bb45-487d-87b8-ae49c262f0f2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87934) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:54:11.781187 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ba4d01-bb45-487d-87b8-ae49c262f0f2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:54:11.782808 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ba4d01-bb45-487d-87b8-ae49c262f0f2 admin admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:54:11.796516 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 1257/2467] 10.222.0.25 () {58 vars in 1153 bytes} [Tue Sep 13 19:54:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 19:54:11.801252 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1d042d-3005-439f-a7a1-a77473f130a3 None None] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:54:11.810832 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1d042d-3005-439f-a7a1-a77473f130a3 None None] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:54:11.815666 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6009e267-8715-4140-a06a-a7d727578e57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:54:11.816295 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6009e267-8715-4140-a06a-a7d727578e57 admin admin] REQUEST_METHOD: `POST` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:54:11.816570 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6009e267-8715-4140-a06a-a7d727578e57 admin admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:54:11.816833 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6009e267-8715-4140-a06a-a7d727578e57 admin admin] PATH_INFO: `/v3/projects` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:54:11.817460 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6009e267-8715-4140-a06a-a7d727578e57 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:54:11.819341 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6009e267-8715-4140-a06a-a7d727578e57 admin admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:54:11.848014 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 1211/2468] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Sep 13 19:54:11 2022] POST /identity/v3/projects => generated 365 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 13 19:54:11.852067 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ba4d01-bb45-487d-87b8-ae49c262f0f2 admin admin] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:54:11.862042 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ba4d01-bb45-487d-87b8-ae49c262f0f2 admin admin] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:54:11.901773 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG dbcounter [-] [87934] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=87934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:54:11.919181 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f3c41c-e5d7-4ccb-8056-c860a62f7b83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:54:11.919809 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f3c41c-e5d7-4ccb-8056-c860a62f7b83 admin admin] REQUEST_METHOD: `POST` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:54:11.920085 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f3c41c-e5d7-4ccb-8056-c860a62f7b83 admin admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:54:11.920388 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f3c41c-e5d7-4ccb-8056-c860a62f7b83 admin admin] PATH_INFO: `/v3/users` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:54:11.921011 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f3c41c-e5d7-4ccb-8056-c860a62f7b83 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:54:11.922916 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f3c41c-e5d7-4ccb-8056-c860a62f7b83 admin admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:54:11.946549 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 1258/2469] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Sep 13 19:54:11 2022] POST /identity/v3/users => generated 283 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 19:54:11.950824 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6009e267-8715-4140-a06a-a7d727578e57 admin admin] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:54:11.963212 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6009e267-8715-4140-a06a-a7d727578e57 admin admin] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:54:11.967785 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f30590b-c105-4b78-a381-5b7d1ca4eadb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:54:11.968475 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f30590b-c105-4b78-a381-5b7d1ca4eadb admin admin] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:54:11.968773 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f30590b-c105-4b78-a381-5b7d1ca4eadb admin admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:54:11.969041 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f30590b-c105-4b78-a381-5b7d1ca4eadb admin admin] PATH_INFO: `/v3/roles` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:54:11.969716 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f30590b-c105-4b78-a381-5b7d1ca4eadb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:54:11.971297 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f30590b-c105-4b78-a381-5b7d1ca4eadb admin admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:54:11.981093 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 1212/2470] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Sep 13 19:54:11 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 19:54:11.985092 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f3c41c-e5d7-4ccb-8056-c860a62f7b83 admin admin] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:54:11.995050 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f3c41c-e5d7-4ccb-8056-c860a62f7b83 admin admin] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:54:11.999548 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75af781-7dce-438a-ab84-75ce996843d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:54:12.000126 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75af781-7dce-438a-ab84-75ce996843d5 admin admin] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:54:12.000437 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75af781-7dce-438a-ab84-75ce996843d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:54:12.000704 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75af781-7dce-438a-ab84-75ce996843d5 admin admin] PATH_INFO: `/v3/roles` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:54:12.001635 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b75af781-7dce-438a-ab84-75ce996843d5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:54:12.003873 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b75af781-7dce-438a-ab84-75ce996843d5 admin admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:54:12.014446 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 1259/2471] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Sep 13 19:54:11 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 19:54:12.019362 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f30590b-c105-4b78-a381-5b7d1ca4eadb admin admin] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:54:12.029227 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f30590b-c105-4b78-a381-5b7d1ca4eadb admin admin] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:54:12.033896 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78079a1b-65fe-4168-a0fa-950ea2dc60e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:54:12.034535 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78079a1b-65fe-4168-a0fa-950ea2dc60e2 admin admin] REQUEST_METHOD: `PUT` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:54:12.034811 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78079a1b-65fe-4168-a0fa-950ea2dc60e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:54:12.035077 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78079a1b-65fe-4168-a0fa-950ea2dc60e2 admin admin] PATH_INFO: `/v3/projects/ae06a9de0aca43a4a9a3829a60740077/users/270a0175bfed4a5f9dac6d73120d27e1/roles/a259191f6d0e46fabd9f34536bb28747` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:54:12.049353 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78079a1b-65fe-4168-a0fa-950ea2dc60e2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ae06a9de0aca43a4a9a3829a60740077, user_id=270a0175bfed4a5f9dac6d73120d27e1, role_id=a259191f6d0e46fabd9f34536bb28747)` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:54:12.052060 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78079a1b-65fe-4168-a0fa-950ea2dc60e2 admin admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:54:12.065421 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 1213/2472] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Sep 13 19:54:12 2022] PUT /identity/v3/projects/ae06a9de0aca43a4a9a3829a60740077/users/270a0175bfed4a5f9dac6d73120d27e1/roles/a259191f6d0e46fabd9f34536bb28747 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 19:54:12.076923 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36f52be-32ab-465d-9920-e74fd2dc87d2 None None] REQUEST_METHOD: `POST` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:54:12.077207 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36f52be-32ab-465d-9920-e74fd2dc87d2 None None] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:54:12.077768 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36f52be-32ab-465d-9920-e74fd2dc87d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:54:12.105423 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.auth.core [None req-f36f52be-32ab-465d-9920-e74fd2dc87d2 None None] MFA Rules not processed for user `270a0175bfed4a5f9dac6d73120d27e1`. Rule list: `[]` (Enabled: `True`). {{(pid=87934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:54:12.106659 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.fernet_utils [None req-f36f52be-32ab-465d-9920-e74fd2dc87d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:54:12.168869 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 1260/2473] 10.222.0.25 () {58 vars in 958 bytes} [Tue Sep 13 19:54:12 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 19:54:12.173234 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78079a1b-65fe-4168-a0fa-950ea2dc60e2 admin admin] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:54:12.234675 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78079a1b-65fe-4168-a0fa-950ea2dc60e2 admin admin] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:54:12.239451 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffcd3683-47ff-4add-936b-12ce4305c9f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:54:12.240042 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffcd3683-47ff-4add-936b-12ce4305c9f5 admin admin] REQUEST_METHOD: `POST` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:54:12.240349 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffcd3683-47ff-4add-936b-12ce4305c9f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:54:12.240617 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffcd3683-47ff-4add-936b-12ce4305c9f5 admin admin] PATH_INFO: `/v3/projects` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:54:12.241231 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffcd3683-47ff-4add-936b-12ce4305c9f5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:54:12.243122 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffcd3683-47ff-4add-936b-12ce4305c9f5 admin admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:54:12.270937 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 1214/2474] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Sep 13 19:54:12 2022] POST /identity/v3/projects => generated 365 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 13 19:54:12.275217 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36f52be-32ab-465d-9920-e74fd2dc87d2 None None] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:54:12.286008 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36f52be-32ab-465d-9920-e74fd2dc87d2 None None] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:54:12.344548 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad1647e-0971-4dba-bdf6-f237376e94b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:54:12.345151 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad1647e-0971-4dba-bdf6-f237376e94b9 admin admin] REQUEST_METHOD: `POST` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:54:12.345429 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad1647e-0971-4dba-bdf6-f237376e94b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:54:12.345698 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad1647e-0971-4dba-bdf6-f237376e94b9 admin admin] PATH_INFO: `/v3/users` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:54:12.346315 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad1647e-0971-4dba-bdf6-f237376e94b9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:54:12.348248 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad1647e-0971-4dba-bdf6-f237376e94b9 admin admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:54:12.370447 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 1261/2475] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Sep 13 19:54:12 2022] POST /identity/v3/users => generated 289 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 19:54:12.374419 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffcd3683-47ff-4add-936b-12ce4305c9f5 admin admin] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:54:12.385412 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffcd3683-47ff-4add-936b-12ce4305c9f5 admin admin] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:54:12.390020 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238a82e1-6806-4961-ac0d-9aef0fc2e77e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:54:12.390610 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238a82e1-6806-4961-ac0d-9aef0fc2e77e admin admin] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:54:12.390886 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238a82e1-6806-4961-ac0d-9aef0fc2e77e admin admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:54:12.391153 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238a82e1-6806-4961-ac0d-9aef0fc2e77e admin admin] PATH_INFO: `/v3/roles` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:54:12.391783 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-238a82e1-6806-4961-ac0d-9aef0fc2e77e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:54:12.393442 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-238a82e1-6806-4961-ac0d-9aef0fc2e77e admin admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:54:12.403808 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 1215/2476] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Sep 13 19:54:12 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 19:54:12.408075 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad1647e-0971-4dba-bdf6-f237376e94b9 admin admin] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:54:12.418097 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad1647e-0971-4dba-bdf6-f237376e94b9 admin admin] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:54:12.422728 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03cafb3-e37d-46f1-9f0d-3493092972bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:54:12.423416 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03cafb3-e37d-46f1-9f0d-3493092972bf admin admin] REQUEST_METHOD: `PUT` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:54:12.423690 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03cafb3-e37d-46f1-9f0d-3493092972bf admin admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:54:12.423958 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03cafb3-e37d-46f1-9f0d-3493092972bf admin admin] PATH_INFO: `/v3/projects/2c065d3f7936493f9d6ee4abc813f6d9/users/ed3038aec39a4473943e0165aa8ca04c/roles/6ca1d4427ff64e0a9d25d96cfb1445f6` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:54:12.438950 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b03cafb3-e37d-46f1-9f0d-3493092972bf admin admin] RBAC: Authorizing `identity:create_grant(project_id=2c065d3f7936493f9d6ee4abc813f6d9, user_id=ed3038aec39a4473943e0165aa8ca04c, role_id=6ca1d4427ff64e0a9d25d96cfb1445f6)` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:54:12.442193 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b03cafb3-e37d-46f1-9f0d-3493092972bf admin admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:54:12.455193 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 1262/2477] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Sep 13 19:54:12 2022] PUT /identity/v3/projects/2c065d3f7936493f9d6ee4abc813f6d9/users/ed3038aec39a4473943e0165aa8ca04c/roles/6ca1d4427ff64e0a9d25d96cfb1445f6 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 19:54:12.459239 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238a82e1-6806-4961-ac0d-9aef0fc2e77e admin admin] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:54:12.469469 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238a82e1-6806-4961-ac0d-9aef0fc2e77e admin admin] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:54:12.478527 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG dbcounter [-] [87935] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=87935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:54:12.528196 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9cc34ac-8eef-49b9-a916-59b067dde20e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:54:12.528759 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9cc34ac-8eef-49b9-a916-59b067dde20e admin admin] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:54:12.529040 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9cc34ac-8eef-49b9-a916-59b067dde20e admin admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:54:12.529310 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9cc34ac-8eef-49b9-a916-59b067dde20e admin admin] PATH_INFO: `/v3/roles` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:54:12.529945 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9cc34ac-8eef-49b9-a916-59b067dde20e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:54:12.531534 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9cc34ac-8eef-49b9-a916-59b067dde20e admin admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:54:12.541262 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 1216/2478] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Sep 13 19:54:12 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 19:54:12.545357 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03cafb3-e37d-46f1-9f0d-3493092972bf admin admin] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:54:12.556639 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03cafb3-e37d-46f1-9f0d-3493092972bf admin admin] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:54:12.561321 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5d959e-576d-4c56-a353-9eb1aaa04473 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:54:12.561963 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5d959e-576d-4c56-a353-9eb1aaa04473 admin admin] REQUEST_METHOD: `PUT` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:54:12.562243 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5d959e-576d-4c56-a353-9eb1aaa04473 admin admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:54:12.562514 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5d959e-576d-4c56-a353-9eb1aaa04473 admin admin] PATH_INFO: `/v3/projects/2c065d3f7936493f9d6ee4abc813f6d9/users/ed3038aec39a4473943e0165aa8ca04c/roles/6ca1d4427ff64e0a9d25d96cfb1445f6` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:54:12.564452 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac5d959e-576d-4c56-a353-9eb1aaa04473 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2c065d3f7936493f9d6ee4abc813f6d9, user_id=ed3038aec39a4473943e0165aa8ca04c, role_id=6ca1d4427ff64e0a9d25d96cfb1445f6)` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:54:12.567934 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac5d959e-576d-4c56-a353-9eb1aaa04473 admin admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:54:12.578327 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 1263/2479] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Sep 13 19:54:12 2022] PUT /identity/v3/projects/2c065d3f7936493f9d6ee4abc813f6d9/users/ed3038aec39a4473943e0165aa8ca04c/roles/6ca1d4427ff64e0a9d25d96cfb1445f6 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 19:54:12.588850 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938329ef-2810-43e2-aa66-535a6b4153b9 None None] REQUEST_METHOD: `POST` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:54:12.589163 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938329ef-2810-43e2-aa66-535a6b4153b9 None None] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:54:12.589433 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938329ef-2810-43e2-aa66-535a6b4153b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:54:12.617486 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.auth.core [None req-938329ef-2810-43e2-aa66-535a6b4153b9 None None] MFA Rules not processed for user `ed3038aec39a4473943e0165aa8ca04c`. Rule list: `[]` (Enabled: `True`). {{(pid=87935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:54:12.618683 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.fernet_utils [None req-938329ef-2810-43e2-aa66-535a6b4153b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:54:12.686866 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 1217/2480] 10.222.0.25 () {58 vars in 958 bytes} [Tue Sep 13 19:54:12 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 19:54:12.698329 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5d959e-576d-4c56-a353-9eb1aaa04473 admin admin] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:54:12.700032 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.fernet_utils [None req-ac5d959e-576d-4c56-a353-9eb1aaa04473 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:54:12.705669 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG dbcounter [-] [87934] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=87934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:54:12.759683 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5d959e-576d-4c56-a353-9eb1aaa04473 admin admin] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:54:12.763283 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c8eda4-25a2-4982-8b4c-3cbc8ae6f3c3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cbb50c88b794a7f9f26844effde7d63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a10a4268f3c4cb29f4e00c292e2df62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:54:12.763881 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c8eda4-25a2-4982-8b4c-3cbc8ae6f3c3 service cinder] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:54:12.764178 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c8eda4-25a2-4982-8b4c-3cbc8ae6f3c3 service cinder] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:54:12.764530 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c8eda4-25a2-4982-8b4c-3cbc8ae6f3c3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:54:12.773342 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c8eda4-25a2-4982-8b4c-3cbc8ae6f3c3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:54:12.774739 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c8eda4-25a2-4982-8b4c-3cbc8ae6f3c3 service cinder] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:54:12.784523 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 1264/2481] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Sep 13 19:54:12 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 19:54:13.208536 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938329ef-2810-43e2-aa66-535a6b4153b9 None None] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:54:13.271468 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938329ef-2810-43e2-aa66-535a6b4153b9 None None] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:54:13.275919 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6faf2e-d36c-4fc2-bdee-4965697c1c86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:54:13.276577 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6faf2e-d36c-4fc2-bdee-4965697c1c86 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:54:13.276853 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6faf2e-d36c-4fc2-bdee-4965697c1c86 admin admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:54:13.277119 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6faf2e-d36c-4fc2-bdee-4965697c1c86 admin admin] PATH_INFO: `/v3/users/270a0175bfed4a5f9dac6d73120d27e1` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:54:13.278211 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf6faf2e-d36c-4fc2-bdee-4965697c1c86 admin admin] RBAC: Authorizing `identity:delete_user(user_id=270a0175bfed4a5f9dac6d73120d27e1)` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:54:13.280131 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf6faf2e-d36c-4fc2-bdee-4965697c1c86 admin admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:54:13.321316 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG dbcounter [-] [87935] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=87935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:54:13.331421 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.notifications [None req-bf6faf2e-d36c-4fc2-bdee-4965697c1c86 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '270a0175bfed4a5f9dac6d73120d27e1'} {{(pid=87935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:54:13.338817 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.notifications [None req-bf6faf2e-d36c-4fc2-bdee-4965697c1c86 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '270a0175bfed4a5f9dac6d73120d27e1'} {{(pid=87935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:54:13.351768 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.notifications [None req-bf6faf2e-d36c-4fc2-bdee-4965697c1c86 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '270a0175bfed4a5f9dac6d73120d27e1'} {{(pid=87935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:54:13.352420 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.notifications [None req-bf6faf2e-d36c-4fc2-bdee-4965697c1c86 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '270a0175bfed4a5f9dac6d73120d27e1'} {{(pid=87935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:54:13.353014 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.notifications [None req-bf6faf2e-d36c-4fc2-bdee-4965697c1c86 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '270a0175bfed4a5f9dac6d73120d27e1'} {{(pid=87935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:54:13.365822 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 1218/2482] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Sep 13 19:54:13 2022] DELETE /identity/v3/users/270a0175bfed4a5f9dac6d73120d27e1 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 19:54:13.370514 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab661b5-e1b6-4af7-b328-6468f955f3bb None None] REQUEST_METHOD: `POST` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:54:13.371001 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab661b5-e1b6-4af7-b328-6468f955f3bb None None] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:54:13.371104 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab661b5-e1b6-4af7-b328-6468f955f3bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:54:13.391059 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.auth.core [None req-4ab661b5-e1b6-4af7-b328-6468f955f3bb None None] MFA Rules not processed for user `7b0aed92d02344acb92a0e4aa67c3068`. Rule list: `[]` (Enabled: `True`). {{(pid=87934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:54:13.392258 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.fernet_utils [None req-4ab661b5-e1b6-4af7-b328-6468f955f3bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:54:13.449596 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 1265/2483] 10.222.0.25 () {58 vars in 958 bytes} [Tue Sep 13 19:54:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 19:54:13.460394 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6faf2e-d36c-4fc2-bdee-4965697c1c86 admin admin] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:54:13.461828 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.fernet_utils [None req-bf6faf2e-d36c-4fc2-bdee-4965697c1c86 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:54:13.519923 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6faf2e-d36c-4fc2-bdee-4965697c1c86 admin admin] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:54:13.523680 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829d88c7-62b3-44f1-bf70-f9f2feecb136 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1196a96e4a404f559600b69f929ea9da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a10a4268f3c4cb29f4e00c292e2df62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:54:13.524313 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829d88c7-62b3-44f1-bf70-f9f2feecb136 service neutron] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:54:13.524592 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829d88c7-62b3-44f1-bf70-f9f2feecb136 service neutron] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:54:13.524890 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829d88c7-62b3-44f1-bf70-f9f2feecb136 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:54:13.534092 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-829d88c7-62b3-44f1-bf70-f9f2feecb136 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:54:13.535515 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-829d88c7-62b3-44f1-bf70-f9f2feecb136 service neutron] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:54:13.544778 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 1219/2484] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Sep 13 19:54:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 19:54:13.814229 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab661b5-e1b6-4af7-b328-6468f955f3bb None None] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:54:13.816323 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.fernet_utils [None req-4ab661b5-e1b6-4af7-b328-6468f955f3bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:54:13.831386 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab661b5-e1b6-4af7-b328-6468f955f3bb None None] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:54:13.842970 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c1c2c7-0d0d-4f66-8666-b6d1fba261ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:54:13.843624 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c1c2c7-0d0d-4f66-8666-b6d1fba261ae admin admin] REQUEST_METHOD: `DELETE` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:54:13.843903 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c1c2c7-0d0d-4f66-8666-b6d1fba261ae admin admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:54:13.844171 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c1c2c7-0d0d-4f66-8666-b6d1fba261ae admin admin] PATH_INFO: `/v3/projects/ae06a9de0aca43a4a9a3829a60740077` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:54:13.845371 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c1c2c7-0d0d-4f66-8666-b6d1fba261ae admin admin] RBAC: Authorizing `identity:delete_project(project_id=ae06a9de0aca43a4a9a3829a60740077)` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:54:13.847437 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c1c2c7-0d0d-4f66-8666-b6d1fba261ae admin admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:54:13.897204 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.notifications [None req-56c1c2c7-0d0d-4f66-8666-b6d1fba261ae admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ae06a9de0aca43a4a9a3829a60740077', 'request_id': 'req-56c1c2c7-0d0d-4f66-8666-b6d1fba261ae'} {{(pid=87934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:54:13.903292 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.notifications [None req-56c1c2c7-0d0d-4f66-8666-b6d1fba261ae admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ae06a9de0aca43a4a9a3829a60740077', 'request_id': 'req-56c1c2c7-0d0d-4f66-8666-b6d1fba261ae'} {{(pid=87934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:54:13.909027 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.notifications [None req-56c1c2c7-0d0d-4f66-8666-b6d1fba261ae admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ae06a9de0aca43a4a9a3829a60740077', 'request_id': 'req-56c1c2c7-0d0d-4f66-8666-b6d1fba261ae'} {{(pid=87934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:54:13.921064 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.notifications [None req-56c1c2c7-0d0d-4f66-8666-b6d1fba261ae admin admin] The token cache is being invalidate because project ae06a9de0aca43a4a9a3829a60740077 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87934) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 19:54:13.921350 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.notifications [None req-56c1c2c7-0d0d-4f66-8666-b6d1fba261ae admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:54:13.922056 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.notifications [None req-56c1c2c7-0d0d-4f66-8666-b6d1fba261ae admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:54:13.923628 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 1266/2485] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Sep 13 19:54:13 2022] DELETE /identity/v3/projects/ae06a9de0aca43a4a9a3829a60740077 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 19:54:13.928807 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829d88c7-62b3-44f1-bf70-f9f2feecb136 service neutron] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:54:13.938398 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829d88c7-62b3-44f1-bf70-f9f2feecb136 service neutron] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:54:13.994503 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05e7c1e-3f59-4cbe-a5ec-176fb83df423 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:54:13.995122 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05e7c1e-3f59-4cbe-a5ec-176fb83df423 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:54:13.995396 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05e7c1e-3f59-4cbe-a5ec-176fb83df423 admin admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:54:13.995660 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05e7c1e-3f59-4cbe-a5ec-176fb83df423 admin admin] PATH_INFO: `/v3/users/ed3038aec39a4473943e0165aa8ca04c` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:54:13.996797 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f05e7c1e-3f59-4cbe-a5ec-176fb83df423 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ed3038aec39a4473943e0165aa8ca04c)` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:54:13.998760 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f05e7c1e-3f59-4cbe-a5ec-176fb83df423 admin admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:54:14.046505 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.notifications [None req-f05e7c1e-3f59-4cbe-a5ec-176fb83df423 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ed3038aec39a4473943e0165aa8ca04c'} {{(pid=87935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:54:14.055295 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.notifications [None req-f05e7c1e-3f59-4cbe-a5ec-176fb83df423 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ed3038aec39a4473943e0165aa8ca04c'} {{(pid=87935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:54:14.062123 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG dbcounter [-] [87935] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=87935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:54:14.072643 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.notifications [None req-f05e7c1e-3f59-4cbe-a5ec-176fb83df423 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ed3038aec39a4473943e0165aa8ca04c'} {{(pid=87935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:54:14.073408 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.notifications [None req-f05e7c1e-3f59-4cbe-a5ec-176fb83df423 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ed3038aec39a4473943e0165aa8ca04c'} {{(pid=87935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:54:14.074739 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.notifications [None req-f05e7c1e-3f59-4cbe-a5ec-176fb83df423 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ed3038aec39a4473943e0165aa8ca04c'} {{(pid=87935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:54:14.077832 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c1c2c7-0d0d-4f66-8666-b6d1fba261ae admin admin] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:54:14.079216 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.fernet_utils [None req-56c1c2c7-0d0d-4f66-8666-b6d1fba261ae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:54:14.087947 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 1220/2486] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Sep 13 19:54:13 2022] DELETE /identity/v3/users/ed3038aec39a4473943e0165aa8ca04c => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 19:54:14.113779 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG dbcounter [-] [87934] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=87934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:54:14.142970 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c1c2c7-0d0d-4f66-8666-b6d1fba261ae admin admin] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:54:14.196684 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b3d980-4982-4c84-ae3a-342a98aa7756 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1196a96e4a404f559600b69f929ea9da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a10a4268f3c4cb29f4e00c292e2df62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:54:14.197305 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b3d980-4982-4c84-ae3a-342a98aa7756 service neutron] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:54:14.197590 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b3d980-4982-4c84-ae3a-342a98aa7756 service neutron] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:54:14.197865 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b3d980-4982-4c84-ae3a-342a98aa7756 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:54:14.199602 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.fernet_utils [None req-19b3d980-4982-4c84-ae3a-342a98aa7756 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:54:14.275130 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b3d980-4982-4c84-ae3a-342a98aa7756 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:54:14.276774 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b3d980-4982-4c84-ae3a-342a98aa7756 service neutron] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:54:14.288631 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 1267/2487] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Sep 13 19:54:14 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 212 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 13 19:54:14.431262 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05e7c1e-3f59-4cbe-a5ec-176fb83df423 admin admin] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:54:14.432777 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.fernet_utils [None req-f05e7c1e-3f59-4cbe-a5ec-176fb83df423 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:54:14.503260 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05e7c1e-3f59-4cbe-a5ec-176fb83df423 admin admin] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:54:14.507850 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4d09bf-7586-45d3-853e-c4f74d9fac6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:54:14.508508 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4d09bf-7586-45d3-853e-c4f74d9fac6c admin admin] REQUEST_METHOD: `DELETE` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:54:14.508788 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4d09bf-7586-45d3-853e-c4f74d9fac6c admin admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:54:14.509059 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4d09bf-7586-45d3-853e-c4f74d9fac6c admin admin] PATH_INFO: `/v3/projects/2c065d3f7936493f9d6ee4abc813f6d9` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:54:14.510192 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc4d09bf-7586-45d3-853e-c4f74d9fac6c admin admin] RBAC: Authorizing `identity:delete_project(project_id=2c065d3f7936493f9d6ee4abc813f6d9)` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:54:14.512093 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc4d09bf-7586-45d3-853e-c4f74d9fac6c admin admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:54:14.559375 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.notifications [None req-dc4d09bf-7586-45d3-853e-c4f74d9fac6c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2c065d3f7936493f9d6ee4abc813f6d9', 'request_id': 'req-dc4d09bf-7586-45d3-853e-c4f74d9fac6c'} {{(pid=87935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:54:14.565099 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.notifications [None req-dc4d09bf-7586-45d3-853e-c4f74d9fac6c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2c065d3f7936493f9d6ee4abc813f6d9', 'request_id': 'req-dc4d09bf-7586-45d3-853e-c4f74d9fac6c'} {{(pid=87935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:54:14.572971 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.notifications [None req-dc4d09bf-7586-45d3-853e-c4f74d9fac6c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2c065d3f7936493f9d6ee4abc813f6d9', 'request_id': 'req-dc4d09bf-7586-45d3-853e-c4f74d9fac6c'} {{(pid=87935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:54:14.584938 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.notifications [None req-dc4d09bf-7586-45d3-853e-c4f74d9fac6c admin admin] The token cache is being invalidate because project 2c065d3f7936493f9d6ee4abc813f6d9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87935) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 19:54:14.585146 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.notifications [None req-dc4d09bf-7586-45d3-853e-c4f74d9fac6c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:54:14.585775 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.notifications [None req-dc4d09bf-7586-45d3-853e-c4f74d9fac6c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:54:14.587243 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 1221/2488] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Sep 13 19:54:14 2022] DELETE /identity/v3/projects/2c065d3f7936493f9d6ee4abc813f6d9 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 19:54:14.592140 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7316cd-a45b-4b4d-9545-8ee7ce0510f8 None None] REQUEST_METHOD: `POST` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:54:14.592643 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7316cd-a45b-4b4d-9545-8ee7ce0510f8 None None] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:54:14.592751 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7316cd-a45b-4b4d-9545-8ee7ce0510f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:54:14.612556 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.auth.core [None req-7b7316cd-a45b-4b4d-9545-8ee7ce0510f8 None None] MFA Rules not processed for user `7b0aed92d02344acb92a0e4aa67c3068`. Rule list: `[]` (Enabled: `True`). {{(pid=87934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:54:14.613753 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.fernet_utils [None req-7b7316cd-a45b-4b4d-9545-8ee7ce0510f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:54:14.672218 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 1268/2489] 10.222.0.25 () {58 vars in 958 bytes} [Tue Sep 13 19:54:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 19:54:14.681201 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d8cc22-e1cf-4c1b-9c79-c47b2e2f3d64 None None] REQUEST_METHOD: `POST` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:54:14.681485 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d8cc22-e1cf-4c1b-9c79-c47b2e2f3d64 None None] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:54:14.681759 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d8cc22-e1cf-4c1b-9c79-c47b2e2f3d64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:54:14.701337 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.auth.core [None req-94d8cc22-e1cf-4c1b-9c79-c47b2e2f3d64 None None] MFA Rules not processed for user `7b0aed92d02344acb92a0e4aa67c3068`. Rule list: `[]` (Enabled: `True`). {{(pid=87935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:54:14.702783 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.fernet_utils [None req-94d8cc22-e1cf-4c1b-9c79-c47b2e2f3d64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:54:14.711266 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 1222/2490] 10.222.0.25 () {58 vars in 958 bytes} [Tue Sep 13 19:54:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 19:54:14.715704 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7316cd-a45b-4b4d-9545-8ee7ce0510f8 None None] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:54:14.725976 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7316cd-a45b-4b4d-9545-8ee7ce0510f8 None None] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:54:14.730528 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84835d7a-a0ce-43d3-8c79-8ae568ab486e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:54:14.731119 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84835d7a-a0ce-43d3-8c79-8ae568ab486e admin admin] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:54:14.731395 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84835d7a-a0ce-43d3-8c79-8ae568ab486e admin admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:54:14.731667 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84835d7a-a0ce-43d3-8c79-8ae568ab486e admin admin] PATH_INFO: `/v3/domains` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:54:14.732336 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84835d7a-a0ce-43d3-8c79-8ae568ab486e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87934) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:54:14.732640 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84835d7a-a0ce-43d3-8c79-8ae568ab486e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:54:14.734216 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84835d7a-a0ce-43d3-8c79-8ae568ab486e admin admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:54:14.745564 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 1269/2491] 10.222.0.25 () {58 vars in 1153 bytes} [Tue Sep 13 19:54:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:54:14.749806 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d8cc22-e1cf-4c1b-9c79-c47b2e2f3d64 None None] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:54:14.758944 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d8cc22-e1cf-4c1b-9c79-c47b2e2f3d64 None None] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:54:14.763569 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507d8f23-285d-4781-8b07-f7860253a484 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:54:14.764242 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507d8f23-285d-4781-8b07-f7860253a484 admin admin] REQUEST_METHOD: `POST` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:54:14.764525 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507d8f23-285d-4781-8b07-f7860253a484 admin admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:54:14.764790 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507d8f23-285d-4781-8b07-f7860253a484 admin admin] PATH_INFO: `/v3/projects` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:54:14.765402 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-507d8f23-285d-4781-8b07-f7860253a484 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:54:14.767271 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-507d8f23-285d-4781-8b07-f7860253a484 admin admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:54:14.794923 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 1223/2492] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Sep 13 19:54:14 2022] POST /identity/v3/projects => generated 387 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 19:54:14.799225 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84835d7a-a0ce-43d3-8c79-8ae568ab486e admin admin] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:54:14.809761 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84835d7a-a0ce-43d3-8c79-8ae568ab486e admin admin] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:54:14.818927 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG dbcounter [-] [87934] Writing DB stats keystone:SELECT=100 {{(pid=87934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:54:14.867607 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2b9b6c-d19c-46fa-9118-fc86296667f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:54:14.868136 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2b9b6c-d19c-46fa-9118-fc86296667f2 admin admin] REQUEST_METHOD: `POST` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:54:14.868449 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2b9b6c-d19c-46fa-9118-fc86296667f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:54:14.868717 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2b9b6c-d19c-46fa-9118-fc86296667f2 admin admin] PATH_INFO: `/v3/users` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:54:14.869346 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca2b9b6c-d19c-46fa-9118-fc86296667f2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:54:14.871253 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca2b9b6c-d19c-46fa-9118-fc86296667f2 admin admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:54:14.892906 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 1270/2493] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Sep 13 19:54:14 2022] POST /identity/v3/users => generated 294 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 13 19:54:14.898135 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507d8f23-285d-4781-8b07-f7860253a484 admin admin] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:54:14.908781 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507d8f23-285d-4781-8b07-f7860253a484 admin admin] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:54:14.913406 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bbb1e9c-c5e0-4a8d-9551-3e9361134bab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:54:14.914000 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbb1e9c-c5e0-4a8d-9551-3e9361134bab admin admin] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:54:14.914279 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbb1e9c-c5e0-4a8d-9551-3e9361134bab admin admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:54:14.914550 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbb1e9c-c5e0-4a8d-9551-3e9361134bab admin admin] PATH_INFO: `/v3/roles` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:54:14.915180 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bbb1e9c-c5e0-4a8d-9551-3e9361134bab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:54:14.916818 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bbb1e9c-c5e0-4a8d-9551-3e9361134bab admin admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:54:14.926622 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 1224/2494] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Sep 13 19:54:14 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 19:54:14.930680 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2b9b6c-d19c-46fa-9118-fc86296667f2 admin admin] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:54:14.941323 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2b9b6c-d19c-46fa-9118-fc86296667f2 admin admin] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:54:14.945826 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42934944-f865-4803-90d6-aef2684bd6d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:54:14.946399 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42934944-f865-4803-90d6-aef2684bd6d8 admin admin] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:54:14.946674 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42934944-f865-4803-90d6-aef2684bd6d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:54:14.946940 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42934944-f865-4803-90d6-aef2684bd6d8 admin admin] PATH_INFO: `/v3/roles` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:54:14.947564 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42934944-f865-4803-90d6-aef2684bd6d8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:54:14.949181 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42934944-f865-4803-90d6-aef2684bd6d8 admin admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:54:14.961000 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 1271/2495] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Sep 13 19:54:14 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 19:54:14.965283 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bbb1e9c-c5e0-4a8d-9551-3e9361134bab admin admin] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:54:14.975259 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bbb1e9c-c5e0-4a8d-9551-3e9361134bab admin admin] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:54:14.979759 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a916668e-1409-4e33-90b5-749724b4b25f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:54:14.980417 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a916668e-1409-4e33-90b5-749724b4b25f admin admin] REQUEST_METHOD: `PUT` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:54:14.980692 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a916668e-1409-4e33-90b5-749724b4b25f admin admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:54:14.980958 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a916668e-1409-4e33-90b5-749724b4b25f admin admin] PATH_INFO: `/v3/projects/1a87210239b14b9897ac3a22fa4a2a73/users/923a7e47cc8b40f6a1e1027629fea0a6/roles/a259191f6d0e46fabd9f34536bb28747` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:54:14.995444 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a916668e-1409-4e33-90b5-749724b4b25f admin admin] RBAC: Authorizing `identity:create_grant(project_id=1a87210239b14b9897ac3a22fa4a2a73, user_id=923a7e47cc8b40f6a1e1027629fea0a6, role_id=a259191f6d0e46fabd9f34536bb28747)` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:54:14.998124 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a916668e-1409-4e33-90b5-749724b4b25f admin admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:54:15.011806 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 1225/2496] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Sep 13 19:54:14 2022] PUT /identity/v3/projects/1a87210239b14b9897ac3a22fa4a2a73/users/923a7e47cc8b40f6a1e1027629fea0a6/roles/a259191f6d0e46fabd9f34536bb28747 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 19:54:15.022790 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1418e18-ebe0-4b9b-a4e1-8b13a2a8d2bf None None] REQUEST_METHOD: `POST` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:54:15.023075 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1418e18-ebe0-4b9b-a4e1-8b13a2a8d2bf None None] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:54:15.023348 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1418e18-ebe0-4b9b-a4e1-8b13a2a8d2bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:54:15.050357 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.auth.core [None req-e1418e18-ebe0-4b9b-a4e1-8b13a2a8d2bf None None] MFA Rules not processed for user `923a7e47cc8b40f6a1e1027629fea0a6`. Rule list: `[]` (Enabled: `True`). {{(pid=87934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:54:15.051547 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.fernet_utils [None req-e1418e18-ebe0-4b9b-a4e1-8b13a2a8d2bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:54:15.116196 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 1272/2497] 10.222.0.25 () {58 vars in 958 bytes} [Tue Sep 13 19:54:15 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 19:54:15.120802 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a916668e-1409-4e33-90b5-749724b4b25f admin admin] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:54:15.125319 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG dbcounter [-] [87935] Writing DB stats keystone:DELETE=9,keystone:SELECT=88,keystone:INSERT=3 {{(pid=87935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:54:15.184588 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a916668e-1409-4e33-90b5-749724b4b25f admin admin] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:54:15.189226 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14aeca16-194c-4a65-9544-e67924590d9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:54:15.190347 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14aeca16-194c-4a65-9544-e67924590d9c admin admin] REQUEST_METHOD: `POST` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:54:15.190653 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14aeca16-194c-4a65-9544-e67924590d9c admin admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:54:15.191012 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14aeca16-194c-4a65-9544-e67924590d9c admin admin] PATH_INFO: `/v3/projects` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:54:15.191637 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14aeca16-194c-4a65-9544-e67924590d9c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:54:15.193575 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14aeca16-194c-4a65-9544-e67924590d9c admin admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:54:15.224432 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 1226/2498] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Sep 13 19:54:15 2022] POST /identity/v3/projects => generated 385 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 19:54:15.225828 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1418e18-ebe0-4b9b-a4e1-8b13a2a8d2bf None None] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:54:15.236420 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1418e18-ebe0-4b9b-a4e1-8b13a2a8d2bf None None] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:54:15.302868 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b2b45b-7a68-4beb-a829-d52818b5be1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:54:15.303245 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b2b45b-7a68-4beb-a829-d52818b5be1c admin admin] REQUEST_METHOD: `POST` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:54:15.303523 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b2b45b-7a68-4beb-a829-d52818b5be1c admin admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:54:15.303789 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b2b45b-7a68-4beb-a829-d52818b5be1c admin admin] PATH_INFO: `/v3/users` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:54:15.304448 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b2b45b-7a68-4beb-a829-d52818b5be1c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:54:15.306458 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b2b45b-7a68-4beb-a829-d52818b5be1c admin admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:54:15.328370 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 1273/2499] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Sep 13 19:54:15 2022] POST /identity/v3/users => generated 293 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 19:54:15.332640 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14aeca16-194c-4a65-9544-e67924590d9c admin admin] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:54:15.343469 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14aeca16-194c-4a65-9544-e67924590d9c admin admin] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:54:15.348581 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a202a73c-0e96-4c3e-b11c-5168c7ec446f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:54:15.349170 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a202a73c-0e96-4c3e-b11c-5168c7ec446f admin admin] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:54:15.349448 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a202a73c-0e96-4c3e-b11c-5168c7ec446f admin admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:54:15.349714 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a202a73c-0e96-4c3e-b11c-5168c7ec446f admin admin] PATH_INFO: `/v3/roles` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:54:15.350341 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a202a73c-0e96-4c3e-b11c-5168c7ec446f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:54:15.351967 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a202a73c-0e96-4c3e-b11c-5168c7ec446f admin admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:54:15.363197 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 1227/2500] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Sep 13 19:54:15 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 19:54:15.367303 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b2b45b-7a68-4beb-a829-d52818b5be1c admin admin] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:54:15.377964 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b2b45b-7a68-4beb-a829-d52818b5be1c admin admin] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:54:15.382383 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb4812a-50ea-43e9-8602-2198904b23f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:54:15.382961 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb4812a-50ea-43e9-8602-2198904b23f8 admin admin] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:54:15.383235 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb4812a-50ea-43e9-8602-2198904b23f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:54:15.383499 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb4812a-50ea-43e9-8602-2198904b23f8 admin admin] PATH_INFO: `/v3/roles` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:54:15.384122 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb4812a-50ea-43e9-8602-2198904b23f8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:54:15.385717 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb4812a-50ea-43e9-8602-2198904b23f8 admin admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:54:15.390803 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG dbcounter [-] [87934] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=87934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:54:15.398421 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 1274/2501] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Sep 13 19:54:15 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 19:54:15.400046 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a202a73c-0e96-4c3e-b11c-5168c7ec446f admin admin] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:54:15.410092 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a202a73c-0e96-4c3e-b11c-5168c7ec446f admin admin] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:54:15.414766 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c6f780-e5b0-45b4-a402-e18bdfc2eb07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:54:15.415392 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c6f780-e5b0-45b4-a402-e18bdfc2eb07 admin admin] REQUEST_METHOD: `PUT` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:54:15.415670 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c6f780-e5b0-45b4-a402-e18bdfc2eb07 admin admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:54:15.415936 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c6f780-e5b0-45b4-a402-e18bdfc2eb07 admin admin] PATH_INFO: `/v3/projects/f478435fd6f6484ab5c21db5033738f7/users/8d3a1d10d8634b63956631fa168f9c9b/roles/a259191f6d0e46fabd9f34536bb28747` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:54:15.431317 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c6f780-e5b0-45b4-a402-e18bdfc2eb07 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f478435fd6f6484ab5c21db5033738f7, user_id=8d3a1d10d8634b63956631fa168f9c9b, role_id=a259191f6d0e46fabd9f34536bb28747)` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:54:15.433981 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c6f780-e5b0-45b4-a402-e18bdfc2eb07 admin admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:54:15.447520 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 1228/2502] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Sep 13 19:54:15 2022] PUT /identity/v3/projects/f478435fd6f6484ab5c21db5033738f7/users/8d3a1d10d8634b63956631fa168f9c9b/roles/a259191f6d0e46fabd9f34536bb28747 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 19:54:15.458634 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20c02c9-8d71-4f37-b8e1-e932f2c24c6e None None] REQUEST_METHOD: `POST` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:54:15.459300 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20c02c9-8d71-4f37-b8e1-e932f2c24c6e None None] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:54:15.459300 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20c02c9-8d71-4f37-b8e1-e932f2c24c6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:54:15.496259 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.auth.core [None req-e20c02c9-8d71-4f37-b8e1-e932f2c24c6e None None] MFA Rules not processed for user `8d3a1d10d8634b63956631fa168f9c9b`. Rule list: `[]` (Enabled: `True`). {{(pid=87934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:54:15.497564 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.fernet_utils [None req-e20c02c9-8d71-4f37-b8e1-e932f2c24c6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:54:15.507136 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c6f780-e5b0-45b4-a402-e18bdfc2eb07 admin admin] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:54:15.508966 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.fernet_utils [None req-42c6f780-e5b0-45b4-a402-e18bdfc2eb07 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:54:15.572037 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 1275/2503] 10.222.0.25 () {58 vars in 958 bytes} [Tue Sep 13 19:54:15 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 19:54:15.576279 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20c02c9-8d71-4f37-b8e1-e932f2c24c6e None None] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:54:15.578224 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c6f780-e5b0-45b4-a402-e18bdfc2eb07 admin admin] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:54:15.582657 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f4ef44-922e-4188-b189-27657a183091 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1196a96e4a404f559600b69f929ea9da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a10a4268f3c4cb29f4e00c292e2df62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:54:15.583285 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f4ef44-922e-4188-b189-27657a183091 service neutron] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:54:15.583740 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f4ef44-922e-4188-b189-27657a183091 service neutron] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:54:15.584853 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f4ef44-922e-4188-b189-27657a183091 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:54:15.587606 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.fernet_utils [None req-71f4ef44-922e-4188-b189-27657a183091 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:54:15.648565 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20c02c9-8d71-4f37-b8e1-e932f2c24c6e None None] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:54:15.653333 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb56b52-e375-4a55-9e76-3c0bda5fe87b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:54:15.653945 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb56b52-e375-4a55-9e76-3c0bda5fe87b admin admin] REQUEST_METHOD: `POST` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:54:15.654221 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb56b52-e375-4a55-9e76-3c0bda5fe87b admin admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:54:15.654492 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb56b52-e375-4a55-9e76-3c0bda5fe87b admin admin] PATH_INFO: `/v3/projects` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:54:15.655274 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb56b52-e375-4a55-9e76-3c0bda5fe87b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:54:15.657165 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb56b52-e375-4a55-9e76-3c0bda5fe87b admin admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:54:15.670208 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG dbcounter [-] [87935] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=87935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:54:15.675104 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f4ef44-922e-4188-b189-27657a183091 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:54:15.677024 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f4ef44-922e-4188-b189-27657a183091 service neutron] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:54:15.690036 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 1276/2504] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Sep 13 19:54:15 2022] POST /identity/v3/projects => generated 385 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 19:54:15.693409 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 1229/2505] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Sep 13 19:54:15 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 187 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 13 19:54:15.697192 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb56b52-e375-4a55-9e76-3c0bda5fe87b admin admin] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:54:15.767498 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb56b52-e375-4a55-9e76-3c0bda5fe87b admin admin] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:54:15.772142 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29458aa0-30b1-4502-b4a0-6d89aee9bd79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:54:15.772873 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29458aa0-30b1-4502-b4a0-6d89aee9bd79 admin admin] REQUEST_METHOD: `POST` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:54:15.773074 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29458aa0-30b1-4502-b4a0-6d89aee9bd79 admin admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:54:15.773366 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29458aa0-30b1-4502-b4a0-6d89aee9bd79 admin admin] PATH_INFO: `/v3/users` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:54:15.773960 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29458aa0-30b1-4502-b4a0-6d89aee9bd79 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:54:15.775897 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29458aa0-30b1-4502-b4a0-6d89aee9bd79 admin admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:54:15.804451 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 1277/2506] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Sep 13 19:54:15 2022] POST /identity/v3/users => generated 299 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 19:54:15.805742 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f4ef44-922e-4188-b189-27657a183091 service neutron] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:54:15.817598 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f4ef44-922e-4188-b189-27657a183091 service neutron] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:54:15.826283 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa18184b-3969-4fc9-95e6-9020a873a702 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:54:15.826905 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa18184b-3969-4fc9-95e6-9020a873a702 admin admin] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:54:15.827187 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa18184b-3969-4fc9-95e6-9020a873a702 admin admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:54:15.827451 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa18184b-3969-4fc9-95e6-9020a873a702 admin admin] PATH_INFO: `/v3/roles` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:54:15.828388 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa18184b-3969-4fc9-95e6-9020a873a702 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:54:15.829991 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa18184b-3969-4fc9-95e6-9020a873a702 admin admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:54:15.844616 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 1230/2507] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Sep 13 19:54:15 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 19:54:15.849901 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29458aa0-30b1-4502-b4a0-6d89aee9bd79 admin admin] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:54:15.856581 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG dbcounter [-] [87934] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=87934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:54:15.860652 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29458aa0-30b1-4502-b4a0-6d89aee9bd79 admin admin] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:54:15.867628 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a68edf-4e52-4c3f-8a76-0dae98e8e709 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:54:15.868317 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a68edf-4e52-4c3f-8a76-0dae98e8e709 admin admin] REQUEST_METHOD: `PUT` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:54:15.868597 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a68edf-4e52-4c3f-8a76-0dae98e8e709 admin admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:54:15.868873 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a68edf-4e52-4c3f-8a76-0dae98e8e709 admin admin] PATH_INFO: `/v3/projects/ffa6b8dbbad54f479a4f4ba828d7792f/users/7b354a92b4624bdc8a5278dfc3af953b/roles/6ca1d4427ff64e0a9d25d96cfb1445f6` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:54:15.884109 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a68edf-4e52-4c3f-8a76-0dae98e8e709 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ffa6b8dbbad54f479a4f4ba828d7792f, user_id=7b354a92b4624bdc8a5278dfc3af953b, role_id=6ca1d4427ff64e0a9d25d96cfb1445f6)` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:54:15.886811 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a68edf-4e52-4c3f-8a76-0dae98e8e709 admin admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:54:15.900260 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 1278/2508] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Sep 13 19:54:15 2022] PUT /identity/v3/projects/ffa6b8dbbad54f479a4f4ba828d7792f/users/7b354a92b4624bdc8a5278dfc3af953b/roles/6ca1d4427ff64e0a9d25d96cfb1445f6 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 19:54:15.904193 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa18184b-3969-4fc9-95e6-9020a873a702 admin admin] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:54:15.915187 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa18184b-3969-4fc9-95e6-9020a873a702 admin admin] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:54:15.977564 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bcaf86b-b0a5-412f-b38d-faa2f872be79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:54:15.977564 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcaf86b-b0a5-412f-b38d-faa2f872be79 admin admin] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:54:15.977887 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcaf86b-b0a5-412f-b38d-faa2f872be79 admin admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:54:15.978079 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcaf86b-b0a5-412f-b38d-faa2f872be79 admin admin] PATH_INFO: `/v3/roles` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:54:15.978714 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bcaf86b-b0a5-412f-b38d-faa2f872be79 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:54:15.980335 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bcaf86b-b0a5-412f-b38d-faa2f872be79 admin admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:54:15.994008 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 1231/2509] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Sep 13 19:54:15 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 19:54:15.995174 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a68edf-4e52-4c3f-8a76-0dae98e8e709 admin admin] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:54:16.005752 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a68edf-4e52-4c3f-8a76-0dae98e8e709 admin admin] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:54:16.010437 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f50ccb-ef4a-4481-a7ce-f08753fc30df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:54:16.011088 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f50ccb-ef4a-4481-a7ce-f08753fc30df admin admin] REQUEST_METHOD: `PUT` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:54:16.011366 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f50ccb-ef4a-4481-a7ce-f08753fc30df admin admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:54:16.011637 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f50ccb-ef4a-4481-a7ce-f08753fc30df admin admin] PATH_INFO: `/v3/projects/ffa6b8dbbad54f479a4f4ba828d7792f/users/7b354a92b4624bdc8a5278dfc3af953b/roles/6ca1d4427ff64e0a9d25d96cfb1445f6` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:54:16.013923 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f50ccb-ef4a-4481-a7ce-f08753fc30df admin admin] RBAC: Authorizing `identity:create_grant(project_id=ffa6b8dbbad54f479a4f4ba828d7792f, user_id=7b354a92b4624bdc8a5278dfc3af953b, role_id=6ca1d4427ff64e0a9d25d96cfb1445f6)` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:54:16.016596 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f50ccb-ef4a-4481-a7ce-f08753fc30df admin admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:54:16.028679 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 1279/2510] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Sep 13 19:54:15 2022] PUT /identity/v3/projects/ffa6b8dbbad54f479a4f4ba828d7792f/users/7b354a92b4624bdc8a5278dfc3af953b/roles/6ca1d4427ff64e0a9d25d96cfb1445f6 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 19:54:16.042029 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b949e2-3da2-4887-8803-a90504683d37 None None] REQUEST_METHOD: `POST` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:54:16.042315 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b949e2-3da2-4887-8803-a90504683d37 None None] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:54:16.042589 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b949e2-3da2-4887-8803-a90504683d37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:54:16.072702 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.auth.core [None req-d6b949e2-3da2-4887-8803-a90504683d37 None None] MFA Rules not processed for user `7b354a92b4624bdc8a5278dfc3af953b`. Rule list: `[]` (Enabled: `True`). {{(pid=87935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:54:16.073935 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.fernet_utils [None req-d6b949e2-3da2-4887-8803-a90504683d37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:54:16.148797 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 1232/2511] 10.222.0.25 () {58 vars in 958 bytes} [Tue Sep 13 19:54:16 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 19:54:16.159776 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f50ccb-ef4a-4481-a7ce-f08753fc30df admin admin] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:54:16.161511 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.fernet_utils [None req-98f50ccb-ef4a-4481-a7ce-f08753fc30df admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:54:16.219738 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f50ccb-ef4a-4481-a7ce-f08753fc30df admin admin] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:54:16.223474 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dbd76a5-4951-4e37-ba7b-d6ff13387dd4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cbb50c88b794a7f9f26844effde7d63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a10a4268f3c4cb29f4e00c292e2df62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:54:16.224075 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbd76a5-4951-4e37-ba7b-d6ff13387dd4 service cinder] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:54:16.224380 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbd76a5-4951-4e37-ba7b-d6ff13387dd4 service cinder] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:54:16.224649 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbd76a5-4951-4e37-ba7b-d6ff13387dd4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:54:16.233832 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dbd76a5-4951-4e37-ba7b-d6ff13387dd4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:54:16.235258 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dbd76a5-4951-4e37-ba7b-d6ff13387dd4 service cinder] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:54:16.245420 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 1280/2512] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Sep 13 19:54:16 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 19:54:16.437902 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed78915b-23af-4dea-b081-ff02b9c71a29 None None] REQUEST_METHOD: `POST` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:54:16.438352 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed78915b-23af-4dea-b081-ff02b9c71a29 None None] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:54:16.438454 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed78915b-23af-4dea-b081-ff02b9c71a29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:54:16.460012 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.auth.core [None req-ed78915b-23af-4dea-b081-ff02b9c71a29 None None] MFA Rules not processed for user `d44977a3225e43f19cdc4a84f0e170cd`. Rule list: `[]` (Enabled: `True`). {{(pid=87935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:54:16.461258 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.fernet_utils [None req-ed78915b-23af-4dea-b081-ff02b9c71a29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:54:16.542457 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 1233/2513] 10.222.0.25 () {58 vars in 1009 bytes} [Tue Sep 13 19:54:16 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 19:54:16.558678 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dbd76a5-4951-4e37-ba7b-d6ff13387dd4 service cinder] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:54:16.560421 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.fernet_utils [None req-0dbd76a5-4951-4e37-ba7b-d6ff13387dd4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:54:16.650244 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dbd76a5-4951-4e37-ba7b-d6ff13387dd4 service cinder] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:54:16.656696 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd1e1fc-cb5f-4679-bdc5-2304148b3640 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb42d6ac6cdd4d97a80c3ee0c6f8e3f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a10a4268f3c4cb29f4e00c292e2df62', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:54:16.657524 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd1e1fc-cb5f-4679-bdc5-2304148b3640 service swift] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:54:16.657650 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd1e1fc-cb5f-4679-bdc5-2304148b3640 service swift] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:54:16.657880 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd1e1fc-cb5f-4679-bdc5-2304148b3640 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:54:16.669093 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd1e1fc-cb5f-4679-bdc5-2304148b3640 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:54:16.670980 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd1e1fc-cb5f-4679-bdc5-2304148b3640 service swift] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:54:16.682559 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 1281/2514] 10.222.0.25 () {60 vars in 1384 bytes} [Tue Sep 13 19:54:16 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 13 19:54:16.925991 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed78915b-23af-4dea-b081-ff02b9c71a29 None None] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:54:16.927366 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.fernet_utils [None req-ed78915b-23af-4dea-b081-ff02b9c71a29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:54:16.942765 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed78915b-23af-4dea-b081-ff02b9c71a29 None None] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:54:16.947439 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a2b117-59b1-4f7f-86e4-61cdee1ceb9a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cbb50c88b794a7f9f26844effde7d63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a10a4268f3c4cb29f4e00c292e2df62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:54:16.948385 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a2b117-59b1-4f7f-86e4-61cdee1ceb9a service cinder] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:54:16.948661 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a2b117-59b1-4f7f-86e4-61cdee1ceb9a service cinder] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:54:16.949032 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a2b117-59b1-4f7f-86e4-61cdee1ceb9a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:54:16.955216 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG dbcounter [-] [87935] Writing DB stats keystone:SELECT=100 {{(pid=87935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:54:17.035337 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a2b117-59b1-4f7f-86e4-61cdee1ceb9a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:54:17.038347 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a2b117-59b1-4f7f-86e4-61cdee1ceb9a service cinder] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:54:17.049948 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 1234/2515] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Sep 13 19:54:16 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 19:54:21.412521 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd1e1fc-cb5f-4679-bdc5-2304148b3640 service swift] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:54:21.425122 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd1e1fc-cb5f-4679-bdc5-2304148b3640 service swift] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:54:21.428719 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e17f46-1226-4002-82da-77566674e9d2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cbb50c88b794a7f9f26844effde7d63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a10a4268f3c4cb29f4e00c292e2df62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:54:21.429323 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e17f46-1226-4002-82da-77566674e9d2 service cinder] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:54:21.429611 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e17f46-1226-4002-82da-77566674e9d2 service cinder] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:54:21.429883 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e17f46-1226-4002-82da-77566674e9d2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:54:21.510239 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e17f46-1226-4002-82da-77566674e9d2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:54:21.511836 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e17f46-1226-4002-82da-77566674e9d2 service cinder] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:54:21.519710 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG dbcounter [-] [87934] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=87934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:54:21.528455 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 1282/2516] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Sep 13 19:54:21 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 19:54:23.927629 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a2b117-59b1-4f7f-86e4-61cdee1ceb9a service cinder] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:54:24.000409 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a2b117-59b1-4f7f-86e4-61cdee1ceb9a service cinder] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:54:24.006191 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c774378-4833-4da4-8893-8eb68abfd5c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:54:24.006821 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c774378-4833-4da4-8893-8eb68abfd5c8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:54:24.007103 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c774378-4833-4da4-8893-8eb68abfd5c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:54:24.007372 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c774378-4833-4da4-8893-8eb68abfd5c8 admin admin] PATH_INFO: `/v3/users/923a7e47cc8b40f6a1e1027629fea0a6` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:54:24.008572 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c774378-4833-4da4-8893-8eb68abfd5c8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=923a7e47cc8b40f6a1e1027629fea0a6)` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:54:24.010479 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c774378-4833-4da4-8893-8eb68abfd5c8 admin admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:54:24.074753 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.notifications [None req-5c774378-4833-4da4-8893-8eb68abfd5c8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '923a7e47cc8b40f6a1e1027629fea0a6'} {{(pid=87935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:54:24.089196 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.notifications [None req-5c774378-4833-4da4-8893-8eb68abfd5c8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '923a7e47cc8b40f6a1e1027629fea0a6'} {{(pid=87935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:54:24.110651 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.notifications [None req-5c774378-4833-4da4-8893-8eb68abfd5c8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '923a7e47cc8b40f6a1e1027629fea0a6'} {{(pid=87935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:54:24.112573 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.notifications [None req-5c774378-4833-4da4-8893-8eb68abfd5c8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '923a7e47cc8b40f6a1e1027629fea0a6'} {{(pid=87935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:54:24.113191 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.notifications [None req-5c774378-4833-4da4-8893-8eb68abfd5c8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '923a7e47cc8b40f6a1e1027629fea0a6'} {{(pid=87935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:54:24.142654 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 1235/2517] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Sep 13 19:54:23 2022] DELETE /identity/v3/users/923a7e47cc8b40f6a1e1027629fea0a6 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 19:54:24.146061 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623c00aa-7ac1-4a8a-b964-04c5c0510719 None None] REQUEST_METHOD: `POST` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:54:24.146880 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623c00aa-7ac1-4a8a-b964-04c5c0510719 None None] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:54:24.147448 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623c00aa-7ac1-4a8a-b964-04c5c0510719 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:54:24.170529 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.auth.core [None req-623c00aa-7ac1-4a8a-b964-04c5c0510719 None None] MFA Rules not processed for user `7b0aed92d02344acb92a0e4aa67c3068`. Rule list: `[]` (Enabled: `True`). {{(pid=87934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:54:24.172015 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.fernet_utils [None req-623c00aa-7ac1-4a8a-b964-04c5c0510719 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:54:24.259407 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 1283/2518] 10.222.0.25 () {58 vars in 958 bytes} [Tue Sep 13 19:54:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 19:54:24.270076 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c774378-4833-4da4-8893-8eb68abfd5c8 admin admin] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:54:24.271996 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.fernet_utils [None req-5c774378-4833-4da4-8893-8eb68abfd5c8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:54:24.322981 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG dbcounter [-] [87935] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:54:24.359503 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c774378-4833-4da4-8893-8eb68abfd5c8 admin admin] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:54:24.363716 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a396449-ffaa-4398-a1f6-750b876da105 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1196a96e4a404f559600b69f929ea9da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a10a4268f3c4cb29f4e00c292e2df62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:54:24.366727 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a396449-ffaa-4398-a1f6-750b876da105 service neutron] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:54:24.366727 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a396449-ffaa-4398-a1f6-750b876da105 service neutron] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:54:24.366727 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a396449-ffaa-4398-a1f6-750b876da105 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:54:24.377963 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a396449-ffaa-4398-a1f6-750b876da105 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:54:24.379446 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a396449-ffaa-4398-a1f6-750b876da105 service neutron] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:54:24.393151 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 1236/2519] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Sep 13 19:54:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 19:54:24.714104 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623c00aa-7ac1-4a8a-b964-04c5c0510719 None None] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:54:24.715003 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.fernet_utils [None req-623c00aa-7ac1-4a8a-b964-04c5c0510719 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:54:24.735130 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623c00aa-7ac1-4a8a-b964-04c5c0510719 None None] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:54:24.741605 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9308524c-f505-4118-b061-50b8effb838c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:54:24.742287 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9308524c-f505-4118-b061-50b8effb838c admin admin] REQUEST_METHOD: `DELETE` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:54:24.742572 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9308524c-f505-4118-b061-50b8effb838c admin admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:54:24.742842 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9308524c-f505-4118-b061-50b8effb838c admin admin] PATH_INFO: `/v3/projects/1a87210239b14b9897ac3a22fa4a2a73` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:54:24.744069 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9308524c-f505-4118-b061-50b8effb838c admin admin] RBAC: Authorizing `identity:delete_project(project_id=1a87210239b14b9897ac3a22fa4a2a73)` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:54:24.746052 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9308524c-f505-4118-b061-50b8effb838c admin admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:54:24.805094 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.notifications [None req-9308524c-f505-4118-b061-50b8effb838c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1a87210239b14b9897ac3a22fa4a2a73', 'request_id': 'req-9308524c-f505-4118-b061-50b8effb838c'} {{(pid=87934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:54:24.811819 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.notifications [None req-9308524c-f505-4118-b061-50b8effb838c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1a87210239b14b9897ac3a22fa4a2a73', 'request_id': 'req-9308524c-f505-4118-b061-50b8effb838c'} {{(pid=87934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:54:24.818946 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.notifications [None req-9308524c-f505-4118-b061-50b8effb838c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1a87210239b14b9897ac3a22fa4a2a73', 'request_id': 'req-9308524c-f505-4118-b061-50b8effb838c'} {{(pid=87934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:54:24.833347 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.notifications [None req-9308524c-f505-4118-b061-50b8effb838c admin admin] The token cache is being invalidate because project 1a87210239b14b9897ac3a22fa4a2a73 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87934) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 19:54:24.833936 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.notifications [None req-9308524c-f505-4118-b061-50b8effb838c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:54:24.835095 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.notifications [None req-9308524c-f505-4118-b061-50b8effb838c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:54:24.836645 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 1284/2520] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Sep 13 19:54:24 2022] DELETE /identity/v3/projects/1a87210239b14b9897ac3a22fa4a2a73 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 19:54:24.840673 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a396449-ffaa-4398-a1f6-750b876da105 service neutron] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:54:24.851807 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a396449-ffaa-4398-a1f6-750b876da105 service neutron] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:54:24.928869 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19be37ba-0d6e-43b4-b1d7-e6d6f47bb435 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:54:24.929835 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19be37ba-0d6e-43b4-b1d7-e6d6f47bb435 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:54:24.930168 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19be37ba-0d6e-43b4-b1d7-e6d6f47bb435 admin admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:54:24.930508 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19be37ba-0d6e-43b4-b1d7-e6d6f47bb435 admin admin] PATH_INFO: `/v3/users/8d3a1d10d8634b63956631fa168f9c9b` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:54:24.931874 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19be37ba-0d6e-43b4-b1d7-e6d6f47bb435 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8d3a1d10d8634b63956631fa168f9c9b)` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:54:24.933915 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19be37ba-0d6e-43b4-b1d7-e6d6f47bb435 admin admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:54:24.991256 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.notifications [None req-19be37ba-0d6e-43b4-b1d7-e6d6f47bb435 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8d3a1d10d8634b63956631fa168f9c9b'} {{(pid=87935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:54:25.000560 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.notifications [None req-19be37ba-0d6e-43b4-b1d7-e6d6f47bb435 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8d3a1d10d8634b63956631fa168f9c9b'} {{(pid=87935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:54:25.014836 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.notifications [None req-19be37ba-0d6e-43b4-b1d7-e6d6f47bb435 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8d3a1d10d8634b63956631fa168f9c9b'} {{(pid=87935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:54:25.015920 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.notifications [None req-19be37ba-0d6e-43b4-b1d7-e6d6f47bb435 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8d3a1d10d8634b63956631fa168f9c9b'} {{(pid=87935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:54:25.016899 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.notifications [None req-19be37ba-0d6e-43b4-b1d7-e6d6f47bb435 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8d3a1d10d8634b63956631fa168f9c9b'} {{(pid=87935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:54:25.033992 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 1237/2521] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Sep 13 19:54:24 2022] DELETE /identity/v3/users/8d3a1d10d8634b63956631fa168f9c9b => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 19:54:25.381625 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9308524c-f505-4118-b061-50b8effb838c admin admin] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:54:25.383262 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.fernet_utils [None req-9308524c-f505-4118-b061-50b8effb838c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:54:25.399974 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9308524c-f505-4118-b061-50b8effb838c admin admin] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:54:25.477162 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eddd8245-cb69-468b-b6d0-4cd717837a64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:54:25.477799 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eddd8245-cb69-468b-b6d0-4cd717837a64 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:54:25.478076 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eddd8245-cb69-468b-b6d0-4cd717837a64 admin admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:54:25.478346 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eddd8245-cb69-468b-b6d0-4cd717837a64 admin admin] PATH_INFO: `/v3/projects/f478435fd6f6484ab5c21db5033738f7` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:54:25.479459 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eddd8245-cb69-468b-b6d0-4cd717837a64 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f478435fd6f6484ab5c21db5033738f7)` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:54:25.482209 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eddd8245-cb69-468b-b6d0-4cd717837a64 admin admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:54:25.515595 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG dbcounter [-] [87934] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=87934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:54:25.579661 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.notifications [None req-eddd8245-cb69-468b-b6d0-4cd717837a64 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f478435fd6f6484ab5c21db5033738f7', 'request_id': 'req-eddd8245-cb69-468b-b6d0-4cd717837a64'} {{(pid=87934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:54:25.588832 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.notifications [None req-eddd8245-cb69-468b-b6d0-4cd717837a64 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f478435fd6f6484ab5c21db5033738f7', 'request_id': 'req-eddd8245-cb69-468b-b6d0-4cd717837a64'} {{(pid=87934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:54:25.595841 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.notifications [None req-eddd8245-cb69-468b-b6d0-4cd717837a64 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f478435fd6f6484ab5c21db5033738f7', 'request_id': 'req-eddd8245-cb69-468b-b6d0-4cd717837a64'} {{(pid=87934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:54:25.609316 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.notifications [None req-eddd8245-cb69-468b-b6d0-4cd717837a64 admin admin] The token cache is being invalidate because project f478435fd6f6484ab5c21db5033738f7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87934) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 19:54:25.609603 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.notifications [None req-eddd8245-cb69-468b-b6d0-4cd717837a64 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:54:25.610321 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.notifications [None req-eddd8245-cb69-468b-b6d0-4cd717837a64 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:54:25.612347 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 1285/2522] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Sep 13 19:54:25 2022] DELETE /identity/v3/projects/f478435fd6f6484ab5c21db5033738f7 => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 19:54:25.616160 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19be37ba-0d6e-43b4-b1d7-e6d6f47bb435 admin admin] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:54:25.617706 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.fernet_utils [None req-19be37ba-0d6e-43b4-b1d7-e6d6f47bb435 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:54:25.639946 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19be37ba-0d6e-43b4-b1d7-e6d6f47bb435 admin admin] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:54:25.697506 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG dbcounter [-] [87935] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:54:25.712793 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aceeb39a-ce62-40ec-850f-6d9baea443ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:54:25.713595 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aceeb39a-ce62-40ec-850f-6d9baea443ed admin admin] REQUEST_METHOD: `DELETE` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:54:25.714099 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aceeb39a-ce62-40ec-850f-6d9baea443ed admin admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:54:25.714475 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aceeb39a-ce62-40ec-850f-6d9baea443ed admin admin] PATH_INFO: `/v3/users/7b354a92b4624bdc8a5278dfc3af953b` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:54:25.715881 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aceeb39a-ce62-40ec-850f-6d9baea443ed admin admin] RBAC: Authorizing `identity:delete_user(user_id=7b354a92b4624bdc8a5278dfc3af953b)` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:54:25.717996 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aceeb39a-ce62-40ec-850f-6d9baea443ed admin admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:54:25.771403 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.notifications [None req-aceeb39a-ce62-40ec-850f-6d9baea443ed admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7b354a92b4624bdc8a5278dfc3af953b'} {{(pid=87935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:54:25.779930 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.notifications [None req-aceeb39a-ce62-40ec-850f-6d9baea443ed admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7b354a92b4624bdc8a5278dfc3af953b'} {{(pid=87935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:54:25.795098 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.notifications [None req-aceeb39a-ce62-40ec-850f-6d9baea443ed admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7b354a92b4624bdc8a5278dfc3af953b'} {{(pid=87935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:54:25.795832 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.notifications [None req-aceeb39a-ce62-40ec-850f-6d9baea443ed admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7b354a92b4624bdc8a5278dfc3af953b'} {{(pid=87935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:54:25.796544 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.notifications [None req-aceeb39a-ce62-40ec-850f-6d9baea443ed admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7b354a92b4624bdc8a5278dfc3af953b'} {{(pid=87935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:54:25.815437 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 1238/2523] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Sep 13 19:54:25 2022] DELETE /identity/v3/users/7b354a92b4624bdc8a5278dfc3af953b => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 19:54:26.126006 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eddd8245-cb69-468b-b6d0-4cd717837a64 admin admin] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:54:26.127711 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.fernet_utils [None req-eddd8245-cb69-468b-b6d0-4cd717837a64 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:54:26.148167 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eddd8245-cb69-468b-b6d0-4cd717837a64 admin admin] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:54:26.211216 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5437ce-a7da-408a-b413-847265cfa00d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:54:26.211845 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5437ce-a7da-408a-b413-847265cfa00d admin admin] REQUEST_METHOD: `DELETE` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:54:26.212119 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5437ce-a7da-408a-b413-847265cfa00d admin admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:54:26.212418 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5437ce-a7da-408a-b413-847265cfa00d admin admin] PATH_INFO: `/v3/projects/ffa6b8dbbad54f479a4f4ba828d7792f` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:54:26.213581 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb5437ce-a7da-408a-b413-847265cfa00d admin admin] RBAC: Authorizing `identity:delete_project(project_id=ffa6b8dbbad54f479a4f4ba828d7792f)` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:54:26.215504 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb5437ce-a7da-408a-b413-847265cfa00d admin admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:54:26.282890 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.notifications [None req-fb5437ce-a7da-408a-b413-847265cfa00d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ffa6b8dbbad54f479a4f4ba828d7792f', 'request_id': 'req-fb5437ce-a7da-408a-b413-847265cfa00d'} {{(pid=87934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:54:26.290504 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.notifications [None req-fb5437ce-a7da-408a-b413-847265cfa00d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ffa6b8dbbad54f479a4f4ba828d7792f', 'request_id': 'req-fb5437ce-a7da-408a-b413-847265cfa00d'} {{(pid=87934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:54:26.296676 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.notifications [None req-fb5437ce-a7da-408a-b413-847265cfa00d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ffa6b8dbbad54f479a4f4ba828d7792f', 'request_id': 'req-fb5437ce-a7da-408a-b413-847265cfa00d'} {{(pid=87934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:54:26.312775 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.notifications [None req-fb5437ce-a7da-408a-b413-847265cfa00d admin admin] The token cache is being invalidate because project ffa6b8dbbad54f479a4f4ba828d7792f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87934) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 19:54:26.313359 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.notifications [None req-fb5437ce-a7da-408a-b413-847265cfa00d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:54:26.314012 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.notifications [None req-fb5437ce-a7da-408a-b413-847265cfa00d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:54:26.316115 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 1286/2524] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Sep 13 19:54:26 2022] DELETE /identity/v3/projects/ffa6b8dbbad54f479a4f4ba828d7792f => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 19:54:26.322498 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284d248d-316e-4e37-9c9e-966bd3f50683 None None] REQUEST_METHOD: `POST` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:54:26.322881 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284d248d-316e-4e37-9c9e-966bd3f50683 None None] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:54:26.323046 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284d248d-316e-4e37-9c9e-966bd3f50683 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:54:26.343997 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.auth.core [None req-284d248d-316e-4e37-9c9e-966bd3f50683 None None] MFA Rules not processed for user `7b0aed92d02344acb92a0e4aa67c3068`. Rule list: `[]` (Enabled: `True`). {{(pid=87935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:54:26.345498 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.fernet_utils [None req-284d248d-316e-4e37-9c9e-966bd3f50683 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:54:26.413198 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 1239/2525] 10.222.0.25 () {58 vars in 958 bytes} [Tue Sep 13 19:54:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 19:54:26.421628 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba780215-8918-4a38-8960-915b6fcff1d3 None None] REQUEST_METHOD: `POST` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:54:26.422062 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba780215-8918-4a38-8960-915b6fcff1d3 None None] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:54:26.422364 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba780215-8918-4a38-8960-915b6fcff1d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:54:26.442620 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.auth.core [None req-ba780215-8918-4a38-8960-915b6fcff1d3 None None] MFA Rules not processed for user `7b0aed92d02344acb92a0e4aa67c3068`. Rule list: `[]` (Enabled: `True`). {{(pid=87934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:54:26.443798 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.fernet_utils [None req-ba780215-8918-4a38-8960-915b6fcff1d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:54:26.451516 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 1287/2526] 10.222.0.25 () {58 vars in 958 bytes} [Tue Sep 13 19:54:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 19:54:26.456709 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284d248d-316e-4e37-9c9e-966bd3f50683 None None] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:54:26.466766 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284d248d-316e-4e37-9c9e-966bd3f50683 None None] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:54:26.471469 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8005b9b-1152-46bb-b1f5-bf77ef0abb05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:54:26.472083 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8005b9b-1152-46bb-b1f5-bf77ef0abb05 admin admin] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:54:26.472390 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8005b9b-1152-46bb-b1f5-bf77ef0abb05 admin admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:54:26.472660 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8005b9b-1152-46bb-b1f5-bf77ef0abb05 admin admin] PATH_INFO: `/v3/domains` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:54:26.473291 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8005b9b-1152-46bb-b1f5-bf77ef0abb05 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87935) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:54:26.473587 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8005b9b-1152-46bb-b1f5-bf77ef0abb05 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:54:26.475166 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8005b9b-1152-46bb-b1f5-bf77ef0abb05 admin admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:54:26.486805 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 1240/2527] 10.222.0.25 () {58 vars in 1153 bytes} [Tue Sep 13 19:54:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 19:54:26.490972 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba780215-8918-4a38-8960-915b6fcff1d3 None None] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:54:26.499956 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba780215-8918-4a38-8960-915b6fcff1d3 None None] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:54:26.505763 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ca9849-d2d7-4625-bddf-00e167b11960 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:54:26.506367 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ca9849-d2d7-4625-bddf-00e167b11960 admin admin] REQUEST_METHOD: `POST` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:54:26.506649 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ca9849-d2d7-4625-bddf-00e167b11960 admin admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:54:26.506917 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ca9849-d2d7-4625-bddf-00e167b11960 admin admin] PATH_INFO: `/v3/projects` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:54:26.507539 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ca9849-d2d7-4625-bddf-00e167b11960 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:54:26.509512 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ca9849-d2d7-4625-bddf-00e167b11960 admin admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:54:26.540568 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 1288/2528] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Sep 13 19:54:26 2022] POST /identity/v3/projects => generated 383 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 19:54:26.541591 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8005b9b-1152-46bb-b1f5-bf77ef0abb05 admin admin] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:54:26.554436 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8005b9b-1152-46bb-b1f5-bf77ef0abb05 admin admin] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:54:26.606488 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG dbcounter [-] [87935] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:54:26.615674 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a619162-e4d7-4501-bdac-6aa6cf1b172f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:54:26.616666 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a619162-e4d7-4501-bdac-6aa6cf1b172f admin admin] REQUEST_METHOD: `POST` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:54:26.617311 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a619162-e4d7-4501-bdac-6aa6cf1b172f admin admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:54:26.617901 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a619162-e4d7-4501-bdac-6aa6cf1b172f admin admin] PATH_INFO: `/v3/users` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:54:26.618552 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a619162-e4d7-4501-bdac-6aa6cf1b172f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:54:26.621169 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a619162-e4d7-4501-bdac-6aa6cf1b172f admin admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:54:26.643884 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 1241/2529] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Sep 13 19:54:26 2022] POST /identity/v3/users => generated 292 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 13 19:54:26.647973 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ca9849-d2d7-4625-bddf-00e167b11960 admin admin] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:54:26.658550 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ca9849-d2d7-4625-bddf-00e167b11960 admin admin] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:54:26.663167 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8714e7f-52c2-47f8-afeb-9f45aa1b4e3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:54:26.663765 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8714e7f-52c2-47f8-afeb-9f45aa1b4e3c admin admin] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:54:26.664038 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8714e7f-52c2-47f8-afeb-9f45aa1b4e3c admin admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:54:26.664348 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8714e7f-52c2-47f8-afeb-9f45aa1b4e3c admin admin] PATH_INFO: `/v3/roles` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:54:26.664984 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8714e7f-52c2-47f8-afeb-9f45aa1b4e3c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:54:26.666695 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8714e7f-52c2-47f8-afeb-9f45aa1b4e3c admin admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:54:26.678937 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 1289/2530] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Sep 13 19:54:26 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 19:54:26.682746 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a619162-e4d7-4501-bdac-6aa6cf1b172f admin admin] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:54:26.694052 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a619162-e4d7-4501-bdac-6aa6cf1b172f admin admin] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:54:26.698701 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf34dc1-0f30-4cfd-b56c-08e3e70a8fd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:54:26.699296 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf34dc1-0f30-4cfd-b56c-08e3e70a8fd1 admin admin] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:54:26.699569 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf34dc1-0f30-4cfd-b56c-08e3e70a8fd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:54:26.699838 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf34dc1-0f30-4cfd-b56c-08e3e70a8fd1 admin admin] PATH_INFO: `/v3/roles` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:54:26.700502 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf34dc1-0f30-4cfd-b56c-08e3e70a8fd1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:54:26.702377 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf34dc1-0f30-4cfd-b56c-08e3e70a8fd1 admin admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:54:26.713579 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 1242/2531] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Sep 13 19:54:26 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 19:54:26.717588 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8714e7f-52c2-47f8-afeb-9f45aa1b4e3c admin admin] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:54:26.727938 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG dbcounter [-] [87934] Writing DB stats keystone:SELECT=84,keystone:DELETE=13,keystone:INSERT=3 {{(pid=87934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:54:26.734276 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8714e7f-52c2-47f8-afeb-9f45aa1b4e3c admin admin] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:54:26.740709 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6a1b07-6b07-4611-abbd-7b0935fcf95f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:54:26.741478 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6a1b07-6b07-4611-abbd-7b0935fcf95f admin admin] REQUEST_METHOD: `PUT` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:54:26.741758 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6a1b07-6b07-4611-abbd-7b0935fcf95f admin admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:54:26.742162 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6a1b07-6b07-4611-abbd-7b0935fcf95f admin admin] PATH_INFO: `/v3/projects/30309188ff254de9b8f65335ad930638/users/c79f3b0731cb49088772d6240e12c5ef/roles/a259191f6d0e46fabd9f34536bb28747` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:54:26.757397 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f6a1b07-6b07-4611-abbd-7b0935fcf95f admin admin] RBAC: Authorizing `identity:create_grant(project_id=30309188ff254de9b8f65335ad930638, user_id=c79f3b0731cb49088772d6240e12c5ef, role_id=a259191f6d0e46fabd9f34536bb28747)` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:54:26.760045 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f6a1b07-6b07-4611-abbd-7b0935fcf95f admin admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:54:26.773248 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 1290/2532] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Sep 13 19:54:26 2022] PUT /identity/v3/projects/30309188ff254de9b8f65335ad930638/users/c79f3b0731cb49088772d6240e12c5ef/roles/a259191f6d0e46fabd9f34536bb28747 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 19:54:26.785787 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa403528-e130-4020-adff-5f9d356a17a1 None None] REQUEST_METHOD: `POST` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:54:26.786159 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa403528-e130-4020-adff-5f9d356a17a1 None None] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:54:26.786440 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa403528-e130-4020-adff-5f9d356a17a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:54:26.818816 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.auth.core [None req-fa403528-e130-4020-adff-5f9d356a17a1 None None] MFA Rules not processed for user `c79f3b0731cb49088772d6240e12c5ef`. Rule list: `[]` (Enabled: `True`). {{(pid=87935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:54:26.820092 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.fernet_utils [None req-fa403528-e130-4020-adff-5f9d356a17a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:54:26.887009 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 1243/2533] 10.222.0.25 () {58 vars in 958 bytes} [Tue Sep 13 19:54:26 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 19:54:26.891988 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6a1b07-6b07-4611-abbd-7b0935fcf95f admin admin] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:54:26.965035 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6a1b07-6b07-4611-abbd-7b0935fcf95f admin admin] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:54:26.972139 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f13eefc-cbf3-49e4-a627-fa1cbcc0594b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:54:26.972813 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f13eefc-cbf3-49e4-a627-fa1cbcc0594b admin admin] REQUEST_METHOD: `POST` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:54:26.973095 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f13eefc-cbf3-49e4-a627-fa1cbcc0594b admin admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:54:26.973371 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f13eefc-cbf3-49e4-a627-fa1cbcc0594b admin admin] PATH_INFO: `/v3/projects` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:54:26.974038 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f13eefc-cbf3-49e4-a627-fa1cbcc0594b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:54:26.975974 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f13eefc-cbf3-49e4-a627-fa1cbcc0594b admin admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:54:27.006769 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 1291/2534] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Sep 13 19:54:26 2022] POST /identity/v3/projects => generated 385 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 13 19:54:27.008351 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa403528-e130-4020-adff-5f9d356a17a1 None None] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:54:27.020141 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa403528-e130-4020-adff-5f9d356a17a1 None None] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:54:27.077268 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92fb48ab-4a69-4c4a-b008-fe80fca2d5e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:54:27.078049 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fb48ab-4a69-4c4a-b008-fe80fca2d5e0 admin admin] REQUEST_METHOD: `POST` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:54:27.078324 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fb48ab-4a69-4c4a-b008-fe80fca2d5e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:54:27.078591 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fb48ab-4a69-4c4a-b008-fe80fca2d5e0 admin admin] PATH_INFO: `/v3/users` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:54:27.079211 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92fb48ab-4a69-4c4a-b008-fe80fca2d5e0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:54:27.081239 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92fb48ab-4a69-4c4a-b008-fe80fca2d5e0 admin admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:54:27.103729 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 1244/2535] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Sep 13 19:54:27 2022] POST /identity/v3/users => generated 299 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 13 19:54:27.107695 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f13eefc-cbf3-49e4-a627-fa1cbcc0594b admin admin] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:54:27.118986 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f13eefc-cbf3-49e4-a627-fa1cbcc0594b admin admin] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:54:27.123730 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea945225-c0ea-4117-84d5-52bdf0777f94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:54:27.124382 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea945225-c0ea-4117-84d5-52bdf0777f94 admin admin] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:54:27.124666 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea945225-c0ea-4117-84d5-52bdf0777f94 admin admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:54:27.124938 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea945225-c0ea-4117-84d5-52bdf0777f94 admin admin] PATH_INFO: `/v3/roles` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:54:27.125574 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea945225-c0ea-4117-84d5-52bdf0777f94 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:54:27.127197 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea945225-c0ea-4117-84d5-52bdf0777f94 admin admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:54:27.143014 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 1292/2536] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Sep 13 19:54:27 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 19:54:27.149048 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92fb48ab-4a69-4c4a-b008-fe80fca2d5e0 admin admin] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:54:27.167147 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92fb48ab-4a69-4c4a-b008-fe80fca2d5e0 admin admin] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:54:27.176378 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a6052a-17ec-4522-8f98-5236abcc07bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:54:27.177757 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a6052a-17ec-4522-8f98-5236abcc07bf admin admin] REQUEST_METHOD: `PUT` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:54:27.178254 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a6052a-17ec-4522-8f98-5236abcc07bf admin admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:54:27.178746 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a6052a-17ec-4522-8f98-5236abcc07bf admin admin] PATH_INFO: `/v3/projects/f2cce49cc4d54aa69b1ca3dcdfd2dcd5/users/2e9636201bc94a6ca880af38bd6058da/roles/6ca1d4427ff64e0a9d25d96cfb1445f6` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:54:27.201923 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a6052a-17ec-4522-8f98-5236abcc07bf admin admin] RBAC: Authorizing `identity:create_grant(project_id=f2cce49cc4d54aa69b1ca3dcdfd2dcd5, user_id=2e9636201bc94a6ca880af38bd6058da, role_id=6ca1d4427ff64e0a9d25d96cfb1445f6)` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:54:27.204990 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a6052a-17ec-4522-8f98-5236abcc07bf admin admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:54:27.218999 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 1245/2537] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Sep 13 19:54:27 2022] PUT /identity/v3/projects/f2cce49cc4d54aa69b1ca3dcdfd2dcd5/users/2e9636201bc94a6ca880af38bd6058da/roles/6ca1d4427ff64e0a9d25d96cfb1445f6 => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 19:54:27.223582 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea945225-c0ea-4117-84d5-52bdf0777f94 admin admin] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:54:27.234121 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea945225-c0ea-4117-84d5-52bdf0777f94 admin admin] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:54:27.295588 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05f928b-acb5-4104-9626-3029d4a63ba2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:54:27.296226 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05f928b-acb5-4104-9626-3029d4a63ba2 admin admin] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:54:27.296528 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05f928b-acb5-4104-9626-3029d4a63ba2 admin admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:54:27.296790 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05f928b-acb5-4104-9626-3029d4a63ba2 admin admin] PATH_INFO: `/v3/roles` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:54:27.297410 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d05f928b-acb5-4104-9626-3029d4a63ba2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:54:27.300047 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d05f928b-acb5-4104-9626-3029d4a63ba2 admin admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:54:27.312666 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 1293/2538] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Sep 13 19:54:27 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 19:54:27.315015 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a6052a-17ec-4522-8f98-5236abcc07bf admin admin] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:54:27.325337 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a6052a-17ec-4522-8f98-5236abcc07bf admin admin] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:54:27.330827 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73fefd42-a64c-4f7b-8b58-ca47305bc183 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:54:27.331406 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fefd42-a64c-4f7b-8b58-ca47305bc183 admin admin] REQUEST_METHOD: `PUT` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:54:27.331676 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fefd42-a64c-4f7b-8b58-ca47305bc183 admin admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:54:27.331938 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fefd42-a64c-4f7b-8b58-ca47305bc183 admin admin] PATH_INFO: `/v3/projects/f2cce49cc4d54aa69b1ca3dcdfd2dcd5/users/2e9636201bc94a6ca880af38bd6058da/roles/6ca1d4427ff64e0a9d25d96cfb1445f6` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:54:27.333899 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73fefd42-a64c-4f7b-8b58-ca47305bc183 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f2cce49cc4d54aa69b1ca3dcdfd2dcd5, user_id=2e9636201bc94a6ca880af38bd6058da, role_id=6ca1d4427ff64e0a9d25d96cfb1445f6)` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:54:27.336636 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73fefd42-a64c-4f7b-8b58-ca47305bc183 admin admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:54:27.347727 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 1246/2539] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Sep 13 19:54:27 2022] PUT /identity/v3/projects/f2cce49cc4d54aa69b1ca3dcdfd2dcd5/users/2e9636201bc94a6ca880af38bd6058da/roles/6ca1d4427ff64e0a9d25d96cfb1445f6 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 19:54:27.357849 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecd53f9-3d9e-4f44-87b7-bd6317fe25ed None None] REQUEST_METHOD: `POST` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:54:27.358140 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecd53f9-3d9e-4f44-87b7-bd6317fe25ed None None] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:54:27.358417 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecd53f9-3d9e-4f44-87b7-bd6317fe25ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:54:27.387995 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.auth.core [None req-5ecd53f9-3d9e-4f44-87b7-bd6317fe25ed None None] MFA Rules not processed for user `2e9636201bc94a6ca880af38bd6058da`. Rule list: `[]` (Enabled: `True`). {{(pid=87934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:54:27.389239 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.fernet_utils [None req-5ecd53f9-3d9e-4f44-87b7-bd6317fe25ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:54:27.436895 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG dbcounter [-] [87934] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=87934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:54:27.468119 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 1294/2540] 10.222.0.25 () {58 vars in 958 bytes} [Tue Sep 13 19:54:27 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 19:54:27.479033 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73fefd42-a64c-4f7b-8b58-ca47305bc183 admin admin] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:54:27.480843 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.fernet_utils [None req-73fefd42-a64c-4f7b-8b58-ca47305bc183 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:54:27.499971 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG dbcounter [-] [87935] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=87935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:54:27.540737 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73fefd42-a64c-4f7b-8b58-ca47305bc183 admin admin] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:54:27.544334 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f55e3e2-5854-4d6e-8203-8d0f976e9f59 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cbb50c88b794a7f9f26844effde7d63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a10a4268f3c4cb29f4e00c292e2df62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:54:27.544923 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f55e3e2-5854-4d6e-8203-8d0f976e9f59 service cinder] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:54:27.545197 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f55e3e2-5854-4d6e-8203-8d0f976e9f59 service cinder] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:54:27.545463 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f55e3e2-5854-4d6e-8203-8d0f976e9f59 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:54:27.555004 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f55e3e2-5854-4d6e-8203-8d0f976e9f59 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:54:27.556443 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f55e3e2-5854-4d6e-8203-8d0f976e9f59 service cinder] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:54:27.566376 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 1247/2541] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Sep 13 19:54:27 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 19:54:28.113220 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ecd53f9-3d9e-4f44-87b7-bd6317fe25ed None None] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:54:28.174944 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ecd53f9-3d9e-4f44-87b7-bd6317fe25ed None None] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:54:28.179450 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82936149-3b04-4118-a011-2c337e6bab8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:54:28.180072 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82936149-3b04-4118-a011-2c337e6bab8c admin admin] REQUEST_METHOD: `DELETE` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:54:28.180447 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82936149-3b04-4118-a011-2c337e6bab8c admin admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:54:28.180717 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82936149-3b04-4118-a011-2c337e6bab8c admin admin] PATH_INFO: `/v3/users/c79f3b0731cb49088772d6240e12c5ef` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:54:28.181812 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82936149-3b04-4118-a011-2c337e6bab8c admin admin] RBAC: Authorizing `identity:delete_user(user_id=c79f3b0731cb49088772d6240e12c5ef)` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:54:28.183720 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82936149-3b04-4118-a011-2c337e6bab8c admin admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:54:28.229327 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.notifications [None req-82936149-3b04-4118-a011-2c337e6bab8c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c79f3b0731cb49088772d6240e12c5ef'} {{(pid=87934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:54:28.229961 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.notifications [None req-82936149-3b04-4118-a011-2c337e6bab8c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c79f3b0731cb49088772d6240e12c5ef'} {{(pid=87934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:54:28.230553 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.notifications [None req-82936149-3b04-4118-a011-2c337e6bab8c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c79f3b0731cb49088772d6240e12c5ef'} {{(pid=87934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:54:28.237471 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.notifications [None req-82936149-3b04-4118-a011-2c337e6bab8c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c79f3b0731cb49088772d6240e12c5ef'} {{(pid=87934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:54:28.249127 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.notifications [None req-82936149-3b04-4118-a011-2c337e6bab8c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c79f3b0731cb49088772d6240e12c5ef'} {{(pid=87934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:54:28.262529 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 1295/2542] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Sep 13 19:54:28 2022] DELETE /identity/v3/users/c79f3b0731cb49088772d6240e12c5ef => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 19:54:28.266994 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa9b6d0-4d4e-4f12-8a2c-e2083698d229 None None] REQUEST_METHOD: `POST` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:54:28.267878 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa9b6d0-4d4e-4f12-8a2c-e2083698d229 None None] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:54:28.268170 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa9b6d0-4d4e-4f12-8a2c-e2083698d229 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:54:28.288644 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.auth.core [None req-eaa9b6d0-4d4e-4f12-8a2c-e2083698d229 None None] MFA Rules not processed for user `7b0aed92d02344acb92a0e4aa67c3068`. Rule list: `[]` (Enabled: `True`). {{(pid=87935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:54:28.289855 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.fernet_utils [None req-eaa9b6d0-4d4e-4f12-8a2c-e2083698d229 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:54:28.348049 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 1248/2543] 10.222.0.25 () {58 vars in 958 bytes} [Tue Sep 13 19:54:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 19:54:28.357814 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82936149-3b04-4118-a011-2c337e6bab8c admin admin] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:54:28.359192 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.fernet_utils [None req-82936149-3b04-4118-a011-2c337e6bab8c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:54:28.414610 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82936149-3b04-4118-a011-2c337e6bab8c admin admin] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:54:28.418223 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a7d03c-3168-4a60-bb47-6c75ac419a00 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1196a96e4a404f559600b69f929ea9da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a10a4268f3c4cb29f4e00c292e2df62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:54:28.418815 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a7d03c-3168-4a60-bb47-6c75ac419a00 service neutron] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:54:28.419088 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a7d03c-3168-4a60-bb47-6c75ac419a00 service neutron] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:54:28.419350 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a7d03c-3168-4a60-bb47-6c75ac419a00 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:54:28.428147 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a7d03c-3168-4a60-bb47-6c75ac419a00 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:54:28.430007 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG dbcounter [-] [87934] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:54:28.430631 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a7d03c-3168-4a60-bb47-6c75ac419a00 service neutron] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:54:28.442800 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 1296/2544] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Sep 13 19:54:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 19:54:28.710965 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa9b6d0-4d4e-4f12-8a2c-e2083698d229 None None] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:54:28.712545 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.fernet_utils [None req-eaa9b6d0-4d4e-4f12-8a2c-e2083698d229 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:54:28.727914 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa9b6d0-4d4e-4f12-8a2c-e2083698d229 None None] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:54:28.732749 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60bc47b-c233-4d23-b3da-9f3a0511b4e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:54:28.733570 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60bc47b-c233-4d23-b3da-9f3a0511b4e6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:54:28.734010 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60bc47b-c233-4d23-b3da-9f3a0511b4e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:54:28.734291 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60bc47b-c233-4d23-b3da-9f3a0511b4e6 admin admin] PATH_INFO: `/v3/projects/30309188ff254de9b8f65335ad930638` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:54:28.735504 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f60bc47b-c233-4d23-b3da-9f3a0511b4e6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=30309188ff254de9b8f65335ad930638)` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:54:28.737803 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f60bc47b-c233-4d23-b3da-9f3a0511b4e6 admin admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:54:28.784866 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.notifications [None req-f60bc47b-c233-4d23-b3da-9f3a0511b4e6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '30309188ff254de9b8f65335ad930638', 'request_id': 'req-f60bc47b-c233-4d23-b3da-9f3a0511b4e6'} {{(pid=87935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:54:28.791442 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.notifications [None req-f60bc47b-c233-4d23-b3da-9f3a0511b4e6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '30309188ff254de9b8f65335ad930638', 'request_id': 'req-f60bc47b-c233-4d23-b3da-9f3a0511b4e6'} {{(pid=87935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:54:28.799842 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.notifications [None req-f60bc47b-c233-4d23-b3da-9f3a0511b4e6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '30309188ff254de9b8f65335ad930638', 'request_id': 'req-f60bc47b-c233-4d23-b3da-9f3a0511b4e6'} {{(pid=87935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:54:28.811095 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.notifications [None req-f60bc47b-c233-4d23-b3da-9f3a0511b4e6 admin admin] The token cache is being invalidate because project 30309188ff254de9b8f65335ad930638 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87935) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 19:54:28.811389 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.notifications [None req-f60bc47b-c233-4d23-b3da-9f3a0511b4e6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:54:28.812015 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.notifications [None req-f60bc47b-c233-4d23-b3da-9f3a0511b4e6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:54:28.813521 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 1249/2545] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Sep 13 19:54:28 2022] DELETE /identity/v3/projects/30309188ff254de9b8f65335ad930638 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 19:54:28.818219 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a7d03c-3168-4a60-bb47-6c75ac419a00 service neutron] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:54:28.827961 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a7d03c-3168-4a60-bb47-6c75ac419a00 service neutron] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:54:28.888368 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0525779d-78de-42ee-a028-92e7af12205c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:54:28.888932 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0525779d-78de-42ee-a028-92e7af12205c admin admin] REQUEST_METHOD: `DELETE` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:54:28.889355 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0525779d-78de-42ee-a028-92e7af12205c admin admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:54:28.889639 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0525779d-78de-42ee-a028-92e7af12205c admin admin] PATH_INFO: `/v3/users/2e9636201bc94a6ca880af38bd6058da` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:54:28.890758 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0525779d-78de-42ee-a028-92e7af12205c admin admin] RBAC: Authorizing `identity:delete_user(user_id=2e9636201bc94a6ca880af38bd6058da)` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:54:28.892905 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0525779d-78de-42ee-a028-92e7af12205c admin admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:54:28.937835 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.notifications [None req-0525779d-78de-42ee-a028-92e7af12205c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2e9636201bc94a6ca880af38bd6058da'} {{(pid=87934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:54:28.938499 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.notifications [None req-0525779d-78de-42ee-a028-92e7af12205c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2e9636201bc94a6ca880af38bd6058da'} {{(pid=87934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:54:28.939126 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.notifications [None req-0525779d-78de-42ee-a028-92e7af12205c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2e9636201bc94a6ca880af38bd6058da'} {{(pid=87934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:54:28.950793 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.notifications [None req-0525779d-78de-42ee-a028-92e7af12205c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2e9636201bc94a6ca880af38bd6058da'} {{(pid=87934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:54:28.965058 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.notifications [None req-0525779d-78de-42ee-a028-92e7af12205c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2e9636201bc94a6ca880af38bd6058da'} {{(pid=87934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:54:28.980326 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 1297/2546] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Sep 13 19:54:28 2022] DELETE /identity/v3/users/2e9636201bc94a6ca880af38bd6058da => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 19:54:29.279864 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60bc47b-c233-4d23-b3da-9f3a0511b4e6 admin admin] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:54:29.281353 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.fernet_utils [None req-f60bc47b-c233-4d23-b3da-9f3a0511b4e6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:54:29.298396 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60bc47b-c233-4d23-b3da-9f3a0511b4e6 admin admin] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:54:29.341630 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG dbcounter [-] [87935] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=87935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:54:29.359376 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7189850-75c2-4062-bb49-5326cf1138e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:54:29.360076 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7189850-75c2-4062-bb49-5326cf1138e3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:54:29.360286 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7189850-75c2-4062-bb49-5326cf1138e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:54:29.360560 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7189850-75c2-4062-bb49-5326cf1138e3 admin admin] PATH_INFO: `/v3/projects/f2cce49cc4d54aa69b1ca3dcdfd2dcd5` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:54:29.362317 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7189850-75c2-4062-bb49-5326cf1138e3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f2cce49cc4d54aa69b1ca3dcdfd2dcd5)` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:54:29.364146 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7189850-75c2-4062-bb49-5326cf1138e3 admin admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:54:29.409019 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.notifications [None req-e7189850-75c2-4062-bb49-5326cf1138e3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f2cce49cc4d54aa69b1ca3dcdfd2dcd5', 'request_id': 'req-e7189850-75c2-4062-bb49-5326cf1138e3'} {{(pid=87935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:54:29.414628 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.notifications [None req-e7189850-75c2-4062-bb49-5326cf1138e3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f2cce49cc4d54aa69b1ca3dcdfd2dcd5', 'request_id': 'req-e7189850-75c2-4062-bb49-5326cf1138e3'} {{(pid=87935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:54:29.429334 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.notifications [None req-e7189850-75c2-4062-bb49-5326cf1138e3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f2cce49cc4d54aa69b1ca3dcdfd2dcd5', 'request_id': 'req-e7189850-75c2-4062-bb49-5326cf1138e3'} {{(pid=87935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:54:29.442914 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.notifications [None req-e7189850-75c2-4062-bb49-5326cf1138e3 admin admin] The token cache is being invalidate because project f2cce49cc4d54aa69b1ca3dcdfd2dcd5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87935) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 19:54:29.443202 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.notifications [None req-e7189850-75c2-4062-bb49-5326cf1138e3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:54:29.443864 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.notifications [None req-e7189850-75c2-4062-bb49-5326cf1138e3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:54:29.445514 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 1250/2547] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Sep 13 19:54:29 2022] DELETE /identity/v3/projects/f2cce49cc4d54aa69b1ca3dcdfd2dcd5 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 19:54:29.450416 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216020fc-c1e1-48fd-95c7-5a2a285d5260 None None] REQUEST_METHOD: `POST` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:54:29.450898 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216020fc-c1e1-48fd-95c7-5a2a285d5260 None None] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:54:29.451128 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216020fc-c1e1-48fd-95c7-5a2a285d5260 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:54:29.471991 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.auth.core [None req-216020fc-c1e1-48fd-95c7-5a2a285d5260 None None] MFA Rules not processed for user `7b0aed92d02344acb92a0e4aa67c3068`. Rule list: `[]` (Enabled: `True`). {{(pid=87934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:54:29.473289 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.fernet_utils [None req-216020fc-c1e1-48fd-95c7-5a2a285d5260 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:54:29.534078 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 1298/2548] 10.222.0.25 () {58 vars in 958 bytes} [Tue Sep 13 19:54:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 19:54:29.542129 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a23f0f-e0c2-4c48-b295-71d4eab857ea None None] REQUEST_METHOD: `POST` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:54:29.542411 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a23f0f-e0c2-4c48-b295-71d4eab857ea None None] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:54:29.542682 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a23f0f-e0c2-4c48-b295-71d4eab857ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:54:29.562170 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.auth.core [None req-e4a23f0f-e0c2-4c48-b295-71d4eab857ea None None] MFA Rules not processed for user `7b0aed92d02344acb92a0e4aa67c3068`. Rule list: `[]` (Enabled: `True`). {{(pid=87935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:54:29.563355 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.fernet_utils [None req-e4a23f0f-e0c2-4c48-b295-71d4eab857ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:54:29.571207 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 1251/2549] 10.222.0.25 () {58 vars in 958 bytes} [Tue Sep 13 19:54:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 19:54:29.575547 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216020fc-c1e1-48fd-95c7-5a2a285d5260 None None] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:54:29.586133 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216020fc-c1e1-48fd-95c7-5a2a285d5260 None None] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:54:29.590621 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a222e7-4c5f-4d07-b837-a864ce94991f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:54:29.591217 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a222e7-4c5f-4d07-b837-a864ce94991f admin admin] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:54:29.591495 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a222e7-4c5f-4d07-b837-a864ce94991f admin admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:54:29.591766 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a222e7-4c5f-4d07-b837-a864ce94991f admin admin] PATH_INFO: `/v3/domains` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:54:29.592440 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a222e7-4c5f-4d07-b837-a864ce94991f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87934) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:54:29.592743 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a222e7-4c5f-4d07-b837-a864ce94991f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:54:29.594369 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a222e7-4c5f-4d07-b837-a864ce94991f admin admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:54:29.606740 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 1299/2550] 10.222.0.25 () {58 vars in 1153 bytes} [Tue Sep 13 19:54:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:54:29.611164 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a23f0f-e0c2-4c48-b295-71d4eab857ea None None] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:54:29.620481 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a23f0f-e0c2-4c48-b295-71d4eab857ea None None] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:54:29.625204 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f727e920-6fbb-44f5-a89f-94094312734a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:54:29.625789 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f727e920-6fbb-44f5-a89f-94094312734a admin admin] REQUEST_METHOD: `POST` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:54:29.626061 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f727e920-6fbb-44f5-a89f-94094312734a admin admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:54:29.626330 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f727e920-6fbb-44f5-a89f-94094312734a admin admin] PATH_INFO: `/v3/projects` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:54:29.626991 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f727e920-6fbb-44f5-a89f-94094312734a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:54:29.628912 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f727e920-6fbb-44f5-a89f-94094312734a admin admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:54:29.657748 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 1252/2551] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Sep 13 19:54:29 2022] POST /identity/v3/projects => generated 373 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 19:54:29.662586 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a222e7-4c5f-4d07-b837-a864ce94991f admin admin] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:54:29.667577 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG dbcounter [-] [87934] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:54:29.674408 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a222e7-4c5f-4d07-b837-a864ce94991f admin admin] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:54:29.731809 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63fb4f6-be8a-40f3-9aa3-d2134925430e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:54:29.732441 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63fb4f6-be8a-40f3-9aa3-d2134925430e admin admin] REQUEST_METHOD: `POST` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:54:29.732717 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63fb4f6-be8a-40f3-9aa3-d2134925430e admin admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:54:29.732987 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63fb4f6-be8a-40f3-9aa3-d2134925430e admin admin] PATH_INFO: `/v3/users` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:54:29.733609 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a63fb4f6-be8a-40f3-9aa3-d2134925430e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:54:29.735507 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a63fb4f6-be8a-40f3-9aa3-d2134925430e admin admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:54:29.756435 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 1300/2552] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Sep 13 19:54:29 2022] POST /identity/v3/users => generated 287 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 19:54:29.760496 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f727e920-6fbb-44f5-a89f-94094312734a admin admin] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:54:29.771396 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f727e920-6fbb-44f5-a89f-94094312734a admin admin] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:54:29.775977 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05cf7a0-fce8-47a7-ac36-4ba9774d02fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:54:29.776597 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05cf7a0-fce8-47a7-ac36-4ba9774d02fd admin admin] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:54:29.776874 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05cf7a0-fce8-47a7-ac36-4ba9774d02fd admin admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:54:29.777144 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05cf7a0-fce8-47a7-ac36-4ba9774d02fd admin admin] PATH_INFO: `/v3/roles` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:54:29.777771 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d05cf7a0-fce8-47a7-ac36-4ba9774d02fd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:54:29.779352 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d05cf7a0-fce8-47a7-ac36-4ba9774d02fd admin admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:54:29.791120 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 1253/2553] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Sep 13 19:54:29 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 19:54:29.795480 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63fb4f6-be8a-40f3-9aa3-d2134925430e admin admin] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:54:29.805901 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63fb4f6-be8a-40f3-9aa3-d2134925430e admin admin] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:54:29.810483 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eca40ad-ff96-4e1f-b192-3435cc70977c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:54:29.811069 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eca40ad-ff96-4e1f-b192-3435cc70977c admin admin] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:54:29.811345 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eca40ad-ff96-4e1f-b192-3435cc70977c admin admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:54:29.811614 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eca40ad-ff96-4e1f-b192-3435cc70977c admin admin] PATH_INFO: `/v3/roles` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:54:29.812385 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eca40ad-ff96-4e1f-b192-3435cc70977c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:54:29.813971 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eca40ad-ff96-4e1f-b192-3435cc70977c admin admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:54:29.824531 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 1301/2554] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Sep 13 19:54:29 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 19:54:29.828746 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05cf7a0-fce8-47a7-ac36-4ba9774d02fd admin admin] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:54:29.839278 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05cf7a0-fce8-47a7-ac36-4ba9774d02fd admin admin] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:54:29.843904 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62cef6c-5b51-4da5-9e7a-d4b7d53f918b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:54:29.844570 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62cef6c-5b51-4da5-9e7a-d4b7d53f918b admin admin] REQUEST_METHOD: `PUT` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:54:29.844849 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62cef6c-5b51-4da5-9e7a-d4b7d53f918b admin admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:54:29.845118 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62cef6c-5b51-4da5-9e7a-d4b7d53f918b admin admin] PATH_INFO: `/v3/projects/a2d36f4307d0487bb1c0b5bf3e6c700a/users/974712afe9ef4124ac800080500f1c51/roles/a259191f6d0e46fabd9f34536bb28747` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:54:29.860227 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e62cef6c-5b51-4da5-9e7a-d4b7d53f918b admin admin] RBAC: Authorizing `identity:create_grant(project_id=a2d36f4307d0487bb1c0b5bf3e6c700a, user_id=974712afe9ef4124ac800080500f1c51, role_id=a259191f6d0e46fabd9f34536bb28747)` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:54:29.862894 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e62cef6c-5b51-4da5-9e7a-d4b7d53f918b admin admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:54:29.875658 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 1254/2555] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Sep 13 19:54:29 2022] PUT /identity/v3/projects/a2d36f4307d0487bb1c0b5bf3e6c700a/users/974712afe9ef4124ac800080500f1c51/roles/a259191f6d0e46fabd9f34536bb28747 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 19:54:29.942437 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872c0557-0526-40d6-b157-c01e2db9b988 None None] REQUEST_METHOD: `POST` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:54:29.942630 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872c0557-0526-40d6-b157-c01e2db9b988 None None] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:54:29.942880 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872c0557-0526-40d6-b157-c01e2db9b988 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:54:29.971363 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.auth.core [None req-872c0557-0526-40d6-b157-c01e2db9b988 None None] MFA Rules not processed for user `974712afe9ef4124ac800080500f1c51`. Rule list: `[]` (Enabled: `True`). {{(pid=87934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:54:29.972620 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.fernet_utils [None req-872c0557-0526-40d6-b157-c01e2db9b988 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:54:30.036376 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 1302/2556] 10.222.0.25 () {58 vars in 958 bytes} [Tue Sep 13 19:54:29 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 19:54:30.047518 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62cef6c-5b51-4da5-9e7a-d4b7d53f918b admin admin] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:54:30.049386 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.fernet_utils [None req-e62cef6c-5b51-4da5-9e7a-d4b7d53f918b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:54:30.106041 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62cef6c-5b51-4da5-9e7a-d4b7d53f918b admin admin] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:54:30.109805 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15293af6-fdb7-4b8e-b209-2d429395e9ac service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cbb50c88b794a7f9f26844effde7d63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a10a4268f3c4cb29f4e00c292e2df62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:54:30.110422 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15293af6-fdb7-4b8e-b209-2d429395e9ac service cinder] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:54:30.110703 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15293af6-fdb7-4b8e-b209-2d429395e9ac service cinder] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:54:30.111142 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15293af6-fdb7-4b8e-b209-2d429395e9ac service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:54:30.119426 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15293af6-fdb7-4b8e-b209-2d429395e9ac service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:54:30.120906 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15293af6-fdb7-4b8e-b209-2d429395e9ac service cinder] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:54:30.130255 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 1255/2557] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Sep 13 19:54:30 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 19:54:30.153316 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872c0557-0526-40d6-b157-c01e2db9b988 None None] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:54:30.158714 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15293af6-fdb7-4b8e-b209-2d429395e9ac service cinder] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:54:30.160475 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.fernet_utils [None req-15293af6-fdb7-4b8e-b209-2d429395e9ac service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:54:30.173979 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG dbcounter [-] [87935] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=87935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:54:30.245647 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15293af6-fdb7-4b8e-b209-2d429395e9ac service cinder] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:54:30.252372 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225793d6-68c9-4bbd-a543-de0882bb568d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd71fe5a8275f4ea98555afdcefc902a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a10a4268f3c4cb29f4e00c292e2df62', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:54:30.253004 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225793d6-68c9-4bbd-a543-de0882bb568d service nova] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:54:30.253281 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225793d6-68c9-4bbd-a543-de0882bb568d service nova] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:54:30.253553 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225793d6-68c9-4bbd-a543-de0882bb568d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:54:30.255414 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.fernet_utils [None req-225793d6-68c9-4bbd-a543-de0882bb568d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:54:30.319056 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-225793d6-68c9-4bbd-a543-de0882bb568d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:54:30.320669 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-225793d6-68c9-4bbd-a543-de0882bb568d service nova] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:54:30.331272 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 1256/2558] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Sep 13 19:54:30 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 173 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 13 19:54:30.345050 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872c0557-0526-40d6-b157-c01e2db9b988 None None] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:54:30.350754 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81142f8-0a82-4d3e-a654-ca745788bef2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:54:30.351111 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81142f8-0a82-4d3e-a654-ca745788bef2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:54:30.351384 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81142f8-0a82-4d3e-a654-ca745788bef2 admin admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:54:30.351652 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81142f8-0a82-4d3e-a654-ca745788bef2 admin admin] PATH_INFO: `/v3/users/974712afe9ef4124ac800080500f1c51` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:54:30.353233 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d81142f8-0a82-4d3e-a654-ca745788bef2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=974712afe9ef4124ac800080500f1c51)` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:54:30.355125 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d81142f8-0a82-4d3e-a654-ca745788bef2 admin admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:54:30.369758 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG dbcounter [-] [87934] Writing DB stats keystone:SELECT=96,keystone:INSERT=3,keystone:DELETE=1 {{(pid=87934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:54:30.415088 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.notifications [None req-d81142f8-0a82-4d3e-a654-ca745788bef2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '974712afe9ef4124ac800080500f1c51'} {{(pid=87934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:54:30.415702 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.notifications [None req-d81142f8-0a82-4d3e-a654-ca745788bef2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '974712afe9ef4124ac800080500f1c51'} {{(pid=87934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:54:30.416404 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.notifications [None req-d81142f8-0a82-4d3e-a654-ca745788bef2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '974712afe9ef4124ac800080500f1c51'} {{(pid=87934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:54:30.426304 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.notifications [None req-d81142f8-0a82-4d3e-a654-ca745788bef2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '974712afe9ef4124ac800080500f1c51'} {{(pid=87934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:54:30.441491 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.notifications [None req-d81142f8-0a82-4d3e-a654-ca745788bef2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '974712afe9ef4124ac800080500f1c51'} {{(pid=87934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:54:30.461728 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 1303/2559] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Sep 13 19:54:30 2022] DELETE /identity/v3/users/974712afe9ef4124ac800080500f1c51 => generated 0 bytes in 309 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 19:54:30.466219 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad9906d-2dd2-44cc-838e-40d03c8ce09c None None] REQUEST_METHOD: `POST` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:54:30.466673 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad9906d-2dd2-44cc-838e-40d03c8ce09c None None] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:54:30.466968 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad9906d-2dd2-44cc-838e-40d03c8ce09c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:54:30.496007 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.auth.core [None req-4ad9906d-2dd2-44cc-838e-40d03c8ce09c None None] MFA Rules not processed for user `7b0aed92d02344acb92a0e4aa67c3068`. Rule list: `[]` (Enabled: `True`). {{(pid=87935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:54:30.497888 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.fernet_utils [None req-4ad9906d-2dd2-44cc-838e-40d03c8ce09c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:54:30.568911 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 1257/2560] 10.222.0.25 () {58 vars in 958 bytes} [Tue Sep 13 19:54:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 19:54:30.578813 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81142f8-0a82-4d3e-a654-ca745788bef2 admin admin] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:54:30.580259 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.fernet_utils [None req-d81142f8-0a82-4d3e-a654-ca745788bef2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:54:30.638486 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81142f8-0a82-4d3e-a654-ca745788bef2 admin admin] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:54:30.644151 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959cc0b6-6ac8-4689-b0ad-f3c810477069 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1196a96e4a404f559600b69f929ea9da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a10a4268f3c4cb29f4e00c292e2df62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:54:30.644871 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959cc0b6-6ac8-4689-b0ad-f3c810477069 service neutron] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:54:30.645154 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959cc0b6-6ac8-4689-b0ad-f3c810477069 service neutron] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:54:30.645432 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959cc0b6-6ac8-4689-b0ad-f3c810477069 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:54:30.655425 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-959cc0b6-6ac8-4689-b0ad-f3c810477069 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:54:30.656912 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-959cc0b6-6ac8-4689-b0ad-f3c810477069 service neutron] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:54:30.667686 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 1304/2561] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Sep 13 19:54:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 19:54:30.949246 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad9906d-2dd2-44cc-838e-40d03c8ce09c None None] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:54:30.950775 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.fernet_utils [None req-4ad9906d-2dd2-44cc-838e-40d03c8ce09c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:54:30.966545 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad9906d-2dd2-44cc-838e-40d03c8ce09c None None] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:54:30.972470 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2cae423-a412-418a-9de9-45a2d50ee5aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:54:30.973380 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2cae423-a412-418a-9de9-45a2d50ee5aa admin admin] REQUEST_METHOD: `DELETE` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:54:30.973510 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2cae423-a412-418a-9de9-45a2d50ee5aa admin admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:54:30.973726 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2cae423-a412-418a-9de9-45a2d50ee5aa admin admin] PATH_INFO: `/v3/projects/a2d36f4307d0487bb1c0b5bf3e6c700a` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:54:30.974945 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2cae423-a412-418a-9de9-45a2d50ee5aa admin admin] RBAC: Authorizing `identity:delete_project(project_id=a2d36f4307d0487bb1c0b5bf3e6c700a)` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:54:30.977084 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2cae423-a412-418a-9de9-45a2d50ee5aa admin admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:54:31.029062 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG dbcounter [-] [87935] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=87935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:54:31.034475 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.notifications [None req-d2cae423-a412-418a-9de9-45a2d50ee5aa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a2d36f4307d0487bb1c0b5bf3e6c700a', 'request_id': 'req-d2cae423-a412-418a-9de9-45a2d50ee5aa'} {{(pid=87935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:54:31.040835 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.notifications [None req-d2cae423-a412-418a-9de9-45a2d50ee5aa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a2d36f4307d0487bb1c0b5bf3e6c700a', 'request_id': 'req-d2cae423-a412-418a-9de9-45a2d50ee5aa'} {{(pid=87935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:54:31.049126 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.notifications [None req-d2cae423-a412-418a-9de9-45a2d50ee5aa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a2d36f4307d0487bb1c0b5bf3e6c700a', 'request_id': 'req-d2cae423-a412-418a-9de9-45a2d50ee5aa'} {{(pid=87935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:54:31.061269 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.notifications [None req-d2cae423-a412-418a-9de9-45a2d50ee5aa admin admin] The token cache is being invalidate because project a2d36f4307d0487bb1c0b5bf3e6c700a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87935) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 19:54:31.061922 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.notifications [None req-d2cae423-a412-418a-9de9-45a2d50ee5aa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:54:31.062558 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.notifications [None req-d2cae423-a412-418a-9de9-45a2d50ee5aa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:54:31.064579 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 1258/2562] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Sep 13 19:54:30 2022] DELETE /identity/v3/projects/a2d36f4307d0487bb1c0b5bf3e6c700a => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 19:54:31.069472 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de5868f-e0ba-438f-bb91-2aefca430604 None None] REQUEST_METHOD: `POST` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:54:31.069756 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de5868f-e0ba-438f-bb91-2aefca430604 None None] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:54:31.070024 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de5868f-e0ba-438f-bb91-2aefca430604 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:54:31.090547 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.auth.core [None req-1de5868f-e0ba-438f-bb91-2aefca430604 None None] MFA Rules not processed for user `7b0aed92d02344acb92a0e4aa67c3068`. Rule list: `[]` (Enabled: `True`). {{(pid=87934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:54:31.091741 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.fernet_utils [None req-1de5868f-e0ba-438f-bb91-2aefca430604 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:54:31.158737 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 1305/2563] 10.222.0.25 () {58 vars in 958 bytes} [Tue Sep 13 19:54:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 19:54:31.166453 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36d20f5-5959-4c59-9c62-a991bb069625 None None] REQUEST_METHOD: `POST` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:54:31.166740 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36d20f5-5959-4c59-9c62-a991bb069625 None None] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:54:31.167066 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36d20f5-5959-4c59-9c62-a991bb069625 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:54:31.187393 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.auth.core [None req-b36d20f5-5959-4c59-9c62-a991bb069625 None None] MFA Rules not processed for user `7b0aed92d02344acb92a0e4aa67c3068`. Rule list: `[]` (Enabled: `True`). {{(pid=87935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:54:31.188716 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.fernet_utils [None req-b36d20f5-5959-4c59-9c62-a991bb069625 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:54:31.197298 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 1259/2564] 10.222.0.25 () {58 vars in 958 bytes} [Tue Sep 13 19:54:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 19:54:31.201591 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de5868f-e0ba-438f-bb91-2aefca430604 None None] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:54:31.212458 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de5868f-e0ba-438f-bb91-2aefca430604 None None] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:54:31.217634 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea694014-190b-478c-be86-2ad7736f8b5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:54:31.218302 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea694014-190b-478c-be86-2ad7736f8b5b admin admin] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:54:31.218625 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea694014-190b-478c-be86-2ad7736f8b5b admin admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:54:31.218936 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea694014-190b-478c-be86-2ad7736f8b5b admin admin] PATH_INFO: `/v3/domains` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:54:31.219543 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea694014-190b-478c-be86-2ad7736f8b5b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87934) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:54:31.219844 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea694014-190b-478c-be86-2ad7736f8b5b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:54:31.222217 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea694014-190b-478c-be86-2ad7736f8b5b admin admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:54:31.237260 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 1306/2565] 10.222.0.25 () {58 vars in 1153 bytes} [Tue Sep 13 19:54:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:54:31.238431 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36d20f5-5959-4c59-9c62-a991bb069625 None None] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:54:31.247754 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36d20f5-5959-4c59-9c62-a991bb069625 None None] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:54:31.252694 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8a2bb4-d0c2-4606-b78d-3cad3f054c3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:54:31.253308 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8a2bb4-d0c2-4606-b78d-3cad3f054c3f admin admin] REQUEST_METHOD: `POST` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:54:31.253584 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8a2bb4-d0c2-4606-b78d-3cad3f054c3f admin admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:54:31.253946 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8a2bb4-d0c2-4606-b78d-3cad3f054c3f admin admin] PATH_INFO: `/v3/projects` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:54:31.254488 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db8a2bb4-d0c2-4606-b78d-3cad3f054c3f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:54:31.256453 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db8a2bb4-d0c2-4606-b78d-3cad3f054c3f admin admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:54:31.289944 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 1260/2566] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Sep 13 19:54:31 2022] POST /identity/v3/projects => generated 373 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 19:54:31.293923 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea694014-190b-478c-be86-2ad7736f8b5b admin admin] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:54:31.304538 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea694014-190b-478c-be86-2ad7736f8b5b admin admin] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:54:31.322052 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG dbcounter [-] [87934] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=87934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:54:31.374191 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b301a62-ab16-4acc-8f85-d46acf12e53e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:54:31.374925 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b301a62-ab16-4acc-8f85-d46acf12e53e admin admin] REQUEST_METHOD: `POST` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:54:31.375206 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b301a62-ab16-4acc-8f85-d46acf12e53e admin admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:54:31.375478 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b301a62-ab16-4acc-8f85-d46acf12e53e admin admin] PATH_INFO: `/v3/users` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:54:31.376117 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b301a62-ab16-4acc-8f85-d46acf12e53e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:54:31.378798 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b301a62-ab16-4acc-8f85-d46acf12e53e admin admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:54:31.401418 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 1307/2567] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Sep 13 19:54:31 2022] POST /identity/v3/users => generated 287 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 19:54:31.405731 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8a2bb4-d0c2-4606-b78d-3cad3f054c3f admin admin] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:54:31.435170 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8a2bb4-d0c2-4606-b78d-3cad3f054c3f admin admin] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:54:31.445973 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faba859a-97e4-45dc-bb8b-408bb7b03d0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:54:31.447153 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faba859a-97e4-45dc-bb8b-408bb7b03d0e admin admin] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:54:31.447901 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faba859a-97e4-45dc-bb8b-408bb7b03d0e admin admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:54:31.448489 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faba859a-97e4-45dc-bb8b-408bb7b03d0e admin admin] PATH_INFO: `/v3/roles` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:54:31.450272 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faba859a-97e4-45dc-bb8b-408bb7b03d0e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:54:31.454148 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faba859a-97e4-45dc-bb8b-408bb7b03d0e admin admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:54:31.466787 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 1261/2568] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Sep 13 19:54:31 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 19:54:31.471682 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b301a62-ab16-4acc-8f85-d46acf12e53e admin admin] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:54:31.485703 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b301a62-ab16-4acc-8f85-d46acf12e53e admin admin] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:54:31.496673 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3276d0-7fb3-4567-bc0a-06a6af12f137 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:54:31.497366 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3276d0-7fb3-4567-bc0a-06a6af12f137 admin admin] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:54:31.497965 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3276d0-7fb3-4567-bc0a-06a6af12f137 admin admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:54:31.497965 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3276d0-7fb3-4567-bc0a-06a6af12f137 admin admin] PATH_INFO: `/v3/roles` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:54:31.499036 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df3276d0-7fb3-4567-bc0a-06a6af12f137 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:54:31.500777 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df3276d0-7fb3-4567-bc0a-06a6af12f137 admin admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:54:31.515828 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 1308/2569] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Sep 13 19:54:31 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 19:54:31.521639 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faba859a-97e4-45dc-bb8b-408bb7b03d0e admin admin] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:54:31.535748 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faba859a-97e4-45dc-bb8b-408bb7b03d0e admin admin] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:54:31.542209 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4cfc88e-a6eb-4132-802d-066fed236f53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:54:31.542839 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cfc88e-a6eb-4132-802d-066fed236f53 admin admin] REQUEST_METHOD: `PUT` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:54:31.543118 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cfc88e-a6eb-4132-802d-066fed236f53 admin admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:54:31.543388 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cfc88e-a6eb-4132-802d-066fed236f53 admin admin] PATH_INFO: `/v3/projects/77117ed04c0847ba8aa8bf10a4f6a039/users/982787f45a4d461e845e3d7194fbdc15/roles/a259191f6d0e46fabd9f34536bb28747` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:54:31.560377 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4cfc88e-a6eb-4132-802d-066fed236f53 admin admin] RBAC: Authorizing `identity:create_grant(project_id=77117ed04c0847ba8aa8bf10a4f6a039, user_id=982787f45a4d461e845e3d7194fbdc15, role_id=a259191f6d0e46fabd9f34536bb28747)` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:54:31.563169 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4cfc88e-a6eb-4132-802d-066fed236f53 admin admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:54:31.579176 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 1262/2570] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Sep 13 19:54:31 2022] PUT /identity/v3/projects/77117ed04c0847ba8aa8bf10a4f6a039/users/982787f45a4d461e845e3d7194fbdc15/roles/a259191f6d0e46fabd9f34536bb28747 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 19:54:31.590458 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510267f5-0709-412e-84cc-5b7767dd0d43 None None] REQUEST_METHOD: `POST` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:54:31.590458 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510267f5-0709-412e-84cc-5b7767dd0d43 None None] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:54:31.590663 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510267f5-0709-412e-84cc-5b7767dd0d43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:54:31.622163 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.auth.core [None req-510267f5-0709-412e-84cc-5b7767dd0d43 None None] MFA Rules not processed for user `982787f45a4d461e845e3d7194fbdc15`. Rule list: `[]` (Enabled: `True`). {{(pid=87934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:54:31.623488 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.fernet_utils [None req-510267f5-0709-412e-84cc-5b7767dd0d43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:54:31.692711 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 1309/2571] 10.222.0.25 () {58 vars in 958 bytes} [Tue Sep 13 19:54:31 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 19:54:31.703660 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4cfc88e-a6eb-4132-802d-066fed236f53 admin admin] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:54:31.706305 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.fernet_utils [None req-e4cfc88e-a6eb-4132-802d-066fed236f53 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:54:31.767128 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4cfc88e-a6eb-4132-802d-066fed236f53 admin admin] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:54:31.771661 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8b8496-15d9-40f3-9030-5f581db02a6c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cbb50c88b794a7f9f26844effde7d63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a10a4268f3c4cb29f4e00c292e2df62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:54:31.772321 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8b8496-15d9-40f3-9030-5f581db02a6c service cinder] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:54:31.772599 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8b8496-15d9-40f3-9030-5f581db02a6c service cinder] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:54:31.772873 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8b8496-15d9-40f3-9030-5f581db02a6c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:54:31.781700 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f8b8496-15d9-40f3-9030-5f581db02a6c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:54:31.783309 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f8b8496-15d9-40f3-9030-5f581db02a6c service cinder] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:54:31.800788 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 1263/2572] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Sep 13 19:54:31 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 19:54:33.279386 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516ef300-6ecf-4e9f-80c8-0e6fcc09e07c None None] REQUEST_METHOD: `POST` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:54:33.279862 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516ef300-6ecf-4e9f-80c8-0e6fcc09e07c None None] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:54:33.279959 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516ef300-6ecf-4e9f-80c8-0e6fcc09e07c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:54:33.300148 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.auth.core [None req-516ef300-6ecf-4e9f-80c8-0e6fcc09e07c None None] MFA Rules not processed for user `d44977a3225e43f19cdc4a84f0e170cd`. Rule list: `[]` (Enabled: `True`). {{(pid=87934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:54:33.301375 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.fernet_utils [None req-516ef300-6ecf-4e9f-80c8-0e6fcc09e07c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:54:33.360557 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 1310/2573] 10.222.0.25 () {58 vars in 1009 bytes} [Tue Sep 13 19:54:33 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 19:54:33.373790 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8b8496-15d9-40f3-9030-5f581db02a6c service cinder] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:54:33.375278 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.fernet_utils [None req-1f8b8496-15d9-40f3-9030-5f581db02a6c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:54:33.450904 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8b8496-15d9-40f3-9030-5f581db02a6c service cinder] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:54:33.457085 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f94f0f2-2173-4914-9613-facab67cd335 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb42d6ac6cdd4d97a80c3ee0c6f8e3f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a10a4268f3c4cb29f4e00c292e2df62', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:54:33.457689 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f94f0f2-2173-4914-9613-facab67cd335 service swift] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:54:33.457967 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f94f0f2-2173-4914-9613-facab67cd335 service swift] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:54:33.458236 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f94f0f2-2173-4914-9613-facab67cd335 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:54:33.470303 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f94f0f2-2173-4914-9613-facab67cd335 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:54:33.473890 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f94f0f2-2173-4914-9613-facab67cd335 service swift] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:54:33.481339 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG dbcounter [-] [87935] Writing DB stats keystone:SELECT=93,keystone:DELETE=4,keystone:INSERT=3 {{(pid=87935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:54:33.485372 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 1264/2574] 10.222.0.25 () {60 vars in 1384 bytes} [Tue Sep 13 19:54:33 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 13 19:54:35.009695 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516ef300-6ecf-4e9f-80c8-0e6fcc09e07c None None] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:54:35.050242 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG dbcounter [-] [87934] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:54:35.081276 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516ef300-6ecf-4e9f-80c8-0e6fcc09e07c None None] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:54:35.086583 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a8dd8e-9f4a-4ea8-8278-a0de36272698 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:54:35.087445 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a8dd8e-9f4a-4ea8-8278-a0de36272698 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:54:35.087731 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a8dd8e-9f4a-4ea8-8278-a0de36272698 admin admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:54:35.088039 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a8dd8e-9f4a-4ea8-8278-a0de36272698 admin admin] PATH_INFO: `/v3/users/982787f45a4d461e845e3d7194fbdc15` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:54:35.089197 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a8dd8e-9f4a-4ea8-8278-a0de36272698 admin admin] RBAC: Authorizing `identity:delete_user(user_id=982787f45a4d461e845e3d7194fbdc15)` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:54:35.091093 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a8dd8e-9f4a-4ea8-8278-a0de36272698 admin admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:54:35.150369 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.notifications [None req-c9a8dd8e-9f4a-4ea8-8278-a0de36272698 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '982787f45a4d461e845e3d7194fbdc15'} {{(pid=87934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:54:35.151069 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.notifications [None req-c9a8dd8e-9f4a-4ea8-8278-a0de36272698 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '982787f45a4d461e845e3d7194fbdc15'} {{(pid=87934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:54:35.151678 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.notifications [None req-c9a8dd8e-9f4a-4ea8-8278-a0de36272698 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '982787f45a4d461e845e3d7194fbdc15'} {{(pid=87934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:54:35.159868 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.notifications [None req-c9a8dd8e-9f4a-4ea8-8278-a0de36272698 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '982787f45a4d461e845e3d7194fbdc15'} {{(pid=87934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:54:35.193393 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.notifications [None req-c9a8dd8e-9f4a-4ea8-8278-a0de36272698 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '982787f45a4d461e845e3d7194fbdc15'} {{(pid=87934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:54:35.219701 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 1311/2575] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Sep 13 19:54:35 2022] DELETE /identity/v3/users/982787f45a4d461e845e3d7194fbdc15 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 19:54:35.224939 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f3b26d-492f-45b3-b36d-3d097c8f0a3d None None] REQUEST_METHOD: `POST` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:54:35.225893 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f3b26d-492f-45b3-b36d-3d097c8f0a3d None None] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:54:35.226389 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f3b26d-492f-45b3-b36d-3d097c8f0a3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:54:35.247930 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.auth.core [None req-40f3b26d-492f-45b3-b36d-3d097c8f0a3d None None] MFA Rules not processed for user `7b0aed92d02344acb92a0e4aa67c3068`. Rule list: `[]` (Enabled: `True`). {{(pid=87935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:54:35.249283 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.fernet_utils [None req-40f3b26d-492f-45b3-b36d-3d097c8f0a3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:54:35.316616 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 1265/2576] 10.222.0.25 () {58 vars in 958 bytes} [Tue Sep 13 19:54:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 19:54:35.326536 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a8dd8e-9f4a-4ea8-8278-a0de36272698 admin admin] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:54:35.328401 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.fernet_utils [None req-c9a8dd8e-9f4a-4ea8-8278-a0de36272698 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:54:35.416727 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a8dd8e-9f4a-4ea8-8278-a0de36272698 admin admin] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:54:35.421384 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d55b79f-49dc-457a-bdc0-ad43da403a28 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1196a96e4a404f559600b69f929ea9da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a10a4268f3c4cb29f4e00c292e2df62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:54:35.422004 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d55b79f-49dc-457a-bdc0-ad43da403a28 service neutron] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:54:35.422288 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d55b79f-49dc-457a-bdc0-ad43da403a28 service neutron] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:54:35.422565 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d55b79f-49dc-457a-bdc0-ad43da403a28 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:54:35.432648 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d55b79f-49dc-457a-bdc0-ad43da403a28 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:54:35.434128 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d55b79f-49dc-457a-bdc0-ad43da403a28 service neutron] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:54:35.445399 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 1312/2577] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Sep 13 19:54:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 19:54:35.764935 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f3b26d-492f-45b3-b36d-3d097c8f0a3d None None] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:54:35.766354 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.fernet_utils [None req-40f3b26d-492f-45b3-b36d-3d097c8f0a3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:54:35.779238 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f3b26d-492f-45b3-b36d-3d097c8f0a3d None None] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:54:35.785129 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98439e67-54bd-4dfb-8b45-ee3bdfbffac8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:54:35.785787 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98439e67-54bd-4dfb-8b45-ee3bdfbffac8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:54:35.786032 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98439e67-54bd-4dfb-8b45-ee3bdfbffac8 admin admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:54:35.786296 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98439e67-54bd-4dfb-8b45-ee3bdfbffac8 admin admin] PATH_INFO: `/v3/projects/77117ed04c0847ba8aa8bf10a4f6a039` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:54:35.787427 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98439e67-54bd-4dfb-8b45-ee3bdfbffac8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=77117ed04c0847ba8aa8bf10a4f6a039)` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:54:35.789455 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98439e67-54bd-4dfb-8b45-ee3bdfbffac8 admin admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:54:35.849093 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.notifications [None req-98439e67-54bd-4dfb-8b45-ee3bdfbffac8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '77117ed04c0847ba8aa8bf10a4f6a039', 'request_id': 'req-98439e67-54bd-4dfb-8b45-ee3bdfbffac8'} {{(pid=87935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:54:35.855486 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.notifications [None req-98439e67-54bd-4dfb-8b45-ee3bdfbffac8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '77117ed04c0847ba8aa8bf10a4f6a039', 'request_id': 'req-98439e67-54bd-4dfb-8b45-ee3bdfbffac8'} {{(pid=87935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:54:35.875617 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.notifications [None req-98439e67-54bd-4dfb-8b45-ee3bdfbffac8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '77117ed04c0847ba8aa8bf10a4f6a039', 'request_id': 'req-98439e67-54bd-4dfb-8b45-ee3bdfbffac8'} {{(pid=87935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:54:35.893508 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.notifications [None req-98439e67-54bd-4dfb-8b45-ee3bdfbffac8 admin admin] The token cache is being invalidate because project 77117ed04c0847ba8aa8bf10a4f6a039 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87935) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 19:54:35.893797 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.notifications [None req-98439e67-54bd-4dfb-8b45-ee3bdfbffac8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:54:35.894476 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.notifications [None req-98439e67-54bd-4dfb-8b45-ee3bdfbffac8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:54:35.896015 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 1266/2578] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Sep 13 19:54:35 2022] DELETE /identity/v3/projects/77117ed04c0847ba8aa8bf10a4f6a039 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 19:54:35.901129 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebddfb8-b916-4ecb-8b74-9ed113663ed6 None None] REQUEST_METHOD: `POST` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:54:35.901629 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebddfb8-b916-4ecb-8b74-9ed113663ed6 None None] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:54:35.901990 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebddfb8-b916-4ecb-8b74-9ed113663ed6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:54:35.925770 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.auth.core [None req-1ebddfb8-b916-4ecb-8b74-9ed113663ed6 None None] MFA Rules not processed for user `7b0aed92d02344acb92a0e4aa67c3068`. Rule list: `[]` (Enabled: `True`). {{(pid=87934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:54:35.927164 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.fernet_utils [None req-1ebddfb8-b916-4ecb-8b74-9ed113663ed6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:54:35.986004 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG dbcounter [-] [87934] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:54:36.011949 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 1313/2579] 10.222.0.25 () {58 vars in 958 bytes} [Tue Sep 13 19:54:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 19:54:36.020897 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1731b4-1661-441c-beb9-278ed7252d00 None None] REQUEST_METHOD: `POST` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:54:36.021184 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1731b4-1661-441c-beb9-278ed7252d00 None None] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:54:36.021481 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1731b4-1661-441c-beb9-278ed7252d00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:54:36.042926 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.auth.core [None req-ab1731b4-1661-441c-beb9-278ed7252d00 None None] MFA Rules not processed for user `7b0aed92d02344acb92a0e4aa67c3068`. Rule list: `[]` (Enabled: `True`). {{(pid=87935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:54:36.044158 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.fernet_utils [None req-ab1731b4-1661-441c-beb9-278ed7252d00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:54:36.056247 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 1267/2580] 10.222.0.25 () {58 vars in 958 bytes} [Tue Sep 13 19:54:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 19:54:36.060635 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ebddfb8-b916-4ecb-8b74-9ed113663ed6 None None] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:54:36.071317 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ebddfb8-b916-4ecb-8b74-9ed113663ed6 None None] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:54:36.076603 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41ae1dd-c455-493b-8daa-4e73c0bf5305 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:54:36.077297 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41ae1dd-c455-493b-8daa-4e73c0bf5305 admin admin] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:54:36.077894 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41ae1dd-c455-493b-8daa-4e73c0bf5305 admin admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:54:36.078267 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41ae1dd-c455-493b-8daa-4e73c0bf5305 admin admin] PATH_INFO: `/v3/domains` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:54:36.079019 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d41ae1dd-c455-493b-8daa-4e73c0bf5305 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87934) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:54:36.079443 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d41ae1dd-c455-493b-8daa-4e73c0bf5305 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:54:36.082115 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d41ae1dd-c455-493b-8daa-4e73c0bf5305 admin admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:54:36.094766 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 1314/2581] 10.222.0.25 () {58 vars in 1153 bytes} [Tue Sep 13 19:54:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:54:36.099533 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1731b4-1661-441c-beb9-278ed7252d00 None None] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:54:36.109409 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1731b4-1661-441c-beb9-278ed7252d00 None None] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:54:36.114661 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bdfcf96-252d-490d-a070-e4e38f49b6aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:54:36.115275 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdfcf96-252d-490d-a070-e4e38f49b6aa admin admin] REQUEST_METHOD: `POST` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:54:36.115556 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdfcf96-252d-490d-a070-e4e38f49b6aa admin admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:54:36.115830 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdfcf96-252d-490d-a070-e4e38f49b6aa admin admin] PATH_INFO: `/v3/projects` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:54:36.116526 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bdfcf96-252d-490d-a070-e4e38f49b6aa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:54:36.118458 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bdfcf96-252d-490d-a070-e4e38f49b6aa admin admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:54:36.151651 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 1268/2582] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Sep 13 19:54:36 2022] POST /identity/v3/projects => generated 381 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 13 19:54:36.156050 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41ae1dd-c455-493b-8daa-4e73c0bf5305 admin admin] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:54:36.166738 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41ae1dd-c455-493b-8daa-4e73c0bf5305 admin admin] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:54:36.234658 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5928e88b-fefc-4a2a-9269-3872bcdf5e8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:54:36.235275 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5928e88b-fefc-4a2a-9269-3872bcdf5e8f admin admin] REQUEST_METHOD: `POST` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:54:36.235558 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5928e88b-fefc-4a2a-9269-3872bcdf5e8f admin admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:54:36.235861 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5928e88b-fefc-4a2a-9269-3872bcdf5e8f admin admin] PATH_INFO: `/v3/users` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:54:36.236608 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5928e88b-fefc-4a2a-9269-3872bcdf5e8f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:54:36.238485 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5928e88b-fefc-4a2a-9269-3872bcdf5e8f admin admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:54:36.267782 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 1315/2583] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Sep 13 19:54:36 2022] POST /identity/v3/users => generated 291 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 19:54:36.269141 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bdfcf96-252d-490d-a070-e4e38f49b6aa admin admin] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:54:36.284898 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bdfcf96-252d-490d-a070-e4e38f49b6aa admin admin] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:54:36.289771 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909b2edd-4553-44b3-a73d-d78feb764580 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:54:36.290388 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909b2edd-4553-44b3-a73d-d78feb764580 admin admin] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:54:36.290673 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909b2edd-4553-44b3-a73d-d78feb764580 admin admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:54:36.290946 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909b2edd-4553-44b3-a73d-d78feb764580 admin admin] PATH_INFO: `/v3/roles` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:54:36.291900 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-909b2edd-4553-44b3-a73d-d78feb764580 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:54:36.293658 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-909b2edd-4553-44b3-a73d-d78feb764580 admin admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:54:36.306374 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 1269/2584] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Sep 13 19:54:36 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 19:54:36.310696 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5928e88b-fefc-4a2a-9269-3872bcdf5e8f admin admin] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:54:36.324269 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5928e88b-fefc-4a2a-9269-3872bcdf5e8f admin admin] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:54:36.329335 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b0883e-28b4-4878-8b53-7abf8e392e76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:54:36.330141 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b0883e-28b4-4878-8b53-7abf8e392e76 admin admin] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:54:36.330642 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b0883e-28b4-4878-8b53-7abf8e392e76 admin admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:54:36.330933 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b0883e-28b4-4878-8b53-7abf8e392e76 admin admin] PATH_INFO: `/v3/roles` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:54:36.331912 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b0883e-28b4-4878-8b53-7abf8e392e76 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:54:36.333183 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b0883e-28b4-4878-8b53-7abf8e392e76 admin admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:54:36.344914 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 1316/2585] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Sep 13 19:54:36 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 19:54:36.349280 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909b2edd-4553-44b3-a73d-d78feb764580 admin admin] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:54:36.360373 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909b2edd-4553-44b3-a73d-d78feb764580 admin admin] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:54:36.366137 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6185d1-4299-4b37-9ab1-1642c38aad2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:54:36.366892 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6185d1-4299-4b37-9ab1-1642c38aad2c admin admin] REQUEST_METHOD: `PUT` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:54:36.367244 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6185d1-4299-4b37-9ab1-1642c38aad2c admin admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:54:36.367588 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6185d1-4299-4b37-9ab1-1642c38aad2c admin admin] PATH_INFO: `/v3/projects/bb9c8c3ef83449ababe431601eec990d/users/54a4fca5e980468e8a28d904871f49b3/roles/a259191f6d0e46fabd9f34536bb28747` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:54:36.400001 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c6185d1-4299-4b37-9ab1-1642c38aad2c admin admin] RBAC: Authorizing `identity:create_grant(project_id=bb9c8c3ef83449ababe431601eec990d, user_id=54a4fca5e980468e8a28d904871f49b3, role_id=a259191f6d0e46fabd9f34536bb28747)` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:54:36.402687 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c6185d1-4299-4b37-9ab1-1642c38aad2c admin admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:54:36.434438 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 1270/2586] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Sep 13 19:54:36 2022] PUT /identity/v3/projects/bb9c8c3ef83449ababe431601eec990d/users/54a4fca5e980468e8a28d904871f49b3/roles/a259191f6d0e46fabd9f34536bb28747 => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 19:54:36.440108 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b4daa2-e351-4153-9ec2-c74647e4db37 None None] REQUEST_METHOD: `POST` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:54:36.440409 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b4daa2-e351-4153-9ec2-c74647e4db37 None None] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:54:36.440686 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b4daa2-e351-4153-9ec2-c74647e4db37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:54:36.464994 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.auth.core [None req-19b4daa2-e351-4153-9ec2-c74647e4db37 None None] MFA Rules not processed for user `7b0aed92d02344acb92a0e4aa67c3068`. Rule list: `[]` (Enabled: `True`). {{(pid=87934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:54:36.466270 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.fernet_utils [None req-19b4daa2-e351-4153-9ec2-c74647e4db37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:54:36.542833 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 1317/2587] 10.222.0.25 () {58 vars in 958 bytes} [Tue Sep 13 19:54:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 19:54:36.556099 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6185d1-4299-4b37-9ab1-1642c38aad2c admin admin] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:54:36.558031 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.fernet_utils [None req-4c6185d1-4299-4b37-9ab1-1642c38aad2c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:54:36.583957 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG dbcounter [-] [87935] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=87935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:54:36.630586 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6185d1-4299-4b37-9ab1-1642c38aad2c admin admin] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:54:36.635118 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085662af-d713-4154-8d73-9b3c99bb0cc8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1196a96e4a404f559600b69f929ea9da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a10a4268f3c4cb29f4e00c292e2df62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:54:36.635768 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085662af-d713-4154-8d73-9b3c99bb0cc8 service neutron] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:54:36.636049 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085662af-d713-4154-8d73-9b3c99bb0cc8 service neutron] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:54:36.636355 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085662af-d713-4154-8d73-9b3c99bb0cc8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:54:36.646906 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-085662af-d713-4154-8d73-9b3c99bb0cc8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:54:36.648819 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-085662af-d713-4154-8d73-9b3c99bb0cc8 service neutron] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:54:36.660117 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 1271/2588] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Sep 13 19:54:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 19:54:37.446598 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e203e9-ccbd-4ab6-9ddc-b10ce117e855 None None] REQUEST_METHOD: `POST` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:54:37.448032 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e203e9-ccbd-4ab6-9ddc-b10ce117e855 None None] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:54:37.448502 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e203e9-ccbd-4ab6-9ddc-b10ce117e855 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:54:37.489003 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.auth.core [None req-63e203e9-ccbd-4ab6-9ddc-b10ce117e855 None None] MFA Rules not processed for user `54a4fca5e980468e8a28d904871f49b3`. Rule list: `[]` (Enabled: `True`). {{(pid=87934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:54:37.490564 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.fernet_utils [None req-63e203e9-ccbd-4ab6-9ddc-b10ce117e855 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:54:37.555524 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG dbcounter [-] [87934] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:54:37.580481 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 1318/2589] 10.222.0.25 () {58 vars in 958 bytes} [Tue Sep 13 19:54:37 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 19:54:37.596093 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085662af-d713-4154-8d73-9b3c99bb0cc8 service neutron] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:54:37.598320 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.fernet_utils [None req-085662af-d713-4154-8d73-9b3c99bb0cc8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:54:37.692614 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085662af-d713-4154-8d73-9b3c99bb0cc8 service neutron] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:54:37.696434 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad92f87-cf08-4e71-859c-4904dc670235 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cbb50c88b794a7f9f26844effde7d63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a10a4268f3c4cb29f4e00c292e2df62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:54:37.697047 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad92f87-cf08-4e71-859c-4904dc670235 service cinder] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:54:37.697334 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad92f87-cf08-4e71-859c-4904dc670235 service cinder] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:54:37.697593 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad92f87-cf08-4e71-859c-4904dc670235 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:54:37.708319 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad92f87-cf08-4e71-859c-4904dc670235 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:54:37.709769 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad92f87-cf08-4e71-859c-4904dc670235 service cinder] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:54:37.721391 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 1272/2590] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Sep 13 19:54:37 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 19:54:39.139787 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44049141-8089-4f16-a47a-ac33956aa490 None None] REQUEST_METHOD: `POST` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:54:39.140392 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44049141-8089-4f16-a47a-ac33956aa490 None None] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:54:39.140392 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44049141-8089-4f16-a47a-ac33956aa490 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:54:39.163151 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.auth.core [None req-44049141-8089-4f16-a47a-ac33956aa490 None None] MFA Rules not processed for user `54a4fca5e980468e8a28d904871f49b3`. Rule list: `[]` (Enabled: `True`). {{(pid=87934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:54:39.164407 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.fernet_utils [None req-44049141-8089-4f16-a47a-ac33956aa490 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:54:39.171384 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 1319/2591] 10.222.0.25 () {58 vars in 958 bytes} [Tue Sep 13 19:54:39 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 19:54:39.683292 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad92f87-cf08-4e71-859c-4904dc670235 service cinder] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:54:39.684731 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.fernet_utils [None req-8ad92f87-cf08-4e71-859c-4904dc670235 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:54:39.697256 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad92f87-cf08-4e71-859c-4904dc670235 service cinder] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:54:39.703843 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edbb8f71-e0f6-44d4-9a82-1f3961b7df5a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1196a96e4a404f559600b69f929ea9da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a10a4268f3c4cb29f4e00c292e2df62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:54:39.704490 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbb8f71-e0f6-44d4-9a82-1f3961b7df5a service neutron] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:54:39.704760 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbb8f71-e0f6-44d4-9a82-1f3961b7df5a service neutron] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:54:39.705028 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbb8f71-e0f6-44d4-9a82-1f3961b7df5a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:54:39.706752 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.fernet_utils [None req-edbb8f71-e0f6-44d4-9a82-1f3961b7df5a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:54:39.724652 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edbb8f71-e0f6-44d4-9a82-1f3961b7df5a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:54:39.726167 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edbb8f71-e0f6-44d4-9a82-1f3961b7df5a service neutron] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:54:39.737392 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 1273/2592] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Sep 13 19:54:39 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 19:54:40.193901 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44049141-8089-4f16-a47a-ac33956aa490 None None] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:54:40.196008 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.fernet_utils [None req-44049141-8089-4f16-a47a-ac33956aa490 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:54:40.340969 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44049141-8089-4f16-a47a-ac33956aa490 None None] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:54:40.346224 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0b7029-88e6-4d8e-bcd0-baed1d5093d8 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02eb3d3173c1476cb83a72add0e878e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a10a4268f3c4cb29f4e00c292e2df62', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:54:40.346829 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0b7029-88e6-4d8e-bcd0-baed1d5093d8 service placement] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:54:40.347104 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0b7029-88e6-4d8e-bcd0-baed1d5093d8 service placement] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:54:40.347364 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0b7029-88e6-4d8e-bcd0-baed1d5093d8 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:54:40.349100 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.fernet_utils [None req-4e0b7029-88e6-4d8e-bcd0-baed1d5093d8 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:54:40.360345 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e0b7029-88e6-4d8e-bcd0-baed1d5093d8 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:54:40.362412 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e0b7029-88e6-4d8e-bcd0-baed1d5093d8 service placement] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:54:40.372700 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 1320/2593] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Sep 13 19:54:40 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 179 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 19:54:41.834889 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edbb8f71-e0f6-44d4-9a82-1f3961b7df5a service neutron] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:54:41.836232 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.fernet_utils [None req-edbb8f71-e0f6-44d4-9a82-1f3961b7df5a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:54:41.909341 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edbb8f71-e0f6-44d4-9a82-1f3961b7df5a service neutron] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:54:41.914783 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f058c56f-72ba-4b98-bc7d-7e2e5704f226 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd71fe5a8275f4ea98555afdcefc902a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a10a4268f3c4cb29f4e00c292e2df62', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:54:41.915381 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f058c56f-72ba-4b98-bc7d-7e2e5704f226 service nova] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:54:41.915657 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f058c56f-72ba-4b98-bc7d-7e2e5704f226 service nova] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:54:41.915924 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f058c56f-72ba-4b98-bc7d-7e2e5704f226 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:54:41.917647 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.fernet_utils [None req-f058c56f-72ba-4b98-bc7d-7e2e5704f226 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:54:41.966162 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG dbcounter [-] [87935] Writing DB stats keystone:SELECT=100 {{(pid=87935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:54:41.977721 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f058c56f-72ba-4b98-bc7d-7e2e5704f226 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:54:41.979371 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f058c56f-72ba-4b98-bc7d-7e2e5704f226 service nova] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:54:41.989471 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 1274/2594] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Sep 13 19:54:41 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 19:54:43.991430 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0b7029-88e6-4d8e-bcd0-baed1d5093d8 service placement] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:54:44.001687 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0b7029-88e6-4d8e-bcd0-baed1d5093d8 service placement] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:54:44.005742 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e668e9-e80c-4ea9-825f-dab2f7147a21 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1196a96e4a404f559600b69f929ea9da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a10a4268f3c4cb29f4e00c292e2df62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:54:44.006341 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e668e9-e80c-4ea9-825f-dab2f7147a21 service neutron] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:54:44.006622 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e668e9-e80c-4ea9-825f-dab2f7147a21 service neutron] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:54:44.006885 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e668e9-e80c-4ea9-825f-dab2f7147a21 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:54:44.008617 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.fernet_utils [None req-c4e668e9-e80c-4ea9-825f-dab2f7147a21 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:54:44.018886 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e668e9-e80c-4ea9-825f-dab2f7147a21 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:54:44.020341 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e668e9-e80c-4ea9-825f-dab2f7147a21 service neutron] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:54:44.028064 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 1321/2595] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Sep 13 19:54:43 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 19:54:50.447132 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bbaa27-a01c-4c97-a001-42d3e2999b20 None None] REQUEST_METHOD: `POST` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:54:50.447622 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bbaa27-a01c-4c97-a001-42d3e2999b20 None None] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:54:50.447924 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bbaa27-a01c-4c97-a001-42d3e2999b20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:54:50.468831 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.auth.core [None req-e4bbaa27-a01c-4c97-a001-42d3e2999b20 None None] MFA Rules not processed for user `d44977a3225e43f19cdc4a84f0e170cd`. Rule list: `[]` (Enabled: `True`). {{(pid=87935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:54:50.470189 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.fernet_utils [None req-e4bbaa27-a01c-4c97-a001-42d3e2999b20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:54:50.538227 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 1275/2596] 10.222.0.25 () {58 vars in 967 bytes} [Tue Sep 13 19:54:50 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 19:54:50.551325 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e668e9-e80c-4ea9-825f-dab2f7147a21 service neutron] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:54:50.552809 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.fernet_utils [None req-c4e668e9-e80c-4ea9-825f-dab2f7147a21 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:54:50.627725 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e668e9-e80c-4ea9-825f-dab2f7147a21 service neutron] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:54:50.632877 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f035a910-e130-43b0-aa3e-83396cc799f4 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb42d6ac6cdd4d97a80c3ee0c6f8e3f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a10a4268f3c4cb29f4e00c292e2df62', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:54:50.633478 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f035a910-e130-43b0-aa3e-83396cc799f4 service swift] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:54:50.633752 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f035a910-e130-43b0-aa3e-83396cc799f4 service swift] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:54:50.634016 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f035a910-e130-43b0-aa3e-83396cc799f4 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:54:50.642618 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f035a910-e130-43b0-aa3e-83396cc799f4 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:54:50.644613 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f035a910-e130-43b0-aa3e-83396cc799f4 service swift] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:54:50.653001 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 1322/2597] 10.222.0.25 () {60 vars in 1384 bytes} [Tue Sep 13 19:54:50 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 13 19:54:55.537699 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4bbaa27-a01c-4c97-a001-42d3e2999b20 None None] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:54:55.547278 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4bbaa27-a01c-4c97-a001-42d3e2999b20 None None] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:54:55.550934 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9658ff0f-9d5b-4899-a928-27d61041448e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1196a96e4a404f559600b69f929ea9da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a10a4268f3c4cb29f4e00c292e2df62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:54:55.551522 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9658ff0f-9d5b-4899-a928-27d61041448e service neutron] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:54:55.551795 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9658ff0f-9d5b-4899-a928-27d61041448e service neutron] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:54:55.552112 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9658ff0f-9d5b-4899-a928-27d61041448e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:54:55.553791 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.fernet_utils [None req-9658ff0f-9d5b-4899-a928-27d61041448e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:54:55.565952 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9658ff0f-9d5b-4899-a928-27d61041448e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:54:55.567384 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9658ff0f-9d5b-4899-a928-27d61041448e service neutron] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:54:55.576989 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 1276/2598] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Sep 13 19:54:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 19:54:58.787342 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f035a910-e130-43b0-aa3e-83396cc799f4 service swift] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:54:58.788822 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.fernet_utils [None req-f035a910-e130-43b0-aa3e-83396cc799f4 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:54:58.812407 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f035a910-e130-43b0-aa3e-83396cc799f4 service swift] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:54:58.822472 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91507841-360b-4b88-b492-b37509ebaa65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:54:58.822472 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91507841-360b-4b88-b492-b37509ebaa65 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:54:58.822472 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91507841-360b-4b88-b492-b37509ebaa65 admin admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:54:58.822472 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91507841-360b-4b88-b492-b37509ebaa65 admin admin] PATH_INFO: `/v3/users/066fb7f5f8a548ea99de513906a49cfe` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:54:58.822905 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91507841-360b-4b88-b492-b37509ebaa65 admin admin] RBAC: Authorizing `identity:delete_user(user_id=066fb7f5f8a548ea99de513906a49cfe)` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:54:58.822905 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91507841-360b-4b88-b492-b37509ebaa65 admin admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:54:58.874711 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG dbcounter [-] [87934] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=87934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:54:58.876924 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.notifications [None req-91507841-360b-4b88-b492-b37509ebaa65 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '066fb7f5f8a548ea99de513906a49cfe'} {{(pid=87934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:54:58.878428 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.notifications [None req-91507841-360b-4b88-b492-b37509ebaa65 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '066fb7f5f8a548ea99de513906a49cfe'} {{(pid=87934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:54:58.879764 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.notifications [None req-91507841-360b-4b88-b492-b37509ebaa65 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '066fb7f5f8a548ea99de513906a49cfe'} {{(pid=87934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:54:58.887148 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.notifications [None req-91507841-360b-4b88-b492-b37509ebaa65 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '066fb7f5f8a548ea99de513906a49cfe'} {{(pid=87934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:54:58.899441 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.notifications [None req-91507841-360b-4b88-b492-b37509ebaa65 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '066fb7f5f8a548ea99de513906a49cfe'} {{(pid=87934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:54:58.912605 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 1323/2599] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Sep 13 19:54:58 2022] DELETE /identity/v3/users/066fb7f5f8a548ea99de513906a49cfe => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 19:54:59.097442 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9658ff0f-9d5b-4899-a928-27d61041448e service neutron] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:54:59.109059 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9658ff0f-9d5b-4899-a928-27d61041448e service neutron] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:54:59.169028 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51772dd1-2893-44cf-81c5-7896ebed5e63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:54:59.169655 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51772dd1-2893-44cf-81c5-7896ebed5e63 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:54:59.169930 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51772dd1-2893-44cf-81c5-7896ebed5e63 admin admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:54:59.170201 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51772dd1-2893-44cf-81c5-7896ebed5e63 admin admin] PATH_INFO: `/v3/projects/88fe628e13b94b668c1eeaeb6db9afcf` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:54:59.171305 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51772dd1-2893-44cf-81c5-7896ebed5e63 admin admin] RBAC: Authorizing `identity:delete_project(project_id=88fe628e13b94b668c1eeaeb6db9afcf)` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:54:59.173283 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51772dd1-2893-44cf-81c5-7896ebed5e63 admin admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:54:59.219950 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.notifications [None req-51772dd1-2893-44cf-81c5-7896ebed5e63 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '88fe628e13b94b668c1eeaeb6db9afcf', 'request_id': 'req-51772dd1-2893-44cf-81c5-7896ebed5e63'} {{(pid=87935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:54:59.226380 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.notifications [None req-51772dd1-2893-44cf-81c5-7896ebed5e63 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '88fe628e13b94b668c1eeaeb6db9afcf', 'request_id': 'req-51772dd1-2893-44cf-81c5-7896ebed5e63'} {{(pid=87935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:54:59.233782 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.notifications [None req-51772dd1-2893-44cf-81c5-7896ebed5e63 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '88fe628e13b94b668c1eeaeb6db9afcf', 'request_id': 'req-51772dd1-2893-44cf-81c5-7896ebed5e63'} {{(pid=87935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:54:59.245840 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.notifications [None req-51772dd1-2893-44cf-81c5-7896ebed5e63 admin admin] The token cache is being invalidate because project 88fe628e13b94b668c1eeaeb6db9afcf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87935) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 19:54:59.246131 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.notifications [None req-51772dd1-2893-44cf-81c5-7896ebed5e63 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:54:59.246789 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.notifications [None req-51772dd1-2893-44cf-81c5-7896ebed5e63 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:54:59.248332 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 1277/2600] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Sep 13 19:54:59 2022] DELETE /identity/v3/projects/88fe628e13b94b668c1eeaeb6db9afcf => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 19:54:59.253256 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c41cc86-a7a2-4a80-9de3-674cfb5c059a None None] REQUEST_METHOD: `POST` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:54:59.253541 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c41cc86-a7a2-4a80-9de3-674cfb5c059a None None] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:54:59.253810 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c41cc86-a7a2-4a80-9de3-674cfb5c059a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:54:59.273651 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.auth.core [None req-9c41cc86-a7a2-4a80-9de3-674cfb5c059a None None] MFA Rules not processed for user `7b0aed92d02344acb92a0e4aa67c3068`. Rule list: `[]` (Enabled: `True`). {{(pid=87934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:54:59.274862 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.fernet_utils [None req-9c41cc86-a7a2-4a80-9de3-674cfb5c059a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:54:59.334915 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 1324/2601] 10.222.0.25 () {58 vars in 958 bytes} [Tue Sep 13 19:54:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 19:54:59.343605 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c800afda-d9e0-40a1-80e3-c2347de38eec None None] REQUEST_METHOD: `POST` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:54:59.343912 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c800afda-d9e0-40a1-80e3-c2347de38eec None None] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:54:59.344168 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c800afda-d9e0-40a1-80e3-c2347de38eec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:54:59.364409 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.auth.core [None req-c800afda-d9e0-40a1-80e3-c2347de38eec None None] MFA Rules not processed for user `7b0aed92d02344acb92a0e4aa67c3068`. Rule list: `[]` (Enabled: `True`). {{(pid=87935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:54:59.365619 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.fernet_utils [None req-c800afda-d9e0-40a1-80e3-c2347de38eec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:54:59.373480 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 1278/2602] 10.222.0.25 () {58 vars in 958 bytes} [Tue Sep 13 19:54:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 19:54:59.379112 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c41cc86-a7a2-4a80-9de3-674cfb5c059a None None] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:54:59.388864 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c41cc86-a7a2-4a80-9de3-674cfb5c059a None None] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:54:59.394052 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6adb0643-08ed-48af-a40d-84b502161e69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:54:59.394865 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6adb0643-08ed-48af-a40d-84b502161e69 admin admin] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:54:59.395142 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6adb0643-08ed-48af-a40d-84b502161e69 admin admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:54:59.395407 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6adb0643-08ed-48af-a40d-84b502161e69 admin admin] PATH_INFO: `/v3/domains` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:54:59.396043 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6adb0643-08ed-48af-a40d-84b502161e69 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87934) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:54:59.396371 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6adb0643-08ed-48af-a40d-84b502161e69 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:54:59.397973 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6adb0643-08ed-48af-a40d-84b502161e69 admin admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:54:59.409380 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 1325/2603] 10.222.0.25 () {58 vars in 1153 bytes} [Tue Sep 13 19:54:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:54:59.413946 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c800afda-d9e0-40a1-80e3-c2347de38eec None None] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:54:59.420187 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG dbcounter [-] [87935] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=87935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:54:59.424526 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c800afda-d9e0-40a1-80e3-c2347de38eec None None] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:54:59.432405 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca1f460-8880-4c37-9b92-704b4f47e1d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:54:59.433060 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca1f460-8880-4c37-9b92-704b4f47e1d9 admin admin] REQUEST_METHOD: `POST` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:54:59.433556 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca1f460-8880-4c37-9b92-704b4f47e1d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:54:59.433885 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca1f460-8880-4c37-9b92-704b4f47e1d9 admin admin] PATH_INFO: `/v3/projects` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:54:59.434730 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca1f460-8880-4c37-9b92-704b4f47e1d9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:54:59.436691 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca1f460-8880-4c37-9b92-704b4f47e1d9 admin admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:54:59.465943 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 1279/2604] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Sep 13 19:54:59 2022] POST /identity/v3/projects => generated 403 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 13 19:54:59.470944 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6adb0643-08ed-48af-a40d-84b502161e69 admin admin] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:54:59.481164 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6adb0643-08ed-48af-a40d-84b502161e69 admin admin] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:54:59.537734 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb7f33d-6843-47e0-bc09-da3dd5979c76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:54:59.538379 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb7f33d-6843-47e0-bc09-da3dd5979c76 admin admin] REQUEST_METHOD: `POST` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:54:59.538674 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb7f33d-6843-47e0-bc09-da3dd5979c76 admin admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:54:59.538943 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb7f33d-6843-47e0-bc09-da3dd5979c76 admin admin] PATH_INFO: `/v3/users` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:54:59.539568 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb7f33d-6843-47e0-bc09-da3dd5979c76 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:54:59.541558 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb7f33d-6843-47e0-bc09-da3dd5979c76 admin admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:54:59.562552 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 1326/2605] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Sep 13 19:54:59 2022] POST /identity/v3/users => generated 302 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 19:54:59.567329 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca1f460-8880-4c37-9b92-704b4f47e1d9 admin admin] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:54:59.579059 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca1f460-8880-4c37-9b92-704b4f47e1d9 admin admin] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:54:59.584024 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64d0ab7-b21f-424f-90ce-a0f871dcc1b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:54:59.584671 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64d0ab7-b21f-424f-90ce-a0f871dcc1b1 admin admin] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:54:59.585000 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64d0ab7-b21f-424f-90ce-a0f871dcc1b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:54:59.585274 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64d0ab7-b21f-424f-90ce-a0f871dcc1b1 admin admin] PATH_INFO: `/v3/roles` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:54:59.585916 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a64d0ab7-b21f-424f-90ce-a0f871dcc1b1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:54:59.587514 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a64d0ab7-b21f-424f-90ce-a0f871dcc1b1 admin admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:54:59.598401 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 1280/2606] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Sep 13 19:54:59 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 19:54:59.602844 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb7f33d-6843-47e0-bc09-da3dd5979c76 admin admin] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:54:59.613548 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb7f33d-6843-47e0-bc09-da3dd5979c76 admin admin] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:54:59.618318 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012bea06-3e13-4f80-9c22-c98ab45185b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:54:59.618912 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012bea06-3e13-4f80-9c22-c98ab45185b0 admin admin] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:54:59.619219 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012bea06-3e13-4f80-9c22-c98ab45185b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:54:59.619488 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012bea06-3e13-4f80-9c22-c98ab45185b0 admin admin] PATH_INFO: `/v3/roles` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:54:59.620122 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-012bea06-3e13-4f80-9c22-c98ab45185b0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:54:59.621726 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-012bea06-3e13-4f80-9c22-c98ab45185b0 admin admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:54:59.632958 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 1327/2607] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Sep 13 19:54:59 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 19:54:59.637906 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64d0ab7-b21f-424f-90ce-a0f871dcc1b1 admin admin] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:54:59.648047 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64d0ab7-b21f-424f-90ce-a0f871dcc1b1 admin admin] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:54:59.652651 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048f2cc2-c321-46d1-bd9a-b0ba13e04fdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:54:59.653290 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048f2cc2-c321-46d1-bd9a-b0ba13e04fdc admin admin] REQUEST_METHOD: `PUT` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:54:59.653561 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048f2cc2-c321-46d1-bd9a-b0ba13e04fdc admin admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:54:59.653829 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048f2cc2-c321-46d1-bd9a-b0ba13e04fdc admin admin] PATH_INFO: `/v3/projects/9ac79fa521b74e949755f0a662adefb9/users/86fb968728444a82a9d31ed3dea7457a/roles/a259191f6d0e46fabd9f34536bb28747` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:54:59.668433 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-048f2cc2-c321-46d1-bd9a-b0ba13e04fdc admin admin] RBAC: Authorizing `identity:create_grant(project_id=9ac79fa521b74e949755f0a662adefb9, user_id=86fb968728444a82a9d31ed3dea7457a, role_id=a259191f6d0e46fabd9f34536bb28747)` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:54:59.671112 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-048f2cc2-c321-46d1-bd9a-b0ba13e04fdc admin admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:54:59.684366 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 1281/2608] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Sep 13 19:54:59 2022] PUT /identity/v3/projects/9ac79fa521b74e949755f0a662adefb9/users/86fb968728444a82a9d31ed3dea7457a/roles/a259191f6d0e46fabd9f34536bb28747 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 19:54:59.689500 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efccf55-69b2-4979-b3de-b2ed96ba50a0 None None] REQUEST_METHOD: `POST` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:54:59.689798 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efccf55-69b2-4979-b3de-b2ed96ba50a0 None None] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:54:59.690139 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efccf55-69b2-4979-b3de-b2ed96ba50a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:54:59.710320 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.auth.core [None req-1efccf55-69b2-4979-b3de-b2ed96ba50a0 None None] MFA Rules not processed for user `7b0aed92d02344acb92a0e4aa67c3068`. Rule list: `[]` (Enabled: `True`). {{(pid=87934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:54:59.711544 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.fernet_utils [None req-1efccf55-69b2-4979-b3de-b2ed96ba50a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:54:59.734985 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG dbcounter [-] [87934] Writing DB stats keystone:SELECT=93,keystone:DELETE=3,keystone:INSERT=4 {{(pid=87934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:54:59.773307 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 1328/2609] 10.222.0.25 () {58 vars in 958 bytes} [Tue Sep 13 19:54:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 19:54:59.783155 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048f2cc2-c321-46d1-bd9a-b0ba13e04fdc admin admin] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:54:59.785144 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.fernet_utils [None req-048f2cc2-c321-46d1-bd9a-b0ba13e04fdc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:54:59.849149 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048f2cc2-c321-46d1-bd9a-b0ba13e04fdc admin admin] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:54:59.852730 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f3d280-54b4-4ce8-8f9e-0882e5622ac0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1196a96e4a404f559600b69f929ea9da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a10a4268f3c4cb29f4e00c292e2df62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:54:59.853329 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f3d280-54b4-4ce8-8f9e-0882e5622ac0 service neutron] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:54:59.853604 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f3d280-54b4-4ce8-8f9e-0882e5622ac0 service neutron] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:54:59.853869 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f3d280-54b4-4ce8-8f9e-0882e5622ac0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:54:59.863753 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f3d280-54b4-4ce8-8f9e-0882e5622ac0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:54:59.865246 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f3d280-54b4-4ce8-8f9e-0882e5622ac0 service neutron] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:54:59.875684 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 1282/2610] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Sep 13 19:54:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 13 19:55:00.510951 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad0d28c-2e1e-4b33-bbdd-ae85404ba1d6 None None] REQUEST_METHOD: `POST` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:55:00.511486 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad0d28c-2e1e-4b33-bbdd-ae85404ba1d6 None None] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:55:00.511575 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad0d28c-2e1e-4b33-bbdd-ae85404ba1d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:55:00.545828 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.auth.core [None req-3ad0d28c-2e1e-4b33-bbdd-ae85404ba1d6 None None] MFA Rules not processed for user `86fb968728444a82a9d31ed3dea7457a`. Rule list: `[]` (Enabled: `True`). {{(pid=87934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:55:00.547050 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.fernet_utils [None req-3ad0d28c-2e1e-4b33-bbdd-ae85404ba1d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:55:00.615519 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 1329/2611] 10.222.0.25 () {58 vars in 958 bytes} [Tue Sep 13 19:55:00 2022] POST /identity/v3/auth/tokens => generated 3280 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 19:55:00.620189 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f3d280-54b4-4ce8-8f9e-0882e5622ac0 service neutron] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:55:00.630798 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f3d280-54b4-4ce8-8f9e-0882e5622ac0 service neutron] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:55:00.635580 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2808d878-2deb-4b2e-a0b4-2fd0c960cd3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:55:00.636115 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2808d878-2deb-4b2e-a0b4-2fd0c960cd3a admin admin] REQUEST_METHOD: `POST` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:55:00.636421 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2808d878-2deb-4b2e-a0b4-2fd0c960cd3a admin admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:55:00.637161 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2808d878-2deb-4b2e-a0b4-2fd0c960cd3a admin admin] PATH_INFO: `/v3/projects` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:55:00.637374 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2808d878-2deb-4b2e-a0b4-2fd0c960cd3a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:55:00.639300 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2808d878-2deb-4b2e-a0b4-2fd0c960cd3a admin admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:55:00.668246 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 1283/2612] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Sep 13 19:55:00 2022] POST /identity/v3/projects => generated 405 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 13 19:55:00.671967 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad0d28c-2e1e-4b33-bbdd-ae85404ba1d6 None None] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:55:00.683000 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad0d28c-2e1e-4b33-bbdd-ae85404ba1d6 None None] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:55:00.746201 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c13f8d-e2f9-4919-9414-303b62a54f04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:55:00.746807 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c13f8d-e2f9-4919-9414-303b62a54f04 admin admin] REQUEST_METHOD: `POST` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:55:00.747083 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c13f8d-e2f9-4919-9414-303b62a54f04 admin admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:55:00.747354 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c13f8d-e2f9-4919-9414-303b62a54f04 admin admin] PATH_INFO: `/v3/users` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:55:00.747978 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c13f8d-e2f9-4919-9414-303b62a54f04 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:55:00.749905 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c13f8d-e2f9-4919-9414-303b62a54f04 admin admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:55:00.771663 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 1330/2613] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Sep 13 19:55:00 2022] POST /identity/v3/users => generated 309 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 13 19:55:00.776390 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2808d878-2deb-4b2e-a0b4-2fd0c960cd3a admin admin] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:55:00.787247 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2808d878-2deb-4b2e-a0b4-2fd0c960cd3a admin admin] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:55:00.791962 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae8e294-6e38-46cf-b9e4-322f41dd6c89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:55:00.792588 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae8e294-6e38-46cf-b9e4-322f41dd6c89 admin admin] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:55:00.792860 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae8e294-6e38-46cf-b9e4-322f41dd6c89 admin admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:55:00.793127 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae8e294-6e38-46cf-b9e4-322f41dd6c89 admin admin] PATH_INFO: `/v3/roles` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:55:00.793759 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae8e294-6e38-46cf-b9e4-322f41dd6c89 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:55:00.795326 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae8e294-6e38-46cf-b9e4-322f41dd6c89 admin admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:55:00.806623 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 1284/2614] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Sep 13 19:55:00 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 19:55:00.812858 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c13f8d-e2f9-4919-9414-303b62a54f04 admin admin] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:55:00.823456 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c13f8d-e2f9-4919-9414-303b62a54f04 admin admin] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:55:00.828192 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba20672-0ca6-4595-8d21-07a4ee252a35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:55:00.828855 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba20672-0ca6-4595-8d21-07a4ee252a35 admin admin] REQUEST_METHOD: `PUT` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:55:00.829132 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba20672-0ca6-4595-8d21-07a4ee252a35 admin admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:55:00.829400 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba20672-0ca6-4595-8d21-07a4ee252a35 admin admin] PATH_INFO: `/v3/projects/91ee076b0bcd44999a64dfa0a3ba9f9c/users/f9b3670aa7a4491ca33c8742ff786b1c/roles/6ca1d4427ff64e0a9d25d96cfb1445f6` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:55:00.846151 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba20672-0ca6-4595-8d21-07a4ee252a35 admin admin] RBAC: Authorizing `identity:create_grant(project_id=91ee076b0bcd44999a64dfa0a3ba9f9c, user_id=f9b3670aa7a4491ca33c8742ff786b1c, role_id=6ca1d4427ff64e0a9d25d96cfb1445f6)` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:55:00.848810 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba20672-0ca6-4595-8d21-07a4ee252a35 admin admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:55:00.861037 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 1331/2615] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Sep 13 19:55:00 2022] PUT /identity/v3/projects/91ee076b0bcd44999a64dfa0a3ba9f9c/users/f9b3670aa7a4491ca33c8742ff786b1c/roles/6ca1d4427ff64e0a9d25d96cfb1445f6 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 19:55:00.865447 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae8e294-6e38-46cf-b9e4-322f41dd6c89 admin admin] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:55:00.876606 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae8e294-6e38-46cf-b9e4-322f41dd6c89 admin admin] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:55:00.934566 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69947895-875d-48dc-b69b-139579c79631 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:55:00.935448 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69947895-875d-48dc-b69b-139579c79631 admin admin] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:55:00.935926 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69947895-875d-48dc-b69b-139579c79631 admin admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:55:00.936203 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69947895-875d-48dc-b69b-139579c79631 admin admin] PATH_INFO: `/v3/roles` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:55:00.936877 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69947895-875d-48dc-b69b-139579c79631 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:55:00.938487 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69947895-875d-48dc-b69b-139579c79631 admin admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:55:00.951347 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 1285/2616] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Sep 13 19:55:00 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 19:55:00.954200 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba20672-0ca6-4595-8d21-07a4ee252a35 admin admin] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:55:00.965146 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba20672-0ca6-4595-8d21-07a4ee252a35 admin admin] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:55:00.969738 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd64a78e-a556-4c7c-a8c5-e98d54f15ad7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:55:00.970375 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd64a78e-a556-4c7c-a8c5-e98d54f15ad7 admin admin] REQUEST_METHOD: `PUT` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:55:00.970650 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd64a78e-a556-4c7c-a8c5-e98d54f15ad7 admin admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:55:00.970918 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd64a78e-a556-4c7c-a8c5-e98d54f15ad7 admin admin] PATH_INFO: `/v3/projects/91ee076b0bcd44999a64dfa0a3ba9f9c/users/f9b3670aa7a4491ca33c8742ff786b1c/roles/6ca1d4427ff64e0a9d25d96cfb1445f6` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:55:00.972884 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd64a78e-a556-4c7c-a8c5-e98d54f15ad7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=91ee076b0bcd44999a64dfa0a3ba9f9c, user_id=f9b3670aa7a4491ca33c8742ff786b1c, role_id=6ca1d4427ff64e0a9d25d96cfb1445f6)` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:55:00.975465 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd64a78e-a556-4c7c-a8c5-e98d54f15ad7 admin admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:55:00.986070 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 1332/2617] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Sep 13 19:55:00 2022] PUT /identity/v3/projects/91ee076b0bcd44999a64dfa0a3ba9f9c/users/f9b3670aa7a4491ca33c8742ff786b1c/roles/6ca1d4427ff64e0a9d25d96cfb1445f6 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 19:55:01.630310 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8466583-6534-449d-8eec-48b47de4827f None None] REQUEST_METHOD: `POST` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:55:01.630854 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8466583-6534-449d-8eec-48b47de4827f None None] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:55:01.631195 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8466583-6534-449d-8eec-48b47de4827f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:55:01.657790 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG dbcounter [-] [87935] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:55:01.665029 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.auth.core [None req-c8466583-6534-449d-8eec-48b47de4827f None None] MFA Rules not processed for user `f9b3670aa7a4491ca33c8742ff786b1c`. Rule list: `[]` (Enabled: `True`). {{(pid=87935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:55:01.666662 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.fernet_utils [None req-c8466583-6534-449d-8eec-48b47de4827f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:55:01.749230 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 1286/2618] 10.222.0.25 () {58 vars in 958 bytes} [Tue Sep 13 19:55:01 2022] POST /identity/v3/auth/tokens => generated 3349 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 19:55:02.814184 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd64a78e-a556-4c7c-a8c5-e98d54f15ad7 admin admin] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:55:02.828113 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG dbcounter [-] [87934] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=87934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:55:02.880959 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd64a78e-a556-4c7c-a8c5-e98d54f15ad7 admin admin] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:55:02.885525 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869d0233-f7de-43be-83dc-a6eade816374 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:55:02.886151 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869d0233-f7de-43be-83dc-a6eade816374 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:55:02.886427 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869d0233-f7de-43be-83dc-a6eade816374 admin admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:55:02.886697 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869d0233-f7de-43be-83dc-a6eade816374 admin admin] PATH_INFO: `/v3/users/86fb968728444a82a9d31ed3dea7457a` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:55:02.887825 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-869d0233-f7de-43be-83dc-a6eade816374 admin admin] RBAC: Authorizing `identity:delete_user(user_id=86fb968728444a82a9d31ed3dea7457a)` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:55:02.889761 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-869d0233-f7de-43be-83dc-a6eade816374 admin admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:55:02.937686 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.notifications [None req-869d0233-f7de-43be-83dc-a6eade816374 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '86fb968728444a82a9d31ed3dea7457a'} {{(pid=87934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:55:02.938450 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.notifications [None req-869d0233-f7de-43be-83dc-a6eade816374 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '86fb968728444a82a9d31ed3dea7457a'} {{(pid=87934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:55:02.939047 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.notifications [None req-869d0233-f7de-43be-83dc-a6eade816374 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '86fb968728444a82a9d31ed3dea7457a'} {{(pid=87934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:55:02.946765 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.notifications [None req-869d0233-f7de-43be-83dc-a6eade816374 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '86fb968728444a82a9d31ed3dea7457a'} {{(pid=87934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:55:02.959569 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.notifications [None req-869d0233-f7de-43be-83dc-a6eade816374 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '86fb968728444a82a9d31ed3dea7457a'} {{(pid=87934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:55:02.973442 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 1333/2619] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Sep 13 19:55:02 2022] DELETE /identity/v3/users/86fb968728444a82a9d31ed3dea7457a => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 19:55:03.153261 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8466583-6534-449d-8eec-48b47de4827f None None] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:55:03.164178 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8466583-6534-449d-8eec-48b47de4827f None None] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:55:03.224599 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c6e23b-3efd-4ddd-ad96-b18884ecf6f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:55:03.225382 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c6e23b-3efd-4ddd-ad96-b18884ecf6f6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:55:03.225661 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c6e23b-3efd-4ddd-ad96-b18884ecf6f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:55:03.225926 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c6e23b-3efd-4ddd-ad96-b18884ecf6f6 admin admin] PATH_INFO: `/v3/projects/9ac79fa521b74e949755f0a662adefb9` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:55:03.227086 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c6e23b-3efd-4ddd-ad96-b18884ecf6f6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9ac79fa521b74e949755f0a662adefb9)` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:55:03.229013 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c6e23b-3efd-4ddd-ad96-b18884ecf6f6 admin admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:55:03.281304 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.notifications [None req-91c6e23b-3efd-4ddd-ad96-b18884ecf6f6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9ac79fa521b74e949755f0a662adefb9', 'request_id': 'req-91c6e23b-3efd-4ddd-ad96-b18884ecf6f6'} {{(pid=87935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:55:03.286820 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.notifications [None req-91c6e23b-3efd-4ddd-ad96-b18884ecf6f6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9ac79fa521b74e949755f0a662adefb9', 'request_id': 'req-91c6e23b-3efd-4ddd-ad96-b18884ecf6f6'} {{(pid=87935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:55:03.294670 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.notifications [None req-91c6e23b-3efd-4ddd-ad96-b18884ecf6f6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9ac79fa521b74e949755f0a662adefb9', 'request_id': 'req-91c6e23b-3efd-4ddd-ad96-b18884ecf6f6'} {{(pid=87935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:55:03.307116 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.notifications [None req-91c6e23b-3efd-4ddd-ad96-b18884ecf6f6 admin admin] The token cache is being invalidate because project 9ac79fa521b74e949755f0a662adefb9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87935) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 19:55:03.307404 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.notifications [None req-91c6e23b-3efd-4ddd-ad96-b18884ecf6f6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:55:03.308035 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.notifications [None req-91c6e23b-3efd-4ddd-ad96-b18884ecf6f6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:55:03.309575 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 1287/2620] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Sep 13 19:55:03 2022] DELETE /identity/v3/projects/9ac79fa521b74e949755f0a662adefb9 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 19:55:03.314064 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869d0233-f7de-43be-83dc-a6eade816374 admin admin] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:55:03.316366 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.fernet_utils [None req-869d0233-f7de-43be-83dc-a6eade816374 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:55:03.329628 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869d0233-f7de-43be-83dc-a6eade816374 admin admin] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:55:03.389257 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a5cef5-b7d1-4119-870a-922f0c22cb41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:55:03.389891 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a5cef5-b7d1-4119-870a-922f0c22cb41 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:55:03.390196 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a5cef5-b7d1-4119-870a-922f0c22cb41 admin admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:55:03.390463 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a5cef5-b7d1-4119-870a-922f0c22cb41 admin admin] PATH_INFO: `/v3/users/f9b3670aa7a4491ca33c8742ff786b1c` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:55:03.391610 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a5cef5-b7d1-4119-870a-922f0c22cb41 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f9b3670aa7a4491ca33c8742ff786b1c)` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:55:03.393949 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a5cef5-b7d1-4119-870a-922f0c22cb41 admin admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:55:03.428026 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG dbcounter [-] [87934] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=87934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:55:03.443415 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.notifications [None req-f4a5cef5-b7d1-4119-870a-922f0c22cb41 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f9b3670aa7a4491ca33c8742ff786b1c'} {{(pid=87934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:55:03.444072 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.notifications [None req-f4a5cef5-b7d1-4119-870a-922f0c22cb41 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f9b3670aa7a4491ca33c8742ff786b1c'} {{(pid=87934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:55:03.444706 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.notifications [None req-f4a5cef5-b7d1-4119-870a-922f0c22cb41 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f9b3670aa7a4491ca33c8742ff786b1c'} {{(pid=87934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:55:03.451462 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.notifications [None req-f4a5cef5-b7d1-4119-870a-922f0c22cb41 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f9b3670aa7a4491ca33c8742ff786b1c'} {{(pid=87934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:55:03.463868 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.notifications [None req-f4a5cef5-b7d1-4119-870a-922f0c22cb41 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f9b3670aa7a4491ca33c8742ff786b1c'} {{(pid=87934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:55:03.476659 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 1334/2621] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Sep 13 19:55:03 2022] DELETE /identity/v3/users/f9b3670aa7a4491ca33c8742ff786b1c => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 19:55:03.664767 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c6e23b-3efd-4ddd-ad96-b18884ecf6f6 admin admin] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:55:03.666312 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.fernet_utils [None req-91c6e23b-3efd-4ddd-ad96-b18884ecf6f6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:55:03.680737 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c6e23b-3efd-4ddd-ad96-b18884ecf6f6 admin admin] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:55:03.708113 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG dbcounter [-] [87935] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=87935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:55:03.741980 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd0bfe5-a0dd-4b3a-b478-2c415fa2eec1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:55:03.742646 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd0bfe5-a0dd-4b3a-b478-2c415fa2eec1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:55:03.742932 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd0bfe5-a0dd-4b3a-b478-2c415fa2eec1 admin admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:55:03.743279 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd0bfe5-a0dd-4b3a-b478-2c415fa2eec1 admin admin] PATH_INFO: `/v3/projects/91ee076b0bcd44999a64dfa0a3ba9f9c` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:55:03.744919 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd0bfe5-a0dd-4b3a-b478-2c415fa2eec1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=91ee076b0bcd44999a64dfa0a3ba9f9c)` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:55:03.746940 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd0bfe5-a0dd-4b3a-b478-2c415fa2eec1 admin admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:55:03.795466 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.notifications [None req-9dd0bfe5-a0dd-4b3a-b478-2c415fa2eec1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '91ee076b0bcd44999a64dfa0a3ba9f9c', 'request_id': 'req-9dd0bfe5-a0dd-4b3a-b478-2c415fa2eec1'} {{(pid=87935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:55:03.801738 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.notifications [None req-9dd0bfe5-a0dd-4b3a-b478-2c415fa2eec1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '91ee076b0bcd44999a64dfa0a3ba9f9c', 'request_id': 'req-9dd0bfe5-a0dd-4b3a-b478-2c415fa2eec1'} {{(pid=87935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:55:03.808412 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.notifications [None req-9dd0bfe5-a0dd-4b3a-b478-2c415fa2eec1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '91ee076b0bcd44999a64dfa0a3ba9f9c', 'request_id': 'req-9dd0bfe5-a0dd-4b3a-b478-2c415fa2eec1'} {{(pid=87935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:55:03.820254 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.notifications [None req-9dd0bfe5-a0dd-4b3a-b478-2c415fa2eec1 admin admin] The token cache is being invalidate because project 91ee076b0bcd44999a64dfa0a3ba9f9c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87935) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 19:55:03.820550 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.notifications [None req-9dd0bfe5-a0dd-4b3a-b478-2c415fa2eec1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:55:03.821194 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.notifications [None req-9dd0bfe5-a0dd-4b3a-b478-2c415fa2eec1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:55:03.822684 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 1288/2622] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Sep 13 19:55:03 2022] DELETE /identity/v3/projects/91ee076b0bcd44999a64dfa0a3ba9f9c => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 19:55:03.827935 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1dbfd4-dd82-437f-abdf-228ba7f59d81 None None] REQUEST_METHOD: `POST` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:55:03.828428 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1dbfd4-dd82-437f-abdf-228ba7f59d81 None None] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:55:03.828521 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1dbfd4-dd82-437f-abdf-228ba7f59d81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:55:03.848968 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.auth.core [None req-ee1dbfd4-dd82-437f-abdf-228ba7f59d81 None None] MFA Rules not processed for user `7b0aed92d02344acb92a0e4aa67c3068`. Rule list: `[]` (Enabled: `True`). {{(pid=87934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:55:03.850151 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.fernet_utils [None req-ee1dbfd4-dd82-437f-abdf-228ba7f59d81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:55:03.913046 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 1335/2623] 10.222.0.25 () {58 vars in 958 bytes} [Tue Sep 13 19:55:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 19:55:03.920906 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e081ce58-933c-492e-a872-b347c4dc22bc None None] REQUEST_METHOD: `POST` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:55:03.921261 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e081ce58-933c-492e-a872-b347c4dc22bc None None] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:55:03.921652 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e081ce58-933c-492e-a872-b347c4dc22bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:55:03.943444 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.auth.core [None req-e081ce58-933c-492e-a872-b347c4dc22bc None None] MFA Rules not processed for user `7b0aed92d02344acb92a0e4aa67c3068`. Rule list: `[]` (Enabled: `True`). {{(pid=87935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:55:03.944818 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.fernet_utils [None req-e081ce58-933c-492e-a872-b347c4dc22bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:55:03.953496 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 1289/2624] 10.222.0.25 () {58 vars in 958 bytes} [Tue Sep 13 19:55:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 19:55:03.958675 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1dbfd4-dd82-437f-abdf-228ba7f59d81 None None] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:55:03.969480 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1dbfd4-dd82-437f-abdf-228ba7f59d81 None None] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:55:03.974925 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a5eeba-facc-4953-a0e7-d435c51bea24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:55:03.975987 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a5eeba-facc-4953-a0e7-d435c51bea24 admin admin] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:55:03.976325 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a5eeba-facc-4953-a0e7-d435c51bea24 admin admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:55:03.976705 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a5eeba-facc-4953-a0e7-d435c51bea24 admin admin] PATH_INFO: `/v3/domains` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:55:03.977366 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a5eeba-facc-4953-a0e7-d435c51bea24 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87934) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:55:03.977670 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a5eeba-facc-4953-a0e7-d435c51bea24 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:55:03.979408 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a5eeba-facc-4953-a0e7-d435c51bea24 admin admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:55:03.994726 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 1336/2625] 10.222.0.25 () {58 vars in 1153 bytes} [Tue Sep 13 19:55:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:55:03.997454 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e081ce58-933c-492e-a872-b347c4dc22bc None None] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:55:04.010280 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e081ce58-933c-492e-a872-b347c4dc22bc None None] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:55:04.015098 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03799a5a-0d1b-4991-9923-615a1d95371a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:55:04.015693 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03799a5a-0d1b-4991-9923-615a1d95371a admin admin] REQUEST_METHOD: `POST` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:55:04.015968 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03799a5a-0d1b-4991-9923-615a1d95371a admin admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:55:04.016256 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03799a5a-0d1b-4991-9923-615a1d95371a admin admin] PATH_INFO: `/v3/projects` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:55:04.016883 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03799a5a-0d1b-4991-9923-615a1d95371a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:55:04.018858 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03799a5a-0d1b-4991-9923-615a1d95371a admin admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:55:04.045841 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 1290/2626] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Sep 13 19:55:03 2022] POST /identity/v3/projects => generated 371 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 19:55:04.050674 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a5eeba-facc-4953-a0e7-d435c51bea24 admin admin] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:55:04.060538 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a5eeba-facc-4953-a0e7-d435c51bea24 admin admin] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:55:04.116363 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6d232c-0740-401e-a636-58e181b564e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:55:04.117009 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6d232c-0740-401e-a636-58e181b564e6 admin admin] REQUEST_METHOD: `POST` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:55:04.117288 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6d232c-0740-401e-a636-58e181b564e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:55:04.117551 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6d232c-0740-401e-a636-58e181b564e6 admin admin] PATH_INFO: `/v3/users` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:55:04.118175 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d6d232c-0740-401e-a636-58e181b564e6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:55:04.120056 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d6d232c-0740-401e-a636-58e181b564e6 admin admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:55:04.141432 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 1337/2627] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Sep 13 19:55:04 2022] POST /identity/v3/users => generated 286 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 19:55:04.145751 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03799a5a-0d1b-4991-9923-615a1d95371a admin admin] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:55:04.156012 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03799a5a-0d1b-4991-9923-615a1d95371a admin admin] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:55:04.160873 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54ec834-a318-4fee-b033-044b0320219b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:55:04.161511 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54ec834-a318-4fee-b033-044b0320219b admin admin] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:55:04.161811 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54ec834-a318-4fee-b033-044b0320219b admin admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:55:04.162085 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54ec834-a318-4fee-b033-044b0320219b admin admin] PATH_INFO: `/v3/roles` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:55:04.162760 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d54ec834-a318-4fee-b033-044b0320219b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:55:04.164536 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d54ec834-a318-4fee-b033-044b0320219b admin admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:55:04.175110 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 1291/2628] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Sep 13 19:55:04 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 19:55:04.179272 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6d232c-0740-401e-a636-58e181b564e6 admin admin] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:55:04.189082 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6d232c-0740-401e-a636-58e181b564e6 admin admin] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:55:04.194442 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf497767-2f21-4f37-ad94-fc5ffeeae53c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:55:04.195020 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf497767-2f21-4f37-ad94-fc5ffeeae53c admin admin] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:55:04.195295 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf497767-2f21-4f37-ad94-fc5ffeeae53c admin admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:55:04.195564 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf497767-2f21-4f37-ad94-fc5ffeeae53c admin admin] PATH_INFO: `/v3/roles` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:55:04.196193 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf497767-2f21-4f37-ad94-fc5ffeeae53c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:55:04.197782 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf497767-2f21-4f37-ad94-fc5ffeeae53c admin admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:55:04.208553 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 1338/2629] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Sep 13 19:55:04 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 19:55:04.212811 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54ec834-a318-4fee-b033-044b0320219b admin admin] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:55:04.223153 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54ec834-a318-4fee-b033-044b0320219b admin admin] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:55:04.227913 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69665ab3-f72c-471d-b374-c393118d2459 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:55:04.228598 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69665ab3-f72c-471d-b374-c393118d2459 admin admin] REQUEST_METHOD: `PUT` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:55:04.228883 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69665ab3-f72c-471d-b374-c393118d2459 admin admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:55:04.229158 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69665ab3-f72c-471d-b374-c393118d2459 admin admin] PATH_INFO: `/v3/projects/ec22e2e85a394dd0baef3c25d1de188e/users/5f7bc566b41b47c3953461d90f91e8da/roles/a259191f6d0e46fabd9f34536bb28747` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:55:04.246589 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69665ab3-f72c-471d-b374-c393118d2459 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ec22e2e85a394dd0baef3c25d1de188e, user_id=5f7bc566b41b47c3953461d90f91e8da, role_id=a259191f6d0e46fabd9f34536bb28747)` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:55:04.249327 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69665ab3-f72c-471d-b374-c393118d2459 admin admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:55:04.263108 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 1292/2630] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Sep 13 19:55:04 2022] PUT /identity/v3/projects/ec22e2e85a394dd0baef3c25d1de188e/users/5f7bc566b41b47c3953461d90f91e8da/roles/a259191f6d0e46fabd9f34536bb28747 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 19:55:04.273687 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846ebe95-fa52-44a6-8e7c-b34424c19611 None None] REQUEST_METHOD: `POST` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:55:04.273999 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846ebe95-fa52-44a6-8e7c-b34424c19611 None None] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:55:04.274316 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846ebe95-fa52-44a6-8e7c-b34424c19611 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:55:04.305145 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.auth.core [None req-846ebe95-fa52-44a6-8e7c-b34424c19611 None None] MFA Rules not processed for user `5f7bc566b41b47c3953461d90f91e8da`. Rule list: `[]` (Enabled: `True`). {{(pid=87934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:55:04.306549 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.fernet_utils [None req-846ebe95-fa52-44a6-8e7c-b34424c19611 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:55:04.310684 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG dbcounter [-] [87934] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=87934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:55:04.373606 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 1339/2631] 10.222.0.25 () {58 vars in 958 bytes} [Tue Sep 13 19:55:04 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 19:55:04.378161 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69665ab3-f72c-471d-b374-c393118d2459 admin admin] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:55:04.435340 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG dbcounter [-] [87935] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=87935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:55:04.441889 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69665ab3-f72c-471d-b374-c393118d2459 admin admin] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:55:04.447681 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd01611-1aef-499a-9f7c-eadc030279bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:55:04.448337 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd01611-1aef-499a-9f7c-eadc030279bf admin admin] REQUEST_METHOD: `POST` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:55:04.448613 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd01611-1aef-499a-9f7c-eadc030279bf admin admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:55:04.448882 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd01611-1aef-499a-9f7c-eadc030279bf admin admin] PATH_INFO: `/v3/projects` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:55:04.449502 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd01611-1aef-499a-9f7c-eadc030279bf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:55:04.451440 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd01611-1aef-499a-9f7c-eadc030279bf admin admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:55:04.479132 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 1293/2632] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Sep 13 19:55:04 2022] POST /identity/v3/projects => generated 373 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 19:55:04.483106 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846ebe95-fa52-44a6-8e7c-b34424c19611 None None] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:55:04.494404 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846ebe95-fa52-44a6-8e7c-b34424c19611 None None] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:55:04.551130 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b98c97-1764-4c64-b1f6-fa7d5c752fa1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:55:04.551731 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b98c97-1764-4c64-b1f6-fa7d5c752fa1 admin admin] REQUEST_METHOD: `POST` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:55:04.552006 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b98c97-1764-4c64-b1f6-fa7d5c752fa1 admin admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:55:04.552308 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b98c97-1764-4c64-b1f6-fa7d5c752fa1 admin admin] PATH_INFO: `/v3/users` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:55:04.553028 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b98c97-1764-4c64-b1f6-fa7d5c752fa1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:55:04.554863 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b98c97-1764-4c64-b1f6-fa7d5c752fa1 admin admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:55:04.575247 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 1340/2633] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Sep 13 19:55:04 2022] POST /identity/v3/users => generated 293 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 19:55:04.579692 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd01611-1aef-499a-9f7c-eadc030279bf admin admin] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:55:04.590175 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd01611-1aef-499a-9f7c-eadc030279bf admin admin] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:55:04.594840 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f761c09-9d7a-47f1-a14a-39cbfa6d6be4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:55:04.595431 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f761c09-9d7a-47f1-a14a-39cbfa6d6be4 admin admin] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:55:04.595711 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f761c09-9d7a-47f1-a14a-39cbfa6d6be4 admin admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:55:04.595982 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f761c09-9d7a-47f1-a14a-39cbfa6d6be4 admin admin] PATH_INFO: `/v3/roles` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:55:04.597374 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f761c09-9d7a-47f1-a14a-39cbfa6d6be4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:55:04.598961 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f761c09-9d7a-47f1-a14a-39cbfa6d6be4 admin admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:55:04.609673 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 1294/2634] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Sep 13 19:55:04 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 19:55:04.614742 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b98c97-1764-4c64-b1f6-fa7d5c752fa1 admin admin] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:55:04.624664 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b98c97-1764-4c64-b1f6-fa7d5c752fa1 admin admin] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:55:04.629644 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f16b93-87c8-4931-878e-8728716107bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:55:04.630278 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f16b93-87c8-4931-878e-8728716107bc admin admin] REQUEST_METHOD: `PUT` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:55:04.630560 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f16b93-87c8-4931-878e-8728716107bc admin admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:55:04.630833 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f16b93-87c8-4931-878e-8728716107bc admin admin] PATH_INFO: `/v3/projects/26d6809860104146818ed67e5e0e237d/users/781e65438df743358493246252ac6c10/roles/6ca1d4427ff64e0a9d25d96cfb1445f6` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:55:04.645671 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f16b93-87c8-4931-878e-8728716107bc admin admin] RBAC: Authorizing `identity:create_grant(project_id=26d6809860104146818ed67e5e0e237d, user_id=781e65438df743358493246252ac6c10, role_id=6ca1d4427ff64e0a9d25d96cfb1445f6)` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:55:04.648513 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f16b93-87c8-4931-878e-8728716107bc admin admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:55:04.661540 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 1341/2635] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Sep 13 19:55:04 2022] PUT /identity/v3/projects/26d6809860104146818ed67e5e0e237d/users/781e65438df743358493246252ac6c10/roles/6ca1d4427ff64e0a9d25d96cfb1445f6 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 19:55:04.665506 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f761c09-9d7a-47f1-a14a-39cbfa6d6be4 admin admin] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:55:04.675904 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f761c09-9d7a-47f1-a14a-39cbfa6d6be4 admin admin] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:55:04.732471 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ab9dbb-9c07-42b2-8134-4a54ba3b12cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:55:04.733070 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ab9dbb-9c07-42b2-8134-4a54ba3b12cd admin admin] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:55:04.733375 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ab9dbb-9c07-42b2-8134-4a54ba3b12cd admin admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:55:04.733649 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ab9dbb-9c07-42b2-8134-4a54ba3b12cd admin admin] PATH_INFO: `/v3/roles` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:55:04.734276 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ab9dbb-9c07-42b2-8134-4a54ba3b12cd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:55:04.735896 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ab9dbb-9c07-42b2-8134-4a54ba3b12cd admin admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:55:04.746172 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 1295/2636] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Sep 13 19:55:04 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 19:55:04.750416 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f16b93-87c8-4931-878e-8728716107bc admin admin] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:55:04.761130 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f16b93-87c8-4931-878e-8728716107bc admin admin] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:55:04.765637 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afea1243-e6f8-40e8-b323-6bc7445e43f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:55:04.766272 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afea1243-e6f8-40e8-b323-6bc7445e43f0 admin admin] REQUEST_METHOD: `PUT` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:55:04.766544 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afea1243-e6f8-40e8-b323-6bc7445e43f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:55:04.766809 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afea1243-e6f8-40e8-b323-6bc7445e43f0 admin admin] PATH_INFO: `/v3/projects/26d6809860104146818ed67e5e0e237d/users/781e65438df743358493246252ac6c10/roles/6ca1d4427ff64e0a9d25d96cfb1445f6` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:55:04.768841 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afea1243-e6f8-40e8-b323-6bc7445e43f0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=26d6809860104146818ed67e5e0e237d, user_id=781e65438df743358493246252ac6c10, role_id=6ca1d4427ff64e0a9d25d96cfb1445f6)` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:55:04.771421 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afea1243-e6f8-40e8-b323-6bc7445e43f0 admin admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:55:04.781237 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 1342/2637] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Sep 13 19:55:04 2022] PUT /identity/v3/projects/26d6809860104146818ed67e5e0e237d/users/781e65438df743358493246252ac6c10/roles/6ca1d4427ff64e0a9d25d96cfb1445f6 => generated 0 bytes in 31 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 19:55:04.792920 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93bac0c6-20ba-4a3b-a490-9a031d94a80b None None] REQUEST_METHOD: `POST` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:55:04.793223 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93bac0c6-20ba-4a3b-a490-9a031d94a80b None None] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:55:04.793406 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93bac0c6-20ba-4a3b-a490-9a031d94a80b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:55:04.822603 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.auth.core [None req-93bac0c6-20ba-4a3b-a490-9a031d94a80b None None] MFA Rules not processed for user `781e65438df743358493246252ac6c10`. Rule list: `[]` (Enabled: `True`). {{(pid=87935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:55:04.823734 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.fernet_utils [None req-93bac0c6-20ba-4a3b-a490-9a031d94a80b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:55:04.891624 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 1296/2638] 10.222.0.25 () {58 vars in 958 bytes} [Tue Sep 13 19:55:04 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 19:55:04.903706 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afea1243-e6f8-40e8-b323-6bc7445e43f0 admin admin] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:55:04.905540 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.fernet_utils [None req-afea1243-e6f8-40e8-b323-6bc7445e43f0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:55:04.963570 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afea1243-e6f8-40e8-b323-6bc7445e43f0 admin admin] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:55:04.967255 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801ee38f-a6c6-454a-85eb-24bfb01de97d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cbb50c88b794a7f9f26844effde7d63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a10a4268f3c4cb29f4e00c292e2df62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:55:04.967856 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801ee38f-a6c6-454a-85eb-24bfb01de97d service cinder] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:55:04.968134 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801ee38f-a6c6-454a-85eb-24bfb01de97d service cinder] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:55:04.968438 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801ee38f-a6c6-454a-85eb-24bfb01de97d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:55:04.979079 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-801ee38f-a6c6-454a-85eb-24bfb01de97d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:55:04.980550 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-801ee38f-a6c6-454a-85eb-24bfb01de97d service cinder] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:55:04.985353 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG dbcounter [-] [87934] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=87934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:55:04.991204 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 1343/2639] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Sep 13 19:55:04 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 19:55:05.065887 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93bac0c6-20ba-4a3b-a490-9a031d94a80b None None] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:55:05.075576 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93bac0c6-20ba-4a3b-a490-9a031d94a80b None None] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:55:05.079371 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e5aa28-9829-4c03-97b9-1a31b5c0ae5b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cbb50c88b794a7f9f26844effde7d63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a10a4268f3c4cb29f4e00c292e2df62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:55:05.079963 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e5aa28-9829-4c03-97b9-1a31b5c0ae5b service cinder] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:55:05.080268 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e5aa28-9829-4c03-97b9-1a31b5c0ae5b service cinder] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:55:05.081242 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e5aa28-9829-4c03-97b9-1a31b5c0ae5b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:55:05.128438 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG dbcounter [-] [87935] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:55:05.139677 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e5aa28-9829-4c03-97b9-1a31b5c0ae5b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:55:05.141205 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e5aa28-9829-4c03-97b9-1a31b5c0ae5b service cinder] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:55:05.151073 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 1297/2640] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Sep 13 19:55:05 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 19:55:08.463494 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e745a25-0df8-4c61-9547-bf52025dc827 None None] REQUEST_METHOD: `POST` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:55:08.464045 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e745a25-0df8-4c61-9547-bf52025dc827 None None] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:55:08.464045 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e745a25-0df8-4c61-9547-bf52025dc827 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:55:08.483821 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.auth.core [None req-1e745a25-0df8-4c61-9547-bf52025dc827 None None] MFA Rules not processed for user `7b0aed92d02344acb92a0e4aa67c3068`. Rule list: `[]` (Enabled: `True`). {{(pid=87934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:55:08.485091 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.fernet_utils [None req-1e745a25-0df8-4c61-9547-bf52025dc827 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:55:08.542424 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 1344/2641] 10.222.0.57 () {58 vars in 1016 bytes} [Tue Sep 13 19:55:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 19:55:08.558267 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e5aa28-9829-4c03-97b9-1a31b5c0ae5b service cinder] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:55:08.559926 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.fernet_utils [None req-31e5aa28-9829-4c03-97b9-1a31b5c0ae5b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:55:08.633839 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e5aa28-9829-4c03-97b9-1a31b5c0ae5b service cinder] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:55:08.639341 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cba8029-82cf-4752-9406-9373e5595a35 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd71fe5a8275f4ea98555afdcefc902a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a10a4268f3c4cb29f4e00c292e2df62', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:55:08.639947 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cba8029-82cf-4752-9406-9373e5595a35 service nova] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:55:08.640249 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cba8029-82cf-4752-9406-9373e5595a35 service nova] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:55:08.640529 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cba8029-82cf-4752-9406-9373e5595a35 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:55:08.649930 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cba8029-82cf-4752-9406-9373e5595a35 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:55:08.651527 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cba8029-82cf-4752-9406-9373e5595a35 service nova] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:55:08.661768 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 1298/2642] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Sep 13 19:55:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 19:55:11.501351 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da2e90f-94ad-46ae-8fcc-0973f35967e7 None None] REQUEST_METHOD: `POST` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:55:11.501851 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da2e90f-94ad-46ae-8fcc-0973f35967e7 None None] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:55:11.501948 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da2e90f-94ad-46ae-8fcc-0973f35967e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:55:11.521901 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.auth.core [None req-0da2e90f-94ad-46ae-8fcc-0973f35967e7 None None] MFA Rules not processed for user `7b0aed92d02344acb92a0e4aa67c3068`. Rule list: `[]` (Enabled: `True`). {{(pid=87934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:55:11.523085 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.fernet_utils [None req-0da2e90f-94ad-46ae-8fcc-0973f35967e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:55:11.530803 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 1345/2643] 10.222.0.57 () {58 vars in 1016 bytes} [Tue Sep 13 19:55:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 19:55:11.544463 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cba8029-82cf-4752-9406-9373e5595a35 service nova] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:55:11.545955 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.fernet_utils [None req-1cba8029-82cf-4752-9406-9373e5595a35 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:55:11.561000 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cba8029-82cf-4752-9406-9373e5595a35 service nova] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:55:11.567081 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8c0a5b-4f93-411b-a13e-44afa1134618 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd71fe5a8275f4ea98555afdcefc902a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a10a4268f3c4cb29f4e00c292e2df62', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:55:11.567666 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8c0a5b-4f93-411b-a13e-44afa1134618 service nova] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:55:11.567956 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8c0a5b-4f93-411b-a13e-44afa1134618 service nova] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:55:11.568227 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8c0a5b-4f93-411b-a13e-44afa1134618 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:55:11.576294 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be8c0a5b-4f93-411b-a13e-44afa1134618 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:55:11.578125 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be8c0a5b-4f93-411b-a13e-44afa1134618 service nova] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:55:11.587686 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 1299/2644] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Sep 13 19:55:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 19:55:14.774278 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c009f0-d573-4b88-af86-cfeb7cb3c0f2 None None] REQUEST_METHOD: `POST` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:55:14.774794 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c009f0-d573-4b88-af86-cfeb7cb3c0f2 None None] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:55:14.774957 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c009f0-d573-4b88-af86-cfeb7cb3c0f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:55:14.797604 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.auth.core [None req-49c009f0-d573-4b88-af86-cfeb7cb3c0f2 None None] MFA Rules not processed for user `7b0aed92d02344acb92a0e4aa67c3068`. Rule list: `[]` (Enabled: `True`). {{(pid=87934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:55:14.798825 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.fernet_utils [None req-49c009f0-d573-4b88-af86-cfeb7cb3c0f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:55:14.808571 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 1346/2645] 10.222.0.57 () {58 vars in 1016 bytes} [Tue Sep 13 19:55:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 19:55:14.823000 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8c0a5b-4f93-411b-a13e-44afa1134618 service nova] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:55:14.837108 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8c0a5b-4f93-411b-a13e-44afa1134618 service nova] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:55:14.845925 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b0f883-968b-42a0-87f6-b896b7498bba service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd71fe5a8275f4ea98555afdcefc902a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a10a4268f3c4cb29f4e00c292e2df62', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:55:14.846526 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b0f883-968b-42a0-87f6-b896b7498bba service nova] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:55:14.846794 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b0f883-968b-42a0-87f6-b896b7498bba service nova] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:55:14.847054 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b0f883-968b-42a0-87f6-b896b7498bba service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:55:14.857409 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b0f883-968b-42a0-87f6-b896b7498bba service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:55:14.859306 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b0f883-968b-42a0-87f6-b896b7498bba service nova] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:55:14.871985 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 1300/2646] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Sep 13 19:55:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 19:55:17.903738 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac3ef3f-5cb9-4fad-afeb-0ec5d057fb5b None None] REQUEST_METHOD: `POST` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:55:17.904182 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac3ef3f-5cb9-4fad-afeb-0ec5d057fb5b None None] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:55:17.904318 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac3ef3f-5cb9-4fad-afeb-0ec5d057fb5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:55:17.924093 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.auth.core [None req-dac3ef3f-5cb9-4fad-afeb-0ec5d057fb5b None None] MFA Rules not processed for user `7b0aed92d02344acb92a0e4aa67c3068`. Rule list: `[]` (Enabled: `True`). {{(pid=87934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:55:17.925547 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.fernet_utils [None req-dac3ef3f-5cb9-4fad-afeb-0ec5d057fb5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:55:17.935149 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 1347/2647] 10.222.0.57 () {58 vars in 1016 bytes} [Tue Sep 13 19:55:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 19:55:17.963495 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b0f883-968b-42a0-87f6-b896b7498bba service nova] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:55:17.974654 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b0f883-968b-42a0-87f6-b896b7498bba service nova] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:55:17.982208 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38968d8c-5033-4d73-b1e2-ff01cec88074 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd71fe5a8275f4ea98555afdcefc902a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a10a4268f3c4cb29f4e00c292e2df62', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:55:17.983138 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38968d8c-5033-4d73-b1e2-ff01cec88074 service nova] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:55:17.983467 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38968d8c-5033-4d73-b1e2-ff01cec88074 service nova] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:55:17.983806 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38968d8c-5033-4d73-b1e2-ff01cec88074 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:55:17.997657 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38968d8c-5033-4d73-b1e2-ff01cec88074 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:55:17.999579 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38968d8c-5033-4d73-b1e2-ff01cec88074 service nova] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:55:18.011721 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 1301/2648] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Sep 13 19:55:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 19:55:21.018393 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f734550-e1c3-4223-828f-7db68186ba1c None None] REQUEST_METHOD: `POST` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:55:21.018890 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f734550-e1c3-4223-828f-7db68186ba1c None None] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:55:21.018992 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f734550-e1c3-4223-828f-7db68186ba1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:55:21.039702 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.auth.core [None req-8f734550-e1c3-4223-828f-7db68186ba1c None None] MFA Rules not processed for user `7b0aed92d02344acb92a0e4aa67c3068`. Rule list: `[]` (Enabled: `True`). {{(pid=87934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:55:21.040922 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.fernet_utils [None req-8f734550-e1c3-4223-828f-7db68186ba1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:55:21.049469 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 1348/2649] 10.222.0.57 () {58 vars in 1016 bytes} [Tue Sep 13 19:55:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 19:55:21.065656 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38968d8c-5033-4d73-b1e2-ff01cec88074 service nova] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:55:21.078263 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38968d8c-5033-4d73-b1e2-ff01cec88074 service nova] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:55:21.084788 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8cc10d-e5f4-40b8-b46b-9175c5214eb9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd71fe5a8275f4ea98555afdcefc902a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a10a4268f3c4cb29f4e00c292e2df62', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:55:21.085390 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8cc10d-e5f4-40b8-b46b-9175c5214eb9 service nova] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:55:21.085671 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8cc10d-e5f4-40b8-b46b-9175c5214eb9 service nova] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:55:21.085945 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8cc10d-e5f4-40b8-b46b-9175c5214eb9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:55:21.101497 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d8cc10d-e5f4-40b8-b46b-9175c5214eb9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:55:21.103070 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d8cc10d-e5f4-40b8-b46b-9175c5214eb9 service nova] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:55:21.113620 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 1302/2650] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Sep 13 19:55:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 19:55:24.196172 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efff7efc-e005-4fd8-8472-487d59a2a0c5 None None] REQUEST_METHOD: `POST` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:55:24.196693 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efff7efc-e005-4fd8-8472-487d59a2a0c5 None None] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:55:24.196799 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efff7efc-e005-4fd8-8472-487d59a2a0c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:55:24.216232 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.auth.core [None req-efff7efc-e005-4fd8-8472-487d59a2a0c5 None None] MFA Rules not processed for user `7b0aed92d02344acb92a0e4aa67c3068`. Rule list: `[]` (Enabled: `True`). {{(pid=87934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:55:24.217406 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.fernet_utils [None req-efff7efc-e005-4fd8-8472-487d59a2a0c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:55:24.225044 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 1349/2651] 10.222.0.57 () {58 vars in 1016 bytes} [Tue Sep 13 19:55:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 19:55:24.242213 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8cc10d-e5f4-40b8-b46b-9175c5214eb9 service nova] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:55:24.254094 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8cc10d-e5f4-40b8-b46b-9175c5214eb9 service nova] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:55:24.260440 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f010711e-defa-4f1a-85e6-adc5b69c7483 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd71fe5a8275f4ea98555afdcefc902a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a10a4268f3c4cb29f4e00c292e2df62', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:55:24.261041 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f010711e-defa-4f1a-85e6-adc5b69c7483 service nova] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:55:24.261321 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f010711e-defa-4f1a-85e6-adc5b69c7483 service nova] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:55:24.261591 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f010711e-defa-4f1a-85e6-adc5b69c7483 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:55:24.269934 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f010711e-defa-4f1a-85e6-adc5b69c7483 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:55:24.272254 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f010711e-defa-4f1a-85e6-adc5b69c7483 service nova] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:55:24.281705 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 1303/2652] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Sep 13 19:55:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 19:55:29.383948 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efff7efc-e005-4fd8-8472-487d59a2a0c5 None None] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:55:29.397516 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efff7efc-e005-4fd8-8472-487d59a2a0c5 None None] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:55:29.403282 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc4e9ff-19d5-4780-8dd8-a4058655901e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd71fe5a8275f4ea98555afdcefc902a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a10a4268f3c4cb29f4e00c292e2df62', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:55:29.403927 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc4e9ff-19d5-4780-8dd8-a4058655901e service nova] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:55:29.404241 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc4e9ff-19d5-4780-8dd8-a4058655901e service nova] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:55:29.404512 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc4e9ff-19d5-4780-8dd8-a4058655901e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:55:29.406281 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.fernet_utils [None req-fcc4e9ff-19d5-4780-8dd8-a4058655901e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:55:29.419123 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc4e9ff-19d5-4780-8dd8-a4058655901e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:55:29.420764 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc4e9ff-19d5-4780-8dd8-a4058655901e service nova] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:55:29.432066 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 1350/2653] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Sep 13 19:55:29 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 19:55:34.277404 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG dbcounter [-] [87935] Writing DB stats keystone:SELECT=69 {{(pid=87935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:55:34.539740 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f010711e-defa-4f1a-85e6-adc5b69c7483 service nova] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:55:34.554797 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f010711e-defa-4f1a-85e6-adc5b69c7483 service nova] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:55:34.559436 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e733017f-b3e7-4e8c-9737-d40f0740d49b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:55:34.560072 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e733017f-b3e7-4e8c-9737-d40f0740d49b admin admin] REQUEST_METHOD: `DELETE` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:55:34.560390 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e733017f-b3e7-4e8c-9737-d40f0740d49b admin admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:55:34.560660 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e733017f-b3e7-4e8c-9737-d40f0740d49b admin admin] PATH_INFO: `/v3/users/5f7bc566b41b47c3953461d90f91e8da` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:55:34.561764 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e733017f-b3e7-4e8c-9737-d40f0740d49b admin admin] RBAC: Authorizing `identity:delete_user(user_id=5f7bc566b41b47c3953461d90f91e8da)` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:55:34.563657 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e733017f-b3e7-4e8c-9737-d40f0740d49b admin admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:55:34.618346 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.notifications [None req-e733017f-b3e7-4e8c-9737-d40f0740d49b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5f7bc566b41b47c3953461d90f91e8da'} {{(pid=87935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:55:34.625871 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.notifications [None req-e733017f-b3e7-4e8c-9737-d40f0740d49b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5f7bc566b41b47c3953461d90f91e8da'} {{(pid=87935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:55:34.643439 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.notifications [None req-e733017f-b3e7-4e8c-9737-d40f0740d49b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5f7bc566b41b47c3953461d90f91e8da'} {{(pid=87935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:55:34.644315 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.notifications [None req-e733017f-b3e7-4e8c-9737-d40f0740d49b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5f7bc566b41b47c3953461d90f91e8da'} {{(pid=87935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:55:34.644912 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.notifications [None req-e733017f-b3e7-4e8c-9737-d40f0740d49b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5f7bc566b41b47c3953461d90f91e8da'} {{(pid=87935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:55:34.659187 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 1304/2654] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Sep 13 19:55:34 2022] DELETE /identity/v3/users/5f7bc566b41b47c3953461d90f91e8da => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 19:55:34.665198 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8037068-d8f0-4817-acdf-fb959edf0d8d None None] REQUEST_METHOD: `POST` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:55:34.665685 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8037068-d8f0-4817-acdf-fb959edf0d8d None None] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:55:34.665876 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8037068-d8f0-4817-acdf-fb959edf0d8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:55:34.688292 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.auth.core [None req-b8037068-d8f0-4817-acdf-fb959edf0d8d None None] MFA Rules not processed for user `7b0aed92d02344acb92a0e4aa67c3068`. Rule list: `[]` (Enabled: `True`). {{(pid=87934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:55:34.689565 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.fernet_utils [None req-b8037068-d8f0-4817-acdf-fb959edf0d8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:55:34.758911 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 1351/2655] 10.222.0.25 () {58 vars in 958 bytes} [Tue Sep 13 19:55:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 19:55:34.774074 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e733017f-b3e7-4e8c-9737-d40f0740d49b admin admin] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:55:34.774074 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.fernet_utils [None req-e733017f-b3e7-4e8c-9737-d40f0740d49b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:55:34.849871 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e733017f-b3e7-4e8c-9737-d40f0740d49b admin admin] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:55:34.873041 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b71a79d-b503-487f-a66f-61f3129b0dea service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1196a96e4a404f559600b69f929ea9da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a10a4268f3c4cb29f4e00c292e2df62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:55:34.873827 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b71a79d-b503-487f-a66f-61f3129b0dea service neutron] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:55:34.874088 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b71a79d-b503-487f-a66f-61f3129b0dea service neutron] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:55:34.874359 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b71a79d-b503-487f-a66f-61f3129b0dea service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:55:34.897601 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b71a79d-b503-487f-a66f-61f3129b0dea service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:55:34.899413 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b71a79d-b503-487f-a66f-61f3129b0dea service neutron] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:55:34.911996 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 1305/2656] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Sep 13 19:55:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 19:55:35.362302 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8037068-d8f0-4817-acdf-fb959edf0d8d None None] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:55:35.363712 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.fernet_utils [None req-b8037068-d8f0-4817-acdf-fb959edf0d8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:55:35.371491 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG dbcounter [-] [87934] Writing DB stats keystone:SELECT=76 {{(pid=87934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:55:35.379535 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8037068-d8f0-4817-acdf-fb959edf0d8d None None] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:55:35.385795 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac633a48-9f6f-4ebf-8aa9-66a1c79883e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:55:35.386798 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac633a48-9f6f-4ebf-8aa9-66a1c79883e4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:55:35.387295 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac633a48-9f6f-4ebf-8aa9-66a1c79883e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:55:35.387766 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac633a48-9f6f-4ebf-8aa9-66a1c79883e4 admin admin] PATH_INFO: `/v3/projects/ec22e2e85a394dd0baef3c25d1de188e` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:55:35.389173 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac633a48-9f6f-4ebf-8aa9-66a1c79883e4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ec22e2e85a394dd0baef3c25d1de188e)` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:55:35.391917 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac633a48-9f6f-4ebf-8aa9-66a1c79883e4 admin admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:55:35.446522 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.notifications [None req-ac633a48-9f6f-4ebf-8aa9-66a1c79883e4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ec22e2e85a394dd0baef3c25d1de188e', 'request_id': 'req-ac633a48-9f6f-4ebf-8aa9-66a1c79883e4'} {{(pid=87934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:55:35.453268 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.notifications [None req-ac633a48-9f6f-4ebf-8aa9-66a1c79883e4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ec22e2e85a394dd0baef3c25d1de188e', 'request_id': 'req-ac633a48-9f6f-4ebf-8aa9-66a1c79883e4'} {{(pid=87934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:55:35.460176 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.notifications [None req-ac633a48-9f6f-4ebf-8aa9-66a1c79883e4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ec22e2e85a394dd0baef3c25d1de188e', 'request_id': 'req-ac633a48-9f6f-4ebf-8aa9-66a1c79883e4'} {{(pid=87934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:55:35.477109 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.notifications [None req-ac633a48-9f6f-4ebf-8aa9-66a1c79883e4 admin admin] The token cache is being invalidate because project ec22e2e85a394dd0baef3c25d1de188e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87934) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 19:55:35.477380 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.notifications [None req-ac633a48-9f6f-4ebf-8aa9-66a1c79883e4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:55:35.478260 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.notifications [None req-ac633a48-9f6f-4ebf-8aa9-66a1c79883e4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:55:35.479930 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 1352/2657] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Sep 13 19:55:35 2022] DELETE /identity/v3/projects/ec22e2e85a394dd0baef3c25d1de188e => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 19:55:35.484442 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b71a79d-b503-487f-a66f-61f3129b0dea service neutron] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:55:35.496316 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b71a79d-b503-487f-a66f-61f3129b0dea service neutron] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:55:35.561459 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a571cf-ad48-4e7c-a179-d90de41a3b1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:55:35.562089 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a571cf-ad48-4e7c-a179-d90de41a3b1b admin admin] REQUEST_METHOD: `DELETE` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:55:35.562372 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a571cf-ad48-4e7c-a179-d90de41a3b1b admin admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:55:35.562657 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a571cf-ad48-4e7c-a179-d90de41a3b1b admin admin] PATH_INFO: `/v3/users/781e65438df743358493246252ac6c10` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:55:35.563900 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a571cf-ad48-4e7c-a179-d90de41a3b1b admin admin] RBAC: Authorizing `identity:delete_user(user_id=781e65438df743358493246252ac6c10)` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:55:35.566033 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a571cf-ad48-4e7c-a179-d90de41a3b1b admin admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:55:35.584835 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG dbcounter [-] [87935] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=87935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:55:35.617622 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.notifications [None req-27a571cf-ad48-4e7c-a179-d90de41a3b1b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '781e65438df743358493246252ac6c10'} {{(pid=87935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:55:35.626740 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.notifications [None req-27a571cf-ad48-4e7c-a179-d90de41a3b1b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '781e65438df743358493246252ac6c10'} {{(pid=87935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:55:35.645875 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.notifications [None req-27a571cf-ad48-4e7c-a179-d90de41a3b1b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '781e65438df743358493246252ac6c10'} {{(pid=87935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:55:35.646808 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.notifications [None req-27a571cf-ad48-4e7c-a179-d90de41a3b1b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '781e65438df743358493246252ac6c10'} {{(pid=87935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:55:35.647645 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.notifications [None req-27a571cf-ad48-4e7c-a179-d90de41a3b1b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '781e65438df743358493246252ac6c10'} {{(pid=87935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:55:35.660992 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 1306/2658] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Sep 13 19:55:35 2022] DELETE /identity/v3/users/781e65438df743358493246252ac6c10 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 19:55:35.948241 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac633a48-9f6f-4ebf-8aa9-66a1c79883e4 admin admin] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:55:35.949787 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.fernet_utils [None req-ac633a48-9f6f-4ebf-8aa9-66a1c79883e4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:55:35.965938 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac633a48-9f6f-4ebf-8aa9-66a1c79883e4 admin admin] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:55:36.042838 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe253d6-864f-403a-8f51-94e71f3328b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:55:36.043541 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe253d6-864f-403a-8f51-94e71f3328b9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:55:36.043821 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe253d6-864f-403a-8f51-94e71f3328b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:55:36.044098 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe253d6-864f-403a-8f51-94e71f3328b9 admin admin] PATH_INFO: `/v3/projects/26d6809860104146818ed67e5e0e237d` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:55:36.045967 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe253d6-864f-403a-8f51-94e71f3328b9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=26d6809860104146818ed67e5e0e237d)` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:55:36.047986 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe253d6-864f-403a-8f51-94e71f3328b9 admin admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:55:36.098132 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.notifications [None req-dbe253d6-864f-403a-8f51-94e71f3328b9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '26d6809860104146818ed67e5e0e237d', 'request_id': 'req-dbe253d6-864f-403a-8f51-94e71f3328b9'} {{(pid=87934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:55:36.105779 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.notifications [None req-dbe253d6-864f-403a-8f51-94e71f3328b9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '26d6809860104146818ed67e5e0e237d', 'request_id': 'req-dbe253d6-864f-403a-8f51-94e71f3328b9'} {{(pid=87934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:55:36.113148 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.notifications [None req-dbe253d6-864f-403a-8f51-94e71f3328b9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '26d6809860104146818ed67e5e0e237d', 'request_id': 'req-dbe253d6-864f-403a-8f51-94e71f3328b9'} {{(pid=87934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:55:36.127498 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.notifications [None req-dbe253d6-864f-403a-8f51-94e71f3328b9 admin admin] The token cache is being invalidate because project 26d6809860104146818ed67e5e0e237d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87934) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 19:55:36.127853 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.notifications [None req-dbe253d6-864f-403a-8f51-94e71f3328b9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:55:36.128515 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.notifications [None req-dbe253d6-864f-403a-8f51-94e71f3328b9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:55:36.129989 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 1353/2659] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Sep 13 19:55:35 2022] DELETE /identity/v3/projects/26d6809860104146818ed67e5e0e237d => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 19:55:36.135599 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cae7498-c0b5-4f2e-8b76-36165532d9c4 None None] REQUEST_METHOD: `POST` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:55:36.137024 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cae7498-c0b5-4f2e-8b76-36165532d9c4 None None] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:55:36.137024 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cae7498-c0b5-4f2e-8b76-36165532d9c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:55:36.158709 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.auth.core [None req-6cae7498-c0b5-4f2e-8b76-36165532d9c4 None None] MFA Rules not processed for user `7b0aed92d02344acb92a0e4aa67c3068`. Rule list: `[]` (Enabled: `True`). {{(pid=87935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:55:36.159917 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.fernet_utils [None req-6cae7498-c0b5-4f2e-8b76-36165532d9c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:55:36.223643 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 1307/2660] 10.222.0.25 () {58 vars in 958 bytes} [Tue Sep 13 19:55:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 19:55:36.232647 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da6cde0-ffec-4ae0-954b-ee04dfd63633 None None] REQUEST_METHOD: `POST` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:55:36.232867 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da6cde0-ffec-4ae0-954b-ee04dfd63633 None None] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:55:36.233120 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da6cde0-ffec-4ae0-954b-ee04dfd63633 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:55:36.253140 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.auth.core [None req-3da6cde0-ffec-4ae0-954b-ee04dfd63633 None None] MFA Rules not processed for user `7b0aed92d02344acb92a0e4aa67c3068`. Rule list: `[]` (Enabled: `True`). {{(pid=87934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:55:36.255172 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.fernet_utils [None req-3da6cde0-ffec-4ae0-954b-ee04dfd63633 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:55:36.265250 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 1354/2661] 10.222.0.25 () {58 vars in 958 bytes} [Tue Sep 13 19:55:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 19:55:36.269602 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cae7498-c0b5-4f2e-8b76-36165532d9c4 None None] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:55:36.280105 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cae7498-c0b5-4f2e-8b76-36165532d9c4 None None] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:55:36.284916 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1373bd4-4c1f-497b-9165-12da82a953c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:55:36.285507 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1373bd4-4c1f-497b-9165-12da82a953c1 admin admin] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:55:36.285781 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1373bd4-4c1f-497b-9165-12da82a953c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:55:36.286049 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1373bd4-4c1f-497b-9165-12da82a953c1 admin admin] PATH_INFO: `/v3/domains` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:55:36.286748 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1373bd4-4c1f-497b-9165-12da82a953c1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87935) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:55:36.287037 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1373bd4-4c1f-497b-9165-12da82a953c1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:55:36.289867 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1373bd4-4c1f-497b-9165-12da82a953c1 admin admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:55:36.303868 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 1308/2662] 10.222.0.25 () {58 vars in 1153 bytes} [Tue Sep 13 19:55:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:55:36.308339 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da6cde0-ffec-4ae0-954b-ee04dfd63633 None None] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:55:36.317840 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da6cde0-ffec-4ae0-954b-ee04dfd63633 None None] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:55:36.322639 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13a91f2-0ecc-44c7-8eed-07d63dc2a978 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:55:36.323231 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13a91f2-0ecc-44c7-8eed-07d63dc2a978 admin admin] REQUEST_METHOD: `POST` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:55:36.323506 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13a91f2-0ecc-44c7-8eed-07d63dc2a978 admin admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:55:36.323771 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13a91f2-0ecc-44c7-8eed-07d63dc2a978 admin admin] PATH_INFO: `/v3/projects` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:55:36.324493 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c13a91f2-0ecc-44c7-8eed-07d63dc2a978 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:55:36.326396 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c13a91f2-0ecc-44c7-8eed-07d63dc2a978 admin admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:55:36.331978 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG dbcounter [-] [87934] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=87934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:55:36.355848 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 1355/2663] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Sep 13 19:55:36 2022] POST /identity/v3/projects => generated 381 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 19:55:36.360896 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1373bd4-4c1f-497b-9165-12da82a953c1 admin admin] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:55:36.371725 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1373bd4-4c1f-497b-9165-12da82a953c1 admin admin] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:55:36.429602 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5a5382-ac79-4727-a26c-baa7706034cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:55:36.430194 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5a5382-ac79-4727-a26c-baa7706034cf admin admin] REQUEST_METHOD: `POST` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:55:36.430467 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5a5382-ac79-4727-a26c-baa7706034cf admin admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:55:36.430733 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5a5382-ac79-4727-a26c-baa7706034cf admin admin] PATH_INFO: `/v3/users` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:55:36.431624 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f5a5382-ac79-4727-a26c-baa7706034cf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:55:36.434220 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f5a5382-ac79-4727-a26c-baa7706034cf admin admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:55:36.455958 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 1309/2664] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Sep 13 19:55:36 2022] POST /identity/v3/users => generated 291 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 19:55:36.460486 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13a91f2-0ecc-44c7-8eed-07d63dc2a978 admin admin] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:55:36.472027 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13a91f2-0ecc-44c7-8eed-07d63dc2a978 admin admin] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:55:36.478306 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da891982-c329-4004-8b03-9254f7971ab9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:55:36.478895 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da891982-c329-4004-8b03-9254f7971ab9 admin admin] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:55:36.479170 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da891982-c329-4004-8b03-9254f7971ab9 admin admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:55:36.479435 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da891982-c329-4004-8b03-9254f7971ab9 admin admin] PATH_INFO: `/v3/roles` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:55:36.480066 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da891982-c329-4004-8b03-9254f7971ab9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:55:36.481678 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da891982-c329-4004-8b03-9254f7971ab9 admin admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:55:36.494314 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 1356/2665] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Sep 13 19:55:36 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 19:55:36.498431 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5a5382-ac79-4727-a26c-baa7706034cf admin admin] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:55:36.509563 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5a5382-ac79-4727-a26c-baa7706034cf admin admin] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:55:36.514491 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09518e7b-9a46-4d40-b677-96f8d223d7e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:55:36.515092 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09518e7b-9a46-4d40-b677-96f8d223d7e6 admin admin] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:55:36.515372 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09518e7b-9a46-4d40-b677-96f8d223d7e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:55:36.515644 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09518e7b-9a46-4d40-b677-96f8d223d7e6 admin admin] PATH_INFO: `/v3/roles` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:55:36.516309 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09518e7b-9a46-4d40-b677-96f8d223d7e6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:55:36.517901 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09518e7b-9a46-4d40-b677-96f8d223d7e6 admin admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:55:36.524106 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG dbcounter [-] [87935] Writing DB stats keystone:DELETE=9,keystone:SELECT=87,keystone:INSERT=4 {{(pid=87935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:55:36.531046 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 1310/2666] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Sep 13 19:55:36 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 19:55:36.535205 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da891982-c329-4004-8b03-9254f7971ab9 admin admin] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:55:36.545783 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da891982-c329-4004-8b03-9254f7971ab9 admin admin] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:55:36.550601 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a03a3b6-24e4-4129-8ebe-0de1bc751164 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:55:36.551253 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a03a3b6-24e4-4129-8ebe-0de1bc751164 admin admin] REQUEST_METHOD: `PUT` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:55:36.551532 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a03a3b6-24e4-4129-8ebe-0de1bc751164 admin admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:55:36.551805 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a03a3b6-24e4-4129-8ebe-0de1bc751164 admin admin] PATH_INFO: `/v3/projects/d6175f1daceb43ccb7a36e95c1e75f9a/users/2bf8cac5102b4b7990c457ddccffb553/roles/a259191f6d0e46fabd9f34536bb28747` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:55:36.566757 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a03a3b6-24e4-4129-8ebe-0de1bc751164 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d6175f1daceb43ccb7a36e95c1e75f9a, user_id=2bf8cac5102b4b7990c457ddccffb553, role_id=a259191f6d0e46fabd9f34536bb28747)` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:55:36.570501 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a03a3b6-24e4-4129-8ebe-0de1bc751164 admin admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:55:36.585942 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 1357/2667] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Sep 13 19:55:36 2022] PUT /identity/v3/projects/d6175f1daceb43ccb7a36e95c1e75f9a/users/2bf8cac5102b4b7990c457ddccffb553/roles/a259191f6d0e46fabd9f34536bb28747 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 19:55:36.597893 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd827dba-7e2c-438d-96f1-a2f790dc1be3 None None] REQUEST_METHOD: `POST` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:55:36.598178 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd827dba-7e2c-438d-96f1-a2f790dc1be3 None None] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:55:36.598450 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd827dba-7e2c-438d-96f1-a2f790dc1be3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:55:36.628822 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.auth.core [None req-dd827dba-7e2c-438d-96f1-a2f790dc1be3 None None] MFA Rules not processed for user `2bf8cac5102b4b7990c457ddccffb553`. Rule list: `[]` (Enabled: `True`). {{(pid=87935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:55:36.630046 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.fernet_utils [None req-dd827dba-7e2c-438d-96f1-a2f790dc1be3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:55:36.711461 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 1311/2668] 10.222.0.25 () {58 vars in 958 bytes} [Tue Sep 13 19:55:36 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 19:55:36.717084 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a03a3b6-24e4-4129-8ebe-0de1bc751164 admin admin] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:55:36.788950 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a03a3b6-24e4-4129-8ebe-0de1bc751164 admin admin] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:55:36.793925 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f5605b-bfb4-45cf-a9c2-b95dbc43eb8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:55:36.794410 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f5605b-bfb4-45cf-a9c2-b95dbc43eb8e admin admin] REQUEST_METHOD: `POST` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:55:36.794671 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f5605b-bfb4-45cf-a9c2-b95dbc43eb8e admin admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:55:36.794939 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f5605b-bfb4-45cf-a9c2-b95dbc43eb8e admin admin] PATH_INFO: `/v3/projects` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:55:36.795595 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f5605b-bfb4-45cf-a9c2-b95dbc43eb8e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:55:36.797653 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f5605b-bfb4-45cf-a9c2-b95dbc43eb8e admin admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:55:36.831762 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 1358/2669] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Sep 13 19:55:36 2022] POST /identity/v3/projects => generated 383 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 19:55:36.836652 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd827dba-7e2c-438d-96f1-a2f790dc1be3 None None] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:55:36.847491 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd827dba-7e2c-438d-96f1-a2f790dc1be3 None None] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:55:36.914184 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81cbc017-8909-48d2-9c93-ca7ddb56c8a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:55:36.915554 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81cbc017-8909-48d2-9c93-ca7ddb56c8a0 admin admin] REQUEST_METHOD: `POST` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:55:36.915978 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81cbc017-8909-48d2-9c93-ca7ddb56c8a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:55:36.916286 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81cbc017-8909-48d2-9c93-ca7ddb56c8a0 admin admin] PATH_INFO: `/v3/users` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:55:36.917017 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81cbc017-8909-48d2-9c93-ca7ddb56c8a0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:55:36.919366 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81cbc017-8909-48d2-9c93-ca7ddb56c8a0 admin admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:55:36.942555 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 1312/2670] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Sep 13 19:55:36 2022] POST /identity/v3/users => generated 298 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 19:55:36.947355 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f5605b-bfb4-45cf-a9c2-b95dbc43eb8e admin admin] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:55:36.958365 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f5605b-bfb4-45cf-a9c2-b95dbc43eb8e admin admin] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:55:36.963422 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496d99da-4ad2-407c-a5ea-a446cfd5ef78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:55:36.964028 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496d99da-4ad2-407c-a5ea-a446cfd5ef78 admin admin] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:55:36.964345 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496d99da-4ad2-407c-a5ea-a446cfd5ef78 admin admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:55:36.964620 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496d99da-4ad2-407c-a5ea-a446cfd5ef78 admin admin] PATH_INFO: `/v3/roles` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:55:36.965262 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-496d99da-4ad2-407c-a5ea-a446cfd5ef78 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:55:36.966887 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-496d99da-4ad2-407c-a5ea-a446cfd5ef78 admin admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:55:36.978069 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 1359/2671] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Sep 13 19:55:36 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 19:55:36.982525 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81cbc017-8909-48d2-9c93-ca7ddb56c8a0 admin admin] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:55:36.993275 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81cbc017-8909-48d2-9c93-ca7ddb56c8a0 admin admin] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:55:36.997950 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb04e82-1bd6-4857-bc01-fb08d6665a46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:55:36.998579 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb04e82-1bd6-4857-bc01-fb08d6665a46 admin admin] REQUEST_METHOD: `PUT` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:55:36.998860 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb04e82-1bd6-4857-bc01-fb08d6665a46 admin admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:55:36.999132 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb04e82-1bd6-4857-bc01-fb08d6665a46 admin admin] PATH_INFO: `/v3/projects/52beda785080420584c627a5d0124dab/users/cf2f115b49be4ce5906485a47e00a3d7/roles/6ca1d4427ff64e0a9d25d96cfb1445f6` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:55:37.014972 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb04e82-1bd6-4857-bc01-fb08d6665a46 admin admin] RBAC: Authorizing `identity:create_grant(project_id=52beda785080420584c627a5d0124dab, user_id=cf2f115b49be4ce5906485a47e00a3d7, role_id=6ca1d4427ff64e0a9d25d96cfb1445f6)` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:55:37.017646 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb04e82-1bd6-4857-bc01-fb08d6665a46 admin admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:55:37.030977 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 1313/2672] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Sep 13 19:55:36 2022] PUT /identity/v3/projects/52beda785080420584c627a5d0124dab/users/cf2f115b49be4ce5906485a47e00a3d7/roles/6ca1d4427ff64e0a9d25d96cfb1445f6 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 19:55:37.035168 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496d99da-4ad2-407c-a5ea-a446cfd5ef78 admin admin] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:55:37.045385 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496d99da-4ad2-407c-a5ea-a446cfd5ef78 admin admin] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:55:37.120241 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c6818b-69ac-4788-9e3b-6ae3160a6c35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:55:37.120860 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c6818b-69ac-4788-9e3b-6ae3160a6c35 admin admin] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:55:37.121141 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c6818b-69ac-4788-9e3b-6ae3160a6c35 admin admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:55:37.121413 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c6818b-69ac-4788-9e3b-6ae3160a6c35 admin admin] PATH_INFO: `/v3/roles` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:55:37.122047 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c6818b-69ac-4788-9e3b-6ae3160a6c35 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:55:37.123636 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c6818b-69ac-4788-9e3b-6ae3160a6c35 admin admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:55:37.134736 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 1360/2673] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Sep 13 19:55:37 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 19:55:37.140152 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb04e82-1bd6-4857-bc01-fb08d6665a46 admin admin] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:55:37.151415 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb04e82-1bd6-4857-bc01-fb08d6665a46 admin admin] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:55:37.156399 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1334a7de-e63b-409c-9dee-dc7444a498da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:55:37.157078 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1334a7de-e63b-409c-9dee-dc7444a498da admin admin] REQUEST_METHOD: `PUT` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:55:37.157357 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1334a7de-e63b-409c-9dee-dc7444a498da admin admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:55:37.157743 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1334a7de-e63b-409c-9dee-dc7444a498da admin admin] PATH_INFO: `/v3/projects/52beda785080420584c627a5d0124dab/users/cf2f115b49be4ce5906485a47e00a3d7/roles/6ca1d4427ff64e0a9d25d96cfb1445f6` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:55:37.159631 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1334a7de-e63b-409c-9dee-dc7444a498da admin admin] RBAC: Authorizing `identity:create_grant(project_id=52beda785080420584c627a5d0124dab, user_id=cf2f115b49be4ce5906485a47e00a3d7, role_id=6ca1d4427ff64e0a9d25d96cfb1445f6)` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:55:37.162357 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1334a7de-e63b-409c-9dee-dc7444a498da admin admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:55:37.174627 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 1314/2674] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Sep 13 19:55:37 2022] PUT /identity/v3/projects/52beda785080420584c627a5d0124dab/users/cf2f115b49be4ce5906485a47e00a3d7/roles/6ca1d4427ff64e0a9d25d96cfb1445f6 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 19:55:37.186417 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9dac61-9abd-4f61-841c-c3dfc31504dc None None] REQUEST_METHOD: `POST` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:55:37.186709 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9dac61-9abd-4f61-841c-c3dfc31504dc None None] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:55:37.186989 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9dac61-9abd-4f61-841c-c3dfc31504dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:55:37.219931 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.auth.core [None req-cc9dac61-9abd-4f61-841c-c3dfc31504dc None None] MFA Rules not processed for user `cf2f115b49be4ce5906485a47e00a3d7`. Rule list: `[]` (Enabled: `True`). {{(pid=87934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:55:37.221220 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.fernet_utils [None req-cc9dac61-9abd-4f61-841c-c3dfc31504dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:55:37.232474 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG dbcounter [-] [87934] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:55:37.312964 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 1361/2675] 10.222.0.25 () {58 vars in 958 bytes} [Tue Sep 13 19:55:37 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 19:55:37.325931 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1334a7de-e63b-409c-9dee-dc7444a498da admin admin] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:55:37.328182 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.fernet_utils [None req-1334a7de-e63b-409c-9dee-dc7444a498da admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:55:37.393467 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG dbcounter [-] [87935] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=87935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:55:37.407617 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1334a7de-e63b-409c-9dee-dc7444a498da admin admin] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:55:37.411263 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1c270b-48b2-4f9d-bc07-552c7af63050 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cbb50c88b794a7f9f26844effde7d63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a10a4268f3c4cb29f4e00c292e2df62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:55:37.411861 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1c270b-48b2-4f9d-bc07-552c7af63050 service cinder] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:55:37.412134 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1c270b-48b2-4f9d-bc07-552c7af63050 service cinder] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:55:37.413010 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1c270b-48b2-4f9d-bc07-552c7af63050 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:55:37.421948 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e1c270b-48b2-4f9d-bc07-552c7af63050 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:55:37.423358 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e1c270b-48b2-4f9d-bc07-552c7af63050 service cinder] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:55:37.433251 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 1315/2676] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Sep 13 19:55:37 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 19:55:37.512004 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9dac61-9abd-4f61-841c-c3dfc31504dc None None] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:55:37.521787 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9dac61-9abd-4f61-841c-c3dfc31504dc None None] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:55:37.525593 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241583ab-c7c3-456c-8b7c-f758ac6dbc6a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cbb50c88b794a7f9f26844effde7d63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a10a4268f3c4cb29f4e00c292e2df62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:55:37.526422 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241583ab-c7c3-456c-8b7c-f758ac6dbc6a service cinder] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:55:37.526697 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241583ab-c7c3-456c-8b7c-f758ac6dbc6a service cinder] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:55:37.526963 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241583ab-c7c3-456c-8b7c-f758ac6dbc6a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:55:37.586581 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241583ab-c7c3-456c-8b7c-f758ac6dbc6a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:55:37.588008 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241583ab-c7c3-456c-8b7c-f758ac6dbc6a service cinder] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:55:37.596904 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 1362/2677] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Sep 13 19:55:37 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 19:55:37.878235 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1c270b-48b2-4f9d-bc07-552c7af63050 service cinder] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:55:37.933327 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241583ab-c7c3-456c-8b7c-f758ac6dbc6a service cinder] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:55:37.934724 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.fernet_utils [None req-241583ab-c7c3-456c-8b7c-f758ac6dbc6a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:55:37.953312 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1c270b-48b2-4f9d-bc07-552c7af63050 service cinder] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:55:37.957995 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19cd019b-fa65-452e-aeb2-d2497307baaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:55:37.958649 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19cd019b-fa65-452e-aeb2-d2497307baaf admin admin] REQUEST_METHOD: `DELETE` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:55:37.958913 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19cd019b-fa65-452e-aeb2-d2497307baaf admin admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:55:37.959188 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19cd019b-fa65-452e-aeb2-d2497307baaf admin admin] PATH_INFO: `/v3/users/2bf8cac5102b4b7990c457ddccffb553` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:55:37.960839 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19cd019b-fa65-452e-aeb2-d2497307baaf admin admin] RBAC: Authorizing `identity:delete_user(user_id=2bf8cac5102b4b7990c457ddccffb553)` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:55:37.962751 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19cd019b-fa65-452e-aeb2-d2497307baaf admin admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:55:37.996227 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241583ab-c7c3-456c-8b7c-f758ac6dbc6a service cinder] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:55:38.000269 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88484b30-6ef4-4a48-bd0d-a97d8fb1db92 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1196a96e4a404f559600b69f929ea9da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a10a4268f3c4cb29f4e00c292e2df62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:55:38.000888 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88484b30-6ef4-4a48-bd0d-a97d8fb1db92 service neutron] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:55:38.001159 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88484b30-6ef4-4a48-bd0d-a97d8fb1db92 service neutron] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:55:38.001422 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88484b30-6ef4-4a48-bd0d-a97d8fb1db92 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:55:38.003153 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.fernet_utils [None req-88484b30-6ef4-4a48-bd0d-a97d8fb1db92 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:55:38.013444 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.notifications [None req-19cd019b-fa65-452e-aeb2-d2497307baaf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2bf8cac5102b4b7990c457ddccffb553'} {{(pid=87935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:55:38.016347 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88484b30-6ef4-4a48-bd0d-a97d8fb1db92 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:55:38.017774 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88484b30-6ef4-4a48-bd0d-a97d8fb1db92 service neutron] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:55:38.022544 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.notifications [None req-19cd019b-fa65-452e-aeb2-d2497307baaf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2bf8cac5102b4b7990c457ddccffb553'} {{(pid=87935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:55:38.030005 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 1363/2678] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Sep 13 19:55:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 13 19:55:38.035467 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.notifications [None req-19cd019b-fa65-452e-aeb2-d2497307baaf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2bf8cac5102b4b7990c457ddccffb553'} {{(pid=87935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:55:38.036391 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.notifications [None req-19cd019b-fa65-452e-aeb2-d2497307baaf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2bf8cac5102b4b7990c457ddccffb553'} {{(pid=87935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:55:38.037141 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.notifications [None req-19cd019b-fa65-452e-aeb2-d2497307baaf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2bf8cac5102b4b7990c457ddccffb553'} {{(pid=87935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:55:38.049824 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 1316/2679] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Sep 13 19:55:37 2022] DELETE /identity/v3/users/2bf8cac5102b4b7990c457ddccffb553 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 19:55:38.054515 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df9f44a-4f9b-4937-b91b-d062dc5efb97 None None] REQUEST_METHOD: `POST` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:55:38.054798 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df9f44a-4f9b-4937-b91b-d062dc5efb97 None None] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:55:38.055065 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df9f44a-4f9b-4937-b91b-d062dc5efb97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:55:38.074671 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.auth.core [None req-5df9f44a-4f9b-4937-b91b-d062dc5efb97 None None] MFA Rules not processed for user `7b0aed92d02344acb92a0e4aa67c3068`. Rule list: `[]` (Enabled: `True`). {{(pid=87934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:55:38.075870 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.fernet_utils [None req-5df9f44a-4f9b-4937-b91b-d062dc5efb97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:55:38.120152 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG dbcounter [-] [87934] Writing DB stats keystone:SELECT=100 {{(pid=87934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:55:38.139322 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 1364/2680] 10.222.0.25 () {58 vars in 958 bytes} [Tue Sep 13 19:55:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 19:55:38.149797 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19cd019b-fa65-452e-aeb2-d2497307baaf admin admin] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:55:38.151222 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.fernet_utils [None req-19cd019b-fa65-452e-aeb2-d2497307baaf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:55:38.211911 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19cd019b-fa65-452e-aeb2-d2497307baaf admin admin] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:55:38.215622 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf97a4b-2e14-47f0-87ae-767575b639ba service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1196a96e4a404f559600b69f929ea9da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a10a4268f3c4cb29f4e00c292e2df62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:55:38.216247 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf97a4b-2e14-47f0-87ae-767575b639ba service neutron] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:55:38.216521 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf97a4b-2e14-47f0-87ae-767575b639ba service neutron] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:55:38.216789 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf97a4b-2e14-47f0-87ae-767575b639ba service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:55:38.226072 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf97a4b-2e14-47f0-87ae-767575b639ba service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:55:38.227500 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf97a4b-2e14-47f0-87ae-767575b639ba service neutron] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:55:38.237208 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 1317/2681] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Sep 13 19:55:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 19:55:38.416988 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66461aec-4c17-4756-9b5f-ddb3cdce0d57 None None] REQUEST_METHOD: `POST` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:55:38.417499 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66461aec-4c17-4756-9b5f-ddb3cdce0d57 None None] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:55:38.417858 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66461aec-4c17-4756-9b5f-ddb3cdce0d57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:55:38.446534 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.auth.core [None req-66461aec-4c17-4756-9b5f-ddb3cdce0d57 None None] MFA Rules not processed for user `54a4fca5e980468e8a28d904871f49b3`. Rule list: `[]` (Enabled: `True`). {{(pid=87934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:55:38.447769 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.fernet_utils [None req-66461aec-4c17-4756-9b5f-ddb3cdce0d57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:55:38.517605 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 1365/2682] 10.222.0.25 () {58 vars in 958 bytes} [Tue Sep 13 19:55:38 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 19:55:38.551688 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf97a4b-2e14-47f0-87ae-767575b639ba service neutron] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:55:38.554178 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.fernet_utils [None req-aaf97a4b-2e14-47f0-87ae-767575b639ba service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:55:38.583946 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf97a4b-2e14-47f0-87ae-767575b639ba service neutron] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:55:38.603073 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09482f1c-40b0-466e-9170-bbc1f705b163 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:55:38.603715 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09482f1c-40b0-466e-9170-bbc1f705b163 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:55:38.603987 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09482f1c-40b0-466e-9170-bbc1f705b163 admin admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:55:38.604330 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09482f1c-40b0-466e-9170-bbc1f705b163 admin admin] PATH_INFO: `/v3/projects/d6175f1daceb43ccb7a36e95c1e75f9a` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:55:38.605400 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09482f1c-40b0-466e-9170-bbc1f705b163 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d6175f1daceb43ccb7a36e95c1e75f9a)` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:55:38.607343 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09482f1c-40b0-466e-9170-bbc1f705b163 admin admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:55:38.609255 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG dbcounter [-] [87935] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:55:38.664849 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.notifications [None req-09482f1c-40b0-466e-9170-bbc1f705b163 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd6175f1daceb43ccb7a36e95c1e75f9a', 'request_id': 'req-09482f1c-40b0-466e-9170-bbc1f705b163'} {{(pid=87935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:55:38.674539 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.notifications [None req-09482f1c-40b0-466e-9170-bbc1f705b163 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd6175f1daceb43ccb7a36e95c1e75f9a', 'request_id': 'req-09482f1c-40b0-466e-9170-bbc1f705b163'} {{(pid=87935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:55:38.688057 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.notifications [None req-09482f1c-40b0-466e-9170-bbc1f705b163 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd6175f1daceb43ccb7a36e95c1e75f9a', 'request_id': 'req-09482f1c-40b0-466e-9170-bbc1f705b163'} {{(pid=87935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:55:38.706482 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.notifications [None req-09482f1c-40b0-466e-9170-bbc1f705b163 admin admin] The token cache is being invalidate because project d6175f1daceb43ccb7a36e95c1e75f9a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87935) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 19:55:38.706769 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.notifications [None req-09482f1c-40b0-466e-9170-bbc1f705b163 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:55:38.708181 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.notifications [None req-09482f1c-40b0-466e-9170-bbc1f705b163 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:55:38.711173 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 1318/2683] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Sep 13 19:55:38 2022] DELETE /identity/v3/projects/d6175f1daceb43ccb7a36e95c1e75f9a => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 19:55:38.714892 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66461aec-4c17-4756-9b5f-ddb3cdce0d57 None None] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:55:38.726785 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66461aec-4c17-4756-9b5f-ddb3cdce0d57 None None] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:55:38.792371 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3996adad-647d-41a6-84a9-a5b1cf4b3951 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:55:38.793208 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3996adad-647d-41a6-84a9-a5b1cf4b3951 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:55:38.793487 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3996adad-647d-41a6-84a9-a5b1cf4b3951 admin admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:55:38.793860 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3996adad-647d-41a6-84a9-a5b1cf4b3951 admin admin] PATH_INFO: `/v3/users/cf2f115b49be4ce5906485a47e00a3d7` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:55:38.795538 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3996adad-647d-41a6-84a9-a5b1cf4b3951 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cf2f115b49be4ce5906485a47e00a3d7)` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:55:38.798578 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3996adad-647d-41a6-84a9-a5b1cf4b3951 admin admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:55:38.859708 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.notifications [None req-3996adad-647d-41a6-84a9-a5b1cf4b3951 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cf2f115b49be4ce5906485a47e00a3d7'} {{(pid=87934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:55:38.860928 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.notifications [None req-3996adad-647d-41a6-84a9-a5b1cf4b3951 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cf2f115b49be4ce5906485a47e00a3d7'} {{(pid=87934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:55:38.861215 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.notifications [None req-3996adad-647d-41a6-84a9-a5b1cf4b3951 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cf2f115b49be4ce5906485a47e00a3d7'} {{(pid=87934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:55:38.870690 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.notifications [None req-3996adad-647d-41a6-84a9-a5b1cf4b3951 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cf2f115b49be4ce5906485a47e00a3d7'} {{(pid=87934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:55:38.886773 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.notifications [None req-3996adad-647d-41a6-84a9-a5b1cf4b3951 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cf2f115b49be4ce5906485a47e00a3d7'} {{(pid=87934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:55:38.901682 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 1366/2684] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Sep 13 19:55:38 2022] DELETE /identity/v3/users/cf2f115b49be4ce5906485a47e00a3d7 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 19:55:39.340102 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09482f1c-40b0-466e-9170-bbc1f705b163 admin admin] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:55:39.341881 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.fernet_utils [None req-09482f1c-40b0-466e-9170-bbc1f705b163 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:55:39.372837 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09482f1c-40b0-466e-9170-bbc1f705b163 admin admin] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:55:39.446703 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef6e752-ecdd-4b70-8dc0-5ff17af27f34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:55:39.447341 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef6e752-ecdd-4b70-8dc0-5ff17af27f34 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:55:39.447633 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef6e752-ecdd-4b70-8dc0-5ff17af27f34 admin admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:55:39.447889 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef6e752-ecdd-4b70-8dc0-5ff17af27f34 admin admin] PATH_INFO: `/v3/projects/52beda785080420584c627a5d0124dab` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:55:39.449070 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef6e752-ecdd-4b70-8dc0-5ff17af27f34 admin admin] RBAC: Authorizing `identity:delete_project(project_id=52beda785080420584c627a5d0124dab)` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:55:39.451470 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef6e752-ecdd-4b70-8dc0-5ff17af27f34 admin admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:55:39.507449 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.notifications [None req-cef6e752-ecdd-4b70-8dc0-5ff17af27f34 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '52beda785080420584c627a5d0124dab', 'request_id': 'req-cef6e752-ecdd-4b70-8dc0-5ff17af27f34'} {{(pid=87935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:55:39.516951 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.notifications [None req-cef6e752-ecdd-4b70-8dc0-5ff17af27f34 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '52beda785080420584c627a5d0124dab', 'request_id': 'req-cef6e752-ecdd-4b70-8dc0-5ff17af27f34'} {{(pid=87935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:55:39.526277 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.notifications [None req-cef6e752-ecdd-4b70-8dc0-5ff17af27f34 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '52beda785080420584c627a5d0124dab', 'request_id': 'req-cef6e752-ecdd-4b70-8dc0-5ff17af27f34'} {{(pid=87935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:55:39.540551 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.notifications [None req-cef6e752-ecdd-4b70-8dc0-5ff17af27f34 admin admin] The token cache is being invalidate because project 52beda785080420584c627a5d0124dab was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87935) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 19:55:39.540940 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.notifications [None req-cef6e752-ecdd-4b70-8dc0-5ff17af27f34 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:55:39.541977 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.notifications [None req-cef6e752-ecdd-4b70-8dc0-5ff17af27f34 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:55:39.543759 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 1319/2685] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Sep 13 19:55:39 2022] DELETE /identity/v3/projects/52beda785080420584c627a5d0124dab => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 19:55:39.548487 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a389c1-34e0-49c1-b8a3-f2772747bd92 None None] REQUEST_METHOD: `POST` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:55:39.549043 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a389c1-34e0-49c1-b8a3-f2772747bd92 None None] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:55:39.549140 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a389c1-34e0-49c1-b8a3-f2772747bd92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:55:39.573064 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.auth.core [None req-a3a389c1-34e0-49c1-b8a3-f2772747bd92 None None] MFA Rules not processed for user `7b0aed92d02344acb92a0e4aa67c3068`. Rule list: `[]` (Enabled: `True`). {{(pid=87934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:55:39.574752 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.fernet_utils [None req-a3a389c1-34e0-49c1-b8a3-f2772747bd92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:55:39.588549 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG dbcounter [-] [87934] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:55:39.671848 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 1367/2686] 10.222.0.25 () {58 vars in 958 bytes} [Tue Sep 13 19:55:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 19:55:39.684352 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0316862e-7eeb-4d2b-83f1-d257a3472ef0 None None] REQUEST_METHOD: `POST` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:55:39.684352 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0316862e-7eeb-4d2b-83f1-d257a3472ef0 None None] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:55:39.684352 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0316862e-7eeb-4d2b-83f1-d257a3472ef0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:55:39.707112 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.auth.core [None req-0316862e-7eeb-4d2b-83f1-d257a3472ef0 None None] MFA Rules not processed for user `7b0aed92d02344acb92a0e4aa67c3068`. Rule list: `[]` (Enabled: `True`). {{(pid=87935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:55:39.708766 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.fernet_utils [None req-0316862e-7eeb-4d2b-83f1-d257a3472ef0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:55:39.722070 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a389c1-34e0-49c1-b8a3-f2772747bd92 None None] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:55:39.732305 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 1320/2687] 10.222.0.25 () {58 vars in 958 bytes} [Tue Sep 13 19:55:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 19:55:39.734695 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a389c1-34e0-49c1-b8a3-f2772747bd92 None None] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:55:39.741872 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59c7b4e-9ec8-49ef-8c16-a0ff569545f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:55:39.743026 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59c7b4e-9ec8-49ef-8c16-a0ff569545f6 admin admin] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:55:39.743698 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59c7b4e-9ec8-49ef-8c16-a0ff569545f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:55:39.744453 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59c7b4e-9ec8-49ef-8c16-a0ff569545f6 admin admin] PATH_INFO: `/v3/domains` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:55:39.745245 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e59c7b4e-9ec8-49ef-8c16-a0ff569545f6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87934) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:55:39.746062 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e59c7b4e-9ec8-49ef-8c16-a0ff569545f6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:55:39.747936 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e59c7b4e-9ec8-49ef-8c16-a0ff569545f6 admin admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:55:39.762179 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 1368/2688] 10.222.0.25 () {58 vars in 1153 bytes} [Tue Sep 13 19:55:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 19:55:39.766610 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0316862e-7eeb-4d2b-83f1-d257a3472ef0 None None] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:55:39.777261 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0316862e-7eeb-4d2b-83f1-d257a3472ef0 None None] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:55:39.783798 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cca61e9-0a43-4df0-96e8-c18b461f3275 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:55:39.785245 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cca61e9-0a43-4df0-96e8-c18b461f3275 admin admin] REQUEST_METHOD: `POST` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:55:39.785986 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cca61e9-0a43-4df0-96e8-c18b461f3275 admin admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:55:39.786505 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cca61e9-0a43-4df0-96e8-c18b461f3275 admin admin] PATH_INFO: `/v3/projects` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:55:39.787858 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cca61e9-0a43-4df0-96e8-c18b461f3275 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:55:39.790128 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cca61e9-0a43-4df0-96e8-c18b461f3275 admin admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:55:39.806726 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG dbcounter [-] [87935] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=87935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:55:39.839230 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 1321/2689] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Sep 13 19:55:39 2022] POST /identity/v3/projects => generated 385 bytes in 71 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 19:55:39.841012 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59c7b4e-9ec8-49ef-8c16-a0ff569545f6 admin admin] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:55:39.854935 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59c7b4e-9ec8-49ef-8c16-a0ff569545f6 admin admin] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:55:39.936558 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e99accf-4adc-4a10-b73c-3ec5d501c5a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:55:39.937181 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e99accf-4adc-4a10-b73c-3ec5d501c5a3 admin admin] REQUEST_METHOD: `POST` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:55:39.937467 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e99accf-4adc-4a10-b73c-3ec5d501c5a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:55:39.937792 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e99accf-4adc-4a10-b73c-3ec5d501c5a3 admin admin] PATH_INFO: `/v3/users` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:55:39.938436 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e99accf-4adc-4a10-b73c-3ec5d501c5a3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:55:39.940421 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e99accf-4adc-4a10-b73c-3ec5d501c5a3 admin admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:55:39.972803 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 1369/2690] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Sep 13 19:55:39 2022] POST /identity/v3/users => generated 293 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 19:55:39.976248 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cca61e9-0a43-4df0-96e8-c18b461f3275 admin admin] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:55:39.988113 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cca61e9-0a43-4df0-96e8-c18b461f3275 admin admin] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:55:39.997772 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f48813-7c8f-46b9-9554-eeed1d0c0598 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:55:39.998423 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f48813-7c8f-46b9-9554-eeed1d0c0598 admin admin] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:55:39.998767 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f48813-7c8f-46b9-9554-eeed1d0c0598 admin admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:55:39.998905 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f48813-7c8f-46b9-9554-eeed1d0c0598 admin admin] PATH_INFO: `/v3/roles` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:55:39.999668 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f48813-7c8f-46b9-9554-eeed1d0c0598 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:55:40.001693 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f48813-7c8f-46b9-9554-eeed1d0c0598 admin admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:55:40.031619 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 1322/2691] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Sep 13 19:55:39 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 19:55:40.035747 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e99accf-4adc-4a10-b73c-3ec5d501c5a3 admin admin] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:55:40.050652 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e99accf-4adc-4a10-b73c-3ec5d501c5a3 admin admin] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:55:40.063176 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48d10f8-b8d8-4a82-95d7-e9d27b02baae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:55:40.063954 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48d10f8-b8d8-4a82-95d7-e9d27b02baae admin admin] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:55:40.064690 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48d10f8-b8d8-4a82-95d7-e9d27b02baae admin admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:55:40.065080 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48d10f8-b8d8-4a82-95d7-e9d27b02baae admin admin] PATH_INFO: `/v3/roles` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:55:40.066645 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f48d10f8-b8d8-4a82-95d7-e9d27b02baae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:55:40.069129 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f48d10f8-b8d8-4a82-95d7-e9d27b02baae admin admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:55:40.104878 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 1370/2692] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Sep 13 19:55:40 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 19:55:40.109575 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f48813-7c8f-46b9-9554-eeed1d0c0598 admin admin] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:55:40.122165 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f48813-7c8f-46b9-9554-eeed1d0c0598 admin admin] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:55:40.129929 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42543a7b-4e66-4240-8a93-2e71650fd18f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:55:40.132748 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42543a7b-4e66-4240-8a93-2e71650fd18f admin admin] REQUEST_METHOD: `PUT` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:55:40.132748 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42543a7b-4e66-4240-8a93-2e71650fd18f admin admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:55:40.132748 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42543a7b-4e66-4240-8a93-2e71650fd18f admin admin] PATH_INFO: `/v3/projects/fe39852c8cdd4e80be6b0f6378a9da57/users/be5b068e081949c496dfa25d574b1e81/roles/a259191f6d0e46fabd9f34536bb28747` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:55:40.154851 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42543a7b-4e66-4240-8a93-2e71650fd18f admin admin] RBAC: Authorizing `identity:create_grant(project_id=fe39852c8cdd4e80be6b0f6378a9da57, user_id=be5b068e081949c496dfa25d574b1e81, role_id=a259191f6d0e46fabd9f34536bb28747)` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:55:40.157857 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42543a7b-4e66-4240-8a93-2e71650fd18f admin admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:55:40.184301 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 1323/2693] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Sep 13 19:55:40 2022] PUT /identity/v3/projects/fe39852c8cdd4e80be6b0f6378a9da57/users/be5b068e081949c496dfa25d574b1e81/roles/a259191f6d0e46fabd9f34536bb28747 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 19:55:40.190858 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4de26a-f915-4587-a569-d266f01e210c None None] REQUEST_METHOD: `POST` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:55:40.191151 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4de26a-f915-4587-a569-d266f01e210c None None] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:55:40.191427 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4de26a-f915-4587-a569-d266f01e210c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:55:40.229117 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.auth.core [None req-9a4de26a-f915-4587-a569-d266f01e210c None None] MFA Rules not processed for user `be5b068e081949c496dfa25d574b1e81`. Rule list: `[]` (Enabled: `True`). {{(pid=87934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:55:40.229117 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.fernet_utils [None req-9a4de26a-f915-4587-a569-d266f01e210c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:55:40.317846 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 1371/2694] 10.222.0.25 () {58 vars in 958 bytes} [Tue Sep 13 19:55:40 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 19:55:40.328030 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42543a7b-4e66-4240-8a93-2e71650fd18f admin admin] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:55:40.330101 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.fernet_utils [None req-42543a7b-4e66-4240-8a93-2e71650fd18f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:55:40.425883 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42543a7b-4e66-4240-8a93-2e71650fd18f admin admin] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:55:40.433017 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fffba01-4861-4c5f-acc2-ce4ae03cb67f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cbb50c88b794a7f9f26844effde7d63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a10a4268f3c4cb29f4e00c292e2df62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:55:40.433643 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fffba01-4861-4c5f-acc2-ce4ae03cb67f service cinder] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:55:40.433920 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fffba01-4861-4c5f-acc2-ce4ae03cb67f service cinder] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:55:40.434212 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fffba01-4861-4c5f-acc2-ce4ae03cb67f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:55:40.445519 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fffba01-4861-4c5f-acc2-ce4ae03cb67f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:55:40.447087 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fffba01-4861-4c5f-acc2-ce4ae03cb67f service cinder] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:55:40.466222 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 1324/2695] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Sep 13 19:55:40 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 19:55:42.206453 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4de26a-f915-4587-a569-d266f01e210c None None] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:55:42.208000 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.fernet_utils [None req-9a4de26a-f915-4587-a569-d266f01e210c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:55:42.219693 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG dbcounter [-] [87934] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:55:42.286878 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4de26a-f915-4587-a569-d266f01e210c None None] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:55:42.293502 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518643cd-5d97-4e79-b31f-cb91d052788b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02eb3d3173c1476cb83a72add0e878e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a10a4268f3c4cb29f4e00c292e2df62', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:55:42.296337 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518643cd-5d97-4e79-b31f-cb91d052788b service placement] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:55:42.296337 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518643cd-5d97-4e79-b31f-cb91d052788b service placement] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:55:42.296337 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518643cd-5d97-4e79-b31f-cb91d052788b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:55:42.300144 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.fernet_utils [None req-518643cd-5d97-4e79-b31f-cb91d052788b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:55:42.312675 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-518643cd-5d97-4e79-b31f-cb91d052788b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:55:42.314332 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-518643cd-5d97-4e79-b31f-cb91d052788b service placement] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:55:42.326203 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 1372/2696] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Sep 13 19:55:42 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 19:55:42.371638 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fffba01-4861-4c5f-acc2-ce4ae03cb67f service cinder] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:55:42.373228 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.fernet_utils [None req-2fffba01-4861-4c5f-acc2-ce4ae03cb67f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:55:42.441626 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fffba01-4861-4c5f-acc2-ce4ae03cb67f service cinder] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:55:42.446931 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb725ba8-06b5-4885-af0a-1ae49475a872 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:55:42.447559 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb725ba8-06b5-4885-af0a-1ae49475a872 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:55:42.447846 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb725ba8-06b5-4885-af0a-1ae49475a872 admin admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:55:42.448121 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb725ba8-06b5-4885-af0a-1ae49475a872 admin admin] PATH_INFO: `/v3/users/2658bb3ed0fd42948a1b471816e29301` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:55:42.449299 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb725ba8-06b5-4885-af0a-1ae49475a872 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2658bb3ed0fd42948a1b471816e29301)` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:55:42.451219 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb725ba8-06b5-4885-af0a-1ae49475a872 admin admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:55:42.500971 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.notifications [None req-bb725ba8-06b5-4885-af0a-1ae49475a872 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2658bb3ed0fd42948a1b471816e29301'} {{(pid=87935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:55:42.508852 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.notifications [None req-bb725ba8-06b5-4885-af0a-1ae49475a872 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2658bb3ed0fd42948a1b471816e29301'} {{(pid=87935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:55:42.514347 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG dbcounter [-] [87935] Writing DB stats keystone:SELECT=88,keystone:INSERT=3,keystone:DELETE=9 {{(pid=87935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:55:42.522598 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.notifications [None req-bb725ba8-06b5-4885-af0a-1ae49475a872 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2658bb3ed0fd42948a1b471816e29301'} {{(pid=87935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:55:42.523395 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.notifications [None req-bb725ba8-06b5-4885-af0a-1ae49475a872 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2658bb3ed0fd42948a1b471816e29301'} {{(pid=87935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:55:42.524096 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.notifications [None req-bb725ba8-06b5-4885-af0a-1ae49475a872 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2658bb3ed0fd42948a1b471816e29301'} {{(pid=87935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:55:42.536648 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 1325/2697] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Sep 13 19:55:42 2022] DELETE /identity/v3/users/2658bb3ed0fd42948a1b471816e29301 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 19:55:42.722933 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518643cd-5d97-4e79-b31f-cb91d052788b service placement] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:55:42.747720 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518643cd-5d97-4e79-b31f-cb91d052788b service placement] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:55:42.819983 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c731a2-f467-4347-aac3-437780a233d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:55:42.820373 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c731a2-f467-4347-aac3-437780a233d6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:55:42.820701 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c731a2-f467-4347-aac3-437780a233d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:55:42.821039 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c731a2-f467-4347-aac3-437780a233d6 admin admin] PATH_INFO: `/v3/projects/9db7918cdffb41108d00c5c9d5a7d017` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:55:42.822715 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c731a2-f467-4347-aac3-437780a233d6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9db7918cdffb41108d00c5c9d5a7d017)` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:55:42.824830 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c731a2-f467-4347-aac3-437780a233d6 admin admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:55:42.886066 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.notifications [None req-50c731a2-f467-4347-aac3-437780a233d6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9db7918cdffb41108d00c5c9d5a7d017', 'request_id': 'req-50c731a2-f467-4347-aac3-437780a233d6'} {{(pid=87934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:55:42.893246 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.notifications [None req-50c731a2-f467-4347-aac3-437780a233d6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9db7918cdffb41108d00c5c9d5a7d017', 'request_id': 'req-50c731a2-f467-4347-aac3-437780a233d6'} {{(pid=87934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:55:42.900798 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.notifications [None req-50c731a2-f467-4347-aac3-437780a233d6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9db7918cdffb41108d00c5c9d5a7d017', 'request_id': 'req-50c731a2-f467-4347-aac3-437780a233d6'} {{(pid=87934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:55:42.926358 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.notifications [None req-50c731a2-f467-4347-aac3-437780a233d6 admin admin] The token cache is being invalidate because project 9db7918cdffb41108d00c5c9d5a7d017 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87934) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 19:55:42.926700 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.notifications [None req-50c731a2-f467-4347-aac3-437780a233d6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:55:42.929212 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.notifications [None req-50c731a2-f467-4347-aac3-437780a233d6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:55:42.932251 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 1373/2698] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Sep 13 19:55:42 2022] DELETE /identity/v3/projects/9db7918cdffb41108d00c5c9d5a7d017 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 19:55:42.936990 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26639325-4367-4a5b-85ce-021b56c64944 None None] REQUEST_METHOD: `POST` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:55:42.936990 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26639325-4367-4a5b-85ce-021b56c64944 None None] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:55:42.937272 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26639325-4367-4a5b-85ce-021b56c64944 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:55:42.961729 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.auth.core [None req-26639325-4367-4a5b-85ce-021b56c64944 None None] MFA Rules not processed for user `7b0aed92d02344acb92a0e4aa67c3068`. Rule list: `[]` (Enabled: `True`). {{(pid=87935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:55:42.962948 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.fernet_utils [None req-26639325-4367-4a5b-85ce-021b56c64944 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:55:43.027225 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 1326/2699] 10.222.0.25 () {58 vars in 958 bytes} [Tue Sep 13 19:55:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 19:55:43.035977 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96cb69c-b925-4b7c-a27f-d85ff6086522 None None] REQUEST_METHOD: `POST` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:55:43.036291 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96cb69c-b925-4b7c-a27f-d85ff6086522 None None] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:55:43.036560 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96cb69c-b925-4b7c-a27f-d85ff6086522 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:55:43.058016 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.auth.core [None req-a96cb69c-b925-4b7c-a27f-d85ff6086522 None None] MFA Rules not processed for user `7b0aed92d02344acb92a0e4aa67c3068`. Rule list: `[]` (Enabled: `True`). {{(pid=87934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:55:43.059249 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.fernet_utils [None req-a96cb69c-b925-4b7c-a27f-d85ff6086522 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:55:43.066998 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 1374/2700] 10.222.0.25 () {58 vars in 958 bytes} [Tue Sep 13 19:55:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 19:55:43.071491 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26639325-4367-4a5b-85ce-021b56c64944 None None] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:55:43.082429 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26639325-4367-4a5b-85ce-021b56c64944 None None] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:55:43.089195 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9e5119-aed0-44a9-9ccd-865245bed1aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:55:43.089803 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9e5119-aed0-44a9-9ccd-865245bed1aa admin admin] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:55:43.090099 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9e5119-aed0-44a9-9ccd-865245bed1aa admin admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:55:43.090508 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9e5119-aed0-44a9-9ccd-865245bed1aa admin admin] PATH_INFO: `/v3/domains` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:55:43.091162 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e9e5119-aed0-44a9-9ccd-865245bed1aa admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87935) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:55:43.091487 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e9e5119-aed0-44a9-9ccd-865245bed1aa admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:55:43.093138 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e9e5119-aed0-44a9-9ccd-865245bed1aa admin admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:55:43.106015 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 1327/2701] 10.222.0.25 () {58 vars in 1153 bytes} [Tue Sep 13 19:55:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 19:55:43.110268 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96cb69c-b925-4b7c-a27f-d85ff6086522 None None] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:55:43.119410 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96cb69c-b925-4b7c-a27f-d85ff6086522 None None] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:55:43.124008 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fad5954-0531-432a-b0f4-408fceb0ed8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:55:43.124655 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fad5954-0531-432a-b0f4-408fceb0ed8f admin admin] REQUEST_METHOD: `POST` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:55:43.124931 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fad5954-0531-432a-b0f4-408fceb0ed8f admin admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:55:43.125195 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fad5954-0531-432a-b0f4-408fceb0ed8f admin admin] PATH_INFO: `/v3/projects` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:55:43.125827 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fad5954-0531-432a-b0f4-408fceb0ed8f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:55:43.128362 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fad5954-0531-432a-b0f4-408fceb0ed8f admin admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:55:43.154585 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG dbcounter [-] [87934] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=87934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:55:43.164412 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 1375/2702] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Sep 13 19:55:43 2022] POST /identity/v3/projects => generated 375 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 19:55:43.167565 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9e5119-aed0-44a9-9ccd-865245bed1aa admin admin] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:55:43.179766 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9e5119-aed0-44a9-9ccd-865245bed1aa admin admin] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:55:43.257366 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb489bd5-5bf9-4b3b-8e8c-76be621523a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:55:43.258145 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb489bd5-5bf9-4b3b-8e8c-76be621523a2 admin admin] REQUEST_METHOD: `POST` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:55:43.258353 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb489bd5-5bf9-4b3b-8e8c-76be621523a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:55:43.258618 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb489bd5-5bf9-4b3b-8e8c-76be621523a2 admin admin] PATH_INFO: `/v3/users` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:55:43.259257 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb489bd5-5bf9-4b3b-8e8c-76be621523a2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:55:43.261268 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb489bd5-5bf9-4b3b-8e8c-76be621523a2 admin admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:55:43.287590 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 1328/2703] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Sep 13 19:55:43 2022] POST /identity/v3/users => generated 288 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 19:55:43.289038 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fad5954-0531-432a-b0f4-408fceb0ed8f admin admin] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:55:43.299570 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fad5954-0531-432a-b0f4-408fceb0ed8f admin admin] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:55:43.307523 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4e67d6-e5a4-4fcc-8b68-7e1d7247a59f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:55:43.308267 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4e67d6-e5a4-4fcc-8b68-7e1d7247a59f admin admin] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:55:43.308649 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4e67d6-e5a4-4fcc-8b68-7e1d7247a59f admin admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:55:43.310018 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4e67d6-e5a4-4fcc-8b68-7e1d7247a59f admin admin] PATH_INFO: `/v3/roles` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:55:43.311335 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee4e67d6-e5a4-4fcc-8b68-7e1d7247a59f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:55:43.313722 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee4e67d6-e5a4-4fcc-8b68-7e1d7247a59f admin admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:55:43.333986 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 1376/2704] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Sep 13 19:55:43 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 19:55:43.336412 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb489bd5-5bf9-4b3b-8e8c-76be621523a2 admin admin] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:55:43.351411 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb489bd5-5bf9-4b3b-8e8c-76be621523a2 admin admin] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:55:43.356274 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5908f3ec-cba6-40c0-b0c0-e3d0e937642f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:55:43.357041 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5908f3ec-cba6-40c0-b0c0-e3d0e937642f admin admin] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:55:43.357675 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5908f3ec-cba6-40c0-b0c0-e3d0e937642f admin admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:55:43.357675 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5908f3ec-cba6-40c0-b0c0-e3d0e937642f admin admin] PATH_INFO: `/v3/roles` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:55:43.358264 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5908f3ec-cba6-40c0-b0c0-e3d0e937642f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:55:43.359844 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5908f3ec-cba6-40c0-b0c0-e3d0e937642f admin admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:55:43.372743 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 1329/2705] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Sep 13 19:55:43 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 13 19:55:43.376672 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4e67d6-e5a4-4fcc-8b68-7e1d7247a59f admin admin] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:55:43.389484 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4e67d6-e5a4-4fcc-8b68-7e1d7247a59f admin admin] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:55:43.395958 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15258fe7-607d-48d4-866d-338fe7806bc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:55:43.398149 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15258fe7-607d-48d4-866d-338fe7806bc3 admin admin] REQUEST_METHOD: `PUT` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:55:43.398572 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15258fe7-607d-48d4-866d-338fe7806bc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:55:43.398742 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15258fe7-607d-48d4-866d-338fe7806bc3 admin admin] PATH_INFO: `/v3/projects/bba44cf96e114b9e9c3d0287b1aab83b/users/72e83a5489be40e0ba42223c641ae564/roles/a259191f6d0e46fabd9f34536bb28747` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:55:43.417062 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15258fe7-607d-48d4-866d-338fe7806bc3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bba44cf96e114b9e9c3d0287b1aab83b, user_id=72e83a5489be40e0ba42223c641ae564, role_id=a259191f6d0e46fabd9f34536bb28747)` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:55:43.419747 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15258fe7-607d-48d4-866d-338fe7806bc3 admin admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:55:43.435195 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 1377/2706] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Sep 13 19:55:43 2022] PUT /identity/v3/projects/bba44cf96e114b9e9c3d0287b1aab83b/users/72e83a5489be40e0ba42223c641ae564/roles/a259191f6d0e46fabd9f34536bb28747 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 19:55:43.440054 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed2c016-b8cd-422d-b13b-5e6aadbe846d None None] REQUEST_METHOD: `POST` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:55:43.440419 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed2c016-b8cd-422d-b13b-5e6aadbe846d None None] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:55:43.440691 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed2c016-b8cd-422d-b13b-5e6aadbe846d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:55:43.589697 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.auth.core [None req-fed2c016-b8cd-422d-b13b-5e6aadbe846d None None] MFA Rules not processed for user `7b0aed92d02344acb92a0e4aa67c3068`. Rule list: `[]` (Enabled: `True`). {{(pid=87935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:55:43.590900 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.fernet_utils [None req-fed2c016-b8cd-422d-b13b-5e6aadbe846d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:55:43.633506 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG dbcounter [-] [87935] Writing DB stats keystone:SELECT=96,keystone:DELETE=1,keystone:INSERT=3 {{(pid=87935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:55:43.656455 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 1330/2707] 10.222.0.25 () {58 vars in 958 bytes} [Tue Sep 13 19:55:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 19:55:43.668594 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15258fe7-607d-48d4-866d-338fe7806bc3 admin admin] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:55:43.670272 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.fernet_utils [None req-15258fe7-607d-48d4-866d-338fe7806bc3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:55:43.732517 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15258fe7-607d-48d4-866d-338fe7806bc3 admin admin] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:55:43.736248 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4745b2a3-cdf5-4506-9e11-e8a82686f02b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1196a96e4a404f559600b69f929ea9da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a10a4268f3c4cb29f4e00c292e2df62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:55:43.736787 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4745b2a3-cdf5-4506-9e11-e8a82686f02b service neutron] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:55:43.737067 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4745b2a3-cdf5-4506-9e11-e8a82686f02b service neutron] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:55:43.737350 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4745b2a3-cdf5-4506-9e11-e8a82686f02b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:55:43.746943 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4745b2a3-cdf5-4506-9e11-e8a82686f02b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:55:43.748386 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4745b2a3-cdf5-4506-9e11-e8a82686f02b service neutron] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:55:43.758080 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 1378/2708] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Sep 13 19:55:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 19:55:46.065490 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed2c016-b8cd-422d-b13b-5e6aadbe846d None None] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:55:46.067091 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.fernet_utils [None req-fed2c016-b8cd-422d-b13b-5e6aadbe846d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:55:46.090315 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed2c016-b8cd-422d-b13b-5e6aadbe846d None None] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:55:46.095843 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430c959b-d6aa-44ff-a3ee-95e479c5a769 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:55:46.096800 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430c959b-d6aa-44ff-a3ee-95e479c5a769 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:55:46.097260 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430c959b-d6aa-44ff-a3ee-95e479c5a769 admin admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:55:46.097722 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430c959b-d6aa-44ff-a3ee-95e479c5a769 admin admin] PATH_INFO: `/v3/users/be5b068e081949c496dfa25d574b1e81` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:55:46.099704 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-430c959b-d6aa-44ff-a3ee-95e479c5a769 admin admin] RBAC: Authorizing `identity:delete_user(user_id=be5b068e081949c496dfa25d574b1e81)` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:55:46.102756 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-430c959b-d6aa-44ff-a3ee-95e479c5a769 admin admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:55:46.200810 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.notifications [None req-430c959b-d6aa-44ff-a3ee-95e479c5a769 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'be5b068e081949c496dfa25d574b1e81'} {{(pid=87935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:55:46.220730 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.notifications [None req-430c959b-d6aa-44ff-a3ee-95e479c5a769 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'be5b068e081949c496dfa25d574b1e81'} {{(pid=87935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:55:46.242999 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.notifications [None req-430c959b-d6aa-44ff-a3ee-95e479c5a769 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'be5b068e081949c496dfa25d574b1e81'} {{(pid=87935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:55:46.244111 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.notifications [None req-430c959b-d6aa-44ff-a3ee-95e479c5a769 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'be5b068e081949c496dfa25d574b1e81'} {{(pid=87935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:55:46.245103 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.notifications [None req-430c959b-d6aa-44ff-a3ee-95e479c5a769 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'be5b068e081949c496dfa25d574b1e81'} {{(pid=87935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:55:46.266912 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 1331/2709] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Sep 13 19:55:46 2022] DELETE /identity/v3/users/be5b068e081949c496dfa25d574b1e81 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 19:55:46.272558 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3c8bf9-9cf8-44ce-bc24-bd43a4d1f404 None None] REQUEST_METHOD: `POST` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:55:46.273415 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3c8bf9-9cf8-44ce-bc24-bd43a4d1f404 None None] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:55:46.273415 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3c8bf9-9cf8-44ce-bc24-bd43a4d1f404 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:55:46.313677 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.auth.core [None req-ef3c8bf9-9cf8-44ce-bc24-bd43a4d1f404 None None] MFA Rules not processed for user `7b0aed92d02344acb92a0e4aa67c3068`. Rule list: `[]` (Enabled: `True`). {{(pid=87934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:55:46.315631 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.fernet_utils [None req-ef3c8bf9-9cf8-44ce-bc24-bd43a4d1f404 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:55:46.397697 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 1379/2710] 10.222.0.25 () {58 vars in 958 bytes} [Tue Sep 13 19:55:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 19:55:46.420643 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430c959b-d6aa-44ff-a3ee-95e479c5a769 admin admin] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:55:46.422869 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.fernet_utils [None req-430c959b-d6aa-44ff-a3ee-95e479c5a769 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:55:46.522912 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430c959b-d6aa-44ff-a3ee-95e479c5a769 admin admin] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:55:46.529206 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28d0be6-6038-4ea7-9658-fa74acc25cd0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1196a96e4a404f559600b69f929ea9da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a10a4268f3c4cb29f4e00c292e2df62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:55:46.530336 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28d0be6-6038-4ea7-9658-fa74acc25cd0 service neutron] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:55:46.530901 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28d0be6-6038-4ea7-9658-fa74acc25cd0 service neutron] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:55:46.531456 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28d0be6-6038-4ea7-9658-fa74acc25cd0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:55:46.549441 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a28d0be6-6038-4ea7-9658-fa74acc25cd0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:55:46.551770 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a28d0be6-6038-4ea7-9658-fa74acc25cd0 service neutron] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:55:46.571381 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 1332/2711] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Sep 13 19:55:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 13 19:55:47.067089 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3c8bf9-9cf8-44ce-bc24-bd43a4d1f404 None None] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:55:47.070417 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.fernet_utils [None req-ef3c8bf9-9cf8-44ce-bc24-bd43a4d1f404 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:55:47.087500 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3c8bf9-9cf8-44ce-bc24-bd43a4d1f404 None None] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:55:47.099165 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9e9f18-da00-4bbe-90c3-ceceaf1be75f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:55:47.103111 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9e9f18-da00-4bbe-90c3-ceceaf1be75f admin admin] REQUEST_METHOD: `DELETE` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:55:47.103727 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9e9f18-da00-4bbe-90c3-ceceaf1be75f admin admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:55:47.104879 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9e9f18-da00-4bbe-90c3-ceceaf1be75f admin admin] PATH_INFO: `/v3/projects/fe39852c8cdd4e80be6b0f6378a9da57` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:55:47.106505 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b9e9f18-da00-4bbe-90c3-ceceaf1be75f admin admin] RBAC: Authorizing `identity:delete_project(project_id=fe39852c8cdd4e80be6b0f6378a9da57)` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:55:47.111363 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b9e9f18-da00-4bbe-90c3-ceceaf1be75f admin admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:55:47.195936 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.notifications [None req-7b9e9f18-da00-4bbe-90c3-ceceaf1be75f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fe39852c8cdd4e80be6b0f6378a9da57', 'request_id': 'req-7b9e9f18-da00-4bbe-90c3-ceceaf1be75f'} {{(pid=87934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:55:47.204050 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.notifications [None req-7b9e9f18-da00-4bbe-90c3-ceceaf1be75f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fe39852c8cdd4e80be6b0f6378a9da57', 'request_id': 'req-7b9e9f18-da00-4bbe-90c3-ceceaf1be75f'} {{(pid=87934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:55:47.212151 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.notifications [None req-7b9e9f18-da00-4bbe-90c3-ceceaf1be75f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fe39852c8cdd4e80be6b0f6378a9da57', 'request_id': 'req-7b9e9f18-da00-4bbe-90c3-ceceaf1be75f'} {{(pid=87934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:55:47.216721 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG dbcounter [-] [87934] Writing DB stats keystone:SELECT=93,keystone:INSERT=1,keystone:DELETE=6 {{(pid=87934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:55:47.238072 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.notifications [None req-7b9e9f18-da00-4bbe-90c3-ceceaf1be75f admin admin] The token cache is being invalidate because project fe39852c8cdd4e80be6b0f6378a9da57 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87934) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 19:55:47.238379 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.notifications [None req-7b9e9f18-da00-4bbe-90c3-ceceaf1be75f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:55:47.239641 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.notifications [None req-7b9e9f18-da00-4bbe-90c3-ceceaf1be75f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:55:47.242076 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 1380/2712] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Sep 13 19:55:47 2022] DELETE /identity/v3/projects/fe39852c8cdd4e80be6b0f6378a9da57 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 19:55:47.246786 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a6e3c6-698b-4f18-b309-16aff7620a6c None None] REQUEST_METHOD: `POST` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:55:47.247654 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a6e3c6-698b-4f18-b309-16aff7620a6c None None] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:55:47.248067 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a6e3c6-698b-4f18-b309-16aff7620a6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:55:47.282154 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.auth.core [None req-73a6e3c6-698b-4f18-b309-16aff7620a6c None None] MFA Rules not processed for user `7b0aed92d02344acb92a0e4aa67c3068`. Rule list: `[]` (Enabled: `True`). {{(pid=87935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:55:47.283459 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.fernet_utils [None req-73a6e3c6-698b-4f18-b309-16aff7620a6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:55:47.359602 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG dbcounter [-] [87935] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:55:47.379227 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 1333/2713] 10.222.0.25 () {58 vars in 958 bytes} [Tue Sep 13 19:55:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 19:55:47.388371 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c80a26-37d0-4312-b03f-735d59b44421 None None] REQUEST_METHOD: `POST` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:55:47.390125 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c80a26-37d0-4312-b03f-735d59b44421 None None] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:55:47.390560 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c80a26-37d0-4312-b03f-735d59b44421 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:55:47.415930 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.auth.core [None req-f1c80a26-37d0-4312-b03f-735d59b44421 None None] MFA Rules not processed for user `7b0aed92d02344acb92a0e4aa67c3068`. Rule list: `[]` (Enabled: `True`). {{(pid=87934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:55:47.417847 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.fernet_utils [None req-f1c80a26-37d0-4312-b03f-735d59b44421 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:55:47.429329 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 1381/2714] 10.222.0.25 () {58 vars in 958 bytes} [Tue Sep 13 19:55:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 19:55:47.433708 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a6e3c6-698b-4f18-b309-16aff7620a6c None None] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:55:47.445132 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a6e3c6-698b-4f18-b309-16aff7620a6c None None] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:55:47.451422 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3051df3-f387-40d1-b914-1febc13bfcd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:55:47.452183 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3051df3-f387-40d1-b914-1febc13bfcd5 admin admin] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:55:47.452889 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3051df3-f387-40d1-b914-1febc13bfcd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:55:47.453202 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3051df3-f387-40d1-b914-1febc13bfcd5 admin admin] PATH_INFO: `/v3/domains` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:55:47.454055 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3051df3-f387-40d1-b914-1febc13bfcd5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87935) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:55:47.454357 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3051df3-f387-40d1-b914-1febc13bfcd5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:55:47.455948 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3051df3-f387-40d1-b914-1febc13bfcd5 admin admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:55:47.469171 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 1334/2715] 10.222.0.25 () {58 vars in 1153 bytes} [Tue Sep 13 19:55:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:55:47.473836 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c80a26-37d0-4312-b03f-735d59b44421 None None] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:55:47.485257 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c80a26-37d0-4312-b03f-735d59b44421 None None] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:55:47.491291 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02919ca8-8879-484d-a4bb-191726963cb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:55:47.492073 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02919ca8-8879-484d-a4bb-191726963cb5 admin admin] REQUEST_METHOD: `POST` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:55:47.492632 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02919ca8-8879-484d-a4bb-191726963cb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:55:47.493086 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02919ca8-8879-484d-a4bb-191726963cb5 admin admin] PATH_INFO: `/v3/projects` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:55:47.493792 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02919ca8-8879-484d-a4bb-191726963cb5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:55:47.495920 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02919ca8-8879-484d-a4bb-191726963cb5 admin admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:55:47.544970 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 1382/2716] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Sep 13 19:55:47 2022] POST /identity/v3/projects => generated 383 bytes in 71 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 19:55:47.555039 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3051df3-f387-40d1-b914-1febc13bfcd5 admin admin] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:55:47.569354 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3051df3-f387-40d1-b914-1febc13bfcd5 admin admin] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:55:47.674654 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da59954c-3d8e-49c9-a385-8507bc11a2f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:55:47.675570 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da59954c-3d8e-49c9-a385-8507bc11a2f5 admin admin] REQUEST_METHOD: `POST` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:55:47.675899 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da59954c-3d8e-49c9-a385-8507bc11a2f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:55:47.680337 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da59954c-3d8e-49c9-a385-8507bc11a2f5 admin admin] PATH_INFO: `/v3/users` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:55:47.681055 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da59954c-3d8e-49c9-a385-8507bc11a2f5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:55:47.685053 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da59954c-3d8e-49c9-a385-8507bc11a2f5 admin admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:55:47.727644 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 1335/2717] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Sep 13 19:55:47 2022] POST /identity/v3/users => generated 292 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 19:55:47.728971 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02919ca8-8879-484d-a4bb-191726963cb5 admin admin] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:55:47.745020 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02919ca8-8879-484d-a4bb-191726963cb5 admin admin] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:55:47.751065 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec5b325-0dda-4957-8b67-9c0279bea9f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:55:47.751697 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec5b325-0dda-4957-8b67-9c0279bea9f1 admin admin] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:55:47.752067 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec5b325-0dda-4957-8b67-9c0279bea9f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:55:47.752267 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec5b325-0dda-4957-8b67-9c0279bea9f1 admin admin] PATH_INFO: `/v3/roles` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:55:47.753070 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec5b325-0dda-4957-8b67-9c0279bea9f1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:55:47.755456 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec5b325-0dda-4957-8b67-9c0279bea9f1 admin admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:55:47.772295 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 1383/2718] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Sep 13 19:55:47 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 19:55:47.776746 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da59954c-3d8e-49c9-a385-8507bc11a2f5 admin admin] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:55:47.788106 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da59954c-3d8e-49c9-a385-8507bc11a2f5 admin admin] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:55:47.793677 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac37cec6-d165-460f-aa29-ac5cbdbd5044 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:55:47.794248 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac37cec6-d165-460f-aa29-ac5cbdbd5044 admin admin] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:55:47.794553 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac37cec6-d165-460f-aa29-ac5cbdbd5044 admin admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:55:47.794827 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac37cec6-d165-460f-aa29-ac5cbdbd5044 admin admin] PATH_INFO: `/v3/roles` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:55:47.795723 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac37cec6-d165-460f-aa29-ac5cbdbd5044 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:55:47.797677 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac37cec6-d165-460f-aa29-ac5cbdbd5044 admin admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:55:47.817585 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 1336/2719] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Sep 13 19:55:47 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 19:55:47.817841 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec5b325-0dda-4957-8b67-9c0279bea9f1 admin admin] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:55:47.829834 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec5b325-0dda-4957-8b67-9c0279bea9f1 admin admin] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:55:47.836467 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85cadf1e-6320-4abc-adb9-b626e884387c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:55:47.837211 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cadf1e-6320-4abc-adb9-b626e884387c admin admin] REQUEST_METHOD: `PUT` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:55:47.837491 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cadf1e-6320-4abc-adb9-b626e884387c admin admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:55:47.838222 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cadf1e-6320-4abc-adb9-b626e884387c admin admin] PATH_INFO: `/v3/projects/d1072243b3d74733886757072005bf5c/users/c5f7d032f9a1435da8015f29d5b2ec66/roles/a259191f6d0e46fabd9f34536bb28747` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:55:47.854727 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85cadf1e-6320-4abc-adb9-b626e884387c admin admin] RBAC: Authorizing `identity:create_grant(project_id=d1072243b3d74733886757072005bf5c, user_id=c5f7d032f9a1435da8015f29d5b2ec66, role_id=a259191f6d0e46fabd9f34536bb28747)` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:55:47.857395 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85cadf1e-6320-4abc-adb9-b626e884387c admin admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:55:47.895806 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 1384/2720] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Sep 13 19:55:47 2022] PUT /identity/v3/projects/d1072243b3d74733886757072005bf5c/users/c5f7d032f9a1435da8015f29d5b2ec66/roles/a259191f6d0e46fabd9f34536bb28747 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 19:55:47.899188 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65e9aef-aec7-43a1-aee6-a2bb1635a7a3 None None] REQUEST_METHOD: `POST` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:55:47.899480 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65e9aef-aec7-43a1-aee6-a2bb1635a7a3 None None] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:55:47.899754 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65e9aef-aec7-43a1-aee6-a2bb1635a7a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:55:47.938840 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.auth.core [None req-d65e9aef-aec7-43a1-aee6-a2bb1635a7a3 None None] MFA Rules not processed for user `c5f7d032f9a1435da8015f29d5b2ec66`. Rule list: `[]` (Enabled: `True`). {{(pid=87935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:55:47.940394 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.fernet_utils [None req-d65e9aef-aec7-43a1-aee6-a2bb1635a7a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:55:48.067497 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 1337/2721] 10.222.0.25 () {58 vars in 958 bytes} [Tue Sep 13 19:55:47 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 19:55:48.072341 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85cadf1e-6320-4abc-adb9-b626e884387c admin admin] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:55:48.175905 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85cadf1e-6320-4abc-adb9-b626e884387c admin admin] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:55:48.182117 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081ec2bf-93b3-48e5-8204-c2600f69e555 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:55:48.182742 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081ec2bf-93b3-48e5-8204-c2600f69e555 admin admin] REQUEST_METHOD: `POST` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:55:48.183023 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081ec2bf-93b3-48e5-8204-c2600f69e555 admin admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:55:48.183294 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081ec2bf-93b3-48e5-8204-c2600f69e555 admin admin] PATH_INFO: `/v3/projects` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:55:48.188769 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-081ec2bf-93b3-48e5-8204-c2600f69e555 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:55:48.191009 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-081ec2bf-93b3-48e5-8204-c2600f69e555 admin admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:55:48.254680 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 1385/2722] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Sep 13 19:55:48 2022] POST /identity/v3/projects => generated 385 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 19:55:48.259691 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65e9aef-aec7-43a1-aee6-a2bb1635a7a3 None None] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:55:48.279534 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65e9aef-aec7-43a1-aee6-a2bb1635a7a3 None None] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:55:48.352899 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG dbcounter [-] [87935] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:55:48.368250 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23956a09-1add-4c0b-a6e8-8e161dfc66e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:55:48.369395 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23956a09-1add-4c0b-a6e8-8e161dfc66e9 admin admin] REQUEST_METHOD: `POST` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:55:48.369674 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23956a09-1add-4c0b-a6e8-8e161dfc66e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:55:48.369997 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23956a09-1add-4c0b-a6e8-8e161dfc66e9 admin admin] PATH_INFO: `/v3/users` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:55:48.370645 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23956a09-1add-4c0b-a6e8-8e161dfc66e9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:55:48.374111 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23956a09-1add-4c0b-a6e8-8e161dfc66e9 admin admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:55:48.409314 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 1338/2723] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Sep 13 19:55:48 2022] POST /identity/v3/users => generated 293 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 19:55:48.413177 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081ec2bf-93b3-48e5-8204-c2600f69e555 admin admin] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:55:48.429053 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081ec2bf-93b3-48e5-8204-c2600f69e555 admin admin] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:55:48.439422 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b303f180-fd42-41cb-966d-94117f84e159 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:55:48.440171 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b303f180-fd42-41cb-966d-94117f84e159 admin admin] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:55:48.440968 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b303f180-fd42-41cb-966d-94117f84e159 admin admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:55:48.441243 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b303f180-fd42-41cb-966d-94117f84e159 admin admin] PATH_INFO: `/v3/roles` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:55:48.441905 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b303f180-fd42-41cb-966d-94117f84e159 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:55:48.445260 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b303f180-fd42-41cb-966d-94117f84e159 admin admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:55:48.462182 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 1386/2724] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Sep 13 19:55:48 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 19:55:48.466440 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23956a09-1add-4c0b-a6e8-8e161dfc66e9 admin admin] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:55:48.485170 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23956a09-1add-4c0b-a6e8-8e161dfc66e9 admin admin] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:55:48.486867 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f606a9-0067-4af9-aadf-6892369ea4aa None None] REQUEST_METHOD: `POST` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:55:48.487159 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f606a9-0067-4af9-aadf-6892369ea4aa None None] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:55:48.487432 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f606a9-0067-4af9-aadf-6892369ea4aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:55:48.497169 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b9143c-eba8-46c0-8425-efba6f1f36f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:55:48.498277 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b9143c-eba8-46c0-8425-efba6f1f36f9 admin admin] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:55:48.499688 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b9143c-eba8-46c0-8425-efba6f1f36f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:55:48.499688 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b9143c-eba8-46c0-8425-efba6f1f36f9 admin admin] PATH_INFO: `/v3/roles` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:55:48.499688 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b9143c-eba8-46c0-8425-efba6f1f36f9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:55:48.502162 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b9143c-eba8-46c0-8425-efba6f1f36f9 admin admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:55:48.515994 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 1339/2725] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Sep 13 19:55:48 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 19:55:48.519952 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b9143c-eba8-46c0-8425-efba6f1f36f9 admin admin] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:55:48.524495 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.auth.core [None req-e0f606a9-0067-4af9-aadf-6892369ea4aa None None] MFA Rules not processed for user `72e83a5489be40e0ba42223c641ae564`. Rule list: `[]` (Enabled: `True`). {{(pid=87934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:55:48.525700 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.fernet_utils [None req-e0f606a9-0067-4af9-aadf-6892369ea4aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:55:48.531721 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b9143c-eba8-46c0-8425-efba6f1f36f9 admin admin] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:55:48.536382 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817282cb-4549-4cab-ad85-00cf585cf12e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:55:48.537745 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817282cb-4549-4cab-ad85-00cf585cf12e admin admin] REQUEST_METHOD: `PUT` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:55:48.537745 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817282cb-4549-4cab-ad85-00cf585cf12e admin admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:55:48.537745 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817282cb-4549-4cab-ad85-00cf585cf12e admin admin] PATH_INFO: `/v3/projects/ad4a7ce5fe8243d28e2976aee7248e3e/users/6da71bb5368742c6b1501cdd7783f9fe/roles/a259191f6d0e46fabd9f34536bb28747` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:55:48.555061 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-817282cb-4549-4cab-ad85-00cf585cf12e admin admin] RBAC: Authorizing `identity:create_grant(project_id=ad4a7ce5fe8243d28e2976aee7248e3e, user_id=6da71bb5368742c6b1501cdd7783f9fe, role_id=a259191f6d0e46fabd9f34536bb28747)` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:55:48.557845 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-817282cb-4549-4cab-ad85-00cf585cf12e admin admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:55:48.574905 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 1340/2726] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Sep 13 19:55:48 2022] PUT /identity/v3/projects/ad4a7ce5fe8243d28e2976aee7248e3e/users/6da71bb5368742c6b1501cdd7783f9fe/roles/a259191f6d0e46fabd9f34536bb28747 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 19:55:48.586023 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b3c994-9201-40a0-aea4-3d3e9a0a36f0 None None] REQUEST_METHOD: `POST` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:55:48.586304 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b3c994-9201-40a0-aea4-3d3e9a0a36f0 None None] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:55:48.586574 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b3c994-9201-40a0-aea4-3d3e9a0a36f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:55:48.587070 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG dbcounter [-] [87934] Writing DB stats keystone:INSERT=4,keystone:DELETE=1,keystone:SELECT=95 {{(pid=87934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:55:48.609135 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 1387/2727] 10.222.0.25 () {58 vars in 958 bytes} [Tue Sep 13 19:55:48 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 19:55:48.621763 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.auth.core [None req-41b3c994-9201-40a0-aea4-3d3e9a0a36f0 None None] MFA Rules not processed for user `6da71bb5368742c6b1501cdd7783f9fe`. Rule list: `[]` (Enabled: `True`). {{(pid=87935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:55:48.623317 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.fernet_utils [None req-41b3c994-9201-40a0-aea4-3d3e9a0a36f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:55:48.624076 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f606a9-0067-4af9-aadf-6892369ea4aa None None] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:55:48.625482 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.fernet_utils [None req-e0f606a9-0067-4af9-aadf-6892369ea4aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:55:48.701238 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 1341/2728] 10.222.0.25 () {58 vars in 958 bytes} [Tue Sep 13 19:55:48 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 19:55:48.702514 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b3c994-9201-40a0-aea4-3d3e9a0a36f0 None None] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:55:48.709733 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f606a9-0067-4af9-aadf-6892369ea4aa None None] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:55:48.778391 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b3c994-9201-40a0-aea4-3d3e9a0a36f0 None None] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:55:48.783214 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1051a889-e030-4233-9670-6e1c43b3cd0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:55:48.784067 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1051a889-e030-4233-9670-6e1c43b3cd0d admin admin] REQUEST_METHOD: `POST` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:55:48.784371 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1051a889-e030-4233-9670-6e1c43b3cd0d admin admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:55:48.784639 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1051a889-e030-4233-9670-6e1c43b3cd0d admin admin] PATH_INFO: `/v3/projects` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:55:48.785287 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1051a889-e030-4233-9670-6e1c43b3cd0d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:55:48.786628 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec045c6-53c9-417a-b806-9b8fee51fa32 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd71fe5a8275f4ea98555afdcefc902a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a10a4268f3c4cb29f4e00c292e2df62', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:55:48.787982 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1051a889-e030-4233-9670-6e1c43b3cd0d admin admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:55:48.788122 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec045c6-53c9-417a-b806-9b8fee51fa32 service nova] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:55:48.788348 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec045c6-53c9-417a-b806-9b8fee51fa32 service nova] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:55:48.788518 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec045c6-53c9-417a-b806-9b8fee51fa32 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:55:48.818234 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 1342/2729] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Sep 13 19:55:48 2022] POST /identity/v3/projects => generated 385 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 19:55:48.822086 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1051a889-e030-4233-9670-6e1c43b3cd0d admin admin] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:55:48.852907 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG dbcounter [-] [87935] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=87935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:55:48.860752 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec045c6-53c9-417a-b806-9b8fee51fa32 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:55:48.862274 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec045c6-53c9-417a-b806-9b8fee51fa32 service nova] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:55:48.873431 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 1388/2730] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Sep 13 19:55:48 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 250 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 13 19:55:48.896274 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1051a889-e030-4233-9670-6e1c43b3cd0d admin admin] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:55:48.902046 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e39707a-b23d-4a6e-8ee3-e0224b24c0e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:55:48.902683 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e39707a-b23d-4a6e-8ee3-e0224b24c0e9 admin admin] REQUEST_METHOD: `POST` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:55:48.902962 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e39707a-b23d-4a6e-8ee3-e0224b24c0e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:55:48.903233 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e39707a-b23d-4a6e-8ee3-e0224b24c0e9 admin admin] PATH_INFO: `/v3/users` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:55:48.903865 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e39707a-b23d-4a6e-8ee3-e0224b24c0e9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:55:48.905798 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e39707a-b23d-4a6e-8ee3-e0224b24c0e9 admin admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:55:48.934193 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 1343/2731] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Sep 13 19:55:48 2022] POST /identity/v3/users => generated 299 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 13 19:55:48.942198 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec045c6-53c9-417a-b806-9b8fee51fa32 service nova] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:55:48.953949 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec045c6-53c9-417a-b806-9b8fee51fa32 service nova] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:55:48.959815 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4ce97f-8426-4490-958b-d1ccb47f3313 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:55:48.960609 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4ce97f-8426-4490-958b-d1ccb47f3313 admin admin] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:55:48.960921 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4ce97f-8426-4490-958b-d1ccb47f3313 admin admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:55:48.961139 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4ce97f-8426-4490-958b-d1ccb47f3313 admin admin] PATH_INFO: `/v3/roles` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:55:48.961774 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f4ce97f-8426-4490-958b-d1ccb47f3313 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:55:48.963359 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f4ce97f-8426-4490-958b-d1ccb47f3313 admin admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:55:48.978081 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 1389/2732] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Sep 13 19:55:48 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 19:55:48.982153 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e39707a-b23d-4a6e-8ee3-e0224b24c0e9 admin admin] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:55:48.995058 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e39707a-b23d-4a6e-8ee3-e0224b24c0e9 admin admin] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:55:49.001757 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7865d5ca-0ef6-414b-a416-984eecf150ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:55:49.002747 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7865d5ca-0ef6-414b-a416-984eecf150ce admin admin] REQUEST_METHOD: `PUT` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:55:49.003162 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7865d5ca-0ef6-414b-a416-984eecf150ce admin admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:55:49.003446 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7865d5ca-0ef6-414b-a416-984eecf150ce admin admin] PATH_INFO: `/v3/projects/f37579fa749745f5af25353c0a8eb723/users/d5694f060c4b4214b191d8888415a96a/roles/6ca1d4427ff64e0a9d25d96cfb1445f6` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:55:49.027666 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7865d5ca-0ef6-414b-a416-984eecf150ce admin admin] RBAC: Authorizing `identity:create_grant(project_id=f37579fa749745f5af25353c0a8eb723, user_id=d5694f060c4b4214b191d8888415a96a, role_id=6ca1d4427ff64e0a9d25d96cfb1445f6)` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:55:49.030764 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7865d5ca-0ef6-414b-a416-984eecf150ce admin admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:55:49.051456 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 1344/2733] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Sep 13 19:55:48 2022] PUT /identity/v3/projects/f37579fa749745f5af25353c0a8eb723/users/d5694f060c4b4214b191d8888415a96a/roles/6ca1d4427ff64e0a9d25d96cfb1445f6 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 19:55:49.056146 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4ce97f-8426-4490-958b-d1ccb47f3313 admin admin] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:55:49.071318 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4ce97f-8426-4490-958b-d1ccb47f3313 admin admin] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:55:49.105271 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG dbcounter [-] [87934] Writing DB stats keystone:SELECT=100 {{(pid=87934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:55:49.115347 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7865d5ca-0ef6-414b-a416-984eecf150ce admin admin] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:55:49.117972 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.fernet_utils [None req-7865d5ca-0ef6-414b-a416-984eecf150ce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:55:49.203603 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541e26ab-3bbf-4013-a3dc-76f5f24f5d9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:55:49.204959 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541e26ab-3bbf-4013-a3dc-76f5f24f5d9b admin admin] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:55:49.205445 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541e26ab-3bbf-4013-a3dc-76f5f24f5d9b admin admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:55:49.205910 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541e26ab-3bbf-4013-a3dc-76f5f24f5d9b admin admin] PATH_INFO: `/v3/roles` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:55:49.207209 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-541e26ab-3bbf-4013-a3dc-76f5f24f5d9b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:55:49.208601 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-541e26ab-3bbf-4013-a3dc-76f5f24f5d9b admin admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:55:49.234975 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 1390/2734] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Sep 13 19:55:49 2022] GET /identity/v3/roles => generated 1420 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 19:55:49.238939 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541e26ab-3bbf-4013-a3dc-76f5f24f5d9b admin admin] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:55:49.257954 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541e26ab-3bbf-4013-a3dc-76f5f24f5d9b admin admin] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:55:49.265298 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b018f470-d1c9-4e97-ba7f-d349b59602bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:55:49.266273 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b018f470-d1c9-4e97-ba7f-d349b59602bd admin admin] REQUEST_METHOD: `PUT` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:55:49.267206 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b018f470-d1c9-4e97-ba7f-d349b59602bd admin admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:55:49.267634 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b018f470-d1c9-4e97-ba7f-d349b59602bd admin admin] PATH_INFO: `/v3/projects/f37579fa749745f5af25353c0a8eb723/users/d5694f060c4b4214b191d8888415a96a/roles/6ca1d4427ff64e0a9d25d96cfb1445f6` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:55:49.270593 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b018f470-d1c9-4e97-ba7f-d349b59602bd admin admin] RBAC: Authorizing `identity:create_grant(project_id=f37579fa749745f5af25353c0a8eb723, user_id=d5694f060c4b4214b191d8888415a96a, role_id=6ca1d4427ff64e0a9d25d96cfb1445f6)` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:55:49.275787 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b018f470-d1c9-4e97-ba7f-d349b59602bd admin admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:55:49.293451 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7865d5ca-0ef6-414b-a416-984eecf150ce admin admin] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:55:49.310292 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 1391/2735] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Sep 13 19:55:49 2022] PUT /identity/v3/projects/f37579fa749745f5af25353c0a8eb723/users/d5694f060c4b4214b191d8888415a96a/roles/6ca1d4427ff64e0a9d25d96cfb1445f6 => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 19:55:49.323219 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d9b69a-b195-498f-8a45-71bce3472f5b None None] REQUEST_METHOD: `POST` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:55:49.324162 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d9b69a-b195-498f-8a45-71bce3472f5b None None] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:55:49.324560 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d9b69a-b195-498f-8a45-71bce3472f5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:55:49.360242 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.auth.core [None req-67d9b69a-b195-498f-8a45-71bce3472f5b None None] MFA Rules not processed for user `d5694f060c4b4214b191d8888415a96a`. Rule list: `[]` (Enabled: `True`). {{(pid=87934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:55:49.360242 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.fernet_utils [None req-67d9b69a-b195-498f-8a45-71bce3472f5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:55:49.391894 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a70ae29-6e90-4471-8917-2b5646804c3e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd71fe5a8275f4ea98555afdcefc902a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a10a4268f3c4cb29f4e00c292e2df62', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:55:49.392758 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a70ae29-6e90-4471-8917-2b5646804c3e service nova] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:55:49.393267 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a70ae29-6e90-4471-8917-2b5646804c3e service nova] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:55:49.395073 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a70ae29-6e90-4471-8917-2b5646804c3e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:55:49.399560 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.fernet_utils [None req-2a70ae29-6e90-4471-8917-2b5646804c3e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:55:49.413760 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a70ae29-6e90-4471-8917-2b5646804c3e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:55:49.415482 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a70ae29-6e90-4471-8917-2b5646804c3e service nova] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:55:49.427266 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 1345/2736] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Sep 13 19:55:49 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 19:55:49.481239 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 1392/2737] 10.222.0.25 () {58 vars in 958 bytes} [Tue Sep 13 19:55:49 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 19:55:49.494703 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a70ae29-6e90-4471-8917-2b5646804c3e service nova] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:55:49.495767 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.fernet_utils [None req-2a70ae29-6e90-4471-8917-2b5646804c3e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:55:49.545340 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG dbcounter [-] [87935] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=87935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:55:49.628727 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a70ae29-6e90-4471-8917-2b5646804c3e service nova] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:55:49.634570 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d2680e-c926-4f50-a530-2c258e460cab service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cbb50c88b794a7f9f26844effde7d63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a10a4268f3c4cb29f4e00c292e2df62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:55:49.635350 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d2680e-c926-4f50-a530-2c258e460cab service cinder] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:55:49.635868 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d2680e-c926-4f50-a530-2c258e460cab service cinder] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:55:49.636299 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d2680e-c926-4f50-a530-2c258e460cab service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:55:49.716836 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d2680e-c926-4f50-a530-2c258e460cab service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:55:49.718456 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d2680e-c926-4f50-a530-2c258e460cab service cinder] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:55:49.734545 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 1346/2738] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Sep 13 19:55:49 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 241 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 19:55:50.673883 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f450d462-18e7-4acc-b282-5a4083f4aa0a None None] REQUEST_METHOD: `POST` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:55:50.674864 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f450d462-18e7-4acc-b282-5a4083f4aa0a None None] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:55:50.675292 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f450d462-18e7-4acc-b282-5a4083f4aa0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:55:50.704955 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.auth.core [None req-f450d462-18e7-4acc-b282-5a4083f4aa0a None None] MFA Rules not processed for user `72e83a5489be40e0ba42223c641ae564`. Rule list: `[]` (Enabled: `True`). {{(pid=87934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:55:50.716086 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.fernet_utils [None req-f450d462-18e7-4acc-b282-5a4083f4aa0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:55:50.807379 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 1393/2739] 10.222.0.25 () {58 vars in 958 bytes} [Tue Sep 13 19:55:50 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 19:55:51.356072 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d2680e-c926-4f50-a530-2c258e460cab service cinder] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:55:51.357577 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.fernet_utils [None req-66d2680e-c926-4f50-a530-2c258e460cab service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:55:51.369212 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d2680e-c926-4f50-a530-2c258e460cab service cinder] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:55:51.372855 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2742cb12-c69c-4193-bef4-e0caf781ca34 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cbb50c88b794a7f9f26844effde7d63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a10a4268f3c4cb29f4e00c292e2df62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:55:51.373456 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2742cb12-c69c-4193-bef4-e0caf781ca34 service cinder] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:55:51.373733 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2742cb12-c69c-4193-bef4-e0caf781ca34 service cinder] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:55:51.373999 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2742cb12-c69c-4193-bef4-e0caf781ca34 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:55:51.456098 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2742cb12-c69c-4193-bef4-e0caf781ca34 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:55:51.457632 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2742cb12-c69c-4193-bef4-e0caf781ca34 service cinder] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:55:51.469174 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 1347/2740] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Sep 13 19:55:51 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 19:55:52.240176 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f450d462-18e7-4acc-b282-5a4083f4aa0a None None] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:55:52.254677 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f450d462-18e7-4acc-b282-5a4083f4aa0a None None] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:55:52.265516 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92fa8dff-3386-49f4-9330-a9ca857b59d0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cbb50c88b794a7f9f26844effde7d63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a10a4268f3c4cb29f4e00c292e2df62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:55:52.266249 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fa8dff-3386-49f4-9330-a9ca857b59d0 service cinder] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:55:52.266532 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fa8dff-3386-49f4-9330-a9ca857b59d0 service cinder] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:55:52.266801 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fa8dff-3386-49f4-9330-a9ca857b59d0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:55:52.292673 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92fa8dff-3386-49f4-9330-a9ca857b59d0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:55:52.313186 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92fa8dff-3386-49f4-9330-a9ca857b59d0 service cinder] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:55:52.337814 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 1394/2741] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Sep 13 19:55:52 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 19:55:55.460301 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42d1ba0-6772-426c-af03-4e6b0c9903f2 None None] REQUEST_METHOD: `POST` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:55:55.460895 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42d1ba0-6772-426c-af03-4e6b0c9903f2 None None] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:55:55.461153 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42d1ba0-6772-426c-af03-4e6b0c9903f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:55:55.481993 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.auth.core [None req-a42d1ba0-6772-426c-af03-4e6b0c9903f2 None None] MFA Rules not processed for user `7b0aed92d02344acb92a0e4aa67c3068`. Rule list: `[]` (Enabled: `True`). {{(pid=87935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:55:55.482942 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.fernet_utils [None req-a42d1ba0-6772-426c-af03-4e6b0c9903f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:55:55.546320 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 1348/2742] 10.222.0.57 () {58 vars in 1016 bytes} [Tue Sep 13 19:55:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 19:55:55.564168 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92fa8dff-3386-49f4-9330-a9ca857b59d0 service cinder] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:55:55.580741 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92fa8dff-3386-49f4-9330-a9ca857b59d0 service cinder] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:55:55.587868 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083e6627-734f-44ce-a46c-02aeff239f84 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd71fe5a8275f4ea98555afdcefc902a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a10a4268f3c4cb29f4e00c292e2df62', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:55:55.588663 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083e6627-734f-44ce-a46c-02aeff239f84 service nova] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:55:55.589034 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083e6627-734f-44ce-a46c-02aeff239f84 service nova] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:55:55.589461 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083e6627-734f-44ce-a46c-02aeff239f84 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:55:55.600310 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-083e6627-734f-44ce-a46c-02aeff239f84 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:55:55.601915 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-083e6627-734f-44ce-a46c-02aeff239f84 service nova] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:55:55.612327 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 1395/2743] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Sep 13 19:55:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 19:55:56.485079 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42d1ba0-6772-426c-af03-4e6b0c9903f2 None None] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:55:56.495534 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42d1ba0-6772-426c-af03-4e6b0c9903f2 None None] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:55:56.500059 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98fdfb06-11a4-4e56-8eb5-2f00dd966bb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:55:56.500715 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fdfb06-11a4-4e56-8eb5-2f00dd966bb9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:55:56.500995 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fdfb06-11a4-4e56-8eb5-2f00dd966bb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:55:56.501264 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fdfb06-11a4-4e56-8eb5-2f00dd966bb9 admin admin] PATH_INFO: `/v3/users/c5f7d032f9a1435da8015f29d5b2ec66` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:55:56.502375 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98fdfb06-11a4-4e56-8eb5-2f00dd966bb9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c5f7d032f9a1435da8015f29d5b2ec66)` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:55:56.504311 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98fdfb06-11a4-4e56-8eb5-2f00dd966bb9 admin admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:55:56.506733 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG dbcounter [-] [87935] Writing DB stats keystone:SELECT=100 {{(pid=87935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:55:56.551570 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.notifications [None req-98fdfb06-11a4-4e56-8eb5-2f00dd966bb9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c5f7d032f9a1435da8015f29d5b2ec66'} {{(pid=87935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:55:56.560490 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.notifications [None req-98fdfb06-11a4-4e56-8eb5-2f00dd966bb9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c5f7d032f9a1435da8015f29d5b2ec66'} {{(pid=87935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:55:56.573415 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.notifications [None req-98fdfb06-11a4-4e56-8eb5-2f00dd966bb9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c5f7d032f9a1435da8015f29d5b2ec66'} {{(pid=87935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:55:56.574095 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.notifications [None req-98fdfb06-11a4-4e56-8eb5-2f00dd966bb9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c5f7d032f9a1435da8015f29d5b2ec66'} {{(pid=87935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:55:56.574694 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.notifications [None req-98fdfb06-11a4-4e56-8eb5-2f00dd966bb9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c5f7d032f9a1435da8015f29d5b2ec66'} {{(pid=87935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:55:56.587514 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 1349/2744] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Sep 13 19:55:56 2022] DELETE /identity/v3/users/c5f7d032f9a1435da8015f29d5b2ec66 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 19:55:56.591989 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bb45ab-f93a-42b6-8c91-751be9c1c6c4 None None] REQUEST_METHOD: `POST` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:55:56.592514 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bb45ab-f93a-42b6-8c91-751be9c1c6c4 None None] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:55:56.592800 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bb45ab-f93a-42b6-8c91-751be9c1c6c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:55:56.599975 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG dbcounter [-] [87934] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:55:56.614482 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.auth.core [None req-86bb45ab-f93a-42b6-8c91-751be9c1c6c4 None None] MFA Rules not processed for user `7b0aed92d02344acb92a0e4aa67c3068`. Rule list: `[]` (Enabled: `True`). {{(pid=87934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:55:56.616356 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.fernet_utils [None req-86bb45ab-f93a-42b6-8c91-751be9c1c6c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:55:56.686034 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 1396/2745] 10.222.0.25 () {58 vars in 958 bytes} [Tue Sep 13 19:55:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 19:55:56.696894 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98fdfb06-11a4-4e56-8eb5-2f00dd966bb9 admin admin] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:55:56.698311 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.fernet_utils [None req-98fdfb06-11a4-4e56-8eb5-2f00dd966bb9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:55:56.756619 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98fdfb06-11a4-4e56-8eb5-2f00dd966bb9 admin admin] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:55:56.760377 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db82a54-2b5f-4372-98ba-2fb2c9d0dd57 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1196a96e4a404f559600b69f929ea9da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a10a4268f3c4cb29f4e00c292e2df62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:55:56.760981 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db82a54-2b5f-4372-98ba-2fb2c9d0dd57 service neutron] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:55:56.761258 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db82a54-2b5f-4372-98ba-2fb2c9d0dd57 service neutron] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:55:56.761525 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db82a54-2b5f-4372-98ba-2fb2c9d0dd57 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:55:56.770828 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db82a54-2b5f-4372-98ba-2fb2c9d0dd57 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:55:56.772320 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db82a54-2b5f-4372-98ba-2fb2c9d0dd57 service neutron] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:55:56.781878 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 1350/2746] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Sep 13 19:55:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 19:55:57.641876 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86bb45ab-f93a-42b6-8c91-751be9c1c6c4 None None] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:55:57.643378 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.fernet_utils [None req-86bb45ab-f93a-42b6-8c91-751be9c1c6c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:55:57.656911 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86bb45ab-f93a-42b6-8c91-751be9c1c6c4 None None] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:55:57.661910 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60c8bc0-dec1-46b1-ba79-b7eab01e8da7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:55:57.662582 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60c8bc0-dec1-46b1-ba79-b7eab01e8da7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:55:57.662865 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60c8bc0-dec1-46b1-ba79-b7eab01e8da7 admin admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:55:57.663135 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60c8bc0-dec1-46b1-ba79-b7eab01e8da7 admin admin] PATH_INFO: `/v3/projects/d1072243b3d74733886757072005bf5c` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:55:57.664353 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a60c8bc0-dec1-46b1-ba79-b7eab01e8da7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d1072243b3d74733886757072005bf5c)` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:55:57.666288 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a60c8bc0-dec1-46b1-ba79-b7eab01e8da7 admin admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:55:57.724469 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.notifications [None req-a60c8bc0-dec1-46b1-ba79-b7eab01e8da7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd1072243b3d74733886757072005bf5c', 'request_id': 'req-a60c8bc0-dec1-46b1-ba79-b7eab01e8da7'} {{(pid=87934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:55:57.731183 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.notifications [None req-a60c8bc0-dec1-46b1-ba79-b7eab01e8da7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd1072243b3d74733886757072005bf5c', 'request_id': 'req-a60c8bc0-dec1-46b1-ba79-b7eab01e8da7'} {{(pid=87934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:55:57.736928 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.notifications [None req-a60c8bc0-dec1-46b1-ba79-b7eab01e8da7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd1072243b3d74733886757072005bf5c', 'request_id': 'req-a60c8bc0-dec1-46b1-ba79-b7eab01e8da7'} {{(pid=87934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:55:57.750352 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.notifications [None req-a60c8bc0-dec1-46b1-ba79-b7eab01e8da7 admin admin] The token cache is being invalidate because project d1072243b3d74733886757072005bf5c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87934) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 19:55:57.750688 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.notifications [None req-a60c8bc0-dec1-46b1-ba79-b7eab01e8da7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:55:57.751349 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.notifications [None req-a60c8bc0-dec1-46b1-ba79-b7eab01e8da7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:55:57.752913 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 1397/2747] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Sep 13 19:55:57 2022] DELETE /identity/v3/projects/d1072243b3d74733886757072005bf5c => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 19:55:57.757672 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db82a54-2b5f-4372-98ba-2fb2c9d0dd57 service neutron] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:55:57.767754 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db82a54-2b5f-4372-98ba-2fb2c9d0dd57 service neutron] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:55:57.825885 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4f6e31-7f5a-4c19-9165-c4ba06168cfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:55:57.826402 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4f6e31-7f5a-4c19-9165-c4ba06168cfe admin admin] REQUEST_METHOD: `DELETE` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:55:57.826681 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4f6e31-7f5a-4c19-9165-c4ba06168cfe admin admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:55:57.826936 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4f6e31-7f5a-4c19-9165-c4ba06168cfe admin admin] PATH_INFO: `/v3/users/6da71bb5368742c6b1501cdd7783f9fe` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:55:57.828324 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f4f6e31-7f5a-4c19-9165-c4ba06168cfe admin admin] RBAC: Authorizing `identity:delete_user(user_id=6da71bb5368742c6b1501cdd7783f9fe)` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:55:57.830232 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f4f6e31-7f5a-4c19-9165-c4ba06168cfe admin admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:55:57.854318 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG dbcounter [-] [87935] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=87935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:55:57.880195 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.notifications [None req-0f4f6e31-7f5a-4c19-9165-c4ba06168cfe admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6da71bb5368742c6b1501cdd7783f9fe'} {{(pid=87935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:55:57.893163 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.notifications [None req-0f4f6e31-7f5a-4c19-9165-c4ba06168cfe admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6da71bb5368742c6b1501cdd7783f9fe'} {{(pid=87935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:55:57.907403 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.notifications [None req-0f4f6e31-7f5a-4c19-9165-c4ba06168cfe admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6da71bb5368742c6b1501cdd7783f9fe'} {{(pid=87935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:55:57.908126 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.notifications [None req-0f4f6e31-7f5a-4c19-9165-c4ba06168cfe admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6da71bb5368742c6b1501cdd7783f9fe'} {{(pid=87935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:55:57.908900 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.notifications [None req-0f4f6e31-7f5a-4c19-9165-c4ba06168cfe admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6da71bb5368742c6b1501cdd7783f9fe'} {{(pid=87935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:55:57.921605 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 1351/2748] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Sep 13 19:55:57 2022] DELETE /identity/v3/users/6da71bb5368742c6b1501cdd7783f9fe => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 19:55:58.223878 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60c8bc0-dec1-46b1-ba79-b7eab01e8da7 admin admin] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:55:58.227065 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.fernet_utils [None req-a60c8bc0-dec1-46b1-ba79-b7eab01e8da7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:55:58.245176 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60c8bc0-dec1-46b1-ba79-b7eab01e8da7 admin admin] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:55:58.319685 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7867d21e-147f-4571-9e47-ab82b13b120f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:55:58.320852 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7867d21e-147f-4571-9e47-ab82b13b120f admin admin] REQUEST_METHOD: `DELETE` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:55:58.322230 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7867d21e-147f-4571-9e47-ab82b13b120f admin admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:55:58.322725 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7867d21e-147f-4571-9e47-ab82b13b120f admin admin] PATH_INFO: `/v3/projects/ad4a7ce5fe8243d28e2976aee7248e3e` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:55:58.324821 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7867d21e-147f-4571-9e47-ab82b13b120f admin admin] RBAC: Authorizing `identity:delete_project(project_id=ad4a7ce5fe8243d28e2976aee7248e3e)` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:55:58.328988 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7867d21e-147f-4571-9e47-ab82b13b120f admin admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:55:58.373225 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG dbcounter [-] [87934] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=87934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:55:58.397608 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.notifications [None req-7867d21e-147f-4571-9e47-ab82b13b120f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ad4a7ce5fe8243d28e2976aee7248e3e', 'request_id': 'req-7867d21e-147f-4571-9e47-ab82b13b120f'} {{(pid=87934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:55:58.404052 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.notifications [None req-7867d21e-147f-4571-9e47-ab82b13b120f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ad4a7ce5fe8243d28e2976aee7248e3e', 'request_id': 'req-7867d21e-147f-4571-9e47-ab82b13b120f'} {{(pid=87934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:55:58.411215 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.notifications [None req-7867d21e-147f-4571-9e47-ab82b13b120f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ad4a7ce5fe8243d28e2976aee7248e3e', 'request_id': 'req-7867d21e-147f-4571-9e47-ab82b13b120f'} {{(pid=87934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:55:58.428603 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.notifications [None req-7867d21e-147f-4571-9e47-ab82b13b120f admin admin] The token cache is being invalidate because project ad4a7ce5fe8243d28e2976aee7248e3e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87934) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 19:55:58.428953 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.notifications [None req-7867d21e-147f-4571-9e47-ab82b13b120f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:55:58.429642 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.notifications [None req-7867d21e-147f-4571-9e47-ab82b13b120f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:55:58.431168 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 1398/2749] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Sep 13 19:55:58 2022] DELETE /identity/v3/projects/ad4a7ce5fe8243d28e2976aee7248e3e => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 19:55:58.435156 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4f6e31-7f5a-4c19-9165-c4ba06168cfe admin admin] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:55:58.436691 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.fernet_utils [None req-0f4f6e31-7f5a-4c19-9165-c4ba06168cfe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:55:58.452526 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4f6e31-7f5a-4c19-9165-c4ba06168cfe admin admin] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:55:58.522717 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d908bcde-5b09-45a7-a49c-14f5880f4f0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:55:58.523650 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d908bcde-5b09-45a7-a49c-14f5880f4f0f admin admin] REQUEST_METHOD: `DELETE` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:55:58.523929 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d908bcde-5b09-45a7-a49c-14f5880f4f0f admin admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:55:58.524232 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d908bcde-5b09-45a7-a49c-14f5880f4f0f admin admin] PATH_INFO: `/v3/users/d5694f060c4b4214b191d8888415a96a` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:55:58.525399 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d908bcde-5b09-45a7-a49c-14f5880f4f0f admin admin] RBAC: Authorizing `identity:delete_user(user_id=d5694f060c4b4214b191d8888415a96a)` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:55:58.527323 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d908bcde-5b09-45a7-a49c-14f5880f4f0f admin admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:55:58.587473 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.notifications [None req-d908bcde-5b09-45a7-a49c-14f5880f4f0f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd5694f060c4b4214b191d8888415a96a'} {{(pid=87935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:55:58.598554 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.notifications [None req-d908bcde-5b09-45a7-a49c-14f5880f4f0f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd5694f060c4b4214b191d8888415a96a'} {{(pid=87935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:55:58.631208 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.notifications [None req-d908bcde-5b09-45a7-a49c-14f5880f4f0f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd5694f060c4b4214b191d8888415a96a'} {{(pid=87935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:55:58.632325 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.notifications [None req-d908bcde-5b09-45a7-a49c-14f5880f4f0f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd5694f060c4b4214b191d8888415a96a'} {{(pid=87935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:55:58.633840 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.notifications [None req-d908bcde-5b09-45a7-a49c-14f5880f4f0f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd5694f060c4b4214b191d8888415a96a'} {{(pid=87935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:55:58.654339 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 1352/2750] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Sep 13 19:55:58 2022] DELETE /identity/v3/users/d5694f060c4b4214b191d8888415a96a => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 19:55:58.767115 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5755818e-22d4-4b1a-b9d7-5fb012b948eb None None] REQUEST_METHOD: `POST` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:55:58.767676 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5755818e-22d4-4b1a-b9d7-5fb012b948eb None None] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:55:58.768540 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5755818e-22d4-4b1a-b9d7-5fb012b948eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:55:58.810034 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.auth.core [None req-5755818e-22d4-4b1a-b9d7-5fb012b948eb None None] MFA Rules not processed for user `7b0aed92d02344acb92a0e4aa67c3068`. Rule list: `[]` (Enabled: `True`). {{(pid=87934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:55:58.816906 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.fernet_utils [None req-5755818e-22d4-4b1a-b9d7-5fb012b948eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:55:58.951559 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 1399/2751] 10.222.0.57 () {58 vars in 1016 bytes} [Tue Sep 13 19:55:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 19:55:58.966060 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d908bcde-5b09-45a7-a49c-14f5880f4f0f admin admin] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:55:58.967675 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.fernet_utils [None req-d908bcde-5b09-45a7-a49c-14f5880f4f0f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:55:59.004867 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG dbcounter [-] [87935] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=87935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:55:59.084367 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d908bcde-5b09-45a7-a49c-14f5880f4f0f admin admin] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:55:59.091197 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8cd6ea5-0b66-4443-b6b2-4e5a117fc2d1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd71fe5a8275f4ea98555afdcefc902a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a10a4268f3c4cb29f4e00c292e2df62', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:55:59.092033 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8cd6ea5-0b66-4443-b6b2-4e5a117fc2d1 service nova] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:55:59.092484 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8cd6ea5-0b66-4443-b6b2-4e5a117fc2d1 service nova] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:55:59.092857 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8cd6ea5-0b66-4443-b6b2-4e5a117fc2d1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:55:59.104588 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8cd6ea5-0b66-4443-b6b2-4e5a117fc2d1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:55:59.106314 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8cd6ea5-0b66-4443-b6b2-4e5a117fc2d1 service nova] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:55:59.131872 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 1353/2752] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Sep 13 19:55:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 19:55:59.199271 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5755818e-22d4-4b1a-b9d7-5fb012b948eb None None] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:55:59.203323 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.fernet_utils [None req-5755818e-22d4-4b1a-b9d7-5fb012b948eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:55:59.227949 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5755818e-22d4-4b1a-b9d7-5fb012b948eb None None] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:55:59.235016 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70251a00-5e1f-42e9-831e-c141eec5efc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:55:59.235609 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70251a00-5e1f-42e9-831e-c141eec5efc9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:55:59.235886 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70251a00-5e1f-42e9-831e-c141eec5efc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:55:59.236278 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70251a00-5e1f-42e9-831e-c141eec5efc9 admin admin] PATH_INFO: `/v3/projects/f37579fa749745f5af25353c0a8eb723` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:55:59.237328 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70251a00-5e1f-42e9-831e-c141eec5efc9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f37579fa749745f5af25353c0a8eb723)` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:55:59.239379 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70251a00-5e1f-42e9-831e-c141eec5efc9 admin admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:55:59.293409 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.notifications [None req-70251a00-5e1f-42e9-831e-c141eec5efc9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f37579fa749745f5af25353c0a8eb723', 'request_id': 'req-70251a00-5e1f-42e9-831e-c141eec5efc9'} {{(pid=87934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:55:59.300787 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.notifications [None req-70251a00-5e1f-42e9-831e-c141eec5efc9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f37579fa749745f5af25353c0a8eb723', 'request_id': 'req-70251a00-5e1f-42e9-831e-c141eec5efc9'} {{(pid=87934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:55:59.309014 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.notifications [None req-70251a00-5e1f-42e9-831e-c141eec5efc9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f37579fa749745f5af25353c0a8eb723', 'request_id': 'req-70251a00-5e1f-42e9-831e-c141eec5efc9'} {{(pid=87934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:55:59.327085 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.notifications [None req-70251a00-5e1f-42e9-831e-c141eec5efc9 admin admin] The token cache is being invalidate because project f37579fa749745f5af25353c0a8eb723 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87934) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 19:55:59.327846 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.notifications [None req-70251a00-5e1f-42e9-831e-c141eec5efc9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:55:59.328913 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.notifications [None req-70251a00-5e1f-42e9-831e-c141eec5efc9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:55:59.331491 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 1400/2753] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Sep 13 19:55:59 2022] DELETE /identity/v3/projects/f37579fa749745f5af25353c0a8eb723 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 19:55:59.338515 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25dbd49f-f80a-403f-b81e-dd6d53b57fb8 None None] REQUEST_METHOD: `POST` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:55:59.338889 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25dbd49f-f80a-403f-b81e-dd6d53b57fb8 None None] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:55:59.339164 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25dbd49f-f80a-403f-b81e-dd6d53b57fb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:55:59.360005 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.auth.core [None req-25dbd49f-f80a-403f-b81e-dd6d53b57fb8 None None] MFA Rules not processed for user `7b0aed92d02344acb92a0e4aa67c3068`. Rule list: `[]` (Enabled: `True`). {{(pid=87935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:55:59.361564 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.fernet_utils [None req-25dbd49f-f80a-403f-b81e-dd6d53b57fb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:55:59.424711 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 1354/2754] 10.222.0.25 () {58 vars in 958 bytes} [Tue Sep 13 19:55:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 19:55:59.491677 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3138d78-c00f-4d9f-ba64-10942bb397c1 None None] REQUEST_METHOD: `POST` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:55:59.491953 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3138d78-c00f-4d9f-ba64-10942bb397c1 None None] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:55:59.492239 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3138d78-c00f-4d9f-ba64-10942bb397c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:55:59.515124 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.auth.core [None req-d3138d78-c00f-4d9f-ba64-10942bb397c1 None None] MFA Rules not processed for user `7b0aed92d02344acb92a0e4aa67c3068`. Rule list: `[]` (Enabled: `True`). {{(pid=87934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:55:59.516364 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.fernet_utils [None req-d3138d78-c00f-4d9f-ba64-10942bb397c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:55:59.524615 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 1401/2755] 10.222.0.25 () {58 vars in 958 bytes} [Tue Sep 13 19:55:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 19:55:59.529056 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25dbd49f-f80a-403f-b81e-dd6d53b57fb8 None None] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:55:59.539110 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25dbd49f-f80a-403f-b81e-dd6d53b57fb8 None None] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:55:59.543821 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4af6d1-e234-4ec6-879e-1b9022b54ceb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:55:59.544454 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4af6d1-e234-4ec6-879e-1b9022b54ceb admin admin] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:55:59.544730 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4af6d1-e234-4ec6-879e-1b9022b54ceb admin admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:55:59.544999 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4af6d1-e234-4ec6-879e-1b9022b54ceb admin admin] PATH_INFO: `/v3/domains` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:55:59.545637 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c4af6d1-e234-4ec6-879e-1b9022b54ceb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87935) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:55:59.545942 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c4af6d1-e234-4ec6-879e-1b9022b54ceb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:55:59.547548 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c4af6d1-e234-4ec6-879e-1b9022b54ceb admin admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:55:59.560688 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 1355/2756] 10.222.0.25 () {58 vars in 1153 bytes} [Tue Sep 13 19:55:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:55:59.565381 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3138d78-c00f-4d9f-ba64-10942bb397c1 None None] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:55:59.576140 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3138d78-c00f-4d9f-ba64-10942bb397c1 None None] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:55:59.581351 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476d1440-e419-4940-a5b7-e4c280b49e4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:55:59.581972 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476d1440-e419-4940-a5b7-e4c280b49e4a admin admin] REQUEST_METHOD: `POST` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:55:59.582249 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476d1440-e419-4940-a5b7-e4c280b49e4a admin admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:55:59.582520 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476d1440-e419-4940-a5b7-e4c280b49e4a admin admin] PATH_INFO: `/v3/projects` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:55:59.583160 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-476d1440-e419-4940-a5b7-e4c280b49e4a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:55:59.585455 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-476d1440-e419-4940-a5b7-e4c280b49e4a admin admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:55:59.614633 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 1402/2757] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Sep 13 19:55:59 2022] POST /identity/v3/projects => generated 363 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 19:55:59.619556 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4af6d1-e234-4ec6-879e-1b9022b54ceb admin admin] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:55:59.629859 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4af6d1-e234-4ec6-879e-1b9022b54ceb admin admin] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:55:59.694373 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5423b696-0614-4e01-9cc6-0de2ce33570b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:55:59.695336 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5423b696-0614-4e01-9cc6-0de2ce33570b admin admin] REQUEST_METHOD: `POST` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:55:59.695822 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5423b696-0614-4e01-9cc6-0de2ce33570b admin admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:55:59.696355 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5423b696-0614-4e01-9cc6-0de2ce33570b admin admin] PATH_INFO: `/v3/users` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:55:59.697500 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5423b696-0614-4e01-9cc6-0de2ce33570b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:55:59.701086 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5423b696-0614-4e01-9cc6-0de2ce33570b admin admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:55:59.726252 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 1356/2758] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Sep 13 19:55:59 2022] POST /identity/v3/users => generated 282 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 19:55:59.730693 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476d1440-e419-4940-a5b7-e4c280b49e4a admin admin] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:55:59.741522 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476d1440-e419-4940-a5b7-e4c280b49e4a admin admin] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:55:59.746375 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476cc41d-a57d-4bea-a368-81a88f30ff72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:55:59.746970 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476cc41d-a57d-4bea-a368-81a88f30ff72 admin admin] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:55:59.747244 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476cc41d-a57d-4bea-a368-81a88f30ff72 admin admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:55:59.747507 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476cc41d-a57d-4bea-a368-81a88f30ff72 admin admin] PATH_INFO: `/v3/roles` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:55:59.748138 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-476cc41d-a57d-4bea-a368-81a88f30ff72 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:55:59.749933 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-476cc41d-a57d-4bea-a368-81a88f30ff72 admin admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:55:59.755939 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG dbcounter [-] [87934] Writing DB stats keystone:SELECT=85,keystone:DELETE=12,keystone:INSERT=3 {{(pid=87934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:55:59.762797 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 1403/2759] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Sep 13 19:55:59 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 19:55:59.766295 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5423b696-0614-4e01-9cc6-0de2ce33570b admin admin] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:55:59.777421 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5423b696-0614-4e01-9cc6-0de2ce33570b admin admin] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:55:59.782302 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf77704-7acf-4365-a3fd-d3aa36244e13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:55:59.782897 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf77704-7acf-4365-a3fd-d3aa36244e13 admin admin] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:55:59.783170 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf77704-7acf-4365-a3fd-d3aa36244e13 admin admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:55:59.783435 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf77704-7acf-4365-a3fd-d3aa36244e13 admin admin] PATH_INFO: `/v3/roles` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:55:59.784094 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf77704-7acf-4365-a3fd-d3aa36244e13 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:55:59.785759 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf77704-7acf-4365-a3fd-d3aa36244e13 admin admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:55:59.797807 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 1357/2760] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Sep 13 19:55:59 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 13 19:55:59.802412 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476cc41d-a57d-4bea-a368-81a88f30ff72 admin admin] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:55:59.812845 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476cc41d-a57d-4bea-a368-81a88f30ff72 admin admin] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:55:59.817547 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dabb97b0-e709-4ee2-8145-53a6a9000782 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:55:59.818711 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabb97b0-e709-4ee2-8145-53a6a9000782 admin admin] REQUEST_METHOD: `PUT` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:55:59.819011 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabb97b0-e709-4ee2-8145-53a6a9000782 admin admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:55:59.819445 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabb97b0-e709-4ee2-8145-53a6a9000782 admin admin] PATH_INFO: `/v3/projects/9768b7202daf41aabd8407153bdb9e00/users/4eafd8081cdb42038ea3401088226959/roles/a259191f6d0e46fabd9f34536bb28747` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:55:59.835702 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dabb97b0-e709-4ee2-8145-53a6a9000782 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9768b7202daf41aabd8407153bdb9e00, user_id=4eafd8081cdb42038ea3401088226959, role_id=a259191f6d0e46fabd9f34536bb28747)` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:55:59.838395 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dabb97b0-e709-4ee2-8145-53a6a9000782 admin admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:55:59.852228 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 1404/2761] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Sep 13 19:55:59 2022] PUT /identity/v3/projects/9768b7202daf41aabd8407153bdb9e00/users/4eafd8081cdb42038ea3401088226959/roles/a259191f6d0e46fabd9f34536bb28747 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 19:55:59.862552 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ee3f27-91d5-4936-b709-410a2086f997 None None] REQUEST_METHOD: `POST` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:55:59.862836 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ee3f27-91d5-4936-b709-410a2086f997 None None] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:55:59.863109 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ee3f27-91d5-4936-b709-410a2086f997 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:55:59.885226 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG dbcounter [-] [87935] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:55:59.894332 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.auth.core [None req-95ee3f27-91d5-4936-b709-410a2086f997 None None] MFA Rules not processed for user `4eafd8081cdb42038ea3401088226959`. Rule list: `[]` (Enabled: `True`). {{(pid=87935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:55:59.895961 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.fernet_utils [None req-95ee3f27-91d5-4936-b709-410a2086f997 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:55:59.973173 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 1358/2762] 10.222.0.25 () {58 vars in 958 bytes} [Tue Sep 13 19:55:59 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 19:55:59.985540 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dabb97b0-e709-4ee2-8145-53a6a9000782 admin admin] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:55:59.987244 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.fernet_utils [None req-dabb97b0-e709-4ee2-8145-53a6a9000782 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:56:00.054770 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dabb97b0-e709-4ee2-8145-53a6a9000782 admin admin] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:56:00.058512 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9e3e1a-6b2d-4df7-9722-28a0881ad16e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cbb50c88b794a7f9f26844effde7d63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a10a4268f3c4cb29f4e00c292e2df62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:56:00.059123 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9e3e1a-6b2d-4df7-9722-28a0881ad16e service cinder] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:56:00.059400 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9e3e1a-6b2d-4df7-9722-28a0881ad16e service cinder] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:56:00.059669 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9e3e1a-6b2d-4df7-9722-28a0881ad16e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:56:00.069055 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff9e3e1a-6b2d-4df7-9722-28a0881ad16e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:56:00.070515 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff9e3e1a-6b2d-4df7-9722-28a0881ad16e service cinder] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:56:00.080136 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 1405/2763] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Sep 13 19:55:59 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 19:56:01.888382 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83185ab5-a560-4c59-8ee1-6cf8bae91bf9 None None] REQUEST_METHOD: `POST` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:56:01.889190 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83185ab5-a560-4c59-8ee1-6cf8bae91bf9 None None] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:56:01.889190 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83185ab5-a560-4c59-8ee1-6cf8bae91bf9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:56:01.911750 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.auth.core [None req-83185ab5-a560-4c59-8ee1-6cf8bae91bf9 None None] MFA Rules not processed for user `7b0aed92d02344acb92a0e4aa67c3068`. Rule list: `[]` (Enabled: `True`). {{(pid=87935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:56:01.913745 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.fernet_utils [None req-83185ab5-a560-4c59-8ee1-6cf8bae91bf9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:56:01.995144 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 1359/2764] 10.222.0.57 () {58 vars in 1016 bytes} [Tue Sep 13 19:56:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 19:56:02.029998 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9e3e1a-6b2d-4df7-9722-28a0881ad16e service cinder] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:56:02.031721 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.fernet_utils [None req-ff9e3e1a-6b2d-4df7-9722-28a0881ad16e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:56:02.140971 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9e3e1a-6b2d-4df7-9722-28a0881ad16e service cinder] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:56:02.158568 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28487a5-417e-4873-96c2-d672a49bc214 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd71fe5a8275f4ea98555afdcefc902a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a10a4268f3c4cb29f4e00c292e2df62', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:56:02.159350 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28487a5-417e-4873-96c2-d672a49bc214 service nova] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:56:02.159737 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28487a5-417e-4873-96c2-d672a49bc214 service nova] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:56:02.160110 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28487a5-417e-4873-96c2-d672a49bc214 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:56:02.170392 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a28487a5-417e-4873-96c2-d672a49bc214 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:56:02.172288 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a28487a5-417e-4873-96c2-d672a49bc214 service nova] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:56:02.184900 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 1406/2765] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Sep 13 19:56:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 19:56:05.108903 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf4545e-7e9e-4acb-974e-81d44c096ad3 None None] REQUEST_METHOD: `POST` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:56:05.109476 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf4545e-7e9e-4acb-974e-81d44c096ad3 None None] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:56:05.109476 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf4545e-7e9e-4acb-974e-81d44c096ad3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:56:05.144532 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.auth.core [None req-0cf4545e-7e9e-4acb-974e-81d44c096ad3 None None] MFA Rules not processed for user `7b0aed92d02344acb92a0e4aa67c3068`. Rule list: `[]` (Enabled: `True`). {{(pid=87935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:56:05.145962 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.fernet_utils [None req-0cf4545e-7e9e-4acb-974e-81d44c096ad3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:56:05.156075 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 1360/2766] 10.222.0.57 () {58 vars in 1016 bytes} [Tue Sep 13 19:56:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 19:56:05.172568 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28487a5-417e-4873-96c2-d672a49bc214 service nova] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:56:05.186224 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28487a5-417e-4873-96c2-d672a49bc214 service nova] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:56:05.194495 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78811164-ef6e-487f-abbc-4109a676c880 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd71fe5a8275f4ea98555afdcefc902a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a10a4268f3c4cb29f4e00c292e2df62', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:56:05.195227 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78811164-ef6e-487f-abbc-4109a676c880 service nova] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:56:05.195572 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78811164-ef6e-487f-abbc-4109a676c880 service nova] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:56:05.195938 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78811164-ef6e-487f-abbc-4109a676c880 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:56:05.207532 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78811164-ef6e-487f-abbc-4109a676c880 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:56:05.210130 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78811164-ef6e-487f-abbc-4109a676c880 service nova] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:56:05.222146 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 1407/2767] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Sep 13 19:56:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 19:56:08.346397 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4ed810-212e-4f41-80ec-336edea6676d None None] REQUEST_METHOD: `POST` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:56:08.346905 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4ed810-212e-4f41-80ec-336edea6676d None None] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:56:08.347060 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4ed810-212e-4f41-80ec-336edea6676d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:56:08.376181 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.auth.core [None req-dd4ed810-212e-4f41-80ec-336edea6676d None None] MFA Rules not processed for user `7b0aed92d02344acb92a0e4aa67c3068`. Rule list: `[]` (Enabled: `True`). {{(pid=87935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:56:08.377464 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.fernet_utils [None req-dd4ed810-212e-4f41-80ec-336edea6676d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:56:08.387139 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 1361/2768] 10.222.0.57 () {58 vars in 1016 bytes} [Tue Sep 13 19:56:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 19:56:08.402873 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78811164-ef6e-487f-abbc-4109a676c880 service nova] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:56:08.415189 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78811164-ef6e-487f-abbc-4109a676c880 service nova] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:56:08.422720 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60ab631-b9fa-4560-8fa8-e6cb377213bf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd71fe5a8275f4ea98555afdcefc902a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a10a4268f3c4cb29f4e00c292e2df62', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:56:08.423753 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60ab631-b9fa-4560-8fa8-e6cb377213bf service nova] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:56:08.424292 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60ab631-b9fa-4560-8fa8-e6cb377213bf service nova] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:56:08.424776 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60ab631-b9fa-4560-8fa8-e6cb377213bf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:56:08.441001 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b60ab631-b9fa-4560-8fa8-e6cb377213bf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:56:08.442643 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b60ab631-b9fa-4560-8fa8-e6cb377213bf service nova] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:56:08.454037 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 1408/2769] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Sep 13 19:56:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 19:56:18.369799 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG dbcounter [-] [87935] Writing DB stats keystone:SELECT=60 {{(pid=87935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:56:18.448982 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG dbcounter [-] [87934] Writing DB stats keystone:SELECT=82,keystone:INSERT=1 {{(pid=87934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:56:32.370702 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4ed810-212e-4f41-80ec-336edea6676d None None] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:56:32.380372 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4ed810-212e-4f41-80ec-336edea6676d None None] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:56:32.385677 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629d6cff-6eec-4df3-b71f-d3c8a7df5dbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:56:32.386283 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629d6cff-6eec-4df3-b71f-d3c8a7df5dbc admin admin] REQUEST_METHOD: `DELETE` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:56:32.386555 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629d6cff-6eec-4df3-b71f-d3c8a7df5dbc admin admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:56:32.386931 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629d6cff-6eec-4df3-b71f-d3c8a7df5dbc admin admin] PATH_INFO: `/v3/users/4eafd8081cdb42038ea3401088226959` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:56:32.388030 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-629d6cff-6eec-4df3-b71f-d3c8a7df5dbc admin admin] RBAC: Authorizing `identity:delete_user(user_id=4eafd8081cdb42038ea3401088226959)` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:56:32.389953 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-629d6cff-6eec-4df3-b71f-d3c8a7df5dbc admin admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:56:32.434663 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.notifications [None req-629d6cff-6eec-4df3-b71f-d3c8a7df5dbc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4eafd8081cdb42038ea3401088226959'} {{(pid=87935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:56:32.442018 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.notifications [None req-629d6cff-6eec-4df3-b71f-d3c8a7df5dbc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4eafd8081cdb42038ea3401088226959'} {{(pid=87935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:56:32.455357 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.notifications [None req-629d6cff-6eec-4df3-b71f-d3c8a7df5dbc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4eafd8081cdb42038ea3401088226959'} {{(pid=87935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:56:32.455988 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.notifications [None req-629d6cff-6eec-4df3-b71f-d3c8a7df5dbc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4eafd8081cdb42038ea3401088226959'} {{(pid=87935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:56:32.456625 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.notifications [None req-629d6cff-6eec-4df3-b71f-d3c8a7df5dbc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4eafd8081cdb42038ea3401088226959'} {{(pid=87935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:56:32.469192 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 1362/2770] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Sep 13 19:56:32 2022] DELETE /identity/v3/users/4eafd8081cdb42038ea3401088226959 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 19:56:32.473745 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2132fc7-5650-40ed-8269-f936b80ca135 None None] REQUEST_METHOD: `POST` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:56:32.474214 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2132fc7-5650-40ed-8269-f936b80ca135 None None] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:56:32.474489 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2132fc7-5650-40ed-8269-f936b80ca135 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:56:32.493910 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.auth.core [None req-f2132fc7-5650-40ed-8269-f936b80ca135 None None] MFA Rules not processed for user `7b0aed92d02344acb92a0e4aa67c3068`. Rule list: `[]` (Enabled: `True`). {{(pid=87934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:56:32.495187 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.fernet_utils [None req-f2132fc7-5650-40ed-8269-f936b80ca135 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:56:32.554472 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 1409/2771] 10.222.0.25 () {58 vars in 958 bytes} [Tue Sep 13 19:56:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 19:56:32.564023 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629d6cff-6eec-4df3-b71f-d3c8a7df5dbc admin admin] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:56:32.565527 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.fernet_utils [None req-629d6cff-6eec-4df3-b71f-d3c8a7df5dbc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:56:32.624085 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629d6cff-6eec-4df3-b71f-d3c8a7df5dbc admin admin] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:56:32.627734 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3400ed-a0be-4e0c-99e6-b7bf742cf2b5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1196a96e4a404f559600b69f929ea9da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a10a4268f3c4cb29f4e00c292e2df62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:56:32.628359 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3400ed-a0be-4e0c-99e6-b7bf742cf2b5 service neutron] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:56:32.628638 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3400ed-a0be-4e0c-99e6-b7bf742cf2b5 service neutron] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:56:32.628997 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3400ed-a0be-4e0c-99e6-b7bf742cf2b5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:56:32.639543 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed3400ed-a0be-4e0c-99e6-b7bf742cf2b5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:56:32.641028 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed3400ed-a0be-4e0c-99e6-b7bf742cf2b5 service neutron] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:56:32.651670 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 1363/2772] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Sep 13 19:56:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 19:56:32.944907 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2132fc7-5650-40ed-8269-f936b80ca135 None None] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:56:32.946525 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.fernet_utils [None req-f2132fc7-5650-40ed-8269-f936b80ca135 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:56:32.963923 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2132fc7-5650-40ed-8269-f936b80ca135 None None] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:56:32.968744 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304d3865-a5ef-4461-a38f-c3304289f10f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:56:32.969515 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304d3865-a5ef-4461-a38f-c3304289f10f admin admin] REQUEST_METHOD: `DELETE` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:56:32.969862 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304d3865-a5ef-4461-a38f-c3304289f10f admin admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:56:32.970230 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304d3865-a5ef-4461-a38f-c3304289f10f admin admin] PATH_INFO: `/v3/projects/9768b7202daf41aabd8407153bdb9e00` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:56:32.971447 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-304d3865-a5ef-4461-a38f-c3304289f10f admin admin] RBAC: Authorizing `identity:delete_project(project_id=9768b7202daf41aabd8407153bdb9e00)` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:56:32.973524 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-304d3865-a5ef-4461-a38f-c3304289f10f admin admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:56:33.025266 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.notifications [None req-304d3865-a5ef-4461-a38f-c3304289f10f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9768b7202daf41aabd8407153bdb9e00', 'request_id': 'req-304d3865-a5ef-4461-a38f-c3304289f10f'} {{(pid=87934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:56:33.030984 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.notifications [None req-304d3865-a5ef-4461-a38f-c3304289f10f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9768b7202daf41aabd8407153bdb9e00', 'request_id': 'req-304d3865-a5ef-4461-a38f-c3304289f10f'} {{(pid=87934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:56:33.036556 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.notifications [None req-304d3865-a5ef-4461-a38f-c3304289f10f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9768b7202daf41aabd8407153bdb9e00', 'request_id': 'req-304d3865-a5ef-4461-a38f-c3304289f10f'} {{(pid=87934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:56:33.049012 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.notifications [None req-304d3865-a5ef-4461-a38f-c3304289f10f admin admin] The token cache is being invalidate because project 9768b7202daf41aabd8407153bdb9e00 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87934) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 19:56:33.049303 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.notifications [None req-304d3865-a5ef-4461-a38f-c3304289f10f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:56:33.049999 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.notifications [None req-304d3865-a5ef-4461-a38f-c3304289f10f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:56:33.052336 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 1410/2773] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Sep 13 19:56:32 2022] DELETE /identity/v3/projects/9768b7202daf41aabd8407153bdb9e00 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 19:56:33.058196 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9838060-b366-46d7-8c80-1b1d2ef1fcfe None None] REQUEST_METHOD: `POST` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:56:33.058627 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9838060-b366-46d7-8c80-1b1d2ef1fcfe None None] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:56:33.058978 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9838060-b366-46d7-8c80-1b1d2ef1fcfe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:56:33.081166 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.auth.core [None req-f9838060-b366-46d7-8c80-1b1d2ef1fcfe None None] MFA Rules not processed for user `7b0aed92d02344acb92a0e4aa67c3068`. Rule list: `[]` (Enabled: `True`). {{(pid=87935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:56:33.082375 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.fernet_utils [None req-f9838060-b366-46d7-8c80-1b1d2ef1fcfe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:56:33.143566 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 1364/2774] 10.222.0.25 () {58 vars in 958 bytes} [Tue Sep 13 19:56:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 19:56:33.152502 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a6a30f-912f-4a9a-aeaa-b666026ccc46 None None] REQUEST_METHOD: `POST` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:56:33.152800 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a6a30f-912f-4a9a-aeaa-b666026ccc46 None None] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:56:33.153112 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a6a30f-912f-4a9a-aeaa-b666026ccc46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:56:33.172997 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.auth.core [None req-91a6a30f-912f-4a9a-aeaa-b666026ccc46 None None] MFA Rules not processed for user `7b0aed92d02344acb92a0e4aa67c3068`. Rule list: `[]` (Enabled: `True`). {{(pid=87934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:56:33.174205 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.fernet_utils [None req-91a6a30f-912f-4a9a-aeaa-b666026ccc46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:56:33.182786 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 1411/2775] 10.222.0.25 () {58 vars in 958 bytes} [Tue Sep 13 19:56:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 19:56:33.187131 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9838060-b366-46d7-8c80-1b1d2ef1fcfe None None] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:56:33.198022 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9838060-b366-46d7-8c80-1b1d2ef1fcfe None None] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:56:33.202855 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c529a009-75be-4e95-9d50-8ad3b4609b3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:56:33.203477 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c529a009-75be-4e95-9d50-8ad3b4609b3d admin admin] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:56:33.203756 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c529a009-75be-4e95-9d50-8ad3b4609b3d admin admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:56:33.204028 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c529a009-75be-4e95-9d50-8ad3b4609b3d admin admin] PATH_INFO: `/v3/domains` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:56:33.204708 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c529a009-75be-4e95-9d50-8ad3b4609b3d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87935) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:56:33.205013 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c529a009-75be-4e95-9d50-8ad3b4609b3d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:56:33.206599 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c529a009-75be-4e95-9d50-8ad3b4609b3d admin admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:56:33.218681 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 1365/2776] 10.222.0.25 () {58 vars in 1153 bytes} [Tue Sep 13 19:56:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:56:33.222914 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a6a30f-912f-4a9a-aeaa-b666026ccc46 None None] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:56:33.232194 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a6a30f-912f-4a9a-aeaa-b666026ccc46 None None] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:56:33.236801 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2740d049-896f-441b-a124-db8af4c71f35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:56:33.237396 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2740d049-896f-441b-a124-db8af4c71f35 admin admin] REQUEST_METHOD: `POST` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:56:33.237673 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2740d049-896f-441b-a124-db8af4c71f35 admin admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:56:33.237938 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2740d049-896f-441b-a124-db8af4c71f35 admin admin] PATH_INFO: `/v3/projects` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:56:33.238563 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2740d049-896f-441b-a124-db8af4c71f35 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:56:33.240962 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2740d049-896f-441b-a124-db8af4c71f35 admin admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:56:33.268957 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 1412/2777] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Sep 13 19:56:33 2022] POST /identity/v3/projects => generated 373 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 19:56:33.273312 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c529a009-75be-4e95-9d50-8ad3b4609b3d admin admin] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:56:33.278392 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG dbcounter [-] [87935] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:56:33.284759 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c529a009-75be-4e95-9d50-8ad3b4609b3d admin admin] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:56:33.342758 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0acf19-e581-406e-885f-40a167541c32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:56:33.343282 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0acf19-e581-406e-885f-40a167541c32 admin admin] REQUEST_METHOD: `POST` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:56:33.343564 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0acf19-e581-406e-885f-40a167541c32 admin admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:56:33.343840 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0acf19-e581-406e-885f-40a167541c32 admin admin] PATH_INFO: `/v3/users` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:56:33.344492 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae0acf19-e581-406e-885f-40a167541c32 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:56:33.346402 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae0acf19-e581-406e-885f-40a167541c32 admin admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:56:33.367948 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 1366/2778] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Sep 13 19:56:33 2022] POST /identity/v3/users => generated 287 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 19:56:33.372051 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2740d049-896f-441b-a124-db8af4c71f35 admin admin] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:56:33.382945 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2740d049-896f-441b-a124-db8af4c71f35 admin admin] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:56:33.387552 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc3ac77-297d-4dc0-8713-d83488e942a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:56:33.388143 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc3ac77-297d-4dc0-8713-d83488e942a2 admin admin] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:56:33.388456 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc3ac77-297d-4dc0-8713-d83488e942a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:56:33.388728 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc3ac77-297d-4dc0-8713-d83488e942a2 admin admin] PATH_INFO: `/v3/roles` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:56:33.389358 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc3ac77-297d-4dc0-8713-d83488e942a2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:56:33.390962 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc3ac77-297d-4dc0-8713-d83488e942a2 admin admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:56:33.401078 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 1413/2779] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Sep 13 19:56:33 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 19:56:33.404878 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0acf19-e581-406e-885f-40a167541c32 admin admin] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:56:33.415223 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0acf19-e581-406e-885f-40a167541c32 admin admin] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:56:33.419785 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e18461-fc6a-437a-b936-73a4dc0174e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:56:33.420395 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e18461-fc6a-437a-b936-73a4dc0174e0 admin admin] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:56:33.420670 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e18461-fc6a-437a-b936-73a4dc0174e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:56:33.420937 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e18461-fc6a-437a-b936-73a4dc0174e0 admin admin] PATH_INFO: `/v3/roles` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:56:33.421561 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e18461-fc6a-437a-b936-73a4dc0174e0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:56:33.423154 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e18461-fc6a-437a-b936-73a4dc0174e0 admin admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:56:33.435067 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 1367/2780] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Sep 13 19:56:33 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 19:56:33.439195 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc3ac77-297d-4dc0-8713-d83488e942a2 admin admin] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:56:33.449035 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc3ac77-297d-4dc0-8713-d83488e942a2 admin admin] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:56:33.453915 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a727b4d3-331f-4b7f-8162-7ed15f8af721 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:56:33.454551 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a727b4d3-331f-4b7f-8162-7ed15f8af721 admin admin] REQUEST_METHOD: `PUT` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:56:33.454831 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a727b4d3-331f-4b7f-8162-7ed15f8af721 admin admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:56:33.455104 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a727b4d3-331f-4b7f-8162-7ed15f8af721 admin admin] PATH_INFO: `/v3/projects/d6744652585f403c9fd76727c2d7ef23/users/61090841e9f246fd92f6d9c894bc8880/roles/a259191f6d0e46fabd9f34536bb28747` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:56:33.469553 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a727b4d3-331f-4b7f-8162-7ed15f8af721 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d6744652585f403c9fd76727c2d7ef23, user_id=61090841e9f246fd92f6d9c894bc8880, role_id=a259191f6d0e46fabd9f34536bb28747)` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:56:33.472181 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a727b4d3-331f-4b7f-8162-7ed15f8af721 admin admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:56:33.485957 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 1414/2781] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Sep 13 19:56:33 2022] PUT /identity/v3/projects/d6744652585f403c9fd76727c2d7ef23/users/61090841e9f246fd92f6d9c894bc8880/roles/a259191f6d0e46fabd9f34536bb28747 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 19:56:33.491660 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d9ff50-a552-4ebf-a0a4-f8f41b1618ad None None] REQUEST_METHOD: `POST` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:56:33.491939 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d9ff50-a552-4ebf-a0a4-f8f41b1618ad None None] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:56:33.492218 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d9ff50-a552-4ebf-a0a4-f8f41b1618ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:56:33.510879 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.auth.core [None req-c3d9ff50-a552-4ebf-a0a4-f8f41b1618ad None None] MFA Rules not processed for user `7b0aed92d02344acb92a0e4aa67c3068`. Rule list: `[]` (Enabled: `True`). {{(pid=87935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:56:33.512077 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.fernet_utils [None req-c3d9ff50-a552-4ebf-a0a4-f8f41b1618ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:56:33.570131 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 1368/2782] 10.222.0.25 () {58 vars in 958 bytes} [Tue Sep 13 19:56:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 19:56:33.580106 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a727b4d3-331f-4b7f-8162-7ed15f8af721 admin admin] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:56:33.581863 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.fernet_utils [None req-a727b4d3-331f-4b7f-8162-7ed15f8af721 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:56:33.604124 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG dbcounter [-] [87934] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=87934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:56:33.640996 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a727b4d3-331f-4b7f-8162-7ed15f8af721 admin admin] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:56:33.644869 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8afc7953-6993-492f-b579-a270a1d6af71 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1196a96e4a404f559600b69f929ea9da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a10a4268f3c4cb29f4e00c292e2df62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:56:33.645464 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afc7953-6993-492f-b579-a270a1d6af71 service neutron] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:56:33.645736 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afc7953-6993-492f-b579-a270a1d6af71 service neutron] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:56:33.645999 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afc7953-6993-492f-b579-a270a1d6af71 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:56:33.655156 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8afc7953-6993-492f-b579-a270a1d6af71 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:56:33.656608 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8afc7953-6993-492f-b579-a270a1d6af71 service neutron] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:56:33.666686 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 1415/2783] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Sep 13 19:56:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 19:56:37.122040 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d9ff50-a552-4ebf-a0a4-f8f41b1618ad None None] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:56:37.123494 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.fernet_utils [None req-c3d9ff50-a552-4ebf-a0a4-f8f41b1618ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:56:37.152047 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d9ff50-a552-4ebf-a0a4-f8f41b1618ad None None] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:56:37.162934 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a5e241-11a3-4208-b34e-86a1d8b5d0ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:56:37.166490 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a5e241-11a3-4208-b34e-86a1d8b5d0ce admin admin] REQUEST_METHOD: `DELETE` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:56:37.166879 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a5e241-11a3-4208-b34e-86a1d8b5d0ce admin admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:56:37.167260 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a5e241-11a3-4208-b34e-86a1d8b5d0ce admin admin] PATH_INFO: `/v3/users/54a4fca5e980468e8a28d904871f49b3` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:56:37.169384 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a5e241-11a3-4208-b34e-86a1d8b5d0ce admin admin] RBAC: Authorizing `identity:delete_user(user_id=54a4fca5e980468e8a28d904871f49b3)` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:56:37.172470 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a5e241-11a3-4208-b34e-86a1d8b5d0ce admin admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:56:37.231892 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.notifications [None req-c4a5e241-11a3-4208-b34e-86a1d8b5d0ce admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '54a4fca5e980468e8a28d904871f49b3'} {{(pid=87935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:56:37.242481 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.notifications [None req-c4a5e241-11a3-4208-b34e-86a1d8b5d0ce admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '54a4fca5e980468e8a28d904871f49b3'} {{(pid=87935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:56:37.278984 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.notifications [None req-c4a5e241-11a3-4208-b34e-86a1d8b5d0ce admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '54a4fca5e980468e8a28d904871f49b3'} {{(pid=87935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:56:37.279740 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.notifications [None req-c4a5e241-11a3-4208-b34e-86a1d8b5d0ce admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '54a4fca5e980468e8a28d904871f49b3'} {{(pid=87935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:56:37.280425 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.notifications [None req-c4a5e241-11a3-4208-b34e-86a1d8b5d0ce admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '54a4fca5e980468e8a28d904871f49b3'} {{(pid=87935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:56:37.285857 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG dbcounter [-] [87935] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=87935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:56:37.301899 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 1369/2784] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Sep 13 19:56:37 2022] DELETE /identity/v3/users/54a4fca5e980468e8a28d904871f49b3 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 19:56:37.544847 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8afc7953-6993-492f-b579-a270a1d6af71 service neutron] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:56:37.563878 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8afc7953-6993-492f-b579-a270a1d6af71 service neutron] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:56:37.634728 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6426b31-1e83-4ced-acc8-5ed5002fab63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:56:37.637980 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6426b31-1e83-4ced-acc8-5ed5002fab63 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:56:37.638503 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6426b31-1e83-4ced-acc8-5ed5002fab63 admin admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:56:37.639000 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6426b31-1e83-4ced-acc8-5ed5002fab63 admin admin] PATH_INFO: `/v3/projects/bb9c8c3ef83449ababe431601eec990d` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:56:37.641417 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6426b31-1e83-4ced-acc8-5ed5002fab63 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bb9c8c3ef83449ababe431601eec990d)` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:56:37.645380 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6426b31-1e83-4ced-acc8-5ed5002fab63 admin admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:56:37.717179 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.notifications [None req-e6426b31-1e83-4ced-acc8-5ed5002fab63 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bb9c8c3ef83449ababe431601eec990d', 'request_id': 'req-e6426b31-1e83-4ced-acc8-5ed5002fab63'} {{(pid=87934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:56:37.724082 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.notifications [None req-e6426b31-1e83-4ced-acc8-5ed5002fab63 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bb9c8c3ef83449ababe431601eec990d', 'request_id': 'req-e6426b31-1e83-4ced-acc8-5ed5002fab63'} {{(pid=87934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:56:37.732126 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.notifications [None req-e6426b31-1e83-4ced-acc8-5ed5002fab63 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bb9c8c3ef83449ababe431601eec990d', 'request_id': 'req-e6426b31-1e83-4ced-acc8-5ed5002fab63'} {{(pid=87934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:56:37.748539 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.notifications [None req-e6426b31-1e83-4ced-acc8-5ed5002fab63 admin admin] The token cache is being invalidate because project bb9c8c3ef83449ababe431601eec990d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87934) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 19:56:37.748834 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.notifications [None req-e6426b31-1e83-4ced-acc8-5ed5002fab63 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:56:37.749468 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.notifications [None req-e6426b31-1e83-4ced-acc8-5ed5002fab63 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:56:37.764250 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 1416/2785] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Sep 13 19:56:37 2022] DELETE /identity/v3/projects/bb9c8c3ef83449ababe431601eec990d => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 19:56:37.800895 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052b6b9c-cb99-4604-bc96-68f1c080921e None None] REQUEST_METHOD: `POST` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:56:37.801296 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052b6b9c-cb99-4604-bc96-68f1c080921e None None] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:56:37.801622 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052b6b9c-cb99-4604-bc96-68f1c080921e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:56:37.842605 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.auth.core [None req-052b6b9c-cb99-4604-bc96-68f1c080921e None None] MFA Rules not processed for user `61090841e9f246fd92f6d9c894bc8880`. Rule list: `[]` (Enabled: `True`). {{(pid=87935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:56:37.843764 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.fernet_utils [None req-052b6b9c-cb99-4604-bc96-68f1c080921e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:56:37.928590 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 1370/2786] 10.222.0.25 () {58 vars in 958 bytes} [Tue Sep 13 19:56:37 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 19:56:37.933305 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6426b31-1e83-4ced-acc8-5ed5002fab63 admin admin] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:56:37.935231 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.fernet_utils [None req-e6426b31-1e83-4ced-acc8-5ed5002fab63 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:56:38.046075 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG dbcounter [-] [87934] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=87934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:56:38.062508 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6426b31-1e83-4ced-acc8-5ed5002fab63 admin admin] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:56:38.067993 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919f7070-b5e9-4651-8a51-fc840abc373e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:56:38.072629 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919f7070-b5e9-4651-8a51-fc840abc373e admin admin] REQUEST_METHOD: `POST` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:56:38.073001 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919f7070-b5e9-4651-8a51-fc840abc373e admin admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:56:38.073361 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919f7070-b5e9-4651-8a51-fc840abc373e admin admin] PATH_INFO: `/v3/projects` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:56:38.074122 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-919f7070-b5e9-4651-8a51-fc840abc373e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:56:38.076145 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-919f7070-b5e9-4651-8a51-fc840abc373e admin admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:56:38.114721 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 1417/2787] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Sep 13 19:56:37 2022] POST /identity/v3/projects => generated 371 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 19:56:38.119732 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052b6b9c-cb99-4604-bc96-68f1c080921e None None] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:56:38.131149 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052b6b9c-cb99-4604-bc96-68f1c080921e None None] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:56:38.200787 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e48607-611f-4089-902e-1296b4b88cd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:56:38.201521 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e48607-611f-4089-902e-1296b4b88cd1 admin admin] REQUEST_METHOD: `POST` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:56:38.202300 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e48607-611f-4089-902e-1296b4b88cd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:56:38.202707 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e48607-611f-4089-902e-1296b4b88cd1 admin admin] PATH_INFO: `/v3/users` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:56:38.203445 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e48607-611f-4089-902e-1296b4b88cd1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:56:38.205592 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e48607-611f-4089-902e-1296b4b88cd1 admin admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:56:38.232308 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 1371/2788] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Sep 13 19:56:38 2022] POST /identity/v3/users => generated 292 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 19:56:38.236327 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919f7070-b5e9-4651-8a51-fc840abc373e admin admin] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:56:38.248661 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919f7070-b5e9-4651-8a51-fc840abc373e admin admin] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:56:38.257016 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ecc9af-2772-45ce-9ba8-412292268555 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:56:38.257642 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ecc9af-2772-45ce-9ba8-412292268555 admin admin] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:56:38.257921 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ecc9af-2772-45ce-9ba8-412292268555 admin admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:56:38.258190 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ecc9af-2772-45ce-9ba8-412292268555 admin admin] PATH_INFO: `/v3/roles` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:56:38.258842 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ecc9af-2772-45ce-9ba8-412292268555 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:56:38.260752 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ecc9af-2772-45ce-9ba8-412292268555 admin admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:56:38.272394 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 1418/2789] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Sep 13 19:56:38 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 19:56:38.277070 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e48607-611f-4089-902e-1296b4b88cd1 admin admin] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:56:38.287982 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e48607-611f-4089-902e-1296b4b88cd1 admin admin] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:56:38.298481 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8b302e-3ddd-4cb9-9b60-fcdde9d8a12a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:56:38.298829 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8b302e-3ddd-4cb9-9b60-fcdde9d8a12a admin admin] REQUEST_METHOD: `PUT` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:56:38.299110 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8b302e-3ddd-4cb9-9b60-fcdde9d8a12a admin admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:56:38.299387 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8b302e-3ddd-4cb9-9b60-fcdde9d8a12a admin admin] PATH_INFO: `/v3/projects/76dcc4aa025f4682825d21b9c8350346/users/096f2aadcb174ee0aa5c04a9e8d8529a/roles/6ca1d4427ff64e0a9d25d96cfb1445f6` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:56:38.316676 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f8b302e-3ddd-4cb9-9b60-fcdde9d8a12a admin admin] RBAC: Authorizing `identity:create_grant(project_id=76dcc4aa025f4682825d21b9c8350346, user_id=096f2aadcb174ee0aa5c04a9e8d8529a, role_id=6ca1d4427ff64e0a9d25d96cfb1445f6)` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:56:38.319736 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f8b302e-3ddd-4cb9-9b60-fcdde9d8a12a admin admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:56:38.339089 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 1372/2790] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Sep 13 19:56:38 2022] PUT /identity/v3/projects/76dcc4aa025f4682825d21b9c8350346/users/096f2aadcb174ee0aa5c04a9e8d8529a/roles/6ca1d4427ff64e0a9d25d96cfb1445f6 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 19:56:38.344379 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ecc9af-2772-45ce-9ba8-412292268555 admin admin] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:56:38.355524 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ecc9af-2772-45ce-9ba8-412292268555 admin admin] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:56:38.431939 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca0e89c-9e00-4439-97df-1891176b28c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:56:38.433203 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca0e89c-9e00-4439-97df-1891176b28c3 admin admin] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:56:38.433203 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca0e89c-9e00-4439-97df-1891176b28c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:56:38.433203 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca0e89c-9e00-4439-97df-1891176b28c3 admin admin] PATH_INFO: `/v3/roles` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:56:38.433696 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca0e89c-9e00-4439-97df-1891176b28c3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:56:38.435366 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca0e89c-9e00-4439-97df-1891176b28c3 admin admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:56:38.451524 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 1419/2791] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Sep 13 19:56:38 2022] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 13 19:56:38.455975 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8b302e-3ddd-4cb9-9b60-fcdde9d8a12a admin admin] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:56:38.467111 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8b302e-3ddd-4cb9-9b60-fcdde9d8a12a admin admin] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:56:38.471849 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b781f2-c065-4c99-ab53-7d8ee9d22e63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:56:38.472543 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b781f2-c065-4c99-ab53-7d8ee9d22e63 admin admin] REQUEST_METHOD: `PUT` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:56:38.472815 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b781f2-c065-4c99-ab53-7d8ee9d22e63 admin admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:56:38.473081 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b781f2-c065-4c99-ab53-7d8ee9d22e63 admin admin] PATH_INFO: `/v3/projects/76dcc4aa025f4682825d21b9c8350346/users/096f2aadcb174ee0aa5c04a9e8d8529a/roles/6ca1d4427ff64e0a9d25d96cfb1445f6` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:56:38.475799 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b781f2-c065-4c99-ab53-7d8ee9d22e63 admin admin] RBAC: Authorizing `identity:create_grant(project_id=76dcc4aa025f4682825d21b9c8350346, user_id=096f2aadcb174ee0aa5c04a9e8d8529a, role_id=6ca1d4427ff64e0a9d25d96cfb1445f6)` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:56:38.478482 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b781f2-c065-4c99-ab53-7d8ee9d22e63 admin admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:56:38.489446 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 1373/2792] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Sep 13 19:56:38 2022] PUT /identity/v3/projects/76dcc4aa025f4682825d21b9c8350346/users/096f2aadcb174ee0aa5c04a9e8d8529a/roles/6ca1d4427ff64e0a9d25d96cfb1445f6 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 19:56:43.053669 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c082c6-45c0-4ba5-8118-61e4bbb0c3aa None None] REQUEST_METHOD: `POST` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:56:43.054172 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c082c6-45c0-4ba5-8118-61e4bbb0c3aa None None] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:56:43.054265 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c082c6-45c0-4ba5-8118-61e4bbb0c3aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:56:43.144259 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.auth.core [None req-e7c082c6-45c0-4ba5-8118-61e4bbb0c3aa None None] MFA Rules not processed for user `096f2aadcb174ee0aa5c04a9e8d8529a`. Rule list: `[]` (Enabled: `True`). {{(pid=87934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:56:43.145073 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.fernet_utils [None req-e7c082c6-45c0-4ba5-8118-61e4bbb0c3aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:56:43.248256 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 1420/2793] 10.222.0.25 () {58 vars in 958 bytes} [Tue Sep 13 19:56:43 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 19:56:43.268458 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b781f2-c065-4c99-ab53-7d8ee9d22e63 admin admin] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:56:43.271536 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.fernet_utils [None req-58b781f2-c065-4c99-ab53-7d8ee9d22e63 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:56:43.319850 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG dbcounter [-] [87935] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=87935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:56:43.358176 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b781f2-c065-4c99-ab53-7d8ee9d22e63 admin admin] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:56:43.364545 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7b45ae-9c32-49cc-b286-b18b4e5a9ae0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd71fe5a8275f4ea98555afdcefc902a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a10a4268f3c4cb29f4e00c292e2df62', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:56:43.366058 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7b45ae-9c32-49cc-b286-b18b4e5a9ae0 service nova] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:56:43.366486 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7b45ae-9c32-49cc-b286-b18b4e5a9ae0 service nova] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:56:43.366895 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7b45ae-9c32-49cc-b286-b18b4e5a9ae0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:56:43.445470 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be7b45ae-9c32-49cc-b286-b18b4e5a9ae0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:56:43.447276 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be7b45ae-9c32-49cc-b286-b18b4e5a9ae0 service nova] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:56:43.459250 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 1374/2794] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Sep 13 19:56:43 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 191 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 19:56:44.703058 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cff79fa-d41f-44a9-92d3-304923c773db None None] REQUEST_METHOD: `POST` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:56:44.703583 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cff79fa-d41f-44a9-92d3-304923c773db None None] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:56:44.704147 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cff79fa-d41f-44a9-92d3-304923c773db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:56:44.727314 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.auth.core [None req-2cff79fa-d41f-44a9-92d3-304923c773db None None] MFA Rules not processed for user `61090841e9f246fd92f6d9c894bc8880`. Rule list: `[]` (Enabled: `True`). {{(pid=87934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:56:44.728614 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.fernet_utils [None req-2cff79fa-d41f-44a9-92d3-304923c773db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:56:44.735910 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 1421/2795] 10.222.0.25 () {58 vars in 958 bytes} [Tue Sep 13 19:56:44 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 19:56:53.453065 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG dbcounter [-] [87935] Writing DB stats keystone:SELECT=40 {{(pid=87935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:56:54.720013 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG dbcounter [-] [87934] Writing DB stats keystone:SELECT=80,keystone:INSERT=1 {{(pid=87934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:56:57.186078 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7b45ae-9c32-49cc-b286-b18b4e5a9ae0 service nova] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:56:57.187543 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.fernet_utils [None req-be7b45ae-9c32-49cc-b286-b18b4e5a9ae0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:56:57.248221 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7b45ae-9c32-49cc-b286-b18b4e5a9ae0 service nova] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:56:57.251898 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d38735-ecc4-437d-919d-e0172aea1ca1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1196a96e4a404f559600b69f929ea9da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a10a4268f3c4cb29f4e00c292e2df62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:56:57.252816 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d38735-ecc4-437d-919d-e0172aea1ca1 service neutron] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:56:57.252816 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d38735-ecc4-437d-919d-e0172aea1ca1 service neutron] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:56:57.253061 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d38735-ecc4-437d-919d-e0172aea1ca1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:56:57.254990 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.fernet_utils [None req-99d38735-ecc4-437d-919d-e0172aea1ca1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:56:57.265421 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d38735-ecc4-437d-919d-e0172aea1ca1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:56:57.266859 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d38735-ecc4-437d-919d-e0172aea1ca1 service neutron] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:56:57.275495 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 1375/2796] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Sep 13 19:56:57 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 19:57:07.271505 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG dbcounter [-] [87935] Writing DB stats keystone:SELECT=26 {{(pid=87935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:57:09.874833 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cff79fa-d41f-44a9-92d3-304923c773db None None] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:57:09.885676 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cff79fa-d41f-44a9-92d3-304923c773db None None] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:57:09.889192 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f43e99-318c-4beb-b693-95ab736b6ede service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1196a96e4a404f559600b69f929ea9da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a10a4268f3c4cb29f4e00c292e2df62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:57:09.889791 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f43e99-318c-4beb-b693-95ab736b6ede service neutron] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:57:09.890064 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f43e99-318c-4beb-b693-95ab736b6ede service neutron] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:57:09.890330 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f43e99-318c-4beb-b693-95ab736b6ede service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:57:09.900511 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f43e99-318c-4beb-b693-95ab736b6ede service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:57:09.901978 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f43e99-318c-4beb-b693-95ab736b6ede service neutron] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:57:09.912626 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 1422/2797] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Sep 13 19:57:09 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 19:57:19.907504 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG dbcounter [-] [87934] Writing DB stats keystone:SELECT=6 {{(pid=87934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:57:22.653042 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d38735-ecc4-437d-919d-e0172aea1ca1 service neutron] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:57:22.654435 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.fernet_utils [None req-99d38735-ecc4-437d-919d-e0172aea1ca1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:57:22.793449 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d38735-ecc4-437d-919d-e0172aea1ca1 service neutron] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:57:22.798456 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd735a8-6061-4a2f-8b56-4e7a1c519619 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02eb3d3173c1476cb83a72add0e878e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a10a4268f3c4cb29f4e00c292e2df62', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:57:22.799046 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd735a8-6061-4a2f-8b56-4e7a1c519619 service placement] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:57:22.799319 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd735a8-6061-4a2f-8b56-4e7a1c519619 service placement] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:57:22.799583 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd735a8-6061-4a2f-8b56-4e7a1c519619 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:57:22.801311 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.fernet_utils [None req-5fd735a8-6061-4a2f-8b56-4e7a1c519619 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:57:22.813445 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd735a8-6061-4a2f-8b56-4e7a1c519619 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:57:22.814992 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd735a8-6061-4a2f-8b56-4e7a1c519619 service placement] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:57:22.825383 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 1376/2798] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Sep 13 19:57:22 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 173 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 19:57:32.820430 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG dbcounter [-] [87935] Writing DB stats keystone:SELECT=63 {{(pid=87935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:58:27.396662 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f43e99-318c-4beb-b693-95ab736b6ede service neutron] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:58:27.398474 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.fernet_utils [None req-b9f43e99-318c-4beb-b693-95ab736b6ede service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:58:27.509360 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f43e99-318c-4beb-b693-95ab736b6ede service neutron] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:58:27.523326 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3d6174-7a5d-4509-a516-5fca08d58ed3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd71fe5a8275f4ea98555afdcefc902a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a10a4268f3c4cb29f4e00c292e2df62', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:58:27.524016 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3d6174-7a5d-4509-a516-5fca08d58ed3 service nova] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:58:27.524353 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3d6174-7a5d-4509-a516-5fca08d58ed3 service nova] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:58:27.524804 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3d6174-7a5d-4509-a516-5fca08d58ed3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:58:27.528903 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.fernet_utils [None req-4a3d6174-7a5d-4509-a516-5fca08d58ed3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:58:27.548325 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a3d6174-7a5d-4509-a516-5fca08d58ed3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:58:27.550198 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a3d6174-7a5d-4509-a516-5fca08d58ed3 service nova] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:58:27.566128 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 1423/2799] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Sep 13 19:58:27 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 170 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 19:58:31.197786 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85843fd2-3da0-4793-8291-f2ddfd8fc0bb None None] REQUEST_METHOD: `POST` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:58:31.198330 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85843fd2-3da0-4793-8291-f2ddfd8fc0bb None None] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:58:31.198330 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85843fd2-3da0-4793-8291-f2ddfd8fc0bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:58:31.218451 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.auth.core [None req-85843fd2-3da0-4793-8291-f2ddfd8fc0bb None None] MFA Rules not processed for user `72e83a5489be40e0ba42223c641ae564`. Rule list: `[]` (Enabled: `True`). {{(pid=87935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:58:31.219656 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.fernet_utils [None req-85843fd2-3da0-4793-8291-f2ddfd8fc0bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:58:31.275155 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 1377/2800] 10.222.0.25 () {58 vars in 958 bytes} [Tue Sep 13 19:58:31 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 19:58:37.557888 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG dbcounter [-] [87934] Writing DB stats keystone:SELECT=32 {{(pid=87934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:58:41.267901 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG dbcounter [-] [87935] Writing DB stats keystone:SELECT=25 {{(pid=87935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:59:15.393479 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3d6174-7a5d-4509-a516-5fca08d58ed3 service nova] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:59:15.395777 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.fernet_utils [None req-4a3d6174-7a5d-4509-a516-5fca08d58ed3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:59:15.448935 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3d6174-7a5d-4509-a516-5fca08d58ed3 service nova] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:59:15.453527 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d819581-a068-4fdd-91ac-542a56c11ebc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1196a96e4a404f559600b69f929ea9da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a10a4268f3c4cb29f4e00c292e2df62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:59:15.454202 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d819581-a068-4fdd-91ac-542a56c11ebc service neutron] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:59:15.454536 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d819581-a068-4fdd-91ac-542a56c11ebc service neutron] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:59:15.454884 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d819581-a068-4fdd-91ac-542a56c11ebc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:59:15.457046 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.fernet_utils [None req-5d819581-a068-4fdd-91ac-542a56c11ebc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:59:15.473295 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d819581-a068-4fdd-91ac-542a56c11ebc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:59:15.474923 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d819581-a068-4fdd-91ac-542a56c11ebc service neutron] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:59:15.491369 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 1424/2801] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Sep 13 19:59:15 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 19:59:16.751152 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85843fd2-3da0-4793-8291-f2ddfd8fc0bb None None] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:59:16.768642 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85843fd2-3da0-4793-8291-f2ddfd8fc0bb None None] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:59:16.774984 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24892a3e-38f6-48e5-86df-f804d123bff9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1196a96e4a404f559600b69f929ea9da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a10a4268f3c4cb29f4e00c292e2df62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:59:16.775989 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24892a3e-38f6-48e5-86df-f804d123bff9 service neutron] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:59:16.776502 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24892a3e-38f6-48e5-86df-f804d123bff9 service neutron] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:59:16.776965 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24892a3e-38f6-48e5-86df-f804d123bff9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:59:16.779801 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.fernet_utils [None req-24892a3e-38f6-48e5-86df-f804d123bff9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:59:16.797719 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24892a3e-38f6-48e5-86df-f804d123bff9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:59:16.799307 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24892a3e-38f6-48e5-86df-f804d123bff9 service neutron] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:59:16.812947 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 1378/2802] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Sep 13 19:59:16 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 19:59:22.077350 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d819581-a068-4fdd-91ac-542a56c11ebc service neutron] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:59:22.093220 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d819581-a068-4fdd-91ac-542a56c11ebc service neutron] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:59:22.102882 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8629542-07c0-44d7-9801-9cdab833eea6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1196a96e4a404f559600b69f929ea9da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a10a4268f3c4cb29f4e00c292e2df62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:59:22.104625 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8629542-07c0-44d7-9801-9cdab833eea6 service neutron] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:59:22.105114 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8629542-07c0-44d7-9801-9cdab833eea6 service neutron] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:59:22.105388 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8629542-07c0-44d7-9801-9cdab833eea6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:59:22.107454 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.fernet_utils [None req-d8629542-07c0-44d7-9801-9cdab833eea6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:59:22.123245 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8629542-07c0-44d7-9801-9cdab833eea6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:59:22.125546 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8629542-07c0-44d7-9801-9cdab833eea6 service neutron] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:59:22.137012 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 1425/2803] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Sep 13 19:59:22 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 19:59:22.294353 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24892a3e-38f6-48e5-86df-f804d123bff9 service neutron] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:59:22.315858 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24892a3e-38f6-48e5-86df-f804d123bff9 service neutron] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:59:22.324413 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673a86e2-8984-4e2f-8818-e65cd54fcab3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1196a96e4a404f559600b69f929ea9da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a10a4268f3c4cb29f4e00c292e2df62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:59:22.325386 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673a86e2-8984-4e2f-8818-e65cd54fcab3 service neutron] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:59:22.325857 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673a86e2-8984-4e2f-8818-e65cd54fcab3 service neutron] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:59:22.326300 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673a86e2-8984-4e2f-8818-e65cd54fcab3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:59:22.330032 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.fernet_utils [None req-673a86e2-8984-4e2f-8818-e65cd54fcab3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:59:22.360301 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-673a86e2-8984-4e2f-8818-e65cd54fcab3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:59:22.363189 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-673a86e2-8984-4e2f-8818-e65cd54fcab3 service neutron] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:59:22.377209 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 1379/2804] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Sep 13 19:59:22 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 19:59:32.133121 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG dbcounter [-] [87934] Writing DB stats keystone:SELECT=21 {{(pid=87934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:59:32.370903 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG dbcounter [-] [87935] Writing DB stats keystone:SELECT=12 {{(pid=87935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:59:44.155176 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8629542-07c0-44d7-9801-9cdab833eea6 service neutron] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:59:44.158901 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.fernet_utils [None req-d8629542-07c0-44d7-9801-9cdab833eea6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:59:44.310469 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8629542-07c0-44d7-9801-9cdab833eea6 service neutron] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:59:44.318712 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b751dca0-2ecc-4649-857d-fa63d26f6444 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:59:44.319881 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b751dca0-2ecc-4649-857d-fa63d26f6444 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:59:44.320423 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b751dca0-2ecc-4649-857d-fa63d26f6444 admin admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:59:44.321040 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b751dca0-2ecc-4649-857d-fa63d26f6444 admin admin] PATH_INFO: `/v3/users/72e83a5489be40e0ba42223c641ae564` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:59:44.323059 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b751dca0-2ecc-4649-857d-fa63d26f6444 admin admin] RBAC: Authorizing `identity:delete_user(user_id=72e83a5489be40e0ba42223c641ae564)` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:59:44.327069 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b751dca0-2ecc-4649-857d-fa63d26f6444 admin admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:59:44.401049 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.notifications [None req-b751dca0-2ecc-4649-857d-fa63d26f6444 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '72e83a5489be40e0ba42223c641ae564'} {{(pid=87934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:59:44.401893 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.notifications [None req-b751dca0-2ecc-4649-857d-fa63d26f6444 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '72e83a5489be40e0ba42223c641ae564'} {{(pid=87934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:59:44.402683 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.notifications [None req-b751dca0-2ecc-4649-857d-fa63d26f6444 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '72e83a5489be40e0ba42223c641ae564'} {{(pid=87934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:59:44.412174 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.notifications [None req-b751dca0-2ecc-4649-857d-fa63d26f6444 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '72e83a5489be40e0ba42223c641ae564'} {{(pid=87934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:59:44.425877 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.notifications [None req-b751dca0-2ecc-4649-857d-fa63d26f6444 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '72e83a5489be40e0ba42223c641ae564'} {{(pid=87934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:59:44.442001 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 1426/2805] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Sep 13 19:59:44 2022] DELETE /identity/v3/users/72e83a5489be40e0ba42223c641ae564 => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 19:59:44.632999 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673a86e2-8984-4e2f-8818-e65cd54fcab3 service neutron] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:59:44.644527 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673a86e2-8984-4e2f-8818-e65cd54fcab3 service neutron] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:59:44.720086 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0d665e-8f73-49f1-b44f-8358a25cc4a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:59:44.720819 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0d665e-8f73-49f1-b44f-8358a25cc4a0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:59:44.721294 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0d665e-8f73-49f1-b44f-8358a25cc4a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:59:44.721620 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0d665e-8f73-49f1-b44f-8358a25cc4a0 admin admin] PATH_INFO: `/v3/projects/bba44cf96e114b9e9c3d0287b1aab83b` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:59:44.722948 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d0d665e-8f73-49f1-b44f-8358a25cc4a0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bba44cf96e114b9e9c3d0287b1aab83b)` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:59:44.724871 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d0d665e-8f73-49f1-b44f-8358a25cc4a0 admin admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:59:44.808240 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.notifications [None req-8d0d665e-8f73-49f1-b44f-8358a25cc4a0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bba44cf96e114b9e9c3d0287b1aab83b', 'request_id': 'req-8d0d665e-8f73-49f1-b44f-8358a25cc4a0'} {{(pid=87935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:59:44.814284 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.notifications [None req-8d0d665e-8f73-49f1-b44f-8358a25cc4a0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bba44cf96e114b9e9c3d0287b1aab83b', 'request_id': 'req-8d0d665e-8f73-49f1-b44f-8358a25cc4a0'} {{(pid=87935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:59:44.826054 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.notifications [None req-8d0d665e-8f73-49f1-b44f-8358a25cc4a0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bba44cf96e114b9e9c3d0287b1aab83b', 'request_id': 'req-8d0d665e-8f73-49f1-b44f-8358a25cc4a0'} {{(pid=87935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:59:44.841736 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.notifications [None req-8d0d665e-8f73-49f1-b44f-8358a25cc4a0 admin admin] The token cache is being invalidate because project bba44cf96e114b9e9c3d0287b1aab83b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87935) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 19:59:44.842046 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.notifications [None req-8d0d665e-8f73-49f1-b44f-8358a25cc4a0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:59:44.842747 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.notifications [None req-8d0d665e-8f73-49f1-b44f-8358a25cc4a0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:59:44.844290 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 1380/2806] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Sep 13 19:59:44 2022] DELETE /identity/v3/projects/bba44cf96e114b9e9c3d0287b1aab83b => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 19:59:44.850285 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c478d232-535b-4e49-9964-f405bad0a716 None None] REQUEST_METHOD: `POST` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:59:44.851110 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c478d232-535b-4e49-9964-f405bad0a716 None None] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:59:44.851391 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c478d232-535b-4e49-9964-f405bad0a716 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:59:44.937050 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.auth.core [None req-c478d232-535b-4e49-9964-f405bad0a716 None None] MFA Rules not processed for user `7b0aed92d02344acb92a0e4aa67c3068`. Rule list: `[]` (Enabled: `True`). {{(pid=87934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:59:44.938229 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.fernet_utils [None req-c478d232-535b-4e49-9964-f405bad0a716 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:59:44.954666 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG dbcounter [-] [87934] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:59:45.017035 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 1427/2807] 10.222.0.25 () {58 vars in 958 bytes} [Tue Sep 13 19:59:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 19:59:45.027513 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79edb66c-fcb4-471a-980e-cfb012befadf None None] REQUEST_METHOD: `POST` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:59:45.027983 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79edb66c-fcb4-471a-980e-cfb012befadf None None] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:59:45.028566 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79edb66c-fcb4-471a-980e-cfb012befadf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:59:45.055957 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.auth.core [None req-79edb66c-fcb4-471a-980e-cfb012befadf None None] MFA Rules not processed for user `7b0aed92d02344acb92a0e4aa67c3068`. Rule list: `[]` (Enabled: `True`). {{(pid=87935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:59:45.057787 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.fernet_utils [None req-79edb66c-fcb4-471a-980e-cfb012befadf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:59:45.070303 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 1381/2808] 10.222.0.25 () {58 vars in 958 bytes} [Tue Sep 13 19:59:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 19:59:45.077396 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c478d232-535b-4e49-9964-f405bad0a716 None None] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:59:45.094833 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c478d232-535b-4e49-9964-f405bad0a716 None None] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:59:45.103666 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9903864-e56b-4964-950d-a6da37345ccc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:59:45.104767 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9903864-e56b-4964-950d-a6da37345ccc admin admin] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:59:45.105234 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9903864-e56b-4964-950d-a6da37345ccc admin admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:59:45.105700 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9903864-e56b-4964-950d-a6da37345ccc admin admin] PATH_INFO: `/v3/domains` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:59:45.106891 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9903864-e56b-4964-950d-a6da37345ccc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87934) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:59:45.107462 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9903864-e56b-4964-950d-a6da37345ccc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:59:45.110611 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9903864-e56b-4964-950d-a6da37345ccc admin admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:59:45.132350 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 1428/2809] 10.222.0.25 () {58 vars in 1153 bytes} [Tue Sep 13 19:59:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 19:59:45.137875 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79edb66c-fcb4-471a-980e-cfb012befadf None None] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:59:45.149596 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79edb66c-fcb4-471a-980e-cfb012befadf None None] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:59:45.155555 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e583f5-b141-48f4-92cb-103255d2d2b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:59:45.156545 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e583f5-b141-48f4-92cb-103255d2d2b3 admin admin] REQUEST_METHOD: `POST` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:59:45.156967 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e583f5-b141-48f4-92cb-103255d2d2b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:59:45.157372 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e583f5-b141-48f4-92cb-103255d2d2b3 admin admin] PATH_INFO: `/v3/projects` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:59:45.158264 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e583f5-b141-48f4-92cb-103255d2d2b3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:59:45.161339 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e583f5-b141-48f4-92cb-103255d2d2b3 admin admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:59:45.207137 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 1382/2810] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Sep 13 19:59:45 2022] POST /identity/v3/projects => generated 367 bytes in 70 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 19:59:45.213708 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9903864-e56b-4964-950d-a6da37345ccc admin admin] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:59:45.224980 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9903864-e56b-4964-950d-a6da37345ccc admin admin] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:59:45.307896 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a84a49-fa9c-4d12-8cd4-2d22e57b80d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:59:45.308580 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a84a49-fa9c-4d12-8cd4-2d22e57b80d4 admin admin] REQUEST_METHOD: `POST` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:59:45.308853 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a84a49-fa9c-4d12-8cd4-2d22e57b80d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:59:45.309119 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a84a49-fa9c-4d12-8cd4-2d22e57b80d4 admin admin] PATH_INFO: `/v3/users` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:59:45.309769 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a84a49-fa9c-4d12-8cd4-2d22e57b80d4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:59:45.311729 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a84a49-fa9c-4d12-8cd4-2d22e57b80d4 admin admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:59:45.338423 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 1429/2811] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Sep 13 19:59:45 2022] POST /identity/v3/users => generated 284 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 19:59:45.344998 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e583f5-b141-48f4-92cb-103255d2d2b3 admin admin] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:59:45.360450 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e583f5-b141-48f4-92cb-103255d2d2b3 admin admin] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:59:45.365777 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5bc8c8-a81a-4709-af25-99f8cd694e49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:59:45.367061 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5bc8c8-a81a-4709-af25-99f8cd694e49 admin admin] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:59:45.367342 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5bc8c8-a81a-4709-af25-99f8cd694e49 admin admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:59:45.367614 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5bc8c8-a81a-4709-af25-99f8cd694e49 admin admin] PATH_INFO: `/v3/roles` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:59:45.368287 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b5bc8c8-a81a-4709-af25-99f8cd694e49 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:59:45.369908 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b5bc8c8-a81a-4709-af25-99f8cd694e49 admin admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:59:45.381035 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 1383/2812] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Sep 13 19:59:45 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 19:59:45.385530 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a84a49-fa9c-4d12-8cd4-2d22e57b80d4 admin admin] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:59:45.397194 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a84a49-fa9c-4d12-8cd4-2d22e57b80d4 admin admin] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:59:45.402671 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb08da78-9b50-4909-94eb-7439217b2f25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:59:45.403330 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb08da78-9b50-4909-94eb-7439217b2f25 admin admin] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:59:45.403608 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb08da78-9b50-4909-94eb-7439217b2f25 admin admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:59:45.403880 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb08da78-9b50-4909-94eb-7439217b2f25 admin admin] PATH_INFO: `/v3/roles` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:59:45.404572 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb08da78-9b50-4909-94eb-7439217b2f25 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:59:45.406238 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb08da78-9b50-4909-94eb-7439217b2f25 admin admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:59:45.426864 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 1430/2813] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Sep 13 19:59:45 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 19:59:45.432035 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5bc8c8-a81a-4709-af25-99f8cd694e49 admin admin] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:59:45.443243 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5bc8c8-a81a-4709-af25-99f8cd694e49 admin admin] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:59:45.449511 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1dea58-2360-487e-b7f9-9eafa66c9cba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:59:45.450252 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1dea58-2360-487e-b7f9-9eafa66c9cba admin admin] REQUEST_METHOD: `PUT` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:59:45.450577 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1dea58-2360-487e-b7f9-9eafa66c9cba admin admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:59:45.450906 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1dea58-2360-487e-b7f9-9eafa66c9cba admin admin] PATH_INFO: `/v3/projects/3ef0ea79c3cb44f18ed016de7906a401/users/f971f208a6964461b31c7e32bb6bad9b/roles/a259191f6d0e46fabd9f34536bb28747` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:59:45.471088 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d1dea58-2360-487e-b7f9-9eafa66c9cba admin admin] RBAC: Authorizing `identity:create_grant(project_id=3ef0ea79c3cb44f18ed016de7906a401, user_id=f971f208a6964461b31c7e32bb6bad9b, role_id=a259191f6d0e46fabd9f34536bb28747)` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:59:45.477152 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d1dea58-2360-487e-b7f9-9eafa66c9cba admin admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:59:45.494906 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 1384/2814] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Sep 13 19:59:45 2022] PUT /identity/v3/projects/3ef0ea79c3cb44f18ed016de7906a401/users/f971f208a6964461b31c7e32bb6bad9b/roles/a259191f6d0e46fabd9f34536bb28747 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 19:59:45.510443 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243d6773-af75-4236-8e55-39f521b1cbc5 None None] REQUEST_METHOD: `POST` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:59:45.510785 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243d6773-af75-4236-8e55-39f521b1cbc5 None None] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:59:45.511123 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243d6773-af75-4236-8e55-39f521b1cbc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:59:45.552752 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.auth.core [None req-243d6773-af75-4236-8e55-39f521b1cbc5 None None] MFA Rules not processed for user `f971f208a6964461b31c7e32bb6bad9b`. Rule list: `[]` (Enabled: `True`). {{(pid=87934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:59:45.554804 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.fernet_utils [None req-243d6773-af75-4236-8e55-39f521b1cbc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:59:45.656133 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 1431/2815] 10.222.0.25 () {58 vars in 958 bytes} [Tue Sep 13 19:59:45 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 19:59:45.661407 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1dea58-2360-487e-b7f9-9eafa66c9cba admin admin] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:59:45.697100 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG dbcounter [-] [87935] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=87935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:59:45.777321 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1dea58-2360-487e-b7f9-9eafa66c9cba admin admin] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:59:45.785442 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d697c1f-1d31-44e4-bac3-6b85aa01e5e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:59:45.786515 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d697c1f-1d31-44e4-bac3-6b85aa01e5e5 admin admin] REQUEST_METHOD: `POST` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:59:45.786985 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d697c1f-1d31-44e4-bac3-6b85aa01e5e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:59:45.787476 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d697c1f-1d31-44e4-bac3-6b85aa01e5e5 admin admin] PATH_INFO: `/v3/projects` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:59:45.789210 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d697c1f-1d31-44e4-bac3-6b85aa01e5e5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:59:45.792965 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d697c1f-1d31-44e4-bac3-6b85aa01e5e5 admin admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:59:45.834636 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 1385/2816] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Sep 13 19:59:45 2022] POST /identity/v3/projects => generated 369 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 19:59:45.839390 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243d6773-af75-4236-8e55-39f521b1cbc5 None None] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:59:45.851303 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243d6773-af75-4236-8e55-39f521b1cbc5 None None] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:59:45.868054 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG dbcounter [-] [87934] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:59:45.958306 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab155f7-77a4-4092-a138-03997fc9fb71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:59:45.959184 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab155f7-77a4-4092-a138-03997fc9fb71 admin admin] REQUEST_METHOD: `POST` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:59:45.959642 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab155f7-77a4-4092-a138-03997fc9fb71 admin admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:59:45.960113 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab155f7-77a4-4092-a138-03997fc9fb71 admin admin] PATH_INFO: `/v3/users` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:59:45.961141 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab155f7-77a4-4092-a138-03997fc9fb71 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:59:45.963280 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab155f7-77a4-4092-a138-03997fc9fb71 admin admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:59:45.993838 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 1432/2817] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Sep 13 19:59:45 2022] POST /identity/v3/users => generated 291 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 19:59:45.998378 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d697c1f-1d31-44e4-bac3-6b85aa01e5e5 admin admin] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:59:46.010679 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d697c1f-1d31-44e4-bac3-6b85aa01e5e5 admin admin] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:59:46.016058 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c9d9c9-94e5-46dc-b7c3-6e2187448eff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:59:46.016739 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c9d9c9-94e5-46dc-b7c3-6e2187448eff admin admin] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:59:46.017010 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c9d9c9-94e5-46dc-b7c3-6e2187448eff admin admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:59:46.017281 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c9d9c9-94e5-46dc-b7c3-6e2187448eff admin admin] PATH_INFO: `/v3/roles` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:59:46.018031 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c9d9c9-94e5-46dc-b7c3-6e2187448eff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:59:46.020077 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c9d9c9-94e5-46dc-b7c3-6e2187448eff admin admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:59:46.032984 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 1386/2818] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Sep 13 19:59:45 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 13 19:59:46.037630 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab155f7-77a4-4092-a138-03997fc9fb71 admin admin] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:59:46.048323 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab155f7-77a4-4092-a138-03997fc9fb71 admin admin] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:59:46.055070 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b1d7ac-1810-4729-94cc-c298a3925a82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:59:46.055814 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b1d7ac-1810-4729-94cc-c298a3925a82 admin admin] REQUEST_METHOD: `PUT` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:59:46.056194 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b1d7ac-1810-4729-94cc-c298a3925a82 admin admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:59:46.056543 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b1d7ac-1810-4729-94cc-c298a3925a82 admin admin] PATH_INFO: `/v3/projects/06c34fd5e9f04546aee7e3d7bae2a5e7/users/eedee39c34aa432480dac38ab94fa228/roles/6ca1d4427ff64e0a9d25d96cfb1445f6` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:59:46.075502 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b1d7ac-1810-4729-94cc-c298a3925a82 admin admin] RBAC: Authorizing `identity:create_grant(project_id=06c34fd5e9f04546aee7e3d7bae2a5e7, user_id=eedee39c34aa432480dac38ab94fa228, role_id=6ca1d4427ff64e0a9d25d96cfb1445f6)` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:59:46.078881 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b1d7ac-1810-4729-94cc-c298a3925a82 admin admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:59:46.098616 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 1433/2819] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Sep 13 19:59:46 2022] PUT /identity/v3/projects/06c34fd5e9f04546aee7e3d7bae2a5e7/users/eedee39c34aa432480dac38ab94fa228/roles/6ca1d4427ff64e0a9d25d96cfb1445f6 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 19:59:46.103855 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c9d9c9-94e5-46dc-b7c3-6e2187448eff admin admin] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:59:46.114965 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c9d9c9-94e5-46dc-b7c3-6e2187448eff admin admin] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:59:46.186730 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96f2410-7cb4-4600-8e80-615621eef132 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:59:46.187477 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96f2410-7cb4-4600-8e80-615621eef132 admin admin] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:59:46.187879 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96f2410-7cb4-4600-8e80-615621eef132 admin admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:59:46.188325 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96f2410-7cb4-4600-8e80-615621eef132 admin admin] PATH_INFO: `/v3/roles` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:59:46.189012 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d96f2410-7cb4-4600-8e80-615621eef132 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:59:46.190670 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d96f2410-7cb4-4600-8e80-615621eef132 admin admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:59:46.204980 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 1387/2820] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Sep 13 19:59:46 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 19:59:46.209618 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b1d7ac-1810-4729-94cc-c298a3925a82 admin admin] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:59:46.220508 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b1d7ac-1810-4729-94cc-c298a3925a82 admin admin] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:59:46.226301 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d591ea3-f95f-4bb5-8ece-1a10cabab14b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:59:46.226963 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d591ea3-f95f-4bb5-8ece-1a10cabab14b admin admin] REQUEST_METHOD: `PUT` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:59:46.227287 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d591ea3-f95f-4bb5-8ece-1a10cabab14b admin admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:59:46.227562 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d591ea3-f95f-4bb5-8ece-1a10cabab14b admin admin] PATH_INFO: `/v3/projects/06c34fd5e9f04546aee7e3d7bae2a5e7/users/eedee39c34aa432480dac38ab94fa228/roles/6ca1d4427ff64e0a9d25d96cfb1445f6` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:59:46.229614 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d591ea3-f95f-4bb5-8ece-1a10cabab14b admin admin] RBAC: Authorizing `identity:create_grant(project_id=06c34fd5e9f04546aee7e3d7bae2a5e7, user_id=eedee39c34aa432480dac38ab94fa228, role_id=6ca1d4427ff64e0a9d25d96cfb1445f6)` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:59:46.232401 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d591ea3-f95f-4bb5-8ece-1a10cabab14b admin admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:59:46.245648 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 1434/2821] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Sep 13 19:59:46 2022] PUT /identity/v3/projects/06c34fd5e9f04546aee7e3d7bae2a5e7/users/eedee39c34aa432480dac38ab94fa228/roles/6ca1d4427ff64e0a9d25d96cfb1445f6 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 19:59:46.259116 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5695a9b2-8d04-471e-8ece-4e51f2a5fa3e None None] REQUEST_METHOD: `POST` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:59:46.259393 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5695a9b2-8d04-471e-8ece-4e51f2a5fa3e None None] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:59:46.259664 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5695a9b2-8d04-471e-8ece-4e51f2a5fa3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:59:46.301745 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.auth.core [None req-5695a9b2-8d04-471e-8ece-4e51f2a5fa3e None None] MFA Rules not processed for user `eedee39c34aa432480dac38ab94fa228`. Rule list: `[]` (Enabled: `True`). {{(pid=87935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:59:46.303448 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.fernet_utils [None req-5695a9b2-8d04-471e-8ece-4e51f2a5fa3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:59:46.386775 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 1388/2822] 10.222.0.25 () {58 vars in 958 bytes} [Tue Sep 13 19:59:46 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 19:59:46.402714 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d591ea3-f95f-4bb5-8ece-1a10cabab14b admin admin] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:59:46.404582 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.fernet_utils [None req-8d591ea3-f95f-4bb5-8ece-1a10cabab14b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:59:46.497466 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d591ea3-f95f-4bb5-8ece-1a10cabab14b admin admin] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:59:46.501310 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c159225-28e4-4231-a8ee-c68d5f4db092 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cbb50c88b794a7f9f26844effde7d63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a10a4268f3c4cb29f4e00c292e2df62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:59:46.501916 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c159225-28e4-4231-a8ee-c68d5f4db092 service cinder] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:59:46.502194 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c159225-28e4-4231-a8ee-c68d5f4db092 service cinder] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:59:46.502462 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c159225-28e4-4231-a8ee-c68d5f4db092 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:59:46.512778 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c159225-28e4-4231-a8ee-c68d5f4db092 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:59:46.514258 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c159225-28e4-4231-a8ee-c68d5f4db092 service cinder] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:59:46.526916 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 1435/2823] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Sep 13 19:59:46 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 19:59:48.436448 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5695a9b2-8d04-471e-8ece-4e51f2a5fa3e None None] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:59:48.460458 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG dbcounter [-] [87935] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:59:48.540928 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5695a9b2-8d04-471e-8ece-4e51f2a5fa3e None None] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:59:48.547475 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27fc9bab-e200-4683-8bd2-4df3b4d35355 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:59:48.548255 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fc9bab-e200-4683-8bd2-4df3b4d35355 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:59:48.548604 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fc9bab-e200-4683-8bd2-4df3b4d35355 admin admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:59:48.549000 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fc9bab-e200-4683-8bd2-4df3b4d35355 admin admin] PATH_INFO: `/v3/users/f971f208a6964461b31c7e32bb6bad9b` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:59:48.551011 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27fc9bab-e200-4683-8bd2-4df3b4d35355 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f971f208a6964461b31c7e32bb6bad9b)` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:59:48.554030 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27fc9bab-e200-4683-8bd2-4df3b4d35355 admin admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:59:48.619842 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.notifications [None req-27fc9bab-e200-4683-8bd2-4df3b4d35355 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f971f208a6964461b31c7e32bb6bad9b'} {{(pid=87935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:59:48.633598 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.notifications [None req-27fc9bab-e200-4683-8bd2-4df3b4d35355 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f971f208a6964461b31c7e32bb6bad9b'} {{(pid=87935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:59:48.656188 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.notifications [None req-27fc9bab-e200-4683-8bd2-4df3b4d35355 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f971f208a6964461b31c7e32bb6bad9b'} {{(pid=87935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:59:48.656904 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.notifications [None req-27fc9bab-e200-4683-8bd2-4df3b4d35355 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f971f208a6964461b31c7e32bb6bad9b'} {{(pid=87935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:59:48.657526 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.notifications [None req-27fc9bab-e200-4683-8bd2-4df3b4d35355 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f971f208a6964461b31c7e32bb6bad9b'} {{(pid=87935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:59:48.676151 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 1389/2824] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Sep 13 19:59:48 2022] DELETE /identity/v3/users/f971f208a6964461b31c7e32bb6bad9b => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 19:59:48.683689 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59be3f23-1754-4b14-9480-b0d178ceb9f9 None None] REQUEST_METHOD: `POST` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:59:48.684634 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59be3f23-1754-4b14-9480-b0d178ceb9f9 None None] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:59:48.684634 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59be3f23-1754-4b14-9480-b0d178ceb9f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:59:48.719815 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.auth.core [None req-59be3f23-1754-4b14-9480-b0d178ceb9f9 None None] MFA Rules not processed for user `7b0aed92d02344acb92a0e4aa67c3068`. Rule list: `[]` (Enabled: `True`). {{(pid=87934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:59:48.721967 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.fernet_utils [None req-59be3f23-1754-4b14-9480-b0d178ceb9f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:59:48.785764 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG dbcounter [-] [87934] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=87934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:59:48.806468 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 1436/2825] 10.222.0.25 () {58 vars in 958 bytes} [Tue Sep 13 19:59:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 19:59:48.819776 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27fc9bab-e200-4683-8bd2-4df3b4d35355 admin admin] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:59:48.822050 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.fernet_utils [None req-27fc9bab-e200-4683-8bd2-4df3b4d35355 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:59:48.911847 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27fc9bab-e200-4683-8bd2-4df3b4d35355 admin admin] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:59:48.918295 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1166e8ef-8ef4-4efd-b2b8-4bad257f2fd7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1196a96e4a404f559600b69f929ea9da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a10a4268f3c4cb29f4e00c292e2df62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:59:48.919310 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1166e8ef-8ef4-4efd-b2b8-4bad257f2fd7 service neutron] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:59:48.919751 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1166e8ef-8ef4-4efd-b2b8-4bad257f2fd7 service neutron] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:59:48.920237 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1166e8ef-8ef4-4efd-b2b8-4bad257f2fd7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:59:48.936507 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1166e8ef-8ef4-4efd-b2b8-4bad257f2fd7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:59:48.938030 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1166e8ef-8ef4-4efd-b2b8-4bad257f2fd7 service neutron] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:59:48.951445 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 1390/2826] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Sep 13 19:59:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 19:59:49.330164 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59be3f23-1754-4b14-9480-b0d178ceb9f9 None None] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:59:49.332711 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.fernet_utils [None req-59be3f23-1754-4b14-9480-b0d178ceb9f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:59:49.353049 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59be3f23-1754-4b14-9480-b0d178ceb9f9 None None] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:59:49.359254 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573ddd1e-b3e0-478b-ad8a-ead5a8fbd9a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:59:49.359942 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573ddd1e-b3e0-478b-ad8a-ead5a8fbd9a0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:59:49.360397 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573ddd1e-b3e0-478b-ad8a-ead5a8fbd9a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:59:49.360584 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573ddd1e-b3e0-478b-ad8a-ead5a8fbd9a0 admin admin] PATH_INFO: `/v3/projects/3ef0ea79c3cb44f18ed016de7906a401` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:59:49.361903 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-573ddd1e-b3e0-478b-ad8a-ead5a8fbd9a0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3ef0ea79c3cb44f18ed016de7906a401)` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:59:49.363779 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-573ddd1e-b3e0-478b-ad8a-ead5a8fbd9a0 admin admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:59:49.440281 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.notifications [None req-573ddd1e-b3e0-478b-ad8a-ead5a8fbd9a0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3ef0ea79c3cb44f18ed016de7906a401', 'request_id': 'req-573ddd1e-b3e0-478b-ad8a-ead5a8fbd9a0'} {{(pid=87934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:59:49.449268 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.notifications [None req-573ddd1e-b3e0-478b-ad8a-ead5a8fbd9a0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3ef0ea79c3cb44f18ed016de7906a401', 'request_id': 'req-573ddd1e-b3e0-478b-ad8a-ead5a8fbd9a0'} {{(pid=87934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:59:49.456587 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.notifications [None req-573ddd1e-b3e0-478b-ad8a-ead5a8fbd9a0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3ef0ea79c3cb44f18ed016de7906a401', 'request_id': 'req-573ddd1e-b3e0-478b-ad8a-ead5a8fbd9a0'} {{(pid=87934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:59:49.472374 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.notifications [None req-573ddd1e-b3e0-478b-ad8a-ead5a8fbd9a0 admin admin] The token cache is being invalidate because project 3ef0ea79c3cb44f18ed016de7906a401 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87934) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 19:59:49.472669 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.notifications [None req-573ddd1e-b3e0-478b-ad8a-ead5a8fbd9a0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:59:49.473336 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.notifications [None req-573ddd1e-b3e0-478b-ad8a-ead5a8fbd9a0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:59:49.474877 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 1437/2827] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Sep 13 19:59:49 2022] DELETE /identity/v3/projects/3ef0ea79c3cb44f18ed016de7906a401 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 19:59:49.481069 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1166e8ef-8ef4-4efd-b2b8-4bad257f2fd7 service neutron] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:59:49.495279 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1166e8ef-8ef4-4efd-b2b8-4bad257f2fd7 service neutron] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:59:49.546479 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG dbcounter [-] [87935] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:59:49.581530 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494a94e2-3354-4f36-b397-8eec4f7b9832 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:59:49.582226 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494a94e2-3354-4f36-b397-8eec4f7b9832 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:59:49.582575 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494a94e2-3354-4f36-b397-8eec4f7b9832 admin admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:59:49.582885 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494a94e2-3354-4f36-b397-8eec4f7b9832 admin admin] PATH_INFO: `/v3/users/eedee39c34aa432480dac38ab94fa228` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:59:49.584523 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-494a94e2-3354-4f36-b397-8eec4f7b9832 admin admin] RBAC: Authorizing `identity:delete_user(user_id=eedee39c34aa432480dac38ab94fa228)` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:59:49.586634 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-494a94e2-3354-4f36-b397-8eec4f7b9832 admin admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:59:49.668193 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.notifications [None req-494a94e2-3354-4f36-b397-8eec4f7b9832 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eedee39c34aa432480dac38ab94fa228'} {{(pid=87935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:59:49.677255 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.notifications [None req-494a94e2-3354-4f36-b397-8eec4f7b9832 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eedee39c34aa432480dac38ab94fa228'} {{(pid=87935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:59:49.697053 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.notifications [None req-494a94e2-3354-4f36-b397-8eec4f7b9832 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eedee39c34aa432480dac38ab94fa228'} {{(pid=87935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:59:49.697724 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.notifications [None req-494a94e2-3354-4f36-b397-8eec4f7b9832 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eedee39c34aa432480dac38ab94fa228'} {{(pid=87935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:59:49.698333 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.notifications [None req-494a94e2-3354-4f36-b397-8eec4f7b9832 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eedee39c34aa432480dac38ab94fa228'} {{(pid=87935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:59:49.713636 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 1391/2828] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Sep 13 19:59:49 2022] DELETE /identity/v3/users/eedee39c34aa432480dac38ab94fa228 => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 19:59:50.112480 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573ddd1e-b3e0-478b-ad8a-ead5a8fbd9a0 admin admin] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:59:50.114621 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.fernet_utils [None req-573ddd1e-b3e0-478b-ad8a-ead5a8fbd9a0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:59:50.142293 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573ddd1e-b3e0-478b-ad8a-ead5a8fbd9a0 admin admin] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:59:50.246348 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ece4e0-2584-46ff-9bf2-a9cdfe622049 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:59:50.247354 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ece4e0-2584-46ff-9bf2-a9cdfe622049 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:59:50.247854 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ece4e0-2584-46ff-9bf2-a9cdfe622049 admin admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:59:50.248384 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ece4e0-2584-46ff-9bf2-a9cdfe622049 admin admin] PATH_INFO: `/v3/projects/06c34fd5e9f04546aee7e3d7bae2a5e7` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:59:50.250394 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ece4e0-2584-46ff-9bf2-a9cdfe622049 admin admin] RBAC: Authorizing `identity:delete_project(project_id=06c34fd5e9f04546aee7e3d7bae2a5e7)` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:59:50.253142 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ece4e0-2584-46ff-9bf2-a9cdfe622049 admin admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:59:50.325531 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.notifications [None req-e6ece4e0-2584-46ff-9bf2-a9cdfe622049 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '06c34fd5e9f04546aee7e3d7bae2a5e7', 'request_id': 'req-e6ece4e0-2584-46ff-9bf2-a9cdfe622049'} {{(pid=87934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:59:50.333016 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.notifications [None req-e6ece4e0-2584-46ff-9bf2-a9cdfe622049 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '06c34fd5e9f04546aee7e3d7bae2a5e7', 'request_id': 'req-e6ece4e0-2584-46ff-9bf2-a9cdfe622049'} {{(pid=87934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:59:50.340741 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.notifications [None req-e6ece4e0-2584-46ff-9bf2-a9cdfe622049 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '06c34fd5e9f04546aee7e3d7bae2a5e7', 'request_id': 'req-e6ece4e0-2584-46ff-9bf2-a9cdfe622049'} {{(pid=87934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:59:50.355822 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.notifications [None req-e6ece4e0-2584-46ff-9bf2-a9cdfe622049 admin admin] The token cache is being invalidate because project 06c34fd5e9f04546aee7e3d7bae2a5e7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87934) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 19:59:50.356161 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.notifications [None req-e6ece4e0-2584-46ff-9bf2-a9cdfe622049 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:59:50.356920 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.notifications [None req-e6ece4e0-2584-46ff-9bf2-a9cdfe622049 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:59:50.358559 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 1438/2829] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Sep 13 19:59:50 2022] DELETE /identity/v3/projects/06c34fd5e9f04546aee7e3d7bae2a5e7 => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 19:59:50.366219 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f481b4e-8e4e-4fcc-82bb-55bda9d584a2 None None] REQUEST_METHOD: `POST` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:59:50.366599 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f481b4e-8e4e-4fcc-82bb-55bda9d584a2 None None] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:59:50.366818 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f481b4e-8e4e-4fcc-82bb-55bda9d584a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:59:50.389636 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.auth.core [None req-3f481b4e-8e4e-4fcc-82bb-55bda9d584a2 None None] MFA Rules not processed for user `7b0aed92d02344acb92a0e4aa67c3068`. Rule list: `[]` (Enabled: `True`). {{(pid=87935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:59:50.391133 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.fernet_utils [None req-3f481b4e-8e4e-4fcc-82bb-55bda9d584a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:59:50.470417 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 1392/2830] 10.222.0.25 () {58 vars in 958 bytes} [Tue Sep 13 19:59:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 19:59:50.484094 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9949f76-0e59-42f3-b7b0-9437e72f7b4f None None] REQUEST_METHOD: `POST` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:59:50.484694 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9949f76-0e59-42f3-b7b0-9437e72f7b4f None None] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:59:50.485160 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9949f76-0e59-42f3-b7b0-9437e72f7b4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:59:50.500444 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG dbcounter [-] [87934] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=87934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:59:50.515966 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.auth.core [None req-e9949f76-0e59-42f3-b7b0-9437e72f7b4f None None] MFA Rules not processed for user `7b0aed92d02344acb92a0e4aa67c3068`. Rule list: `[]` (Enabled: `True`). {{(pid=87934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:59:50.517854 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.fernet_utils [None req-e9949f76-0e59-42f3-b7b0-9437e72f7b4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:59:50.527111 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 1439/2831] 10.222.0.25 () {58 vars in 958 bytes} [Tue Sep 13 19:59:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 19:59:50.532840 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f481b4e-8e4e-4fcc-82bb-55bda9d584a2 None None] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:59:50.546821 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f481b4e-8e4e-4fcc-82bb-55bda9d584a2 None None] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:59:50.551747 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99667538-7f88-4b64-b628-b3b355b54c35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:59:50.552426 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99667538-7f88-4b64-b628-b3b355b54c35 admin admin] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:59:50.552704 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99667538-7f88-4b64-b628-b3b355b54c35 admin admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:59:50.552971 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99667538-7f88-4b64-b628-b3b355b54c35 admin admin] PATH_INFO: `/v3/domains` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:59:50.554169 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99667538-7f88-4b64-b628-b3b355b54c35 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87935) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:59:50.554480 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99667538-7f88-4b64-b628-b3b355b54c35 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:59:50.556293 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99667538-7f88-4b64-b628-b3b355b54c35 admin admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:59:50.570502 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 1393/2832] 10.222.0.25 () {58 vars in 1153 bytes} [Tue Sep 13 19:59:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:59:50.575230 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9949f76-0e59-42f3-b7b0-9437e72f7b4f None None] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:59:50.585523 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9949f76-0e59-42f3-b7b0-9437e72f7b4f None None] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:59:50.590770 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb746bc-d93e-42a3-ae07-1ec99c5c2615 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:59:50.591425 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb746bc-d93e-42a3-ae07-1ec99c5c2615 admin admin] REQUEST_METHOD: `POST` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:59:50.591703 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb746bc-d93e-42a3-ae07-1ec99c5c2615 admin admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:59:50.591976 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb746bc-d93e-42a3-ae07-1ec99c5c2615 admin admin] PATH_INFO: `/v3/projects` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:59:50.592673 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb746bc-d93e-42a3-ae07-1ec99c5c2615 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:59:50.594612 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb746bc-d93e-42a3-ae07-1ec99c5c2615 admin admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:59:50.630720 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 1440/2833] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Sep 13 19:59:50 2022] POST /identity/v3/projects => generated 393 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 19:59:50.636109 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99667538-7f88-4b64-b628-b3b355b54c35 admin admin] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:59:50.648468 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99667538-7f88-4b64-b628-b3b355b54c35 admin admin] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:59:50.698601 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG dbcounter [-] [87935] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:59:50.721342 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8677a3e3-3eb7-41c1-92b6-12fdc0c39ada admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:59:50.721958 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8677a3e3-3eb7-41c1-92b6-12fdc0c39ada admin admin] REQUEST_METHOD: `POST` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:59:50.722242 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8677a3e3-3eb7-41c1-92b6-12fdc0c39ada admin admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:59:50.722515 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8677a3e3-3eb7-41c1-92b6-12fdc0c39ada admin admin] PATH_INFO: `/v3/users` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:59:50.723178 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8677a3e3-3eb7-41c1-92b6-12fdc0c39ada admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:59:50.725722 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8677a3e3-3eb7-41c1-92b6-12fdc0c39ada admin admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:59:50.750658 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 1394/2834] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Sep 13 19:59:50 2022] POST /identity/v3/users => generated 297 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 19:59:50.754912 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb746bc-d93e-42a3-ae07-1ec99c5c2615 admin admin] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:59:50.766826 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb746bc-d93e-42a3-ae07-1ec99c5c2615 admin admin] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:59:50.771925 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8248ad-43a3-4cf7-b8c3-25c1cd3d8358 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:59:50.772732 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8248ad-43a3-4cf7-b8c3-25c1cd3d8358 admin admin] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:59:50.773018 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8248ad-43a3-4cf7-b8c3-25c1cd3d8358 admin admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:59:50.773382 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8248ad-43a3-4cf7-b8c3-25c1cd3d8358 admin admin] PATH_INFO: `/v3/roles` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:59:50.774054 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb8248ad-43a3-4cf7-b8c3-25c1cd3d8358 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:59:50.775710 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb8248ad-43a3-4cf7-b8c3-25c1cd3d8358 admin admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:59:50.788603 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 1441/2835] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Sep 13 19:59:50 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 19:59:50.794498 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8677a3e3-3eb7-41c1-92b6-12fdc0c39ada admin admin] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:59:50.811614 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8677a3e3-3eb7-41c1-92b6-12fdc0c39ada admin admin] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:59:50.821043 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c90e4b-ff50-4ae1-93e4-bd902024a46d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:59:50.822342 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c90e4b-ff50-4ae1-93e4-bd902024a46d admin admin] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:59:50.822764 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c90e4b-ff50-4ae1-93e4-bd902024a46d admin admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:59:50.823273 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c90e4b-ff50-4ae1-93e4-bd902024a46d admin admin] PATH_INFO: `/v3/roles` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:59:50.824346 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c90e4b-ff50-4ae1-93e4-bd902024a46d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:59:50.827495 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c90e4b-ff50-4ae1-93e4-bd902024a46d admin admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:59:50.847469 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 1395/2836] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Sep 13 19:59:50 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 19:59:50.853468 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8248ad-43a3-4cf7-b8c3-25c1cd3d8358 admin admin] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:59:50.867863 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8248ad-43a3-4cf7-b8c3-25c1cd3d8358 admin admin] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:59:50.876009 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e44342-fb04-4392-9b1f-a43b578ae0b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:59:50.876835 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e44342-fb04-4392-9b1f-a43b578ae0b7 admin admin] REQUEST_METHOD: `PUT` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:59:50.877112 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e44342-fb04-4392-9b1f-a43b578ae0b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:59:50.877384 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e44342-fb04-4392-9b1f-a43b578ae0b7 admin admin] PATH_INFO: `/v3/projects/b3e9e75966c04d53bcda09f96f659d00/users/4496a907f3644cf6a3404aa40fcdabb8/roles/a259191f6d0e46fabd9f34536bb28747` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:59:50.904511 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e44342-fb04-4392-9b1f-a43b578ae0b7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b3e9e75966c04d53bcda09f96f659d00, user_id=4496a907f3644cf6a3404aa40fcdabb8, role_id=a259191f6d0e46fabd9f34536bb28747)` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:59:50.909845 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e44342-fb04-4392-9b1f-a43b578ae0b7 admin admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:59:50.930094 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 1442/2837] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Sep 13 19:59:50 2022] PUT /identity/v3/projects/b3e9e75966c04d53bcda09f96f659d00/users/4496a907f3644cf6a3404aa40fcdabb8/roles/a259191f6d0e46fabd9f34536bb28747 => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 19:59:50.948532 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90cd724-cdb6-4823-99c5-cd320b530c60 None None] REQUEST_METHOD: `POST` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:59:50.948958 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90cd724-cdb6-4823-99c5-cd320b530c60 None None] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:59:50.949363 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90cd724-cdb6-4823-99c5-cd320b530c60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:59:50.995600 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.auth.core [None req-d90cd724-cdb6-4823-99c5-cd320b530c60 None None] MFA Rules not processed for user `4496a907f3644cf6a3404aa40fcdabb8`. Rule list: `[]` (Enabled: `True`). {{(pid=87935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:59:50.996955 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.fernet_utils [None req-d90cd724-cdb6-4823-99c5-cd320b530c60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:59:51.101870 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 1396/2838] 10.222.0.25 () {58 vars in 958 bytes} [Tue Sep 13 19:59:50 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 19:59:51.106823 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e44342-fb04-4392-9b1f-a43b578ae0b7 admin admin] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:59:51.209218 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e44342-fb04-4392-9b1f-a43b578ae0b7 admin admin] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:59:51.217774 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73cb4b85-ec07-4c52-95b5-c26d865e3590 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:59:51.218762 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73cb4b85-ec07-4c52-95b5-c26d865e3590 admin admin] REQUEST_METHOD: `POST` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:59:51.219239 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73cb4b85-ec07-4c52-95b5-c26d865e3590 admin admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:59:51.219707 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73cb4b85-ec07-4c52-95b5-c26d865e3590 admin admin] PATH_INFO: `/v3/projects` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:59:51.220955 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73cb4b85-ec07-4c52-95b5-c26d865e3590 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:59:51.223881 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73cb4b85-ec07-4c52-95b5-c26d865e3590 admin admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:59:51.270525 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 1443/2839] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Sep 13 19:59:51 2022] POST /identity/v3/projects => generated 393 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 19:59:51.276773 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90cd724-cdb6-4823-99c5-cd320b530c60 None None] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:59:51.294604 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90cd724-cdb6-4823-99c5-cd320b530c60 None None] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:59:51.375142 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda492f7-79d0-4fab-8cf2-10f2fe4d7ccd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:59:51.375663 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda492f7-79d0-4fab-8cf2-10f2fe4d7ccd admin admin] REQUEST_METHOD: `POST` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:59:51.375937 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda492f7-79d0-4fab-8cf2-10f2fe4d7ccd admin admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:59:51.376233 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda492f7-79d0-4fab-8cf2-10f2fe4d7ccd admin admin] PATH_INFO: `/v3/users` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:59:51.376886 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda492f7-79d0-4fab-8cf2-10f2fe4d7ccd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:59:51.378852 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda492f7-79d0-4fab-8cf2-10f2fe4d7ccd admin admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:59:51.406731 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 1397/2840] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Sep 13 19:59:51 2022] POST /identity/v3/users => generated 303 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 19:59:51.411325 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73cb4b85-ec07-4c52-95b5-c26d865e3590 admin admin] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:59:51.423617 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73cb4b85-ec07-4c52-95b5-c26d865e3590 admin admin] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:59:51.429272 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0b3300-a92c-4f00-a745-81d4091cfbea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:59:51.429904 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0b3300-a92c-4f00-a745-81d4091cfbea admin admin] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:59:51.430183 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0b3300-a92c-4f00-a745-81d4091cfbea admin admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:59:51.430476 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0b3300-a92c-4f00-a745-81d4091cfbea admin admin] PATH_INFO: `/v3/roles` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:59:51.431168 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf0b3300-a92c-4f00-a745-81d4091cfbea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:59:51.433666 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf0b3300-a92c-4f00-a745-81d4091cfbea admin admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:59:51.449544 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 1444/2841] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Sep 13 19:59:51 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 13 19:59:51.455081 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda492f7-79d0-4fab-8cf2-10f2fe4d7ccd admin admin] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:59:51.469393 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda492f7-79d0-4fab-8cf2-10f2fe4d7ccd admin admin] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:59:51.477309 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f85545-fbb5-45f6-b01b-28e70f1da3c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:59:51.478455 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f85545-fbb5-45f6-b01b-28e70f1da3c5 admin admin] REQUEST_METHOD: `PUT` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:59:51.478866 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f85545-fbb5-45f6-b01b-28e70f1da3c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:59:51.479140 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f85545-fbb5-45f6-b01b-28e70f1da3c5 admin admin] PATH_INFO: `/v3/projects/745576d5d20c4f77b3c140d23ef0aab1/users/8c18d2c2b0514e9082415e7bda521a53/roles/6ca1d4427ff64e0a9d25d96cfb1445f6` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:59:51.502615 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f85545-fbb5-45f6-b01b-28e70f1da3c5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=745576d5d20c4f77b3c140d23ef0aab1, user_id=8c18d2c2b0514e9082415e7bda521a53, role_id=6ca1d4427ff64e0a9d25d96cfb1445f6)` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:59:51.505361 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f85545-fbb5-45f6-b01b-28e70f1da3c5 admin admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:59:51.525486 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 1398/2842] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Sep 13 19:59:51 2022] PUT /identity/v3/projects/745576d5d20c4f77b3c140d23ef0aab1/users/8c18d2c2b0514e9082415e7bda521a53/roles/6ca1d4427ff64e0a9d25d96cfb1445f6 => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 19:59:51.531398 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0b3300-a92c-4f00-a745-81d4091cfbea admin admin] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:59:51.552659 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0b3300-a92c-4f00-a745-81d4091cfbea admin admin] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:59:51.639237 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3c1457-4a34-4dbc-9356-a7b2cdc94fef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:59:51.639783 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3c1457-4a34-4dbc-9356-a7b2cdc94fef admin admin] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:59:51.640062 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3c1457-4a34-4dbc-9356-a7b2cdc94fef admin admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:59:51.640543 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3c1457-4a34-4dbc-9356-a7b2cdc94fef admin admin] PATH_INFO: `/v3/roles` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:59:51.641203 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a3c1457-4a34-4dbc-9356-a7b2cdc94fef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:59:51.642879 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a3c1457-4a34-4dbc-9356-a7b2cdc94fef admin admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:59:51.656251 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 1445/2843] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Sep 13 19:59:51 2022] GET /identity/v3/roles => generated 1420 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 19:59:51.661719 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f85545-fbb5-45f6-b01b-28e70f1da3c5 admin admin] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:59:51.682986 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f85545-fbb5-45f6-b01b-28e70f1da3c5 admin admin] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:59:51.689797 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9f884e-9e0e-498f-9d65-bbefa134ccb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:59:51.690626 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9f884e-9e0e-498f-9d65-bbefa134ccb9 admin admin] REQUEST_METHOD: `PUT` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:59:51.690911 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9f884e-9e0e-498f-9d65-bbefa134ccb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:59:51.691186 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9f884e-9e0e-498f-9d65-bbefa134ccb9 admin admin] PATH_INFO: `/v3/projects/745576d5d20c4f77b3c140d23ef0aab1/users/8c18d2c2b0514e9082415e7bda521a53/roles/6ca1d4427ff64e0a9d25d96cfb1445f6` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:59:51.695371 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a9f884e-9e0e-498f-9d65-bbefa134ccb9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=745576d5d20c4f77b3c140d23ef0aab1, user_id=8c18d2c2b0514e9082415e7bda521a53, role_id=6ca1d4427ff64e0a9d25d96cfb1445f6)` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:59:51.698752 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a9f884e-9e0e-498f-9d65-bbefa134ccb9 admin admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:59:51.717546 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 1399/2844] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Sep 13 19:59:51 2022] PUT /identity/v3/projects/745576d5d20c4f77b3c140d23ef0aab1/users/8c18d2c2b0514e9082415e7bda521a53/roles/6ca1d4427ff64e0a9d25d96cfb1445f6 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 19:59:51.730507 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a73f08-648b-4bc8-be3d-88c5fda9014b None None] REQUEST_METHOD: `POST` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:59:51.730835 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a73f08-648b-4bc8-be3d-88c5fda9014b None None] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:59:51.731068 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a73f08-648b-4bc8-be3d-88c5fda9014b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:59:51.756813 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG dbcounter [-] [87934] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:59:51.767146 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.auth.core [None req-08a73f08-648b-4bc8-be3d-88c5fda9014b None None] MFA Rules not processed for user `8c18d2c2b0514e9082415e7bda521a53`. Rule list: `[]` (Enabled: `True`). {{(pid=87934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:59:51.768960 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.fernet_utils [None req-08a73f08-648b-4bc8-be3d-88c5fda9014b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:59:51.892253 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 1446/2845] 10.222.0.25 () {58 vars in 958 bytes} [Tue Sep 13 19:59:51 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 19:59:51.907018 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9f884e-9e0e-498f-9d65-bbefa134ccb9 admin admin] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:59:51.908976 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.fernet_utils [None req-2a9f884e-9e0e-498f-9d65-bbefa134ccb9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:59:51.916273 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG dbcounter [-] [87935] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=87935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:59:51.984881 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9f884e-9e0e-498f-9d65-bbefa134ccb9 admin admin] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:59:51.989024 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64bd0ed-bbbd-4692-bc2b-2848041deea8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cbb50c88b794a7f9f26844effde7d63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a10a4268f3c4cb29f4e00c292e2df62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:59:51.989755 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64bd0ed-bbbd-4692-bc2b-2848041deea8 service cinder] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:59:51.990127 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64bd0ed-bbbd-4692-bc2b-2848041deea8 service cinder] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:59:51.990486 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64bd0ed-bbbd-4692-bc2b-2848041deea8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:59:52.002554 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c64bd0ed-bbbd-4692-bc2b-2848041deea8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:59:52.004170 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c64bd0ed-bbbd-4692-bc2b-2848041deea8 service cinder] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:59:52.016638 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 1400/2846] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Sep 13 19:59:51 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 19:59:52.096763 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a73f08-648b-4bc8-be3d-88c5fda9014b None None] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:59:52.098857 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.fernet_utils [None req-08a73f08-648b-4bc8-be3d-88c5fda9014b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:59:52.118280 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a73f08-648b-4bc8-be3d-88c5fda9014b None None] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:59:52.124166 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3abf731c-0572-4deb-9de7-6ace8dd48c56 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cbb50c88b794a7f9f26844effde7d63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a10a4268f3c4cb29f4e00c292e2df62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:59:52.124965 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abf731c-0572-4deb-9de7-6ace8dd48c56 service cinder] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:59:52.125252 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abf731c-0572-4deb-9de7-6ace8dd48c56 service cinder] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:59:52.125843 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abf731c-0572-4deb-9de7-6ace8dd48c56 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:59:52.222886 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3abf731c-0572-4deb-9de7-6ace8dd48c56 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:59:52.224406 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3abf731c-0572-4deb-9de7-6ace8dd48c56 service cinder] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:59:52.235927 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 1447/2847] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Sep 13 19:59:52 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 19:59:55.969512 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64bd0ed-bbbd-4692-bc2b-2848041deea8 service cinder] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:59:56.049568 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64bd0ed-bbbd-4692-bc2b-2848041deea8 service cinder] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:59:56.054375 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba91096-3f71-4b41-869b-237a347433be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:59:56.055118 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba91096-3f71-4b41-869b-237a347433be admin admin] REQUEST_METHOD: `DELETE` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:59:56.055393 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba91096-3f71-4b41-869b-237a347433be admin admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:59:56.055680 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba91096-3f71-4b41-869b-237a347433be admin admin] PATH_INFO: `/v3/users/4496a907f3644cf6a3404aa40fcdabb8` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:59:56.056872 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba91096-3f71-4b41-869b-237a347433be admin admin] RBAC: Authorizing `identity:delete_user(user_id=4496a907f3644cf6a3404aa40fcdabb8)` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:59:56.058995 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba91096-3f71-4b41-869b-237a347433be admin admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:59:56.115532 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.notifications [None req-6ba91096-3f71-4b41-869b-237a347433be admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4496a907f3644cf6a3404aa40fcdabb8'} {{(pid=87935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:59:56.124968 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.notifications [None req-6ba91096-3f71-4b41-869b-237a347433be admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4496a907f3644cf6a3404aa40fcdabb8'} {{(pid=87935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:59:56.147114 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.notifications [None req-6ba91096-3f71-4b41-869b-237a347433be admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4496a907f3644cf6a3404aa40fcdabb8'} {{(pid=87935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:59:56.147910 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.notifications [None req-6ba91096-3f71-4b41-869b-237a347433be admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4496a907f3644cf6a3404aa40fcdabb8'} {{(pid=87935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:59:56.148656 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.notifications [None req-6ba91096-3f71-4b41-869b-237a347433be admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4496a907f3644cf6a3404aa40fcdabb8'} {{(pid=87935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:59:56.162320 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 1401/2848] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Sep 13 19:59:55 2022] DELETE /identity/v3/users/4496a907f3644cf6a3404aa40fcdabb8 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 19:59:56.168301 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675265fd-74f5-4729-80b7-b27fe5d5a620 None None] REQUEST_METHOD: `POST` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:59:56.168864 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675265fd-74f5-4729-80b7-b27fe5d5a620 None None] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:59:56.168864 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675265fd-74f5-4729-80b7-b27fe5d5a620 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:59:56.189834 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.auth.core [None req-675265fd-74f5-4729-80b7-b27fe5d5a620 None None] MFA Rules not processed for user `7b0aed92d02344acb92a0e4aa67c3068`. Rule list: `[]` (Enabled: `True`). {{(pid=87934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:59:56.191074 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.fernet_utils [None req-675265fd-74f5-4729-80b7-b27fe5d5a620 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:59:56.270275 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 1448/2849] 10.222.0.25 () {58 vars in 958 bytes} [Tue Sep 13 19:59:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 19:59:56.281531 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba91096-3f71-4b41-869b-237a347433be admin admin] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:59:56.283035 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.fernet_utils [None req-6ba91096-3f71-4b41-869b-237a347433be admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:59:56.318576 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG dbcounter [-] [87935] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:59:56.368402 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba91096-3f71-4b41-869b-237a347433be admin admin] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:59:56.372420 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425c03f4-5ea4-494f-9fb0-6d213abf08a7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1196a96e4a404f559600b69f929ea9da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a10a4268f3c4cb29f4e00c292e2df62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:59:56.373137 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425c03f4-5ea4-494f-9fb0-6d213abf08a7 service neutron] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:59:56.373453 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425c03f4-5ea4-494f-9fb0-6d213abf08a7 service neutron] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:59:56.373765 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425c03f4-5ea4-494f-9fb0-6d213abf08a7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:59:56.387017 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-425c03f4-5ea4-494f-9fb0-6d213abf08a7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:59:56.389829 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-425c03f4-5ea4-494f-9fb0-6d213abf08a7 service neutron] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:59:56.410099 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 1402/2850] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Sep 13 19:59:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 13 19:59:56.801667 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675265fd-74f5-4729-80b7-b27fe5d5a620 None None] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:59:56.803729 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.fernet_utils [None req-675265fd-74f5-4729-80b7-b27fe5d5a620 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:59:56.827906 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675265fd-74f5-4729-80b7-b27fe5d5a620 None None] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:59:56.835760 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661c0f22-8e7d-4394-98e3-8990f8f9447c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:59:56.836340 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661c0f22-8e7d-4394-98e3-8990f8f9447c admin admin] REQUEST_METHOD: `DELETE` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:59:56.836642 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661c0f22-8e7d-4394-98e3-8990f8f9447c admin admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:59:56.836907 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661c0f22-8e7d-4394-98e3-8990f8f9447c admin admin] PATH_INFO: `/v3/projects/b3e9e75966c04d53bcda09f96f659d00` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:59:56.839373 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-661c0f22-8e7d-4394-98e3-8990f8f9447c admin admin] RBAC: Authorizing `identity:delete_project(project_id=b3e9e75966c04d53bcda09f96f659d00)` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:59:56.842250 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-661c0f22-8e7d-4394-98e3-8990f8f9447c admin admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:59:56.904698 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG dbcounter [-] [87934] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=87934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:59:56.924351 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.notifications [None req-661c0f22-8e7d-4394-98e3-8990f8f9447c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b3e9e75966c04d53bcda09f96f659d00', 'request_id': 'req-661c0f22-8e7d-4394-98e3-8990f8f9447c'} {{(pid=87934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:59:56.932612 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.notifications [None req-661c0f22-8e7d-4394-98e3-8990f8f9447c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b3e9e75966c04d53bcda09f96f659d00', 'request_id': 'req-661c0f22-8e7d-4394-98e3-8990f8f9447c'} {{(pid=87934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:59:56.943141 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.notifications [None req-661c0f22-8e7d-4394-98e3-8990f8f9447c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b3e9e75966c04d53bcda09f96f659d00', 'request_id': 'req-661c0f22-8e7d-4394-98e3-8990f8f9447c'} {{(pid=87934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:59:56.968178 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.notifications [None req-661c0f22-8e7d-4394-98e3-8990f8f9447c admin admin] The token cache is being invalidate because project b3e9e75966c04d53bcda09f96f659d00 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87934) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 19:59:56.968727 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.notifications [None req-661c0f22-8e7d-4394-98e3-8990f8f9447c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:59:56.969857 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.notifications [None req-661c0f22-8e7d-4394-98e3-8990f8f9447c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:59:56.972504 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 1449/2851] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Sep 13 19:59:56 2022] DELETE /identity/v3/projects/b3e9e75966c04d53bcda09f96f659d00 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 19:59:56.978533 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425c03f4-5ea4-494f-9fb0-6d213abf08a7 service neutron] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:59:56.990405 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425c03f4-5ea4-494f-9fb0-6d213abf08a7 service neutron] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:59:57.087331 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac456480-6567-4804-af21-23935836ca6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:59:57.088281 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac456480-6567-4804-af21-23935836ca6b admin admin] REQUEST_METHOD: `DELETE` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:59:57.088735 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac456480-6567-4804-af21-23935836ca6b admin admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:59:57.089186 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac456480-6567-4804-af21-23935836ca6b admin admin] PATH_INFO: `/v3/users/8c18d2c2b0514e9082415e7bda521a53` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:59:57.091026 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac456480-6567-4804-af21-23935836ca6b admin admin] RBAC: Authorizing `identity:delete_user(user_id=8c18d2c2b0514e9082415e7bda521a53)` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:59:57.094476 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac456480-6567-4804-af21-23935836ca6b admin admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:59:57.185418 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.notifications [None req-ac456480-6567-4804-af21-23935836ca6b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8c18d2c2b0514e9082415e7bda521a53'} {{(pid=87935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:59:57.195021 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.notifications [None req-ac456480-6567-4804-af21-23935836ca6b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8c18d2c2b0514e9082415e7bda521a53'} {{(pid=87935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:59:57.218751 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.notifications [None req-ac456480-6567-4804-af21-23935836ca6b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8c18d2c2b0514e9082415e7bda521a53'} {{(pid=87935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:59:57.219679 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.notifications [None req-ac456480-6567-4804-af21-23935836ca6b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8c18d2c2b0514e9082415e7bda521a53'} {{(pid=87935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:59:57.220417 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.notifications [None req-ac456480-6567-4804-af21-23935836ca6b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8c18d2c2b0514e9082415e7bda521a53'} {{(pid=87935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:59:57.235578 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 1403/2852] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Sep 13 19:59:56 2022] DELETE /identity/v3/users/8c18d2c2b0514e9082415e7bda521a53 => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 19:59:57.639409 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661c0f22-8e7d-4394-98e3-8990f8f9447c admin admin] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:59:57.641877 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.fernet_utils [None req-661c0f22-8e7d-4394-98e3-8990f8f9447c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:59:57.667150 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661c0f22-8e7d-4394-98e3-8990f8f9447c admin admin] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:59:57.751541 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30563b78-6acf-4d66-af32-7e09e973ccfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:59:57.752200 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30563b78-6acf-4d66-af32-7e09e973ccfb admin admin] REQUEST_METHOD: `DELETE` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:59:57.752501 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30563b78-6acf-4d66-af32-7e09e973ccfb admin admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:59:57.752776 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30563b78-6acf-4d66-af32-7e09e973ccfb admin admin] PATH_INFO: `/v3/projects/745576d5d20c4f77b3c140d23ef0aab1` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:59:57.753999 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30563b78-6acf-4d66-af32-7e09e973ccfb admin admin] RBAC: Authorizing `identity:delete_project(project_id=745576d5d20c4f77b3c140d23ef0aab1)` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:59:57.755968 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30563b78-6acf-4d66-af32-7e09e973ccfb admin admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:59:57.811945 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.notifications [None req-30563b78-6acf-4d66-af32-7e09e973ccfb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '745576d5d20c4f77b3c140d23ef0aab1', 'request_id': 'req-30563b78-6acf-4d66-af32-7e09e973ccfb'} {{(pid=87934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:59:57.820158 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.notifications [None req-30563b78-6acf-4d66-af32-7e09e973ccfb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '745576d5d20c4f77b3c140d23ef0aab1', 'request_id': 'req-30563b78-6acf-4d66-af32-7e09e973ccfb'} {{(pid=87934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:59:57.826902 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.notifications [None req-30563b78-6acf-4d66-af32-7e09e973ccfb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '745576d5d20c4f77b3c140d23ef0aab1', 'request_id': 'req-30563b78-6acf-4d66-af32-7e09e973ccfb'} {{(pid=87934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:59:57.843294 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.notifications [None req-30563b78-6acf-4d66-af32-7e09e973ccfb admin admin] The token cache is being invalidate because project 745576d5d20c4f77b3c140d23ef0aab1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87934) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 19:59:57.843685 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.notifications [None req-30563b78-6acf-4d66-af32-7e09e973ccfb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:59:57.844499 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.notifications [None req-30563b78-6acf-4d66-af32-7e09e973ccfb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:59:57.846121 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 1450/2853] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Sep 13 19:59:57 2022] DELETE /identity/v3/projects/745576d5d20c4f77b3c140d23ef0aab1 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 19:59:57.851653 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee301b48-9ffc-4fd4-b223-27edb5844d08 None None] REQUEST_METHOD: `POST` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:59:57.852001 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee301b48-9ffc-4fd4-b223-27edb5844d08 None None] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:59:57.852367 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee301b48-9ffc-4fd4-b223-27edb5844d08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:59:57.882071 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.auth.core [None req-ee301b48-9ffc-4fd4-b223-27edb5844d08 None None] MFA Rules not processed for user `7b0aed92d02344acb92a0e4aa67c3068`. Rule list: `[]` (Enabled: `True`). {{(pid=87935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:59:57.884236 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.fernet_utils [None req-ee301b48-9ffc-4fd4-b223-27edb5844d08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:59:57.951950 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG dbcounter [-] [87935] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:59:57.984508 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 1404/2854] 10.222.0.25 () {58 vars in 958 bytes} [Tue Sep 13 19:59:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 19:59:57.997686 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc40c3d4-1b19-4d8d-9513-52734e142cec None None] REQUEST_METHOD: `POST` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:59:57.998188 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc40c3d4-1b19-4d8d-9513-52734e142cec None None] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:59:57.998667 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc40c3d4-1b19-4d8d-9513-52734e142cec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:59:58.033939 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.auth.core [None req-cc40c3d4-1b19-4d8d-9513-52734e142cec None None] MFA Rules not processed for user `7b0aed92d02344acb92a0e4aa67c3068`. Rule list: `[]` (Enabled: `True`). {{(pid=87934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:59:58.035218 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.fernet_utils [None req-cc40c3d4-1b19-4d8d-9513-52734e142cec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:59:58.047475 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 1451/2855] 10.222.0.25 () {58 vars in 958 bytes} [Tue Sep 13 19:59:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 19:59:58.052265 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee301b48-9ffc-4fd4-b223-27edb5844d08 None None] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:59:58.064772 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee301b48-9ffc-4fd4-b223-27edb5844d08 None None] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:59:58.071166 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2dee1a7-01bd-4c01-b646-8376273502c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:59:58.071873 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2dee1a7-01bd-4c01-b646-8376273502c7 admin admin] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:59:58.072200 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2dee1a7-01bd-4c01-b646-8376273502c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:59:58.072664 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2dee1a7-01bd-4c01-b646-8376273502c7 admin admin] PATH_INFO: `/v3/domains` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:59:58.073463 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2dee1a7-01bd-4c01-b646-8376273502c7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87935) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:59:58.073986 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2dee1a7-01bd-4c01-b646-8376273502c7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:59:58.076102 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2dee1a7-01bd-4c01-b646-8376273502c7 admin admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:59:58.092765 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 1405/2856] 10.222.0.25 () {58 vars in 1153 bytes} [Tue Sep 13 19:59:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:59:58.099271 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc40c3d4-1b19-4d8d-9513-52734e142cec None None] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:59:58.112397 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc40c3d4-1b19-4d8d-9513-52734e142cec None None] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:59:58.120514 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d11d55-3491-43e4-b0da-e0cf38e1f330 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:59:58.121527 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d11d55-3491-43e4-b0da-e0cf38e1f330 admin admin] REQUEST_METHOD: `POST` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:59:58.121985 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d11d55-3491-43e4-b0da-e0cf38e1f330 admin admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:59:58.122432 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d11d55-3491-43e4-b0da-e0cf38e1f330 admin admin] PATH_INFO: `/v3/projects` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:59:58.123629 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d11d55-3491-43e4-b0da-e0cf38e1f330 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:59:58.127159 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d11d55-3491-43e4-b0da-e0cf38e1f330 admin admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:59:58.177605 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 1452/2857] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Sep 13 19:59:58 2022] POST /identity/v3/projects => generated 375 bytes in 79 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 13 19:59:58.183881 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2dee1a7-01bd-4c01-b646-8376273502c7 admin admin] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:59:58.202433 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2dee1a7-01bd-4c01-b646-8376273502c7 admin admin] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:59:58.308469 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b099f1f-ee6e-48ce-8932-2f719cac28d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:59:58.309510 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b099f1f-ee6e-48ce-8932-2f719cac28d1 admin admin] REQUEST_METHOD: `POST` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:59:58.309991 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b099f1f-ee6e-48ce-8932-2f719cac28d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:59:58.310454 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b099f1f-ee6e-48ce-8932-2f719cac28d1 admin admin] PATH_INFO: `/v3/users` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:59:58.311602 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b099f1f-ee6e-48ce-8932-2f719cac28d1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:59:58.315375 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b099f1f-ee6e-48ce-8932-2f719cac28d1 admin admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:59:58.353023 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 1406/2858] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Sep 13 19:59:58 2022] POST /identity/v3/users => generated 288 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 13 19:59:58.357723 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d11d55-3491-43e4-b0da-e0cf38e1f330 admin admin] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:59:58.370209 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d11d55-3491-43e4-b0da-e0cf38e1f330 admin admin] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:59:58.375601 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c376abd1-6733-4427-92ca-0cea16c92899 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:59:58.376268 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c376abd1-6733-4427-92ca-0cea16c92899 admin admin] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:59:58.376558 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c376abd1-6733-4427-92ca-0cea16c92899 admin admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:59:58.376828 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c376abd1-6733-4427-92ca-0cea16c92899 admin admin] PATH_INFO: `/v3/roles` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:59:58.377493 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c376abd1-6733-4427-92ca-0cea16c92899 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:59:58.379143 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c376abd1-6733-4427-92ca-0cea16c92899 admin admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:59:58.391060 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 1453/2859] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Sep 13 19:59:58 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 19:59:58.397739 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b099f1f-ee6e-48ce-8932-2f719cac28d1 admin admin] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:59:58.408900 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b099f1f-ee6e-48ce-8932-2f719cac28d1 admin admin] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:59:58.414907 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0abb15-b19a-4fbf-a71f-cc5dbb8fd090 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:59:58.415826 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0abb15-b19a-4fbf-a71f-cc5dbb8fd090 admin admin] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:59:58.416202 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0abb15-b19a-4fbf-a71f-cc5dbb8fd090 admin admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:59:58.416612 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0abb15-b19a-4fbf-a71f-cc5dbb8fd090 admin admin] PATH_INFO: `/v3/roles` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:59:58.417412 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d0abb15-b19a-4fbf-a71f-cc5dbb8fd090 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:59:58.419300 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d0abb15-b19a-4fbf-a71f-cc5dbb8fd090 admin admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:59:58.432001 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 1407/2860] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Sep 13 19:59:58 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 13 19:59:58.438430 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c376abd1-6733-4427-92ca-0cea16c92899 admin admin] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:59:58.455816 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c376abd1-6733-4427-92ca-0cea16c92899 admin admin] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:59:58.463998 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e95de7e-8519-4957-88dc-dae336f3beba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:59:58.465162 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e95de7e-8519-4957-88dc-dae336f3beba admin admin] REQUEST_METHOD: `PUT` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:59:58.465595 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e95de7e-8519-4957-88dc-dae336f3beba admin admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:59:58.466042 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e95de7e-8519-4957-88dc-dae336f3beba admin admin] PATH_INFO: `/v3/projects/4c2f3fafc2034568a0cadd56aa03daa6/users/78d18d9ab0bb4f6a90136c0a581effed/roles/a259191f6d0e46fabd9f34536bb28747` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:59:58.472671 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG dbcounter [-] [87934] Writing DB stats keystone:SELECT=85,keystone:DELETE=12,keystone:INSERT=3 {{(pid=87934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:59:58.496419 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e95de7e-8519-4957-88dc-dae336f3beba admin admin] RBAC: Authorizing `identity:create_grant(project_id=4c2f3fafc2034568a0cadd56aa03daa6, user_id=78d18d9ab0bb4f6a90136c0a581effed, role_id=a259191f6d0e46fabd9f34536bb28747)` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:59:58.501529 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e95de7e-8519-4957-88dc-dae336f3beba admin admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:59:58.525748 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 1454/2861] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Sep 13 19:59:58 2022] PUT /identity/v3/projects/4c2f3fafc2034568a0cadd56aa03daa6/users/78d18d9ab0bb4f6a90136c0a581effed/roles/a259191f6d0e46fabd9f34536bb28747 => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 19:59:58.544518 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd814b2e-a939-4924-a891-e960d1e025b8 None None] REQUEST_METHOD: `POST` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:59:58.544985 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd814b2e-a939-4924-a891-e960d1e025b8 None None] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:59:58.545314 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd814b2e-a939-4924-a891-e960d1e025b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:59:58.587836 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.auth.core [None req-bd814b2e-a939-4924-a891-e960d1e025b8 None None] MFA Rules not processed for user `78d18d9ab0bb4f6a90136c0a581effed`. Rule list: `[]` (Enabled: `True`). {{(pid=87935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:59:58.589134 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.fernet_utils [None req-bd814b2e-a939-4924-a891-e960d1e025b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:59:58.675802 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 1408/2862] 10.222.0.25 () {58 vars in 958 bytes} [Tue Sep 13 19:59:58 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 19:59:58.692853 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e95de7e-8519-4957-88dc-dae336f3beba admin admin] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:59:58.695389 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.fernet_utils [None req-2e95de7e-8519-4957-88dc-dae336f3beba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:59:58.768862 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e95de7e-8519-4957-88dc-dae336f3beba admin admin] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:59:58.773462 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925d74c9-3580-46bb-ae1e-c0ad06a45696 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '907d44d3b6944ccb83999d8e489871d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a10a4268f3c4cb29f4e00c292e2df62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:59:58.774092 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925d74c9-3580-46bb-ae1e-c0ad06a45696 service glance] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:59:58.774372 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925d74c9-3580-46bb-ae1e-c0ad06a45696 service glance] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:59:58.774642 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925d74c9-3580-46bb-ae1e-c0ad06a45696 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:59:58.785797 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-925d74c9-3580-46bb-ae1e-c0ad06a45696 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:59:58.787645 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-925d74c9-3580-46bb-ae1e-c0ad06a45696 service glance] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:59:58.798673 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 1455/2863] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Sep 13 19:59:58 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 20:00:08.672625 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG dbcounter [-] [87935] Writing DB stats keystone:SELECT=78,keystone:INSERT=3 {{(pid=87935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:00:08.793446 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG dbcounter [-] [87934] Writing DB stats keystone:SELECT=32,keystone:INSERT=1 {{(pid=87934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:00:13.952097 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd814b2e-a939-4924-a891-e960d1e025b8 None None] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:00:14.044680 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd814b2e-a939-4924-a891-e960d1e025b8 None None] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:00:14.050084 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97e88a1-14ce-41c1-8060-9071514586df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:00:14.050790 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97e88a1-14ce-41c1-8060-9071514586df admin admin] REQUEST_METHOD: `DELETE` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:00:14.051078 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97e88a1-14ce-41c1-8060-9071514586df admin admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:00:14.051491 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97e88a1-14ce-41c1-8060-9071514586df admin admin] PATH_INFO: `/v3/users/78d18d9ab0bb4f6a90136c0a581effed` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:00:14.053333 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e97e88a1-14ce-41c1-8060-9071514586df admin admin] RBAC: Authorizing `identity:delete_user(user_id=78d18d9ab0bb4f6a90136c0a581effed)` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:00:14.055739 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e97e88a1-14ce-41c1-8060-9071514586df admin admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:00:14.120966 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.notifications [None req-e97e88a1-14ce-41c1-8060-9071514586df admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '78d18d9ab0bb4f6a90136c0a581effed'} {{(pid=87935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:00:14.131577 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.notifications [None req-e97e88a1-14ce-41c1-8060-9071514586df admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '78d18d9ab0bb4f6a90136c0a581effed'} {{(pid=87935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:00:14.150783 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.notifications [None req-e97e88a1-14ce-41c1-8060-9071514586df admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '78d18d9ab0bb4f6a90136c0a581effed'} {{(pid=87935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:00:14.151990 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.notifications [None req-e97e88a1-14ce-41c1-8060-9071514586df admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '78d18d9ab0bb4f6a90136c0a581effed'} {{(pid=87935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:00:14.153012 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.notifications [None req-e97e88a1-14ce-41c1-8060-9071514586df admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '78d18d9ab0bb4f6a90136c0a581effed'} {{(pid=87935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:00:14.176100 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 1409/2864] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Sep 13 20:00:13 2022] DELETE /identity/v3/users/78d18d9ab0bb4f6a90136c0a581effed => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 20:00:14.182202 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719ee289-fef1-4913-8493-052c96845e9e None None] REQUEST_METHOD: `POST` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:00:14.182754 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719ee289-fef1-4913-8493-052c96845e9e None None] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:00:14.182754 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719ee289-fef1-4913-8493-052c96845e9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:00:14.207312 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.auth.core [None req-719ee289-fef1-4913-8493-052c96845e9e None None] MFA Rules not processed for user `7b0aed92d02344acb92a0e4aa67c3068`. Rule list: `[]` (Enabled: `True`). {{(pid=87934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:00:14.208588 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.fernet_utils [None req-719ee289-fef1-4913-8493-052c96845e9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:00:14.292652 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 1456/2865] 10.222.0.25 () {58 vars in 958 bytes} [Tue Sep 13 20:00:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 20:00:14.304284 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97e88a1-14ce-41c1-8060-9071514586df admin admin] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:00:14.306224 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.fernet_utils [None req-e97e88a1-14ce-41c1-8060-9071514586df admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:00:14.390729 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97e88a1-14ce-41c1-8060-9071514586df admin admin] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:00:14.394916 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2446330d-c85a-4fde-a965-e5db3d6fad9d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1196a96e4a404f559600b69f929ea9da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a10a4268f3c4cb29f4e00c292e2df62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:00:14.395535 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2446330d-c85a-4fde-a965-e5db3d6fad9d service neutron] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:00:14.395808 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2446330d-c85a-4fde-a965-e5db3d6fad9d service neutron] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:00:14.396073 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2446330d-c85a-4fde-a965-e5db3d6fad9d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:00:14.406962 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2446330d-c85a-4fde-a965-e5db3d6fad9d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:00:14.408543 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2446330d-c85a-4fde-a965-e5db3d6fad9d service neutron] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:00:14.420747 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 1410/2866] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Sep 13 20:00:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 20:00:15.065206 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719ee289-fef1-4913-8493-052c96845e9e None None] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:00:15.067413 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.fernet_utils [None req-719ee289-fef1-4913-8493-052c96845e9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:00:15.090902 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719ee289-fef1-4913-8493-052c96845e9e None None] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:00:15.097249 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca75334-7d78-4ca9-b719-cf1ad21e163a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:00:15.098331 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca75334-7d78-4ca9-b719-cf1ad21e163a admin admin] REQUEST_METHOD: `DELETE` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:00:15.098802 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca75334-7d78-4ca9-b719-cf1ad21e163a admin admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:00:15.099369 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca75334-7d78-4ca9-b719-cf1ad21e163a admin admin] PATH_INFO: `/v3/projects/4c2f3fafc2034568a0cadd56aa03daa6` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:00:15.102107 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca75334-7d78-4ca9-b719-cf1ad21e163a admin admin] RBAC: Authorizing `identity:delete_project(project_id=4c2f3fafc2034568a0cadd56aa03daa6)` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:00:15.105892 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca75334-7d78-4ca9-b719-cf1ad21e163a admin admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:00:15.179986 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.notifications [None req-6ca75334-7d78-4ca9-b719-cf1ad21e163a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4c2f3fafc2034568a0cadd56aa03daa6', 'request_id': 'req-6ca75334-7d78-4ca9-b719-cf1ad21e163a'} {{(pid=87934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:00:15.192058 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.notifications [None req-6ca75334-7d78-4ca9-b719-cf1ad21e163a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4c2f3fafc2034568a0cadd56aa03daa6', 'request_id': 'req-6ca75334-7d78-4ca9-b719-cf1ad21e163a'} {{(pid=87934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:00:15.202997 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.notifications [None req-6ca75334-7d78-4ca9-b719-cf1ad21e163a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4c2f3fafc2034568a0cadd56aa03daa6', 'request_id': 'req-6ca75334-7d78-4ca9-b719-cf1ad21e163a'} {{(pid=87934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:00:15.228099 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.notifications [None req-6ca75334-7d78-4ca9-b719-cf1ad21e163a admin admin] The token cache is being invalidate because project 4c2f3fafc2034568a0cadd56aa03daa6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87934) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 20:00:15.228619 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.notifications [None req-6ca75334-7d78-4ca9-b719-cf1ad21e163a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:00:15.229646 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.notifications [None req-6ca75334-7d78-4ca9-b719-cf1ad21e163a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:00:15.232165 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 1457/2867] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Sep 13 20:00:15 2022] DELETE /identity/v3/projects/4c2f3fafc2034568a0cadd56aa03daa6 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 20:00:15.238246 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec5f456-fd81-4b8d-be63-78c2849f6c69 None None] REQUEST_METHOD: `POST` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:00:15.238872 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec5f456-fd81-4b8d-be63-78c2849f6c69 None None] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:00:15.239028 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec5f456-fd81-4b8d-be63-78c2849f6c69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:00:15.263748 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.auth.core [None req-2ec5f456-fd81-4b8d-be63-78c2849f6c69 None None] MFA Rules not processed for user `7b0aed92d02344acb92a0e4aa67c3068`. Rule list: `[]` (Enabled: `True`). {{(pid=87935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:00:15.265486 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.fernet_utils [None req-2ec5f456-fd81-4b8d-be63-78c2849f6c69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:00:15.285609 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG dbcounter [-] [87935] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:00:15.345627 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 1411/2868] 10.222.0.25 () {58 vars in 958 bytes} [Tue Sep 13 20:00:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:00:15.354795 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd690022-f8b1-412b-8a0e-dcb1358fefcd None None] REQUEST_METHOD: `POST` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:00:15.355073 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd690022-f8b1-412b-8a0e-dcb1358fefcd None None] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:00:15.355346 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd690022-f8b1-412b-8a0e-dcb1358fefcd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:00:15.377121 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.auth.core [None req-dd690022-f8b1-412b-8a0e-dcb1358fefcd None None] MFA Rules not processed for user `7b0aed92d02344acb92a0e4aa67c3068`. Rule list: `[]` (Enabled: `True`). {{(pid=87934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:00:15.378344 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.fernet_utils [None req-dd690022-f8b1-412b-8a0e-dcb1358fefcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:00:15.387562 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 1458/2869] 10.222.0.25 () {58 vars in 958 bytes} [Tue Sep 13 20:00:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:00:15.392296 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec5f456-fd81-4b8d-be63-78c2849f6c69 None None] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:00:15.402666 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec5f456-fd81-4b8d-be63-78c2849f6c69 None None] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:00:15.407778 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90bbc673-ce08-4310-8eba-a6a6c750715d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:00:15.408442 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bbc673-ce08-4310-8eba-a6a6c750715d admin admin] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:00:15.408721 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bbc673-ce08-4310-8eba-a6a6c750715d admin admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:00:15.408984 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bbc673-ce08-4310-8eba-a6a6c750715d admin admin] PATH_INFO: `/v3/domains` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:00:15.409634 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90bbc673-ce08-4310-8eba-a6a6c750715d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87935) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 20:00:15.409930 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90bbc673-ce08-4310-8eba-a6a6c750715d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:00:15.411557 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90bbc673-ce08-4310-8eba-a6a6c750715d admin admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:00:15.426135 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 1412/2870] 10.222.0.25 () {58 vars in 1153 bytes} [Tue Sep 13 20:00:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 20:00:15.431708 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd690022-f8b1-412b-8a0e-dcb1358fefcd None None] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:00:15.441367 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd690022-f8b1-412b-8a0e-dcb1358fefcd None None] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:00:15.446826 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1cc59d7-47d4-42bd-8cb0-f269f6714408 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:00:15.447449 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1cc59d7-47d4-42bd-8cb0-f269f6714408 admin admin] REQUEST_METHOD: `POST` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:00:15.447871 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1cc59d7-47d4-42bd-8cb0-f269f6714408 admin admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:00:15.448141 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1cc59d7-47d4-42bd-8cb0-f269f6714408 admin admin] PATH_INFO: `/v3/projects` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:00:15.448815 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1cc59d7-47d4-42bd-8cb0-f269f6714408 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:00:15.450719 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1cc59d7-47d4-42bd-8cb0-f269f6714408 admin admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:00:15.486686 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 1459/2871] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Sep 13 20:00:15 2022] POST /identity/v3/projects => generated 375 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 20:00:15.491862 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90bbc673-ce08-4310-8eba-a6a6c750715d admin admin] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:00:15.502318 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90bbc673-ce08-4310-8eba-a6a6c750715d admin admin] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:00:15.596478 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c516268-7559-4517-a4aa-d135ceb01bbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:00:15.597217 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c516268-7559-4517-a4aa-d135ceb01bbd admin admin] REQUEST_METHOD: `POST` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:00:15.597496 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c516268-7559-4517-a4aa-d135ceb01bbd admin admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:00:15.597851 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c516268-7559-4517-a4aa-d135ceb01bbd admin admin] PATH_INFO: `/v3/users` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:00:15.598494 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c516268-7559-4517-a4aa-d135ceb01bbd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:00:15.601409 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c516268-7559-4517-a4aa-d135ceb01bbd admin admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:00:15.635309 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 1413/2872] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Sep 13 20:00:15 2022] POST /identity/v3/users => generated 288 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 13 20:00:15.640915 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1cc59d7-47d4-42bd-8cb0-f269f6714408 admin admin] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:00:15.658339 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1cc59d7-47d4-42bd-8cb0-f269f6714408 admin admin] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:00:15.666384 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147d3aad-7707-467a-bbaa-38fcef1caa3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:00:15.667060 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147d3aad-7707-467a-bbaa-38fcef1caa3c admin admin] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:00:15.667331 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147d3aad-7707-467a-bbaa-38fcef1caa3c admin admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:00:15.667600 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147d3aad-7707-467a-bbaa-38fcef1caa3c admin admin] PATH_INFO: `/v3/roles` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:00:15.668289 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-147d3aad-7707-467a-bbaa-38fcef1caa3c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:00:15.669981 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-147d3aad-7707-467a-bbaa-38fcef1caa3c admin admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:00:15.682579 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 1460/2873] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Sep 13 20:00:15 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 20:00:15.687993 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c516268-7559-4517-a4aa-d135ceb01bbd admin admin] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:00:15.705006 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c516268-7559-4517-a4aa-d135ceb01bbd admin admin] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:00:15.712842 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44fb08a-5a16-41c0-9cd9-df083eb3b7e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:00:15.713574 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44fb08a-5a16-41c0-9cd9-df083eb3b7e3 admin admin] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:00:15.713932 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44fb08a-5a16-41c0-9cd9-df083eb3b7e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:00:15.714379 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44fb08a-5a16-41c0-9cd9-df083eb3b7e3 admin admin] PATH_INFO: `/v3/roles` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:00:15.715340 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e44fb08a-5a16-41c0-9cd9-df083eb3b7e3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:00:15.718015 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e44fb08a-5a16-41c0-9cd9-df083eb3b7e3 admin admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:00:15.739198 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 1414/2874] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Sep 13 20:00:15 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 13 20:00:15.745386 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147d3aad-7707-467a-bbaa-38fcef1caa3c admin admin] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:00:15.761238 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147d3aad-7707-467a-bbaa-38fcef1caa3c admin admin] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:00:15.768447 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309f7655-27a5-4a6d-8636-79902e86db41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:00:15.769435 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309f7655-27a5-4a6d-8636-79902e86db41 admin admin] REQUEST_METHOD: `PUT` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:00:15.769828 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309f7655-27a5-4a6d-8636-79902e86db41 admin admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:00:15.770213 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309f7655-27a5-4a6d-8636-79902e86db41 admin admin] PATH_INFO: `/v3/projects/2a2822de11fb4fa6831268de0ff6179f/users/28ea234da0b14e0cbcbc34ddad626471/roles/a259191f6d0e46fabd9f34536bb28747` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:00:15.791145 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-309f7655-27a5-4a6d-8636-79902e86db41 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2a2822de11fb4fa6831268de0ff6179f, user_id=28ea234da0b14e0cbcbc34ddad626471, role_id=a259191f6d0e46fabd9f34536bb28747)` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:00:15.794160 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-309f7655-27a5-4a6d-8636-79902e86db41 admin admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:00:15.812303 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 1461/2875] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Sep 13 20:00:15 2022] PUT /identity/v3/projects/2a2822de11fb4fa6831268de0ff6179f/users/28ea234da0b14e0cbcbc34ddad626471/roles/a259191f6d0e46fabd9f34536bb28747 => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 20:00:15.830767 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345a0265-4cac-478a-b4c6-8dd2be059c0b None None] REQUEST_METHOD: `POST` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:00:15.831050 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345a0265-4cac-478a-b4c6-8dd2be059c0b None None] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:00:15.831366 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345a0265-4cac-478a-b4c6-8dd2be059c0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:00:15.870375 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.auth.core [None req-345a0265-4cac-478a-b4c6-8dd2be059c0b None None] MFA Rules not processed for user `28ea234da0b14e0cbcbc34ddad626471`. Rule list: `[]` (Enabled: `True`). {{(pid=87935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:00:15.871601 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.fernet_utils [None req-345a0265-4cac-478a-b4c6-8dd2be059c0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:00:15.948058 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 1415/2876] 10.222.0.25 () {58 vars in 958 bytes} [Tue Sep 13 20:00:15 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:00:15.962421 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309f7655-27a5-4a6d-8636-79902e86db41 admin admin] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:00:15.964372 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.fernet_utils [None req-309f7655-27a5-4a6d-8636-79902e86db41 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:00:15.999646 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG dbcounter [-] [87934] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=87934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:00:16.050092 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309f7655-27a5-4a6d-8636-79902e86db41 admin admin] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:00:16.054513 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb8cc7d-f697-458a-9f01-b93f96aeb96a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cbb50c88b794a7f9f26844effde7d63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a10a4268f3c4cb29f4e00c292e2df62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:00:16.055163 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb8cc7d-f697-458a-9f01-b93f96aeb96a service cinder] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:00:16.055423 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb8cc7d-f697-458a-9f01-b93f96aeb96a service cinder] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:00:16.055692 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb8cc7d-f697-458a-9f01-b93f96aeb96a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:00:16.066802 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb8cc7d-f697-458a-9f01-b93f96aeb96a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:00:16.071635 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb8cc7d-f697-458a-9f01-b93f96aeb96a service cinder] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:00:16.087142 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 1462/2877] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Sep 13 20:00:15 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 20:00:21.504736 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345a0265-4cac-478a-b4c6-8dd2be059c0b None None] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:00:21.507354 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.fernet_utils [None req-345a0265-4cac-478a-b4c6-8dd2be059c0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:00:21.553956 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG dbcounter [-] [87935] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:00:21.646963 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345a0265-4cac-478a-b4c6-8dd2be059c0b None None] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:00:21.652851 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff92f031-27ec-434d-9180-2635938eee5f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1196a96e4a404f559600b69f929ea9da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a10a4268f3c4cb29f4e00c292e2df62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:00:21.654077 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff92f031-27ec-434d-9180-2635938eee5f service neutron] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:00:21.654705 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff92f031-27ec-434d-9180-2635938eee5f service neutron] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:00:21.655297 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff92f031-27ec-434d-9180-2635938eee5f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:00:21.658478 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.fernet_utils [None req-ff92f031-27ec-434d-9180-2635938eee5f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:00:21.677605 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff92f031-27ec-434d-9180-2635938eee5f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:00:21.680091 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff92f031-27ec-434d-9180-2635938eee5f service neutron] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:00:21.693416 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 1416/2878] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Sep 13 20:00:21 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 189 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 20:00:26.081377 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG dbcounter [-] [87934] Writing DB stats keystone:SELECT=17 {{(pid=87934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:00:28.705720 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb8cc7d-f697-458a-9f01-b93f96aeb96a service cinder] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:00:28.819835 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb8cc7d-f697-458a-9f01-b93f96aeb96a service cinder] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:00:28.825979 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed68b89-9455-4c9c-8605-c3e39c133d77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:00:28.827251 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed68b89-9455-4c9c-8605-c3e39c133d77 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:00:28.827708 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed68b89-9455-4c9c-8605-c3e39c133d77 admin admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:00:28.828145 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed68b89-9455-4c9c-8605-c3e39c133d77 admin admin] PATH_INFO: `/v3/users/28ea234da0b14e0cbcbc34ddad626471` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:00:28.830019 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed68b89-9455-4c9c-8605-c3e39c133d77 admin admin] RBAC: Authorizing `identity:delete_user(user_id=28ea234da0b14e0cbcbc34ddad626471)` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:00:28.832795 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed68b89-9455-4c9c-8605-c3e39c133d77 admin admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:00:28.893819 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.notifications [None req-eed68b89-9455-4c9c-8605-c3e39c133d77 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '28ea234da0b14e0cbcbc34ddad626471'} {{(pid=87934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:00:28.894510 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.notifications [None req-eed68b89-9455-4c9c-8605-c3e39c133d77 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '28ea234da0b14e0cbcbc34ddad626471'} {{(pid=87934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:00:28.895121 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.notifications [None req-eed68b89-9455-4c9c-8605-c3e39c133d77 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '28ea234da0b14e0cbcbc34ddad626471'} {{(pid=87934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:00:28.906017 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.notifications [None req-eed68b89-9455-4c9c-8605-c3e39c133d77 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '28ea234da0b14e0cbcbc34ddad626471'} {{(pid=87934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:00:28.921113 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.notifications [None req-eed68b89-9455-4c9c-8605-c3e39c133d77 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '28ea234da0b14e0cbcbc34ddad626471'} {{(pid=87934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:00:28.936697 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 1463/2879] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Sep 13 20:00:28 2022] DELETE /identity/v3/users/28ea234da0b14e0cbcbc34ddad626471 => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 20:00:28.942394 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f12987a-aad0-483f-baec-ac480e463d53 None None] REQUEST_METHOD: `POST` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:00:28.944085 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f12987a-aad0-483f-baec-ac480e463d53 None None] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:00:28.944085 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f12987a-aad0-483f-baec-ac480e463d53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:00:28.969722 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.auth.core [None req-5f12987a-aad0-483f-baec-ac480e463d53 None None] MFA Rules not processed for user `7b0aed92d02344acb92a0e4aa67c3068`. Rule list: `[]` (Enabled: `True`). {{(pid=87935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:00:28.970984 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.fernet_utils [None req-5f12987a-aad0-483f-baec-ac480e463d53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:00:29.047657 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 1417/2880] 10.222.0.25 () {58 vars in 958 bytes} [Tue Sep 13 20:00:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 20:00:29.061815 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed68b89-9455-4c9c-8605-c3e39c133d77 admin admin] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:00:29.063428 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.fernet_utils [None req-eed68b89-9455-4c9c-8605-c3e39c133d77 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:00:29.140235 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed68b89-9455-4c9c-8605-c3e39c133d77 admin admin] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:00:29.144016 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00dbb5b-2a3c-41df-83e4-b15e310dd837 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1196a96e4a404f559600b69f929ea9da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a10a4268f3c4cb29f4e00c292e2df62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:00:29.144665 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00dbb5b-2a3c-41df-83e4-b15e310dd837 service neutron] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:00:29.144930 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00dbb5b-2a3c-41df-83e4-b15e310dd837 service neutron] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:00:29.145198 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00dbb5b-2a3c-41df-83e4-b15e310dd837 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:00:29.162889 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a00dbb5b-2a3c-41df-83e4-b15e310dd837 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:00:29.165297 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a00dbb5b-2a3c-41df-83e4-b15e310dd837 service neutron] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:00:29.183939 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 1464/2881] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Sep 13 20:00:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 20:00:29.528160 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f12987a-aad0-483f-baec-ac480e463d53 None None] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:00:29.530431 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.fernet_utils [None req-5f12987a-aad0-483f-baec-ac480e463d53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:00:29.551594 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f12987a-aad0-483f-baec-ac480e463d53 None None] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:00:29.559370 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a2dc04-acdc-482e-a682-b9e51dd33c72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:00:29.560605 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a2dc04-acdc-482e-a682-b9e51dd33c72 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:00:29.561218 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a2dc04-acdc-482e-a682-b9e51dd33c72 admin admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:00:29.561551 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a2dc04-acdc-482e-a682-b9e51dd33c72 admin admin] PATH_INFO: `/v3/projects/2a2822de11fb4fa6831268de0ff6179f` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:00:29.563616 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a2dc04-acdc-482e-a682-b9e51dd33c72 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2a2822de11fb4fa6831268de0ff6179f)` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:00:29.567273 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a2dc04-acdc-482e-a682-b9e51dd33c72 admin admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:00:29.627988 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.notifications [None req-76a2dc04-acdc-482e-a682-b9e51dd33c72 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2a2822de11fb4fa6831268de0ff6179f', 'request_id': 'req-76a2dc04-acdc-482e-a682-b9e51dd33c72'} {{(pid=87935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:00:29.635390 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.notifications [None req-76a2dc04-acdc-482e-a682-b9e51dd33c72 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2a2822de11fb4fa6831268de0ff6179f', 'request_id': 'req-76a2dc04-acdc-482e-a682-b9e51dd33c72'} {{(pid=87935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:00:29.644244 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.notifications [None req-76a2dc04-acdc-482e-a682-b9e51dd33c72 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2a2822de11fb4fa6831268de0ff6179f', 'request_id': 'req-76a2dc04-acdc-482e-a682-b9e51dd33c72'} {{(pid=87935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:00:29.656640 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.notifications [None req-76a2dc04-acdc-482e-a682-b9e51dd33c72 admin admin] The token cache is being invalidate because project 2a2822de11fb4fa6831268de0ff6179f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87935) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 20:00:29.656950 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.notifications [None req-76a2dc04-acdc-482e-a682-b9e51dd33c72 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:00:29.657640 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.notifications [None req-76a2dc04-acdc-482e-a682-b9e51dd33c72 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:00:29.659184 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 1418/2882] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Sep 13 20:00:29 2022] DELETE /identity/v3/projects/2a2822de11fb4fa6831268de0ff6179f => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 20:00:29.665536 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84463e1b-55a0-4567-a25f-ba423cb77a60 None None] REQUEST_METHOD: `POST` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:00:29.665960 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84463e1b-55a0-4567-a25f-ba423cb77a60 None None] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:00:29.666332 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84463e1b-55a0-4567-a25f-ba423cb77a60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:00:29.688239 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.auth.core [None req-84463e1b-55a0-4567-a25f-ba423cb77a60 None None] MFA Rules not processed for user `7b0aed92d02344acb92a0e4aa67c3068`. Rule list: `[]` (Enabled: `True`). {{(pid=87934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:00:29.689460 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.fernet_utils [None req-84463e1b-55a0-4567-a25f-ba423cb77a60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:00:29.709717 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG dbcounter [-] [87934] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:00:29.759261 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 1465/2883] 10.222.0.25 () {58 vars in 958 bytes} [Tue Sep 13 20:00:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:00:29.767641 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbd04fe-2228-4db6-9a18-c4a198b0acf4 None None] REQUEST_METHOD: `POST` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:00:29.767920 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbd04fe-2228-4db6-9a18-c4a198b0acf4 None None] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:00:29.768197 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbd04fe-2228-4db6-9a18-c4a198b0acf4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:00:29.790576 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.auth.core [None req-3bbd04fe-2228-4db6-9a18-c4a198b0acf4 None None] MFA Rules not processed for user `7b0aed92d02344acb92a0e4aa67c3068`. Rule list: `[]` (Enabled: `True`). {{(pid=87935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:00:29.791822 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.fernet_utils [None req-3bbd04fe-2228-4db6-9a18-c4a198b0acf4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:00:29.800049 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 1419/2884] 10.222.0.25 () {58 vars in 958 bytes} [Tue Sep 13 20:00:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:00:29.805339 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84463e1b-55a0-4567-a25f-ba423cb77a60 None None] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:00:29.815823 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84463e1b-55a0-4567-a25f-ba423cb77a60 None None] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:00:29.821021 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ef8260-2328-4881-a22d-de1821c67b64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:00:29.821702 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ef8260-2328-4881-a22d-de1821c67b64 admin admin] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:00:29.821980 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ef8260-2328-4881-a22d-de1821c67b64 admin admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:00:29.822256 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ef8260-2328-4881-a22d-de1821c67b64 admin admin] PATH_INFO: `/v3/domains` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:00:29.823085 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ef8260-2328-4881-a22d-de1821c67b64 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87934) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 20:00:29.823389 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ef8260-2328-4881-a22d-de1821c67b64 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:00:29.825044 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ef8260-2328-4881-a22d-de1821c67b64 admin admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:00:29.838047 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 1466/2885] 10.222.0.25 () {58 vars in 1153 bytes} [Tue Sep 13 20:00:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 20:00:29.845177 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bbd04fe-2228-4db6-9a18-c4a198b0acf4 None None] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:00:29.860697 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bbd04fe-2228-4db6-9a18-c4a198b0acf4 None None] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:00:29.868718 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf935037-7061-4ac7-a888-bd37a44c7c37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:00:29.869821 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf935037-7061-4ac7-a888-bd37a44c7c37 admin admin] REQUEST_METHOD: `POST` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:00:29.870316 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf935037-7061-4ac7-a888-bd37a44c7c37 admin admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:00:29.870805 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf935037-7061-4ac7-a888-bd37a44c7c37 admin admin] PATH_INFO: `/v3/projects` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:00:29.871917 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf935037-7061-4ac7-a888-bd37a44c7c37 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:00:29.875426 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf935037-7061-4ac7-a888-bd37a44c7c37 admin admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:00:29.920806 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 1420/2886] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Sep 13 20:00:29 2022] POST /identity/v3/projects => generated 385 bytes in 77 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 20:00:29.926397 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ef8260-2328-4881-a22d-de1821c67b64 admin admin] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:00:29.937908 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ef8260-2328-4881-a22d-de1821c67b64 admin admin] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:00:30.007382 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4869a5-6aaa-42ac-a06d-0ffb6f7e670b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:00:30.008007 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4869a5-6aaa-42ac-a06d-0ffb6f7e670b admin admin] REQUEST_METHOD: `POST` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:00:30.008324 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4869a5-6aaa-42ac-a06d-0ffb6f7e670b admin admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:00:30.008607 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4869a5-6aaa-42ac-a06d-0ffb6f7e670b admin admin] PATH_INFO: `/v3/users` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:00:30.009259 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe4869a5-6aaa-42ac-a06d-0ffb6f7e670b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:00:30.011186 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe4869a5-6aaa-42ac-a06d-0ffb6f7e670b admin admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:00:30.034594 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 1467/2887] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Sep 13 20:00:29 2022] POST /identity/v3/users => generated 293 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 13 20:00:30.040603 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf935037-7061-4ac7-a888-bd37a44c7c37 admin admin] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:00:30.058459 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf935037-7061-4ac7-a888-bd37a44c7c37 admin admin] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:00:30.066041 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b087618-41e2-4fed-9fd4-feefcb037782 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:00:30.066750 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b087618-41e2-4fed-9fd4-feefcb037782 admin admin] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:00:30.067039 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b087618-41e2-4fed-9fd4-feefcb037782 admin admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:00:30.067311 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b087618-41e2-4fed-9fd4-feefcb037782 admin admin] PATH_INFO: `/v3/roles` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:00:30.068023 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b087618-41e2-4fed-9fd4-feefcb037782 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:00:30.069669 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b087618-41e2-4fed-9fd4-feefcb037782 admin admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:00:30.080831 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 1421/2888] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Sep 13 20:00:30 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 20:00:30.085808 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4869a5-6aaa-42ac-a06d-0ffb6f7e670b admin admin] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:00:30.099587 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4869a5-6aaa-42ac-a06d-0ffb6f7e670b admin admin] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:00:30.105487 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72d0980-cc9e-459f-9a42-f52abb3420b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:00:30.106104 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72d0980-cc9e-459f-9a42-f52abb3420b4 admin admin] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:00:30.106387 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72d0980-cc9e-459f-9a42-f52abb3420b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:00:30.106663 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72d0980-cc9e-459f-9a42-f52abb3420b4 admin admin] PATH_INFO: `/v3/roles` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:00:30.107319 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a72d0980-cc9e-459f-9a42-f52abb3420b4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:00:30.109039 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a72d0980-cc9e-459f-9a42-f52abb3420b4 admin admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:00:30.121807 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 1468/2889] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Sep 13 20:00:30 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 13 20:00:30.128707 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b087618-41e2-4fed-9fd4-feefcb037782 admin admin] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:00:30.137462 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG dbcounter [-] [87935] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=87935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:00:30.141636 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b087618-41e2-4fed-9fd4-feefcb037782 admin admin] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:00:30.150560 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f8368b-acd9-4220-a7fc-f488588373df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:00:30.151876 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f8368b-acd9-4220-a7fc-f488588373df admin admin] REQUEST_METHOD: `PUT` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:00:30.152262 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f8368b-acd9-4220-a7fc-f488588373df admin admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:00:30.152580 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f8368b-acd9-4220-a7fc-f488588373df admin admin] PATH_INFO: `/v3/projects/76611dc5a7d94e16920967cbb63cc16b/users/958603a479984993839c0e136233871a/roles/a259191f6d0e46fabd9f34536bb28747` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:00:30.174297 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f8368b-acd9-4220-a7fc-f488588373df admin admin] RBAC: Authorizing `identity:create_grant(project_id=76611dc5a7d94e16920967cbb63cc16b, user_id=958603a479984993839c0e136233871a, role_id=a259191f6d0e46fabd9f34536bb28747)` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:00:30.177496 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f8368b-acd9-4220-a7fc-f488588373df admin admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:00:30.192137 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 1422/2890] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Sep 13 20:00:30 2022] PUT /identity/v3/projects/76611dc5a7d94e16920967cbb63cc16b/users/958603a479984993839c0e136233871a/roles/a259191f6d0e46fabd9f34536bb28747 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 20:00:30.204556 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b83031-00af-446a-af6c-c91df7878bdf None None] REQUEST_METHOD: `POST` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:00:30.204893 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b83031-00af-446a-af6c-c91df7878bdf None None] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:00:30.205281 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b83031-00af-446a-af6c-c91df7878bdf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:00:30.245070 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.auth.core [None req-31b83031-00af-446a-af6c-c91df7878bdf None None] MFA Rules not processed for user `958603a479984993839c0e136233871a`. Rule list: `[]` (Enabled: `True`). {{(pid=87934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:00:30.247178 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.fernet_utils [None req-31b83031-00af-446a-af6c-c91df7878bdf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:00:30.337099 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 1469/2891] 10.222.0.25 () {58 vars in 958 bytes} [Tue Sep 13 20:00:30 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:00:30.342199 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f8368b-acd9-4220-a7fc-f488588373df admin admin] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:00:30.417719 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f8368b-acd9-4220-a7fc-f488588373df admin admin] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:00:30.425741 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dee29ae-7061-4db6-83ed-238a28e2f5dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:00:30.426696 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dee29ae-7061-4db6-83ed-238a28e2f5dc admin admin] REQUEST_METHOD: `POST` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:00:30.427247 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dee29ae-7061-4db6-83ed-238a28e2f5dc admin admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:00:30.427871 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dee29ae-7061-4db6-83ed-238a28e2f5dc admin admin] PATH_INFO: `/v3/projects` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:00:30.429089 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dee29ae-7061-4db6-83ed-238a28e2f5dc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:00:30.432641 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dee29ae-7061-4db6-83ed-238a28e2f5dc admin admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:00:30.472743 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 1423/2892] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Sep 13 20:00:30 2022] POST /identity/v3/projects => generated 385 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 20:00:30.479874 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b83031-00af-446a-af6c-c91df7878bdf None None] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:00:30.498952 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b83031-00af-446a-af6c-c91df7878bdf None None] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:00:30.518865 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG dbcounter [-] [87934] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:00:30.578898 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b419ea45-ae7c-42e7-b3a8-25f11f829dc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:00:30.579887 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b419ea45-ae7c-42e7-b3a8-25f11f829dc9 admin admin] REQUEST_METHOD: `POST` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:00:30.580513 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b419ea45-ae7c-42e7-b3a8-25f11f829dc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:00:30.580959 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b419ea45-ae7c-42e7-b3a8-25f11f829dc9 admin admin] PATH_INFO: `/v3/users` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:00:30.582050 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b419ea45-ae7c-42e7-b3a8-25f11f829dc9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:00:30.586515 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b419ea45-ae7c-42e7-b3a8-25f11f829dc9 admin admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:00:30.617645 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 1470/2893] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Sep 13 20:00:30 2022] POST /identity/v3/users => generated 293 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 20:00:30.622467 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dee29ae-7061-4db6-83ed-238a28e2f5dc admin admin] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:00:30.638178 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dee29ae-7061-4db6-83ed-238a28e2f5dc admin admin] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:00:30.643325 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb56d166-245d-46e9-a562-7ae64323c74f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:00:30.643943 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb56d166-245d-46e9-a562-7ae64323c74f admin admin] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:00:30.644239 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb56d166-245d-46e9-a562-7ae64323c74f admin admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:00:30.644528 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb56d166-245d-46e9-a562-7ae64323c74f admin admin] PATH_INFO: `/v3/roles` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:00:30.645180 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb56d166-245d-46e9-a562-7ae64323c74f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:00:30.647701 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb56d166-245d-46e9-a562-7ae64323c74f admin admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:00:30.665896 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 1424/2894] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Sep 13 20:00:30 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 20:00:30.671229 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b419ea45-ae7c-42e7-b3a8-25f11f829dc9 admin admin] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:00:30.686113 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b419ea45-ae7c-42e7-b3a8-25f11f829dc9 admin admin] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:00:30.691687 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf97b6b1-a871-4bce-9759-7da578a348c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:00:30.692377 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf97b6b1-a871-4bce-9759-7da578a348c5 admin admin] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:00:30.693196 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf97b6b1-a871-4bce-9759-7da578a348c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:00:30.693604 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf97b6b1-a871-4bce-9759-7da578a348c5 admin admin] PATH_INFO: `/v3/roles` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:00:30.694632 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf97b6b1-a871-4bce-9759-7da578a348c5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:00:30.696368 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf97b6b1-a871-4bce-9759-7da578a348c5 admin admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:00:30.709828 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 1471/2895] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Sep 13 20:00:30 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 20:00:30.714774 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb56d166-245d-46e9-a562-7ae64323c74f admin admin] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:00:30.725884 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb56d166-245d-46e9-a562-7ae64323c74f admin admin] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:00:30.732727 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448f898b-3b90-4f0a-8435-9f30d21b73c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:00:30.733398 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448f898b-3b90-4f0a-8435-9f30d21b73c0 admin admin] REQUEST_METHOD: `PUT` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:00:30.733677 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448f898b-3b90-4f0a-8435-9f30d21b73c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:00:30.733946 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448f898b-3b90-4f0a-8435-9f30d21b73c0 admin admin] PATH_INFO: `/v3/projects/aded1bd7d456403e92ba6a1883ad3c62/users/a04e543e06df47fa8fcdb465211556d6/roles/a259191f6d0e46fabd9f34536bb28747` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:00:30.753460 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-448f898b-3b90-4f0a-8435-9f30d21b73c0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=aded1bd7d456403e92ba6a1883ad3c62, user_id=a04e543e06df47fa8fcdb465211556d6, role_id=a259191f6d0e46fabd9f34536bb28747)` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:00:30.759145 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-448f898b-3b90-4f0a-8435-9f30d21b73c0 admin admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:00:30.777189 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 1425/2896] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Sep 13 20:00:30 2022] PUT /identity/v3/projects/aded1bd7d456403e92ba6a1883ad3c62/users/a04e543e06df47fa8fcdb465211556d6/roles/a259191f6d0e46fabd9f34536bb28747 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 20:00:30.799869 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf735670-8519-4917-ab22-71c698b62fa8 None None] REQUEST_METHOD: `POST` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:00:30.800155 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf735670-8519-4917-ab22-71c698b62fa8 None None] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:00:30.800475 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf735670-8519-4917-ab22-71c698b62fa8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:00:30.844969 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.auth.core [None req-cf735670-8519-4917-ab22-71c698b62fa8 None None] MFA Rules not processed for user `a04e543e06df47fa8fcdb465211556d6`. Rule list: `[]` (Enabled: `True`). {{(pid=87934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:00:30.846776 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.fernet_utils [None req-cf735670-8519-4917-ab22-71c698b62fa8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:00:30.956348 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 1472/2897] 10.222.0.25 () {58 vars in 958 bytes} [Tue Sep 13 20:00:30 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:00:30.963730 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448f898b-3b90-4f0a-8435-9f30d21b73c0 admin admin] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:00:31.058147 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448f898b-3b90-4f0a-8435-9f30d21b73c0 admin admin] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:00:31.063358 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeabcc77-f84a-44f9-bec5-b809e006e2f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:00:31.063967 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeabcc77-f84a-44f9-bec5-b809e006e2f0 admin admin] REQUEST_METHOD: `POST` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:00:31.064346 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeabcc77-f84a-44f9-bec5-b809e006e2f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:00:31.064621 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeabcc77-f84a-44f9-bec5-b809e006e2f0 admin admin] PATH_INFO: `/v3/projects` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:00:31.065296 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeabcc77-f84a-44f9-bec5-b809e006e2f0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:00:31.067379 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeabcc77-f84a-44f9-bec5-b809e006e2f0 admin admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:00:31.105271 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 1426/2898] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Sep 13 20:00:30 2022] POST /identity/v3/projects => generated 385 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 20:00:31.110057 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf735670-8519-4917-ab22-71c698b62fa8 None None] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:00:31.122372 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf735670-8519-4917-ab22-71c698b62fa8 None None] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:00:31.207064 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee13e24b-17f8-48bb-9102-46a5285b629e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:00:31.207595 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee13e24b-17f8-48bb-9102-46a5285b629e admin admin] REQUEST_METHOD: `POST` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:00:31.207877 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee13e24b-17f8-48bb-9102-46a5285b629e admin admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:00:31.208146 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee13e24b-17f8-48bb-9102-46a5285b629e admin admin] PATH_INFO: `/v3/users` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:00:31.209366 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee13e24b-17f8-48bb-9102-46a5285b629e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:00:31.211344 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee13e24b-17f8-48bb-9102-46a5285b629e admin admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:00:31.237189 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 1473/2899] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Sep 13 20:00:31 2022] POST /identity/v3/users => generated 299 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 20:00:31.241661 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeabcc77-f84a-44f9-bec5-b809e006e2f0 admin admin] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:00:31.253839 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeabcc77-f84a-44f9-bec5-b809e006e2f0 admin admin] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:00:31.259803 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23544b7-1125-4def-a334-969fcaae8db6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:00:31.260446 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23544b7-1125-4def-a334-969fcaae8db6 admin admin] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:00:31.260727 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23544b7-1125-4def-a334-969fcaae8db6 admin admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:00:31.260991 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23544b7-1125-4def-a334-969fcaae8db6 admin admin] PATH_INFO: `/v3/roles` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:00:31.261630 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a23544b7-1125-4def-a334-969fcaae8db6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:00:31.263239 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a23544b7-1125-4def-a334-969fcaae8db6 admin admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:00:31.277051 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 1427/2900] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Sep 13 20:00:31 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 20:00:31.281397 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee13e24b-17f8-48bb-9102-46a5285b629e admin admin] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:00:31.292197 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee13e24b-17f8-48bb-9102-46a5285b629e admin admin] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:00:31.298458 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52222af-4500-4cd7-94a5-8e38d23781c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:00:31.299489 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52222af-4500-4cd7-94a5-8e38d23781c5 admin admin] REQUEST_METHOD: `PUT` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:00:31.300058 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52222af-4500-4cd7-94a5-8e38d23781c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:00:31.300362 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52222af-4500-4cd7-94a5-8e38d23781c5 admin admin] PATH_INFO: `/v3/projects/caf79f1927364bad8cc07d23739d3bcf/users/5a765b09b6c84b89b0615325f53aab66/roles/6ca1d4427ff64e0a9d25d96cfb1445f6` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:00:31.324243 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG dbcounter [-] [87934] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=87934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:00:31.330970 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f52222af-4500-4cd7-94a5-8e38d23781c5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=caf79f1927364bad8cc07d23739d3bcf, user_id=5a765b09b6c84b89b0615325f53aab66, role_id=6ca1d4427ff64e0a9d25d96cfb1445f6)` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:00:31.336702 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f52222af-4500-4cd7-94a5-8e38d23781c5 admin admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:00:31.358529 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 1474/2901] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Sep 13 20:00:31 2022] PUT /identity/v3/projects/caf79f1927364bad8cc07d23739d3bcf/users/5a765b09b6c84b89b0615325f53aab66/roles/6ca1d4427ff64e0a9d25d96cfb1445f6 => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 20:00:31.365443 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23544b7-1125-4def-a334-969fcaae8db6 admin admin] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:00:31.375604 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG dbcounter [-] [87935] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=87935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:00:31.381398 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23544b7-1125-4def-a334-969fcaae8db6 admin admin] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:00:31.478077 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae06594-0808-4da3-b670-1b791f8baedb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:00:31.478922 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae06594-0808-4da3-b670-1b791f8baedb admin admin] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:00:31.479301 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae06594-0808-4da3-b670-1b791f8baedb admin admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:00:31.479664 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae06594-0808-4da3-b670-1b791f8baedb admin admin] PATH_INFO: `/v3/roles` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:00:31.480562 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae06594-0808-4da3-b670-1b791f8baedb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:00:31.483077 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae06594-0808-4da3-b670-1b791f8baedb admin admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:00:31.500451 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 1428/2902] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Sep 13 20:00:31 2022] GET /identity/v3/roles => generated 1420 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 20:00:31.508307 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52222af-4500-4cd7-94a5-8e38d23781c5 admin admin] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:00:31.525388 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52222af-4500-4cd7-94a5-8e38d23781c5 admin admin] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:00:31.533435 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b5349c-1258-41e0-ab31-e7b0ab560a6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:00:31.534224 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b5349c-1258-41e0-ab31-e7b0ab560a6a admin admin] REQUEST_METHOD: `PUT` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:00:31.534491 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b5349c-1258-41e0-ab31-e7b0ab560a6a admin admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:00:31.534801 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b5349c-1258-41e0-ab31-e7b0ab560a6a admin admin] PATH_INFO: `/v3/projects/caf79f1927364bad8cc07d23739d3bcf/users/5a765b09b6c84b89b0615325f53aab66/roles/6ca1d4427ff64e0a9d25d96cfb1445f6` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:00:31.538759 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b5349c-1258-41e0-ab31-e7b0ab560a6a admin admin] RBAC: Authorizing `identity:create_grant(project_id=caf79f1927364bad8cc07d23739d3bcf, user_id=5a765b09b6c84b89b0615325f53aab66, role_id=6ca1d4427ff64e0a9d25d96cfb1445f6)` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:00:31.543833 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b5349c-1258-41e0-ab31-e7b0ab560a6a admin admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:00:31.561354 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 1475/2903] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Sep 13 20:00:31 2022] PUT /identity/v3/projects/caf79f1927364bad8cc07d23739d3bcf/users/5a765b09b6c84b89b0615325f53aab66/roles/6ca1d4427ff64e0a9d25d96cfb1445f6 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 20:00:31.577770 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47dbea04-13ae-43d1-99f3-c3491d814ddd None None] REQUEST_METHOD: `POST` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:00:31.578126 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47dbea04-13ae-43d1-99f3-c3491d814ddd None None] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:00:31.578512 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47dbea04-13ae-43d1-99f3-c3491d814ddd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:00:31.633889 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.auth.core [None req-47dbea04-13ae-43d1-99f3-c3491d814ddd None None] MFA Rules not processed for user `5a765b09b6c84b89b0615325f53aab66`. Rule list: `[]` (Enabled: `True`). {{(pid=87935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:00:31.635952 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.fernet_utils [None req-47dbea04-13ae-43d1-99f3-c3491d814ddd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:00:31.740474 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 1429/2904] 10.222.0.25 () {58 vars in 958 bytes} [Tue Sep 13 20:00:31 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:00:31.757065 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b5349c-1258-41e0-ab31-e7b0ab560a6a admin admin] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:00:31.759960 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.fernet_utils [None req-99b5349c-1258-41e0-ab31-e7b0ab560a6a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:00:31.842260 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b5349c-1258-41e0-ab31-e7b0ab560a6a admin admin] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:00:31.846575 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c1fc32-d335-4a83-9e95-dcf67a664b67 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cbb50c88b794a7f9f26844effde7d63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a10a4268f3c4cb29f4e00c292e2df62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:00:31.847303 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c1fc32-d335-4a83-9e95-dcf67a664b67 service cinder] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:00:31.847687 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c1fc32-d335-4a83-9e95-dcf67a664b67 service cinder] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:00:31.848061 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c1fc32-d335-4a83-9e95-dcf67a664b67 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:00:31.939135 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c1fc32-d335-4a83-9e95-dcf67a664b67 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:00:31.940892 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c1fc32-d335-4a83-9e95-dcf67a664b67 service cinder] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:00:31.955216 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 1476/2905] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Sep 13 20:00:31 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 199 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 20:00:33.649935 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47dbea04-13ae-43d1-99f3-c3491d814ddd None None] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:00:33.651635 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.fernet_utils [None req-47dbea04-13ae-43d1-99f3-c3491d814ddd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:00:33.666667 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47dbea04-13ae-43d1-99f3-c3491d814ddd None None] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:00:33.671047 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aac22fa-a9a5-4c46-af08-4577ee7b4fbc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cbb50c88b794a7f9f26844effde7d63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a10a4268f3c4cb29f4e00c292e2df62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:00:33.671748 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aac22fa-a9a5-4c46-af08-4577ee7b4fbc service cinder] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:00:33.672084 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aac22fa-a9a5-4c46-af08-4577ee7b4fbc service cinder] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:00:33.672512 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aac22fa-a9a5-4c46-af08-4577ee7b4fbc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:00:33.757367 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aac22fa-a9a5-4c46-af08-4577ee7b4fbc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:00:33.759942 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aac22fa-a9a5-4c46-af08-4577ee7b4fbc service cinder] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:00:33.776605 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 1430/2906] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Sep 13 20:00:33 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 20:00:34.487195 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c1fc32-d335-4a83-9e95-dcf67a664b67 service cinder] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:00:34.503765 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c1fc32-d335-4a83-9e95-dcf67a664b67 service cinder] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:00:34.508985 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95ce9e1-f0f0-47a3-9cf8-643d4c7e0957 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cbb50c88b794a7f9f26844effde7d63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a10a4268f3c4cb29f4e00c292e2df62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:00:34.509827 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95ce9e1-f0f0-47a3-9cf8-643d4c7e0957 service cinder] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:00:34.510259 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95ce9e1-f0f0-47a3-9cf8-643d4c7e0957 service cinder] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:00:34.510607 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95ce9e1-f0f0-47a3-9cf8-643d4c7e0957 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:00:34.522467 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b95ce9e1-f0f0-47a3-9cf8-643d4c7e0957 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:00:34.524470 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b95ce9e1-f0f0-47a3-9cf8-643d4c7e0957 service cinder] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:00:34.535353 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 1477/2907] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Sep 13 20:00:34 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 20:00:38.781316 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aac22fa-a9a5-4c46-af08-4577ee7b4fbc service cinder] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:00:38.822242 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG dbcounter [-] [87935] Writing DB stats keystone:SELECT=100 {{(pid=87935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:00:38.889493 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aac22fa-a9a5-4c46-af08-4577ee7b4fbc service cinder] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:00:38.894316 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86637f64-c59b-4f92-accc-6d44c580c528 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:00:38.894948 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86637f64-c59b-4f92-accc-6d44c580c528 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:00:38.895224 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86637f64-c59b-4f92-accc-6d44c580c528 admin admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:00:38.895612 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86637f64-c59b-4f92-accc-6d44c580c528 admin admin] PATH_INFO: `/v3/users/958603a479984993839c0e136233871a` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:00:38.897027 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86637f64-c59b-4f92-accc-6d44c580c528 admin admin] RBAC: Authorizing `identity:delete_user(user_id=958603a479984993839c0e136233871a)` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:00:38.899128 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86637f64-c59b-4f92-accc-6d44c580c528 admin admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:00:38.961940 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.notifications [None req-86637f64-c59b-4f92-accc-6d44c580c528 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '958603a479984993839c0e136233871a'} {{(pid=87935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:00:38.976679 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.notifications [None req-86637f64-c59b-4f92-accc-6d44c580c528 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '958603a479984993839c0e136233871a'} {{(pid=87935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:00:38.998848 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.notifications [None req-86637f64-c59b-4f92-accc-6d44c580c528 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '958603a479984993839c0e136233871a'} {{(pid=87935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:00:38.999999 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.notifications [None req-86637f64-c59b-4f92-accc-6d44c580c528 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '958603a479984993839c0e136233871a'} {{(pid=87935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:00:39.001017 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.notifications [None req-86637f64-c59b-4f92-accc-6d44c580c528 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '958603a479984993839c0e136233871a'} {{(pid=87935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:00:39.021315 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 1431/2908] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Sep 13 20:00:38 2022] DELETE /identity/v3/users/958603a479984993839c0e136233871a => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 20:00:39.026147 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c51dcd-a998-4f4e-8646-a1aa5723ed6f None None] REQUEST_METHOD: `POST` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:00:39.026853 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c51dcd-a998-4f4e-8646-a1aa5723ed6f None None] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:00:39.026853 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c51dcd-a998-4f4e-8646-a1aa5723ed6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:00:39.051921 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.auth.core [None req-70c51dcd-a998-4f4e-8646-a1aa5723ed6f None None] MFA Rules not processed for user `7b0aed92d02344acb92a0e4aa67c3068`. Rule list: `[]` (Enabled: `True`). {{(pid=87934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:00:39.053260 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.fernet_utils [None req-70c51dcd-a998-4f4e-8646-a1aa5723ed6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:00:39.140983 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 1478/2909] 10.222.0.25 () {58 vars in 958 bytes} [Tue Sep 13 20:00:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 20:00:39.152838 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86637f64-c59b-4f92-accc-6d44c580c528 admin admin] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:00:39.154439 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.fernet_utils [None req-86637f64-c59b-4f92-accc-6d44c580c528 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:00:39.222812 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86637f64-c59b-4f92-accc-6d44c580c528 admin admin] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:00:39.227736 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43640d0f-426a-4dfa-a500-aa67aea02e82 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1196a96e4a404f559600b69f929ea9da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a10a4268f3c4cb29f4e00c292e2df62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:00:39.228378 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43640d0f-426a-4dfa-a500-aa67aea02e82 service neutron] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:00:39.228656 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43640d0f-426a-4dfa-a500-aa67aea02e82 service neutron] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:00:39.228922 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43640d0f-426a-4dfa-a500-aa67aea02e82 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:00:39.239211 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43640d0f-426a-4dfa-a500-aa67aea02e82 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:00:39.240725 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43640d0f-426a-4dfa-a500-aa67aea02e82 service neutron] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:00:39.254178 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 1432/2910] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Sep 13 20:00:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 13 20:00:39.605895 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c51dcd-a998-4f4e-8646-a1aa5723ed6f None None] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:00:39.607572 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.fernet_utils [None req-70c51dcd-a998-4f4e-8646-a1aa5723ed6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:00:39.627325 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c51dcd-a998-4f4e-8646-a1aa5723ed6f None None] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:00:39.637358 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9d6bd4-14ca-4a79-a224-ed36b22d21b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:00:39.638278 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9d6bd4-14ca-4a79-a224-ed36b22d21b6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:00:39.638687 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9d6bd4-14ca-4a79-a224-ed36b22d21b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:00:39.639032 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9d6bd4-14ca-4a79-a224-ed36b22d21b6 admin admin] PATH_INFO: `/v3/projects/76611dc5a7d94e16920967cbb63cc16b` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:00:39.640943 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a9d6bd4-14ca-4a79-a224-ed36b22d21b6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=76611dc5a7d94e16920967cbb63cc16b)` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:00:39.645137 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a9d6bd4-14ca-4a79-a224-ed36b22d21b6 admin admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:00:39.674933 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG dbcounter [-] [87934] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=87934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:00:39.716811 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.notifications [None req-6a9d6bd4-14ca-4a79-a224-ed36b22d21b6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '76611dc5a7d94e16920967cbb63cc16b', 'request_id': 'req-6a9d6bd4-14ca-4a79-a224-ed36b22d21b6'} {{(pid=87934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:00:39.725150 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.notifications [None req-6a9d6bd4-14ca-4a79-a224-ed36b22d21b6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '76611dc5a7d94e16920967cbb63cc16b', 'request_id': 'req-6a9d6bd4-14ca-4a79-a224-ed36b22d21b6'} {{(pid=87934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:00:39.731951 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.notifications [None req-6a9d6bd4-14ca-4a79-a224-ed36b22d21b6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '76611dc5a7d94e16920967cbb63cc16b', 'request_id': 'req-6a9d6bd4-14ca-4a79-a224-ed36b22d21b6'} {{(pid=87934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:00:39.750946 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.notifications [None req-6a9d6bd4-14ca-4a79-a224-ed36b22d21b6 admin admin] The token cache is being invalidate because project 76611dc5a7d94e16920967cbb63cc16b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87934) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 20:00:39.751356 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.notifications [None req-6a9d6bd4-14ca-4a79-a224-ed36b22d21b6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:00:39.752488 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.notifications [None req-6a9d6bd4-14ca-4a79-a224-ed36b22d21b6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:00:39.755539 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 1479/2911] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Sep 13 20:00:39 2022] DELETE /identity/v3/projects/76611dc5a7d94e16920967cbb63cc16b => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 20:00:39.761530 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43640d0f-426a-4dfa-a500-aa67aea02e82 service neutron] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:00:39.776966 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43640d0f-426a-4dfa-a500-aa67aea02e82 service neutron] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:00:39.857626 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG dbcounter [-] [87935] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:00:39.888649 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9726c6e7-7831-4c0a-98a3-bf0b2a52a19b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:00:39.889718 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9726c6e7-7831-4c0a-98a3-bf0b2a52a19b admin admin] REQUEST_METHOD: `DELETE` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:00:39.890128 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9726c6e7-7831-4c0a-98a3-bf0b2a52a19b admin admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:00:39.890646 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9726c6e7-7831-4c0a-98a3-bf0b2a52a19b admin admin] PATH_INFO: `/v3/users/a04e543e06df47fa8fcdb465211556d6` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:00:39.892654 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9726c6e7-7831-4c0a-98a3-bf0b2a52a19b admin admin] RBAC: Authorizing `identity:delete_user(user_id=a04e543e06df47fa8fcdb465211556d6)` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:00:39.896132 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9726c6e7-7831-4c0a-98a3-bf0b2a52a19b admin admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:00:39.981017 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.notifications [None req-9726c6e7-7831-4c0a-98a3-bf0b2a52a19b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a04e543e06df47fa8fcdb465211556d6'} {{(pid=87935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:00:39.995255 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.notifications [None req-9726c6e7-7831-4c0a-98a3-bf0b2a52a19b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a04e543e06df47fa8fcdb465211556d6'} {{(pid=87935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:00:40.016058 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.notifications [None req-9726c6e7-7831-4c0a-98a3-bf0b2a52a19b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a04e543e06df47fa8fcdb465211556d6'} {{(pid=87935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:00:40.017367 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.notifications [None req-9726c6e7-7831-4c0a-98a3-bf0b2a52a19b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a04e543e06df47fa8fcdb465211556d6'} {{(pid=87935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:00:40.018534 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.notifications [None req-9726c6e7-7831-4c0a-98a3-bf0b2a52a19b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a04e543e06df47fa8fcdb465211556d6'} {{(pid=87935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:00:40.045456 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 1433/2912] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Sep 13 20:00:39 2022] DELETE /identity/v3/users/a04e543e06df47fa8fcdb465211556d6 => generated 0 bytes in 285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 20:00:40.452363 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9d6bd4-14ca-4a79-a224-ed36b22d21b6 admin admin] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:00:40.454229 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.fernet_utils [None req-6a9d6bd4-14ca-4a79-a224-ed36b22d21b6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:00:40.475168 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9d6bd4-14ca-4a79-a224-ed36b22d21b6 admin admin] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:00:40.555487 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac996d4-2290-4126-b28f-566d36d42b47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:00:40.556480 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac996d4-2290-4126-b28f-566d36d42b47 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:00:40.556963 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac996d4-2290-4126-b28f-566d36d42b47 admin admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:00:40.557437 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac996d4-2290-4126-b28f-566d36d42b47 admin admin] PATH_INFO: `/v3/projects/aded1bd7d456403e92ba6a1883ad3c62` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:00:40.559408 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac996d4-2290-4126-b28f-566d36d42b47 admin admin] RBAC: Authorizing `identity:delete_project(project_id=aded1bd7d456403e92ba6a1883ad3c62)` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:00:40.562595 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac996d4-2290-4126-b28f-566d36d42b47 admin admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:00:40.627205 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.notifications [None req-3ac996d4-2290-4126-b28f-566d36d42b47 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aded1bd7d456403e92ba6a1883ad3c62', 'request_id': 'req-3ac996d4-2290-4126-b28f-566d36d42b47'} {{(pid=87934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:00:40.635444 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.notifications [None req-3ac996d4-2290-4126-b28f-566d36d42b47 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aded1bd7d456403e92ba6a1883ad3c62', 'request_id': 'req-3ac996d4-2290-4126-b28f-566d36d42b47'} {{(pid=87934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:00:40.644160 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.notifications [None req-3ac996d4-2290-4126-b28f-566d36d42b47 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aded1bd7d456403e92ba6a1883ad3c62', 'request_id': 'req-3ac996d4-2290-4126-b28f-566d36d42b47'} {{(pid=87934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:00:40.662396 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.notifications [None req-3ac996d4-2290-4126-b28f-566d36d42b47 admin admin] The token cache is being invalidate because project aded1bd7d456403e92ba6a1883ad3c62 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87934) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 20:00:40.662688 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.notifications [None req-3ac996d4-2290-4126-b28f-566d36d42b47 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:00:40.663351 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.notifications [None req-3ac996d4-2290-4126-b28f-566d36d42b47 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:00:40.664913 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 1480/2913] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Sep 13 20:00:40 2022] DELETE /identity/v3/projects/aded1bd7d456403e92ba6a1883ad3c62 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 20:00:40.669033 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9726c6e7-7831-4c0a-98a3-bf0b2a52a19b admin admin] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:00:40.670485 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.fernet_utils [None req-9726c6e7-7831-4c0a-98a3-bf0b2a52a19b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:00:40.688052 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9726c6e7-7831-4c0a-98a3-bf0b2a52a19b admin admin] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:00:40.757904 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0124c27b-5e24-4d1d-8e84-6a0346bacbda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:00:40.758607 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0124c27b-5e24-4d1d-8e84-6a0346bacbda admin admin] REQUEST_METHOD: `DELETE` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:00:40.759120 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0124c27b-5e24-4d1d-8e84-6a0346bacbda admin admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:00:40.759378 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0124c27b-5e24-4d1d-8e84-6a0346bacbda admin admin] PATH_INFO: `/v3/users/5a765b09b6c84b89b0615325f53aab66` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:00:40.760562 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0124c27b-5e24-4d1d-8e84-6a0346bacbda admin admin] RBAC: Authorizing `identity:delete_user(user_id=5a765b09b6c84b89b0615325f53aab66)` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:00:40.762546 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0124c27b-5e24-4d1d-8e84-6a0346bacbda admin admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:00:40.826076 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.notifications [None req-0124c27b-5e24-4d1d-8e84-6a0346bacbda admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5a765b09b6c84b89b0615325f53aab66'} {{(pid=87935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:00:40.835379 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.notifications [None req-0124c27b-5e24-4d1d-8e84-6a0346bacbda admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5a765b09b6c84b89b0615325f53aab66'} {{(pid=87935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:00:40.847481 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG dbcounter [-] [87935] Writing DB stats keystone:SELECT=79,keystone:DELETE=19,keystone:INSERT=2 {{(pid=87935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:00:40.851226 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.notifications [None req-0124c27b-5e24-4d1d-8e84-6a0346bacbda admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5a765b09b6c84b89b0615325f53aab66'} {{(pid=87935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:00:40.852733 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.notifications [None req-0124c27b-5e24-4d1d-8e84-6a0346bacbda admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5a765b09b6c84b89b0615325f53aab66'} {{(pid=87935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:00:40.854209 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.notifications [None req-0124c27b-5e24-4d1d-8e84-6a0346bacbda admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5a765b09b6c84b89b0615325f53aab66'} {{(pid=87935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:00:40.871347 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 1434/2914] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Sep 13 20:00:40 2022] DELETE /identity/v3/users/5a765b09b6c84b89b0615325f53aab66 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 20:00:41.232904 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac996d4-2290-4126-b28f-566d36d42b47 admin admin] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:00:41.234418 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.fernet_utils [None req-3ac996d4-2290-4126-b28f-566d36d42b47 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:00:41.248449 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac996d4-2290-4126-b28f-566d36d42b47 admin admin] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:00:41.305216 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG dbcounter [-] [87934] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=87934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:00:41.343878 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7d4b30-2f65-4a56-924c-b245ac7734b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:00:41.344564 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7d4b30-2f65-4a56-924c-b245ac7734b7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:00:41.344846 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7d4b30-2f65-4a56-924c-b245ac7734b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:00:41.345114 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7d4b30-2f65-4a56-924c-b245ac7734b7 admin admin] PATH_INFO: `/v3/projects/caf79f1927364bad8cc07d23739d3bcf` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:00:41.346284 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc7d4b30-2f65-4a56-924c-b245ac7734b7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=caf79f1927364bad8cc07d23739d3bcf)` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:00:41.348249 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc7d4b30-2f65-4a56-924c-b245ac7734b7 admin admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:00:41.407836 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.notifications [None req-cc7d4b30-2f65-4a56-924c-b245ac7734b7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'caf79f1927364bad8cc07d23739d3bcf', 'request_id': 'req-cc7d4b30-2f65-4a56-924c-b245ac7734b7'} {{(pid=87934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:00:41.415270 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.notifications [None req-cc7d4b30-2f65-4a56-924c-b245ac7734b7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'caf79f1927364bad8cc07d23739d3bcf', 'request_id': 'req-cc7d4b30-2f65-4a56-924c-b245ac7734b7'} {{(pid=87934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:00:41.421717 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.notifications [None req-cc7d4b30-2f65-4a56-924c-b245ac7734b7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'caf79f1927364bad8cc07d23739d3bcf', 'request_id': 'req-cc7d4b30-2f65-4a56-924c-b245ac7734b7'} {{(pid=87934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:00:41.437898 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.notifications [None req-cc7d4b30-2f65-4a56-924c-b245ac7734b7 admin admin] The token cache is being invalidate because project caf79f1927364bad8cc07d23739d3bcf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87934) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 20:00:41.438182 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.notifications [None req-cc7d4b30-2f65-4a56-924c-b245ac7734b7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:00:41.439011 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.notifications [None req-cc7d4b30-2f65-4a56-924c-b245ac7734b7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:00:41.440577 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 1481/2915] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Sep 13 20:00:41 2022] DELETE /identity/v3/projects/caf79f1927364bad8cc07d23739d3bcf => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 20:00:41.446236 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7698b37c-3ed9-4eff-8995-fdde12c40ba1 None None] REQUEST_METHOD: `POST` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:00:41.446517 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7698b37c-3ed9-4eff-8995-fdde12c40ba1 None None] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:00:41.446789 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7698b37c-3ed9-4eff-8995-fdde12c40ba1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:00:41.467736 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.auth.core [None req-7698b37c-3ed9-4eff-8995-fdde12c40ba1 None None] MFA Rules not processed for user `7b0aed92d02344acb92a0e4aa67c3068`. Rule list: `[]` (Enabled: `True`). {{(pid=87935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:00:41.468985 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.fernet_utils [None req-7698b37c-3ed9-4eff-8995-fdde12c40ba1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:00:41.540391 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 1435/2916] 10.222.0.25 () {58 vars in 958 bytes} [Tue Sep 13 20:00:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 20:00:41.550767 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249b4447-1f06-44c1-a09b-605c6d1e003e None None] REQUEST_METHOD: `POST` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:00:41.551370 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249b4447-1f06-44c1-a09b-605c6d1e003e None None] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:00:41.551770 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249b4447-1f06-44c1-a09b-605c6d1e003e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:00:41.583426 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.auth.core [None req-249b4447-1f06-44c1-a09b-605c6d1e003e None None] MFA Rules not processed for user `7b0aed92d02344acb92a0e4aa67c3068`. Rule list: `[]` (Enabled: `True`). {{(pid=87934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:00:41.585254 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.fernet_utils [None req-249b4447-1f06-44c1-a09b-605c6d1e003e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:00:41.602045 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 1482/2917] 10.222.0.25 () {58 vars in 958 bytes} [Tue Sep 13 20:00:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:00:41.603794 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7698b37c-3ed9-4eff-8995-fdde12c40ba1 None None] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:00:41.619394 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7698b37c-3ed9-4eff-8995-fdde12c40ba1 None None] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:00:41.626569 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ecb808-57f1-492a-835a-78cc7bd2930a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:00:41.627503 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ecb808-57f1-492a-835a-78cc7bd2930a admin admin] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:00:41.627950 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ecb808-57f1-492a-835a-78cc7bd2930a admin admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:00:41.628430 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ecb808-57f1-492a-835a-78cc7bd2930a admin admin] PATH_INFO: `/v3/domains` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:00:41.629487 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ecb808-57f1-492a-835a-78cc7bd2930a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87935) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 20:00:41.630540 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ecb808-57f1-492a-835a-78cc7bd2930a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:00:41.633847 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ecb808-57f1-492a-835a-78cc7bd2930a admin admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:00:41.649377 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 1436/2918] 10.222.0.25 () {58 vars in 1153 bytes} [Tue Sep 13 20:00:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 20:00:41.654744 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249b4447-1f06-44c1-a09b-605c6d1e003e None None] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:00:41.672436 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249b4447-1f06-44c1-a09b-605c6d1e003e None None] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:00:41.680096 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1daddd7d-96af-4aa7-bdc4-31714bdfed39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:00:41.681164 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1daddd7d-96af-4aa7-bdc4-31714bdfed39 admin admin] REQUEST_METHOD: `POST` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:00:41.681653 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1daddd7d-96af-4aa7-bdc4-31714bdfed39 admin admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:00:41.682134 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1daddd7d-96af-4aa7-bdc4-31714bdfed39 admin admin] PATH_INFO: `/v3/projects` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:00:41.683295 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1daddd7d-96af-4aa7-bdc4-31714bdfed39 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:00:41.686262 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1daddd7d-96af-4aa7-bdc4-31714bdfed39 admin admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:00:41.715876 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 1483/2919] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Sep 13 20:00:41 2022] POST /identity/v3/projects => generated 391 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 20:00:41.720418 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ecb808-57f1-492a-835a-78cc7bd2930a admin admin] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:00:41.731224 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ecb808-57f1-492a-835a-78cc7bd2930a admin admin] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:00:41.799915 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21efc179-34cf-4f9a-87a8-29281ba01425 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:00:41.800551 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21efc179-34cf-4f9a-87a8-29281ba01425 admin admin] REQUEST_METHOD: `POST` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:00:41.800833 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21efc179-34cf-4f9a-87a8-29281ba01425 admin admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:00:41.801096 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21efc179-34cf-4f9a-87a8-29281ba01425 admin admin] PATH_INFO: `/v3/users` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:00:41.802275 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21efc179-34cf-4f9a-87a8-29281ba01425 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:00:41.804232 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21efc179-34cf-4f9a-87a8-29281ba01425 admin admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:00:41.828295 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 1437/2920] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Sep 13 20:00:41 2022] POST /identity/v3/users => generated 296 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 20:00:41.832697 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1daddd7d-96af-4aa7-bdc4-31714bdfed39 admin admin] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:00:41.843821 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1daddd7d-96af-4aa7-bdc4-31714bdfed39 admin admin] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:00:41.848538 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a2ab72-a778-4e78-a777-787a2e20292b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:00:41.849164 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a2ab72-a778-4e78-a777-787a2e20292b admin admin] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:00:41.849441 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a2ab72-a778-4e78-a777-787a2e20292b admin admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:00:41.849710 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a2ab72-a778-4e78-a777-787a2e20292b admin admin] PATH_INFO: `/v3/roles` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:00:41.850344 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a2ab72-a778-4e78-a777-787a2e20292b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:00:41.851919 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a2ab72-a778-4e78-a777-787a2e20292b admin admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:00:41.863041 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 1484/2921] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Sep 13 20:00:41 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 20:00:41.867726 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21efc179-34cf-4f9a-87a8-29281ba01425 admin admin] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:00:41.878009 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21efc179-34cf-4f9a-87a8-29281ba01425 admin admin] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:00:41.883167 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2524862c-7b00-41a5-9930-ece8b80af957 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:00:41.883866 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2524862c-7b00-41a5-9930-ece8b80af957 admin admin] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:00:41.884140 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2524862c-7b00-41a5-9930-ece8b80af957 admin admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:00:41.884450 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2524862c-7b00-41a5-9930-ece8b80af957 admin admin] PATH_INFO: `/v3/roles` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:00:41.885079 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2524862c-7b00-41a5-9930-ece8b80af957 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:00:41.886660 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2524862c-7b00-41a5-9930-ece8b80af957 admin admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:00:41.897732 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 1438/2922] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Sep 13 20:00:41 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 20:00:41.901978 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a2ab72-a778-4e78-a777-787a2e20292b admin admin] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:00:41.912562 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a2ab72-a778-4e78-a777-787a2e20292b admin admin] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:00:41.917283 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1003101a-db95-4aed-be4d-29aa351cae04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:00:41.917947 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1003101a-db95-4aed-be4d-29aa351cae04 admin admin] REQUEST_METHOD: `PUT` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:00:41.918229 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1003101a-db95-4aed-be4d-29aa351cae04 admin admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:00:41.918502 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1003101a-db95-4aed-be4d-29aa351cae04 admin admin] PATH_INFO: `/v3/projects/42612d05c9b940cdbb19c1c826fad03a/users/ffaeca8f72e847da8d25adf9c70f281c/roles/a259191f6d0e46fabd9f34536bb28747` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:00:41.934677 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1003101a-db95-4aed-be4d-29aa351cae04 admin admin] RBAC: Authorizing `identity:create_grant(project_id=42612d05c9b940cdbb19c1c826fad03a, user_id=ffaeca8f72e847da8d25adf9c70f281c, role_id=a259191f6d0e46fabd9f34536bb28747)` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:00:41.937296 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1003101a-db95-4aed-be4d-29aa351cae04 admin admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:00:41.951770 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 1485/2923] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Sep 13 20:00:41 2022] PUT /identity/v3/projects/42612d05c9b940cdbb19c1c826fad03a/users/ffaeca8f72e847da8d25adf9c70f281c/roles/a259191f6d0e46fabd9f34536bb28747 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 20:00:41.962800 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae6df5e-7c20-4a93-9c80-d9985bdedea3 None None] REQUEST_METHOD: `POST` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:00:41.963083 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae6df5e-7c20-4a93-9c80-d9985bdedea3 None None] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:00:41.963389 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae6df5e-7c20-4a93-9c80-d9985bdedea3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:00:41.995299 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.auth.core [None req-eae6df5e-7c20-4a93-9c80-d9985bdedea3 None None] MFA Rules not processed for user `ffaeca8f72e847da8d25adf9c70f281c`. Rule list: `[]` (Enabled: `True`). {{(pid=87935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:00:41.996555 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.fernet_utils [None req-eae6df5e-7c20-4a93-9c80-d9985bdedea3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:00:42.041767 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG dbcounter [-] [87935] Writing DB stats keystone:DELETE=1,keystone:SELECT=96,keystone:INSERT=3 {{(pid=87935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:00:42.068896 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 1439/2924] 10.222.0.25 () {58 vars in 958 bytes} [Tue Sep 13 20:00:41 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:00:42.085885 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1003101a-db95-4aed-be4d-29aa351cae04 admin admin] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:00:42.087974 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.fernet_utils [None req-1003101a-db95-4aed-be4d-29aa351cae04 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:00:42.147628 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1003101a-db95-4aed-be4d-29aa351cae04 admin admin] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:00:42.152020 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8c8e12-7ea5-40e2-8275-866a187c7322 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cbb50c88b794a7f9f26844effde7d63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a10a4268f3c4cb29f4e00c292e2df62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:00:42.152174 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8c8e12-7ea5-40e2-8275-866a187c7322 service cinder] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:00:42.152484 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8c8e12-7ea5-40e2-8275-866a187c7322 service cinder] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:00:42.152758 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8c8e12-7ea5-40e2-8275-866a187c7322 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:00:42.162279 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c8c8e12-7ea5-40e2-8275-866a187c7322 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:00:42.163754 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c8c8e12-7ea5-40e2-8275-866a187c7322 service cinder] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:00:42.173209 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 1486/2925] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Sep 13 20:00:42 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 20:00:49.475591 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae6df5e-7c20-4a93-9c80-d9985bdedea3 None None] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:00:49.478065 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.fernet_utils [None req-eae6df5e-7c20-4a93-9c80-d9985bdedea3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:00:49.589856 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae6df5e-7c20-4a93-9c80-d9985bdedea3 None None] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:00:49.595846 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b895d3-bc9a-42b6-8a58-d6c0090f36b8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd71fe5a8275f4ea98555afdcefc902a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a10a4268f3c4cb29f4e00c292e2df62', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:00:49.596537 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b895d3-bc9a-42b6-8a58-d6c0090f36b8 service nova] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:00:49.596870 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b895d3-bc9a-42b6-8a58-d6c0090f36b8 service nova] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:00:49.597080 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b895d3-bc9a-42b6-8a58-d6c0090f36b8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:00:49.599443 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.fernet_utils [None req-30b895d3-bc9a-42b6-8a58-d6c0090f36b8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:00:49.619339 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b895d3-bc9a-42b6-8a58-d6c0090f36b8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:00:49.622087 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b895d3-bc9a-42b6-8a58-d6c0090f36b8 service nova] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:00:49.643232 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 1440/2926] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Sep 13 20:00:49 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 169 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 13 20:00:52.169081 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG dbcounter [-] [87934] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=3 {{(pid=87934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:00:53.233155 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8c8e12-7ea5-40e2-8275-866a187c7322 service cinder] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:00:53.354353 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8c8e12-7ea5-40e2-8275-866a187c7322 service cinder] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:00:53.362714 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c14a047-7c08-4a08-9414-a2f9de06cf78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:00:53.363734 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c14a047-7c08-4a08-9414-a2f9de06cf78 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:00:53.364776 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c14a047-7c08-4a08-9414-a2f9de06cf78 admin admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:00:53.365254 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c14a047-7c08-4a08-9414-a2f9de06cf78 admin admin] PATH_INFO: `/v3/users/ffaeca8f72e847da8d25adf9c70f281c` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:00:53.367150 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c14a047-7c08-4a08-9414-a2f9de06cf78 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ffaeca8f72e847da8d25adf9c70f281c)` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:00:53.370900 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c14a047-7c08-4a08-9414-a2f9de06cf78 admin admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:00:53.436862 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.notifications [None req-7c14a047-7c08-4a08-9414-a2f9de06cf78 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ffaeca8f72e847da8d25adf9c70f281c'} {{(pid=87934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:00:53.437641 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.notifications [None req-7c14a047-7c08-4a08-9414-a2f9de06cf78 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ffaeca8f72e847da8d25adf9c70f281c'} {{(pid=87934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:00:53.438511 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.notifications [None req-7c14a047-7c08-4a08-9414-a2f9de06cf78 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ffaeca8f72e847da8d25adf9c70f281c'} {{(pid=87934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:00:53.452615 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.notifications [None req-7c14a047-7c08-4a08-9414-a2f9de06cf78 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ffaeca8f72e847da8d25adf9c70f281c'} {{(pid=87934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:00:53.473023 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.notifications [None req-7c14a047-7c08-4a08-9414-a2f9de06cf78 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ffaeca8f72e847da8d25adf9c70f281c'} {{(pid=87934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:00:53.494877 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 1487/2927] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Sep 13 20:00:53 2022] DELETE /identity/v3/users/ffaeca8f72e847da8d25adf9c70f281c => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 20:00:53.501651 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38cd6f78-94ba-4c81-84ed-a43e8cbb2d74 None None] REQUEST_METHOD: `POST` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:00:53.502798 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38cd6f78-94ba-4c81-84ed-a43e8cbb2d74 None None] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:00:53.502798 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38cd6f78-94ba-4c81-84ed-a43e8cbb2d74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:00:53.545977 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.auth.core [None req-38cd6f78-94ba-4c81-84ed-a43e8cbb2d74 None None] MFA Rules not processed for user `7b0aed92d02344acb92a0e4aa67c3068`. Rule list: `[]` (Enabled: `True`). {{(pid=87935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:00:53.547833 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.fernet_utils [None req-38cd6f78-94ba-4c81-84ed-a43e8cbb2d74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:00:53.642481 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 1441/2928] 10.222.0.25 () {58 vars in 958 bytes} [Tue Sep 13 20:00:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 20:00:53.653279 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c14a047-7c08-4a08-9414-a2f9de06cf78 admin admin] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:00:53.654730 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.fernet_utils [None req-7c14a047-7c08-4a08-9414-a2f9de06cf78 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:00:53.762589 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c14a047-7c08-4a08-9414-a2f9de06cf78 admin admin] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:00:53.767797 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d02988-5004-4d3d-917c-8b9dbff7d7c3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1196a96e4a404f559600b69f929ea9da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a10a4268f3c4cb29f4e00c292e2df62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:00:53.768834 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d02988-5004-4d3d-917c-8b9dbff7d7c3 service neutron] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:00:53.769362 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d02988-5004-4d3d-917c-8b9dbff7d7c3 service neutron] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:00:53.769789 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d02988-5004-4d3d-917c-8b9dbff7d7c3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:00:53.785364 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d02988-5004-4d3d-917c-8b9dbff7d7c3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:00:53.788286 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d02988-5004-4d3d-917c-8b9dbff7d7c3 service neutron] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:00:53.805199 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 1488/2929] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Sep 13 20:00:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 20:00:54.188652 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38cd6f78-94ba-4c81-84ed-a43e8cbb2d74 None None] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:00:54.192167 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.fernet_utils [None req-38cd6f78-94ba-4c81-84ed-a43e8cbb2d74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:00:54.230830 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38cd6f78-94ba-4c81-84ed-a43e8cbb2d74 None None] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:00:54.240335 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19cacab7-3357-406f-9848-869618cd298b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:00:54.241830 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19cacab7-3357-406f-9848-869618cd298b admin admin] REQUEST_METHOD: `DELETE` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:00:54.242316 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19cacab7-3357-406f-9848-869618cd298b admin admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:00:54.242802 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19cacab7-3357-406f-9848-869618cd298b admin admin] PATH_INFO: `/v3/projects/42612d05c9b940cdbb19c1c826fad03a` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:00:54.245047 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19cacab7-3357-406f-9848-869618cd298b admin admin] RBAC: Authorizing `identity:delete_project(project_id=42612d05c9b940cdbb19c1c826fad03a)` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:00:54.255284 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19cacab7-3357-406f-9848-869618cd298b admin admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:00:54.373556 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.notifications [None req-19cacab7-3357-406f-9848-869618cd298b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '42612d05c9b940cdbb19c1c826fad03a', 'request_id': 'req-19cacab7-3357-406f-9848-869618cd298b'} {{(pid=87935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:00:54.384629 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.notifications [None req-19cacab7-3357-406f-9848-869618cd298b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '42612d05c9b940cdbb19c1c826fad03a', 'request_id': 'req-19cacab7-3357-406f-9848-869618cd298b'} {{(pid=87935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:00:54.389335 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG dbcounter [-] [87935] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=87935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:00:54.398345 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.notifications [None req-19cacab7-3357-406f-9848-869618cd298b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '42612d05c9b940cdbb19c1c826fad03a', 'request_id': 'req-19cacab7-3357-406f-9848-869618cd298b'} {{(pid=87935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:00:54.420090 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.notifications [None req-19cacab7-3357-406f-9848-869618cd298b admin admin] The token cache is being invalidate because project 42612d05c9b940cdbb19c1c826fad03a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87935) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 20:00:54.420663 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.notifications [None req-19cacab7-3357-406f-9848-869618cd298b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:00:54.421730 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.notifications [None req-19cacab7-3357-406f-9848-869618cd298b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:00:54.423676 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 1442/2930] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Sep 13 20:00:54 2022] DELETE /identity/v3/projects/42612d05c9b940cdbb19c1c826fad03a => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 20:00:55.667695 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d02988-5004-4d3d-917c-8b9dbff7d7c3 service neutron] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:00:55.669250 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.fernet_utils [None req-75d02988-5004-4d3d-917c-8b9dbff7d7c3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:00:55.702181 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG dbcounter [-] [87934] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:00:55.791013 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d02988-5004-4d3d-917c-8b9dbff7d7c3 service neutron] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:00:55.890842 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f905c0-81e5-4757-aaae-4705444da68a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02eb3d3173c1476cb83a72add0e878e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a10a4268f3c4cb29f4e00c292e2df62', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:00:55.891397 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f905c0-81e5-4757-aaae-4705444da68a service placement] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:00:55.891744 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f905c0-81e5-4757-aaae-4705444da68a service placement] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:00:55.892150 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f905c0-81e5-4757-aaae-4705444da68a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:00:55.899768 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.fernet_utils [None req-d3f905c0-81e5-4757-aaae-4705444da68a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:00:55.911708 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f905c0-81e5-4757-aaae-4705444da68a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:00:55.913945 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f905c0-81e5-4757-aaae-4705444da68a service placement] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:00:55.929381 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 1489/2931] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Sep 13 20:00:55 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 262 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 13 20:00:59.516356 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19cacab7-3357-406f-9848-869618cd298b admin admin] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:00:59.523207 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.fernet_utils [None req-19cacab7-3357-406f-9848-869618cd298b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:00:59.547894 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19cacab7-3357-406f-9848-869618cd298b admin admin] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:00:59.554480 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0298558f-eb05-4b71-ab06-df6bcc40ebca service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02eb3d3173c1476cb83a72add0e878e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a10a4268f3c4cb29f4e00c292e2df62', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:00:59.555107 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0298558f-eb05-4b71-ab06-df6bcc40ebca service placement] REQUEST_METHOD: `GET` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:00:59.555381 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0298558f-eb05-4b71-ab06-df6bcc40ebca service placement] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:00:59.555652 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0298558f-eb05-4b71-ab06-df6bcc40ebca service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:00:59.558544 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.fernet_utils [None req-0298558f-eb05-4b71-ab06-df6bcc40ebca service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:00:59.582112 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0298558f-eb05-4b71-ab06-df6bcc40ebca service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:00:59.583952 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f905c0-81e5-4757-aaae-4705444da68a service placement] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:00:59.585647 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.fernet_utils [None req-d3f905c0-81e5-4757-aaae-4705444da68a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:00:59.586631 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0298558f-eb05-4b71-ab06-df6bcc40ebca service placement] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:00:59.606565 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 1443/2932] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Sep 13 20:00:59 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 20:00:59.696417 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f905c0-81e5-4757-aaae-4705444da68a service placement] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:00:59.703730 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e27c359-f78c-43f5-b1bb-4772279dd4bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:00:59.704586 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e27c359-f78c-43f5-b1bb-4772279dd4bc admin admin] REQUEST_METHOD: `DELETE` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:00:59.704744 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e27c359-f78c-43f5-b1bb-4772279dd4bc admin admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:00:59.704744 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e27c359-f78c-43f5-b1bb-4772279dd4bc admin admin] PATH_INFO: `/v3/users/61090841e9f246fd92f6d9c894bc8880` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:00:59.706157 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e27c359-f78c-43f5-b1bb-4772279dd4bc admin admin] RBAC: Authorizing `identity:delete_user(user_id=61090841e9f246fd92f6d9c894bc8880)` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:00:59.708713 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e27c359-f78c-43f5-b1bb-4772279dd4bc admin admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:00:59.769826 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.notifications [None req-8e27c359-f78c-43f5-b1bb-4772279dd4bc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '61090841e9f246fd92f6d9c894bc8880'} {{(pid=87934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:00:59.770693 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.notifications [None req-8e27c359-f78c-43f5-b1bb-4772279dd4bc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '61090841e9f246fd92f6d9c894bc8880'} {{(pid=87934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:00:59.771508 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.notifications [None req-8e27c359-f78c-43f5-b1bb-4772279dd4bc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '61090841e9f246fd92f6d9c894bc8880'} {{(pid=87934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:00:59.782685 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.notifications [None req-8e27c359-f78c-43f5-b1bb-4772279dd4bc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '61090841e9f246fd92f6d9c894bc8880'} {{(pid=87934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:00:59.783895 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG dbcounter [-] [87934] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=87934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:00:59.800494 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.notifications [None req-8e27c359-f78c-43f5-b1bb-4772279dd4bc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '61090841e9f246fd92f6d9c894bc8880'} {{(pid=87934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:00:59.815617 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 1490/2933] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Sep 13 20:00:59 2022] DELETE /identity/v3/users/61090841e9f246fd92f6d9c894bc8880 => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 20:01:00.041239 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0298558f-eb05-4b71-ab06-df6bcc40ebca service placement] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:01:00.058493 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0298558f-eb05-4b71-ab06-df6bcc40ebca service placement] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:01:00.159545 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa6a21d-9687-490a-b7aa-0b794c37aee9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:01:00.160181 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa6a21d-9687-490a-b7aa-0b794c37aee9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:01:00.160532 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa6a21d-9687-490a-b7aa-0b794c37aee9 admin admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:01:00.160801 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa6a21d-9687-490a-b7aa-0b794c37aee9 admin admin] PATH_INFO: `/v3/projects/d6744652585f403c9fd76727c2d7ef23` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:01:00.162008 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa6a21d-9687-490a-b7aa-0b794c37aee9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d6744652585f403c9fd76727c2d7ef23)` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:01:00.163942 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa6a21d-9687-490a-b7aa-0b794c37aee9 admin admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:01:00.236851 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.notifications [None req-daa6a21d-9687-490a-b7aa-0b794c37aee9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd6744652585f403c9fd76727c2d7ef23', 'request_id': 'req-daa6a21d-9687-490a-b7aa-0b794c37aee9'} {{(pid=87935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:01:00.245523 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.notifications [None req-daa6a21d-9687-490a-b7aa-0b794c37aee9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd6744652585f403c9fd76727c2d7ef23', 'request_id': 'req-daa6a21d-9687-490a-b7aa-0b794c37aee9'} {{(pid=87935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:01:00.261968 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.notifications [None req-daa6a21d-9687-490a-b7aa-0b794c37aee9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd6744652585f403c9fd76727c2d7ef23', 'request_id': 'req-daa6a21d-9687-490a-b7aa-0b794c37aee9'} {{(pid=87935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:01:00.277829 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.notifications [None req-daa6a21d-9687-490a-b7aa-0b794c37aee9 admin admin] The token cache is being invalidate because project d6744652585f403c9fd76727c2d7ef23 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87935) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 20:01:00.278303 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.notifications [None req-daa6a21d-9687-490a-b7aa-0b794c37aee9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:01:00.279288 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.notifications [None req-daa6a21d-9687-490a-b7aa-0b794c37aee9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:01:00.281736 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 1444/2934] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Sep 13 20:01:00 2022] DELETE /identity/v3/projects/d6744652585f403c9fd76727c2d7ef23 => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 20:01:00.287191 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e27c359-f78c-43f5-b1bb-4772279dd4bc admin admin] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:01:00.289181 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.fernet_utils [None req-8e27c359-f78c-43f5-b1bb-4772279dd4bc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:01:00.310569 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e27c359-f78c-43f5-b1bb-4772279dd4bc admin admin] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:01:00.387560 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95b7050-ab47-4620-b06f-7e1df29fe6a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:01:00.388242 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95b7050-ab47-4620-b06f-7e1df29fe6a3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:01:00.388543 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95b7050-ab47-4620-b06f-7e1df29fe6a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:01:00.388819 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95b7050-ab47-4620-b06f-7e1df29fe6a3 admin admin] PATH_INFO: `/v3/users/096f2aadcb174ee0aa5c04a9e8d8529a` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:01:00.390040 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b95b7050-ab47-4620-b06f-7e1df29fe6a3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=096f2aadcb174ee0aa5c04a9e8d8529a)` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:01:00.391991 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b95b7050-ab47-4620-b06f-7e1df29fe6a3 admin admin] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:01:00.449972 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.notifications [None req-b95b7050-ab47-4620-b06f-7e1df29fe6a3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '096f2aadcb174ee0aa5c04a9e8d8529a'} {{(pid=87934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:01:00.450654 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.notifications [None req-b95b7050-ab47-4620-b06f-7e1df29fe6a3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '096f2aadcb174ee0aa5c04a9e8d8529a'} {{(pid=87934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:01:00.451260 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.notifications [None req-b95b7050-ab47-4620-b06f-7e1df29fe6a3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '096f2aadcb174ee0aa5c04a9e8d8529a'} {{(pid=87934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:01:00.461279 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.notifications [None req-b95b7050-ab47-4620-b06f-7e1df29fe6a3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '096f2aadcb174ee0aa5c04a9e8d8529a'} {{(pid=87934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:01:00.479955 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.notifications [None req-b95b7050-ab47-4620-b06f-7e1df29fe6a3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '096f2aadcb174ee0aa5c04a9e8d8529a'} {{(pid=87934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:01:00.502826 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 1491/2935] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Sep 13 20:01:00 2022] DELETE /identity/v3/users/096f2aadcb174ee0aa5c04a9e8d8529a => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 20:01:00.704978 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa6a21d-9687-490a-b7aa-0b794c37aee9 admin admin] Authenticating user token {{(pid=87935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:01:00.707357 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.fernet_utils [None req-daa6a21d-9687-490a-b7aa-0b794c37aee9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:01:00.726955 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa6a21d-9687-490a-b7aa-0b794c37aee9 admin admin] Validating token access rules against request {{(pid=87935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:01:00.799196 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c122f9-0fd2-4078-8ae2-5c3be341584f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0aed92d02344acb92a0e4aa67c3068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '455c35cf3f4241039d612c7710aac324', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:01:00.799781 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c122f9-0fd2-4078-8ae2-5c3be341584f admin admin] REQUEST_METHOD: `DELETE` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:01:00.800054 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c122f9-0fd2-4078-8ae2-5c3be341584f admin admin] SCRIPT_NAME: `/identity` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:01:00.800353 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c122f9-0fd2-4078-8ae2-5c3be341584f admin admin] PATH_INFO: `/v3/projects/76dcc4aa025f4682825d21b9c8350346` {{(pid=87935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:01:00.802093 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c122f9-0fd2-4078-8ae2-5c3be341584f admin admin] RBAC: Authorizing `identity:delete_project(project_id=76dcc4aa025f4682825d21b9c8350346)` {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:01:00.804006 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c122f9-0fd2-4078-8ae2-5c3be341584f admin admin] RBAC: Authorization granted {{(pid=87935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:01:00.812461 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG dbcounter [-] [87935] Writing DB stats keystone:DELETE=8,keystone:SELECT=91,keystone:INSERT=1 {{(pid=87935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:01:00.860880 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.notifications [None req-a9c122f9-0fd2-4078-8ae2-5c3be341584f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '76dcc4aa025f4682825d21b9c8350346', 'request_id': 'req-a9c122f9-0fd2-4078-8ae2-5c3be341584f'} {{(pid=87935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:01:00.868309 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.notifications [None req-a9c122f9-0fd2-4078-8ae2-5c3be341584f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '76dcc4aa025f4682825d21b9c8350346', 'request_id': 'req-a9c122f9-0fd2-4078-8ae2-5c3be341584f'} {{(pid=87935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:01:00.885329 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.notifications [None req-a9c122f9-0fd2-4078-8ae2-5c3be341584f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '76dcc4aa025f4682825d21b9c8350346', 'request_id': 'req-a9c122f9-0fd2-4078-8ae2-5c3be341584f'} {{(pid=87935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:01:00.899470 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.notifications [None req-a9c122f9-0fd2-4078-8ae2-5c3be341584f admin admin] The token cache is being invalidate because project 76dcc4aa025f4682825d21b9c8350346 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87935) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 20:01:00.899744 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.notifications [None req-a9c122f9-0fd2-4078-8ae2-5c3be341584f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:01:00.900426 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG keystone.notifications [None req-a9c122f9-0fd2-4078-8ae2-5c3be341584f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:01:00.901937 dv-cinder-828805-6-smb devstack@keystone.service[87935]: [pid: 87935|app: 0|req: 1445/2936] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Sep 13 20:01:00 2022] DELETE /identity/v3/projects/76dcc4aa025f4682825d21b9c8350346 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 20:01:10.496336 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG dbcounter [-] [87934] Writing DB stats keystone:SELECT=61,keystone:DELETE=13,keystone:INSERT=2 {{(pid=87934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:01:10.896495 dv-cinder-828805-6-smb devstack@keystone.service[87935]: DEBUG dbcounter [-] [87935] Writing DB stats keystone:SELECT=21,keystone:DELETE=7,keystone:INSERT=1 {{(pid=87935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:02:28.678182 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95b7050-ab47-4620-b06f-7e1df29fe6a3 admin admin] Authenticating user token {{(pid=87934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:02:28.679742 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.fernet_utils [None req-b95b7050-ab47-4620-b06f-7e1df29fe6a3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:02:28.758682 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95b7050-ab47-4620-b06f-7e1df29fe6a3 admin admin] Validating token access rules against request {{(pid=87934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:02:28.856987 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f25f31c-be2f-4d47-b580-597c28a91ea6 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02eb3d3173c1476cb83a72add0e878e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a10a4268f3c4cb29f4e00c292e2df62', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:02:28.857854 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f25f31c-be2f-4d47-b580-597c28a91ea6 service placement] REQUEST_METHOD: `GET` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:02:28.858067 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f25f31c-be2f-4d47-b580-597c28a91ea6 service placement] SCRIPT_NAME: `/identity` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:02:28.858424 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f25f31c-be2f-4d47-b580-597c28a91ea6 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=87934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:02:28.860759 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.fernet_utils [None req-0f25f31c-be2f-4d47-b580-597c28a91ea6 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:02:28.874820 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f25f31c-be2f-4d47-b580-597c28a91ea6 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:02:28.877197 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f25f31c-be2f-4d47-b580-597c28a91ea6 service placement] RBAC: Authorization granted {{(pid=87934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:02:28.889740 dv-cinder-828805-6-smb devstack@keystone.service[87934]: [pid: 87934|app: 0|req: 1492/2937] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Sep 13 20:02:28 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 212 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 20:02:38.884139 dv-cinder-828805-6-smb devstack@keystone.service[87934]: DEBUG dbcounter [-] [87934] Writing DB stats keystone:SELECT=58 {{(pid=87934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}